2024-03-08T05:49:17.164 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-08T05:49:17.164 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name jcollin-2024-03-08_05:43:46-fs:functional-main-distro-default-smithi --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/admin} --archive /home/teuthworker/archive/jcollin-2024-03-08_05:43:46-fs:functional-main-distro-default-smithi/7585422 --owner scheduled_jcollin@teuthology -- /home/teuthworker/archive/jcollin-2024-03-08_05:43:46-fs:functional-main-distro-default-smithi/7585422/orig.config.yaml 2024-03-08T05:49:17.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T05:49:17.284 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/jcollin-2024-03-08_05:43:46-fs:functional-main-distro-default-smithi/7585422 branch: main description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/admin} email: jcollin@redhat.com first_in_suite: false job_id: '7585422' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: jcollin-2024-03-08_05:43:46-fs:functional-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: lockdep: true ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - missing required features sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 kclient: syntax: v2 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-jcollin-test_per-client-perf-counters sha1: de7a7e179fbee9e314fa702f8f6c09d121c5e1a7 owner: scheduled_jcollin@teuthology priority: 10 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7313 sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-jcollin-test_per-client-perf-counters suite_path: /home/teuthworker/src/github.com_joscollin_ceph_de7a7e179fbee9e314fa702f8f6c09d121c5e1a7/qa suite_relpath: qa suite_repo: https://github.com/joscollin/ceph.git suite_sha1: de7a7e179fbee9e314fa702f8f6c09d121c5e1a7 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi019.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMhnua1Zs1mj8A8D1cRc/Y4IbjMxhfVpRiF2YnqmWvfyeRD6YF16t4DA+rwJyXknzLMp+oC1PbiygfStBraqs7s= smithi042.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO0gN7+Sd6N91IoieoXLBfcsav/9+icq+TOZQmNNpWZeaMPPLM5qUZCadPCqlXC4aaBVccfnykxjiaVAvHI1Qz0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_admin.TestLabeledPerfCounters teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-08_05:43:46 tube: smithi user: jcollin verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-08T05:49:17.285 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_joscollin_ceph_de7a7e179fbee9e314fa702f8f6c09d121c5e1a7/qa; will attempt to use it 2024-03-08T05:49:17.285 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_joscollin_ceph_de7a7e179fbee9e314fa702f8f6c09d121c5e1a7/qa/tasks 2024-03-08T05:49:17.286 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-08T05:49:17.287 INFO:teuthology.task.internal:Checking packages... 2024-03-08T05:49:17.312 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1fb5d10608dccee73edd6ef8a2c7b804a097c324' 2024-03-08T05:49:17.312 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-08T05:49:17.312 INFO:teuthology.packaging:ref: None 2024-03-08T05:49:17.312 INFO:teuthology.packaging:tag: None 2024-03-08T05:49:17.312 INFO:teuthology.packaging:branch: main 2024-03-08T05:49:17.312 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-03-08T05:49:17.312 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-03-08T05:49:17.536 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1940.g639d1827 2024-03-08T05:49:17.538 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-08T05:49:17.544 INFO:teuthology.task.internal:no buildpackages task found 2024-03-08T05:49:17.544 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-08T05:49:17.587 INFO:teuthology.task.internal:Saving configuration 2024-03-08T05:49:17.602 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-08T05:49:17.609 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-08T05:49:17.634 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/jcollin-2024-03-08_05:43:46-fs:functional-main-distro-default-smithi/7585422', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-08 05:44:37.649108', 'locked_by': 'scheduled_jcollin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMhnua1Zs1mj8A8D1cRc/Y4IbjMxhfVpRiF2YnqmWvfyeRD6YF16t4DA+rwJyXknzLMp+oC1PbiygfStBraqs7s='} 2024-03-08T05:49:17.657 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/jcollin-2024-03-08_05:43:46-fs:functional-main-distro-default-smithi/7585422', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-08 05:44:37.650371', 'locked_by': 'scheduled_jcollin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO0gN7+Sd6N91IoieoXLBfcsav/9+icq+TOZQmNNpWZeaMPPLM5qUZCadPCqlXC4aaBVccfnykxjiaVAvHI1Qz0='} 2024-03-08T05:49:17.657 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-08T05:49:17.664 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-03-08T05:49:17.664 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-03-08T05:49:17.664 INFO:teuthology.run_tasks:Running task console_log... 2024-03-08T05:49:17.789 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fabd7a280d0>, signals=[15]) 2024-03-08T05:49:17.789 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-08T05:49:17.796 INFO:teuthology.task.internal:Opening connections... 2024-03-08T05:49:17.796 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi019.front.sepia.ceph.com 2024-03-08T05:49:17.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T05:49:17.902 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi042.front.sepia.ceph.com 2024-03-08T05:49:17.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T05:49:18.000 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-08T05:49:18.007 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2024-03-08T05:49:18.025 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2024-03-08T05:49:18.025 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2024-03-08T05:49:18.083 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2024-03-08T05:49:18.083 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2024-03-08T05:49:18.083 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2024-03-08T05:49:18.083 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2024-03-08T05:49:18.083 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2024-03-08T05:49:18.084 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2024-03-08T05:49:18.084 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-08T05:49:18.084 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2024-03-08T05:49:18.084 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2024-03-08T05:49:18.084 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-08T05:49:18.084 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2024-03-08T05:49:18.085 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-08T05:49:18.085 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-08T05:49:18.085 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-08T05:49:18.086 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2024-03-08T05:49:18.108 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2024-03-08T05:49:18.126 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2024-03-08T05:49:18.127 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-03-08T05:49:18.184 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2024-03-08T05:49:18.184 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9" 2024-03-08T05:49:18.185 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2024-03-08T05:49:18.185 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2024-03-08T05:49:18.185 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9" 2024-03-08T05:49:18.185 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9" 2024-03-08T05:49:18.185 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-08T05:49:18.185 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2024-03-08T05:49:18.185 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon" 2024-03-08T05:49:18.185 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-08T05:49:18.186 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2024-03-08T05:49:18.186 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-08T05:49:18.186 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-08T05:49:18.186 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-08T05:49:18.186 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-03-08T05:49:18.224 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-08T05:49:18.237 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-08T05:49:18.245 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-08T05:49:18.245 DEBUG:teuthology.orchestra.run.smithi019:> test '!' -e /home/ubuntu/cephtest 2024-03-08T05:49:18.248 DEBUG:teuthology.orchestra.run.smithi042:> test '!' -e /home/ubuntu/cephtest 2024-03-08T05:49:18.265 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-08T05:49:18.272 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-08T05:49:18.272 DEBUG:teuthology.orchestra.run.smithi019:> test -z $(ls -A /var/lib/ceph) 2024-03-08T05:49:18.306 DEBUG:teuthology.orchestra.run.smithi042:> test -z $(ls -A /var/lib/ceph) 2024-03-08T05:49:18.332 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-08T05:49:18.379 INFO:teuthology.run_tasks:Running task kernel... 2024-03-08T05:49:18.397 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-03-08T05:49:18.397 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-03-08T05:49:18.397 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-03-08T05:49:18.398 DEBUG:teuthology.orchestra.run.smithi019:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-08T05:49:18.398 DEBUG:teuthology.orchestra.run.smithi042:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-08T05:49:18.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T05:49:18.415 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-08T05:49:18.418 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T05:49:18.418 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-08T05:49:18.730 DEBUG:teuthology.task.kernel:sha1 for client.0 is dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-08T05:49:18.730 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412"... 2024-03-08T05:49:18.730 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-03-08T05:49:18.736 DEBUG:teuthology.task.kernel:sha1 for client.1 is dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-08T05:49:18.736 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412"... 2024-03-08T05:49:18.736 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-03-08T05:49:18.748 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-361.el9.x86_64 2024-03-08T05:49:18.748 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-08T05:49:18.748 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-08T05:49:18.748 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum upgrade -y linux-firmware 2024-03-08T05:49:18.754 INFO:teuthology.orchestra.run.smithi042.stdout:5.14.0-361.el9.x86_64 2024-03-08T05:49:18.754 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-08T05:49:18.754 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-08T05:49:18.754 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum upgrade -y linux-firmware 2024-03-08T05:49:20.825 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-03-08T05:49:20.891 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-03-08T05:49:22.234 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS-9 - BaseOS 7.6 MB/s | 2.0 MB 00:00 2024-03-08T05:49:22.342 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.0 MB 00:00 2024-03-08T05:49:23.477 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 9.1 MB/s | 8.0 MB 00:00 2024-03-08T05:49:23.557 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 9.3 MB/s | 8.0 MB 00:00 2024-03-08T05:49:26.450 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-03-08T05:49:30.853 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 6.1 MB 00:00 2024-03-08T05:49:32.486 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 15 kB 00:00 2024-03-08T05:49:35.120 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 8.2 MB/s | 21 MB 00:02 2024-03-08T05:49:40.328 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-03-08T05:49:42.769 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-03-08T05:49:42.779 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-03-08T05:49:42.779 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-03-08T05:49:42.779 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-03-08T05:49:42.779 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrading: 2024-03-08T05:49:42.779 INFO:teuthology.orchestra.run.smithi042.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-08T05:49:42.779 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T05:49:42.779 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-03-08T05:49:42.779 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================ 2024-03-08T05:49:42.779 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrade 1 Package 2024-03-08T05:49:42.779 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T05:49:42.779 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 375 M 2024-03-08T05:49:42.779 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-03-08T05:49:50.039 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 757 kB/s | 19 MB 00:25 2024-03-08T05:49:52.687 INFO:teuthology.orchestra.run.smithi042.stdout:linux-firmware-20240219-143.el9.noarch.rpm 38 MB/s | 375 MB 00:09 2024-03-08T05:49:52.688 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-03-08T05:49:52.689 INFO:teuthology.orchestra.run.smithi042.stdout:Total 38 MB/s | 375 MB 00:09 2024-03-08T05:49:52.689 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-03-08T05:49:52.780 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-03-08T05:49:52.780 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-03-08T05:49:54.328 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.1 MB 00:00 2024-03-08T05:49:55.279 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-03-08T05:49:55.279 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-03-08T05:49:55.740 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 15 kB 00:00 2024-03-08T05:50:01.922 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-03-08T05:50:02.304 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-08T05:50:02.352 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 3.2 MB/s | 21 MB 00:06 2024-03-08T05:50:02.382 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-08T05:50:03.614 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-08T05:50:03.615 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-08T05:50:04.022 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-08T05:50:04.022 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T05:50:04.023 INFO:teuthology.orchestra.run.smithi042.stdout:Upgraded: 2024-03-08T05:50:04.023 INFO:teuthology.orchestra.run.smithi042.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-08T05:50:04.023 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T05:50:04.023 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-03-08T05:50:04.293 INFO:teuthology.task.kernel:Downloading kernel dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 on client.1... 2024-03-08T05:50:04.294 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-08T05:50:04.439 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/centos/9/flavors/default/x86_64/ 2024-03-08T05:50:04.440 DEBUG:teuthology.orchestra.run.smithi042:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc7_gdd5c1cd17167-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-08T05:50:04.443 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi042.front.sepia.ceph.com to complete... 2024-03-08T05:50:07.516 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-03-08T05:50:09.877 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-08T05:50:09.892 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-08T05:50:09.892 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-03-08T05:50:09.892 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-08T05:50:09.892 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrading: 2024-03-08T05:50:09.892 INFO:teuthology.orchestra.run.smithi019.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-08T05:50:09.892 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T05:50:09.892 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-08T05:50:09.892 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-03-08T05:50:09.892 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrade 1 Package 2024-03-08T05:50:09.893 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T05:50:09.893 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 375 M 2024-03-08T05:50:09.893 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-08T05:50:22.821 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08 05:50:22 URL:https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/centos/9/flavors/default/x86_64/kernel-6.8.0_rc7_gdd5c1cd17167-1.x86_64.rpm [336216379/336216379] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-08T05:50:22.822 INFO:teuthology.orchestra.run.smithi042.stderr:FINISHED --2024-03-08 05:50:22-- 2024-03-08T05:50:22.822 INFO:teuthology.orchestra.run.smithi042.stderr:Total wall clock time: 18s 2024-03-08T05:50:22.822 INFO:teuthology.orchestra.run.smithi042.stderr:Downloaded: 1 files, 321M in 18s (18.0 MB/s) 2024-03-08T05:50:22.824 INFO:teuthology.task.kernel:Installing kernel dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 on client.1... 2024-03-08T05:50:22.825 DEBUG:teuthology.orchestra.run.smithi042:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-08T05:50:24.860 INFO:teuthology.orchestra.run.smithi042.stdout:Verifying... ######################################## 2024-03-08T05:50:24.923 INFO:teuthology.orchestra.run.smithi042.stdout:Preparing... ######################################## 2024-03-08T05:50:25.007 INFO:teuthology.orchestra.run.smithi042.stdout:Updating / installing... 2024-03-08T05:50:28.940 INFO:teuthology.orchestra.run.smithi019.stdout:linux-firmware-20240219-143.el9.noarch.rpm 20 MB/s | 375 MB 00:19 2024-03-08T05:50:28.942 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-08T05:50:28.942 INFO:teuthology.orchestra.run.smithi019.stdout:Total 20 MB/s | 375 MB 00:19 2024-03-08T05:50:28.942 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-08T05:50:29.037 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-08T05:50:29.037 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-08T05:50:31.543 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-08T05:50:31.543 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-08T05:50:32.829 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-6.8.0_rc7_gdd5c1cd17167-1 ######################################## 2024-03-08T05:50:38.009 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-08T05:50:38.240 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-08T05:50:38.328 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-08T05:50:39.481 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-08T05:50:39.481 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-08T05:50:39.873 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-08T05:50:39.874 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T05:50:39.874 INFO:teuthology.orchestra.run.smithi019.stdout:Upgraded: 2024-03-08T05:50:39.874 INFO:teuthology.orchestra.run.smithi019.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-08T05:50:39.874 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T05:50:39.874 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-08T05:50:40.184 INFO:teuthology.task.kernel:Downloading kernel dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 on client.0... 2024-03-08T05:50:40.184 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-08T05:50:40.549 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/centos/9/flavors/default/x86_64/ 2024-03-08T05:50:40.550 DEBUG:teuthology.orchestra.run.smithi019:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc7_gdd5c1cd17167-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-08T05:50:40.553 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi019.front.sepia.ceph.com to complete... 2024-03-08T05:50:49.088 INFO:teuthology.orchestra.run.smithi042.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-08T05:51:12.492 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi042.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-08T05:51:12.492 DEBUG:teuthology.orchestra.run.smithi042:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-08T05:51:12.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167 2024-03-08T05:51:12.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/System.map 2024-03-08T05:51:12.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/config 2024-03-08T05:51:12.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel 2024-03-08T05:51:12.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch 2024-03-08T05:51:12.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86 2024-03-08T05:51:12.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto 2024-03-08T05:51:12.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-08T05:51:12.572 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-08T05:51:12.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-08T05:51:12.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-08T05:51:12.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-08T05:51:12.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-08T05:51:12.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-08T05:51:12.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-08T05:51:12.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-08T05:51:12.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-08T05:51:12.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-08T05:51:12.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-08T05:51:12.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-08T05:51:12.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-08T05:51:12.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-08T05:51:12.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-08T05:51:12.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-08T05:51:12.573 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-08T05:51:12.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-08T05:51:12.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-08T05:51:12.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel 2024-03-08T05:51:12.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu 2024-03-08T05:51:12.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/mce 2024-03-08T05:51:12.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-08T05:51:12.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm 2024-03-08T05:51:12.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-08T05:51:12.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-08T05:51:12.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm.ko 2024-03-08T05:51:12.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto 2024-03-08T05:51:12.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ansi_cprng.ko 2024-03-08T05:51:12.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/anubis.ko 2024-03-08T05:51:12.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/arc4.ko 2024-03-08T05:51:12.574 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx 2024-03-08T05:51:12.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_memcpy.ko 2024-03-08T05:51:12.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_pq.ko 2024-03-08T05:51:12.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-08T05:51:12.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_tx.ko 2024-03-08T05:51:12.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_xor.ko 2024-03-08T05:51:12.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/raid6test.ko 2024-03-08T05:51:12.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/authenc.ko 2024-03-08T05:51:12.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/authencesn.ko 2024-03-08T05:51:12.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blake2b_generic.ko 2024-03-08T05:51:12.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blowfish_common.ko 2024-03-08T05:51:12.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blowfish_generic.ko 2024-03-08T05:51:12.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/camellia_generic.ko 2024-03-08T05:51:12.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast5_generic.ko 2024-03-08T05:51:12.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast6_generic.ko 2024-03-08T05:51:12.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast_common.ko 2024-03-08T05:51:12.575 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ccm.ko 2024-03-08T05:51:12.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cmac.ko 2024-03-08T05:51:12.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crc32_generic.ko 2024-03-08T05:51:12.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_engine.ko 2024-03-08T05:51:12.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_user.ko 2024-03-08T05:51:12.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cts.ko 2024-03-08T05:51:12.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/des_generic.ko 2024-03-08T05:51:12.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/dh_generic.ko 2024-03-08T05:51:12.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/echainiv.ko 2024-03-08T05:51:12.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/essiv.ko 2024-03-08T05:51:12.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/fcrypt.ko 2024-03-08T05:51:12.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/khazad.ko 2024-03-08T05:51:12.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lz4.ko 2024-03-08T05:51:12.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lz4hc.ko 2024-03-08T05:51:12.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/md4.ko 2024-03-08T05:51:12.576 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/michael_mic.ko 2024-03-08T05:51:12.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/pcbc.ko 2024-03-08T05:51:12.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/pcrypt.ko 2024-03-08T05:51:12.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/rmd160.ko 2024-03-08T05:51:12.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/seed.ko 2024-03-08T05:51:12.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/serpent_generic.ko 2024-03-08T05:51:12.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/tcrypt.ko 2024-03-08T05:51:12.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/tea.ko 2024-03-08T05:51:12.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/twofish_common.ko 2024-03-08T05:51:12.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/twofish_generic.ko 2024-03-08T05:51:12.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/vmac.ko 2024-03-08T05:51:12.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/wp512.ko 2024-03-08T05:51:12.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xcbc.ko 2024-03-08T05:51:12.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xor.ko 2024-03-08T05:51:12.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xxhash_generic.ko 2024-03-08T05:51:12.577 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers 2024-03-08T05:51:12.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi 2024-03-08T05:51:12.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-08T05:51:12.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_pad.ko 2024-03-08T05:51:12.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/custom_method.ko 2024-03-08T05:51:12.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/ec_sys.ko 2024-03-08T05:51:12.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/platform_profile.ko 2024-03-08T05:51:12.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/sbs.ko 2024-03-08T05:51:12.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/sbshc.ko 2024-03-08T05:51:12.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/video.ko 2024-03-08T05:51:12.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata 2024-03-08T05:51:12.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/acard-ahci.ko 2024-03-08T05:51:12.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ahci_platform.ko 2024-03-08T05:51:12.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ata_generic.ko 2024-03-08T05:51:12.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/libahci_platform.ko 2024-03-08T05:51:12.578 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_acpi.ko 2024-03-08T05:51:12.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ali.ko 2024-03-08T05:51:12.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_amd.ko 2024-03-08T05:51:12.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_artop.ko 2024-03-08T05:51:12.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_atiixp.ko 2024-03-08T05:51:12.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_atp867x.ko 2024-03-08T05:51:12.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cmd640.ko 2024-03-08T05:51:12.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cmd64x.ko 2024-03-08T05:51:12.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cypress.ko 2024-03-08T05:51:12.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_efar.ko 2024-03-08T05:51:12.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt366.ko 2024-03-08T05:51:12.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt37x.ko 2024-03-08T05:51:12.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-08T05:51:12.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-08T05:51:12.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_it8213.ko 2024-03-08T05:51:12.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_it821x.ko 2024-03-08T05:51:12.579 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_jmicron.ko 2024-03-08T05:51:12.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_marvell.ko 2024-03-08T05:51:12.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_mpiix.ko 2024-03-08T05:51:12.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_netcell.ko 2024-03-08T05:51:12.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ninja32.ko 2024-03-08T05:51:12.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ns87410.ko 2024-03-08T05:51:12.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ns87415.ko 2024-03-08T05:51:12.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_oldpiix.ko 2024-03-08T05:51:12.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_opti.ko 2024-03-08T05:51:12.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_optidma.ko 2024-03-08T05:51:12.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pcmcia.ko 2024-03-08T05:51:12.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-08T05:51:12.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-08T05:51:12.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_piccolo.ko 2024-03-08T05:51:12.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_rdc.ko 2024-03-08T05:51:12.580 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sch.ko 2024-03-08T05:51:12.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_serverworks.ko 2024-03-08T05:51:12.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sil680.ko 2024-03-08T05:51:12.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sis.ko 2024-03-08T05:51:12.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sl82c105.ko 2024-03-08T05:51:12.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_triflex.ko 2024-03-08T05:51:12.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_via.ko 2024-03-08T05:51:12.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pdc_adma.ko 2024-03-08T05:51:12.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_inic162x.ko 2024-03-08T05:51:12.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_mv.ko 2024-03-08T05:51:12.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_nv.ko 2024-03-08T05:51:12.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_promise.ko 2024-03-08T05:51:12.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_qstor.ko 2024-03-08T05:51:12.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sil.ko 2024-03-08T05:51:12.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sil24.ko 2024-03-08T05:51:12.581 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sis.ko 2024-03-08T05:51:12.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_svw.ko 2024-03-08T05:51:12.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sx4.ko 2024-03-08T05:51:12.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_uli.ko 2024-03-08T05:51:12.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_via.ko 2024-03-08T05:51:12.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_vsc.ko 2024-03-08T05:51:12.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/auxdisplay 2024-03-08T05:51:12.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/auxdisplay/ks0108.ko 2024-03-08T05:51:12.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base 2024-03-08T05:51:12.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base/regmap 2024-03-08T05:51:12.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-08T05:51:12.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-08T05:51:12.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/bcma 2024-03-08T05:51:12.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/bcma/bcma.ko 2024-03-08T05:51:12.582 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block 2024-03-08T05:51:12.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/aoe 2024-03-08T05:51:12.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/aoe/aoe.ko 2024-03-08T05:51:12.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/brd.ko 2024-03-08T05:51:12.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/drbd 2024-03-08T05:51:12.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/drbd/drbd.ko 2024-03-08T05:51:12.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/floppy.ko 2024-03-08T05:51:12.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/loop.ko 2024-03-08T05:51:12.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/mtip32xx 2024-03-08T05:51:12.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-08T05:51:12.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/nbd.ko 2024-03-08T05:51:12.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/null_blk 2024-03-08T05:51:12.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/null_blk/null_blk.ko 2024-03-08T05:51:12.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/pktcdvd.ko 2024-03-08T05:51:12.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/rbd.ko 2024-03-08T05:51:12.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/virtio_blk.ko 2024-03-08T05:51:12.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkback 2024-03-08T05:51:12.583 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-08T05:51:12.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkfront.ko 2024-03-08T05:51:12.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/zram 2024-03-08T05:51:12.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/zram/zram.ko 2024-03-08T05:51:12.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char 2024-03-08T05:51:12.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hangcheck-timer.ko 2024-03-08T05:51:12.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random 2024-03-08T05:51:12.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-08T05:51:12.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-08T05:51:12.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-08T05:51:12.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/via-rng.ko 2024-03-08T05:51:12.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-08T05:51:12.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi 2024-03-08T05:51:12.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-08T05:51:12.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-08T05:51:12.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-08T05:51:12.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-08T05:51:12.584 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-08T05:51:12.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-08T05:51:12.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/lp.ko 2024-03-08T05:51:12.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/mwave 2024-03-08T05:51:12.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/mwave/mwave.ko 2024-03-08T05:51:12.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ppdev.ko 2024-03-08T05:51:12.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tlclk.ko 2024-03-08T05:51:12.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm 2024-03-08T05:51:12.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm.ko 2024-03-08T05:51:12.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-08T05:51:12.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-08T05:51:12.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-08T05:51:12.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-08T05:51:12.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-08T05:51:12.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/uv_mmtimer.ko 2024-03-08T05:51:12.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/virtio_console.ko 2024-03-08T05:51:12.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq 2024-03-08T05:51:12.585 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-08T05:51:12.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-08T05:51:12.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-08T05:51:12.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-08T05:51:12.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-08T05:51:12.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-08T05:51:12.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto 2024-03-08T05:51:12.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp 2024-03-08T05:51:12.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-08T05:51:12.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ccp.ko 2024-03-08T05:51:12.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel 2024-03-08T05:51:12.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat 2024-03-08T05:51:12.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_common 2024-03-08T05:51:12.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-08T05:51:12.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-08T05:51:12.586 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-08T05:51:12.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/padlock-aes.ko 2024-03-08T05:51:12.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/padlock-sha.ko 2024-03-08T05:51:12.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/virtio 2024-03-08T05:51:12.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-08T05:51:12.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dca 2024-03-08T05:51:12.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dca/dca.ko 2024-03-08T05:51:12.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/devfreq 2024-03-08T05:51:12.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-08T05:51:12.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma 2024-03-08T05:51:12.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/dw 2024-03-08T05:51:12.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-08T05:51:12.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ioat 2024-03-08T05:51:12.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-08T05:51:12.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac 2024-03-08T05:51:12.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/amd64_edac.ko 2024-03-08T05:51:12.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/e752x_edac.ko 2024-03-08T05:51:12.587 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/edac_mce_amd.ko 2024-03-08T05:51:12.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i3000_edac.ko 2024-03-08T05:51:12.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i3200_edac.ko 2024-03-08T05:51:12.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i5100_edac.ko 2024-03-08T05:51:12.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i5400_edac.ko 2024-03-08T05:51:12.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i7300_edac.ko 2024-03-08T05:51:12.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i7core_edac.ko 2024-03-08T05:51:12.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i82975x_edac.ko 2024-03-08T05:51:12.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/ie31200_edac.ko 2024-03-08T05:51:12.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/sb_edac.ko 2024-03-08T05:51:12.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/x38_edac.ko 2024-03-08T05:51:12.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware 2024-03-08T05:51:12.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/edd.ko 2024-03-08T05:51:12.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-08T05:51:12.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio 2024-03-08T05:51:12.588 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-ich.ko 2024-03-08T05:51:12.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-08T05:51:12.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid 2024-03-08T05:51:12.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-appleir.ko 2024-03-08T05:51:12.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-aureal.ko 2024-03-08T05:51:12.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-axff.ko 2024-03-08T05:51:12.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-dr.ko 2024-03-08T05:51:12.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-elecom.ko 2024-03-08T05:51:12.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-elo.ko 2024-03-08T05:51:12.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-emsff.ko 2024-03-08T05:51:12.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gaff.ko 2024-03-08T05:51:12.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gt683r.ko 2024-03-08T05:51:12.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gyration.ko 2024-03-08T05:51:12.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-08T05:51:12.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-08T05:51:12.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtekff.ko 2024-03-08T05:51:12.589 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-hyperv.ko 2024-03-08T05:51:12.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-icade.ko 2024-03-08T05:51:12.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-keytouch.ko 2024-03-08T05:51:12.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-kye.ko 2024-03-08T05:51:12.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lcpower.ko 2024-03-08T05:51:12.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-led.ko 2024-03-08T05:51:12.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lenovo.ko 2024-03-08T05:51:12.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-08T05:51:12.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-08T05:51:12.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-multitouch.ko 2024-03-08T05:51:12.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-ortek.ko 2024-03-08T05:51:12.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-penmount.ko 2024-03-08T05:51:12.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-petalynx.ko 2024-03-08T05:51:12.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-picolcd.ko 2024-03-08T05:51:12.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-pl.ko 2024-03-08T05:51:12.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-plantronics.ko 2024-03-08T05:51:12.590 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-primax.ko 2024-03-08T05:51:12.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-rmi.ko 2024-03-08T05:51:12.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-08T05:51:12.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-common.ko 2024-03-08T05:51:12.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-08T05:51:12.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-08T05:51:12.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-08T05:51:12.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-08T05:51:12.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-08T05:51:12.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-08T05:51:12.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-08T05:51:12.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-08T05:51:12.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-08T05:51:12.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat.ko 2024-03-08T05:51:12.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-saitek.ko 2024-03-08T05:51:12.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-samsung.ko 2024-03-08T05:51:12.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-08T05:51:12.591 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sjoy.ko 2024-03-08T05:51:12.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sony.ko 2024-03-08T05:51:12.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-speedlink.ko 2024-03-08T05:51:12.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-steelseries.ko 2024-03-08T05:51:12.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sunplus.ko 2024-03-08T05:51:12.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-08T05:51:12.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-tivo.ko 2024-03-08T05:51:12.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-tmff.ko 2024-03-08T05:51:12.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-topseed.ko 2024-03-08T05:51:12.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-twinhan.ko 2024-03-08T05:51:12.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-uclogic.ko 2024-03-08T05:51:12.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-waltop.ko 2024-03-08T05:51:12.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-wiimote.ko 2024-03-08T05:51:12.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-xinmo.ko 2024-03-08T05:51:12.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-zpff.ko 2024-03-08T05:51:12.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-zydacron.ko 2024-03-08T05:51:12.592 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/uhid.ko 2024-03-08T05:51:12.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/wacom.ko 2024-03-08T05:51:12.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv 2024-03-08T05:51:12.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_balloon.ko 2024-03-08T05:51:12.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_utils.ko 2024-03-08T05:51:12.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_vmbus.ko 2024-03-08T05:51:12.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon 2024-03-08T05:51:12.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/abituguru.ko 2024-03-08T05:51:12.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/abituguru3.ko 2024-03-08T05:51:12.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-08T05:51:12.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ad7414.ko 2024-03-08T05:51:12.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ad7418.ko 2024-03-08T05:51:12.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adc128d818.ko 2024-03-08T05:51:12.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1025.ko 2024-03-08T05:51:12.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1026.ko 2024-03-08T05:51:12.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1029.ko 2024-03-08T05:51:12.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1031.ko 2024-03-08T05:51:12.593 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm9240.ko 2024-03-08T05:51:12.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ads7828.ko 2024-03-08T05:51:12.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7410.ko 2024-03-08T05:51:12.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7411.ko 2024-03-08T05:51:12.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7462.ko 2024-03-08T05:51:12.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7470.ko 2024-03-08T05:51:12.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7475.ko 2024-03-08T05:51:12.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7x10.ko 2024-03-08T05:51:12.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/amc6821.ko 2024-03-08T05:51:12.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/applesmc.ko 2024-03-08T05:51:12.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asb100.ko 2024-03-08T05:51:12.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asc7621.ko 2024-03-08T05:51:12.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-08T05:51:12.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/atxp1.ko 2024-03-08T05:51:12.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/coretemp.ko 2024-03-08T05:51:12.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-08T05:51:12.594 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/dme1737.ko 2024-03-08T05:51:12.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ds1621.ko 2024-03-08T05:51:12.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ds620.ko 2024-03-08T05:51:12.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc1403.ko 2024-03-08T05:51:12.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc6w201.ko 2024-03-08T05:51:12.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f71805f.ko 2024-03-08T05:51:12.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f71882fg.ko 2024-03-08T05:51:12.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f75375s.ko 2024-03-08T05:51:12.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/fam15h_power.ko 2024-03-08T05:51:12.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/fschmd.ko 2024-03-08T05:51:12.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/g760a.ko 2024-03-08T05:51:12.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/g762.ko 2024-03-08T05:51:12.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/gl518sm.ko 2024-03-08T05:51:12.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/gl520sm.ko 2024-03-08T05:51:12.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-08T05:51:12.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/i5500_temp.ko 2024-03-08T05:51:12.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/i5k_amb.ko 2024-03-08T05:51:12.595 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ibmaem.ko 2024-03-08T05:51:12.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ibmpex.ko 2024-03-08T05:51:12.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ina209.ko 2024-03-08T05:51:12.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ina2xx.ko 2024-03-08T05:51:12.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/it87.ko 2024-03-08T05:51:12.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/k10temp.ko 2024-03-08T05:51:12.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/k8temp.ko 2024-03-08T05:51:12.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lineage-pem.ko 2024-03-08T05:51:12.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm63.ko 2024-03-08T05:51:12.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm73.ko 2024-03-08T05:51:12.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm75.ko 2024-03-08T05:51:12.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm77.ko 2024-03-08T05:51:12.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm78.ko 2024-03-08T05:51:12.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm80.ko 2024-03-08T05:51:12.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm83.ko 2024-03-08T05:51:12.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm85.ko 2024-03-08T05:51:12.596 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm87.ko 2024-03-08T05:51:12.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm90.ko 2024-03-08T05:51:12.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm92.ko 2024-03-08T05:51:12.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm93.ko 2024-03-08T05:51:12.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95234.ko 2024-03-08T05:51:12.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95241.ko 2024-03-08T05:51:12.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95245.ko 2024-03-08T05:51:12.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc2945.ko 2024-03-08T05:51:12.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4151.ko 2024-03-08T05:51:12.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4215.ko 2024-03-08T05:51:12.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4222.ko 2024-03-08T05:51:12.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4245.ko 2024-03-08T05:51:12.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4260.ko 2024-03-08T05:51:12.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4261.ko 2024-03-08T05:51:12.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max16065.ko 2024-03-08T05:51:12.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max1619.ko 2024-03-08T05:51:12.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max1668.ko 2024-03-08T05:51:12.597 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max197.ko 2024-03-08T05:51:12.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6639.ko 2024-03-08T05:51:12.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6650.ko 2024-03-08T05:51:12.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6697.ko 2024-03-08T05:51:12.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/mcp3021.ko 2024-03-08T05:51:12.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6683.ko 2024-03-08T05:51:12.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6775-core.ko 2024-03-08T05:51:12.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6775.ko 2024-03-08T05:51:12.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct7802.ko 2024-03-08T05:51:12.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pc87360.ko 2024-03-08T05:51:12.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pc87427.ko 2024-03-08T05:51:12.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pcf8591.ko 2024-03-08T05:51:12.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus 2024-03-08T05:51:12.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-08T05:51:12.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-08T05:51:12.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-08T05:51:12.598 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-08T05:51:12.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-08T05:51:12.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-08T05:51:12.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-08T05:51:12.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-08T05:51:12.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-08T05:51:12.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-08T05:51:12.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-08T05:51:12.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-08T05:51:12.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/powr1220.ko 2024-03-08T05:51:12.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch5627.ko 2024-03-08T05:51:12.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch5636.ko 2024-03-08T05:51:12.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-08T05:51:12.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sht15.ko 2024-03-08T05:51:12.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sht21.ko 2024-03-08T05:51:12.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/shtc1.ko 2024-03-08T05:51:12.599 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sis5595.ko 2024-03-08T05:51:12.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47b397.ko 2024-03-08T05:51:12.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47m1.ko 2024-03-08T05:51:12.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47m192.ko 2024-03-08T05:51:12.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/thmc50.ko 2024-03-08T05:51:12.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp102.ko 2024-03-08T05:51:12.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp103.ko 2024-03-08T05:51:12.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp401.ko 2024-03-08T05:51:12.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp421.ko 2024-03-08T05:51:12.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/via-cputemp.ko 2024-03-08T05:51:12.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/via686a.ko 2024-03-08T05:51:12.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/vt1211.ko 2024-03-08T05:51:12.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/vt8231.ko 2024-03-08T05:51:12.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83627ehf.ko 2024-03-08T05:51:12.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83627hf.ko 2024-03-08T05:51:12.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83781d.ko 2024-03-08T05:51:12.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83791d.ko 2024-03-08T05:51:12.600 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83792d.ko 2024-03-08T05:51:12.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83793.ko 2024-03-08T05:51:12.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83795.ko 2024-03-08T05:51:12.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83l785ts.ko 2024-03-08T05:51:12.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83l786ng.ko 2024-03-08T05:51:12.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c 2024-03-08T05:51:12.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos 2024-03-08T05:51:12.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-08T05:51:12.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-08T05:51:12.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses 2024-03-08T05:51:12.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-08T05:51:12.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-08T05:51:12.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-08T05:51:12.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-08T05:51:12.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-08T05:51:12.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-08T05:51:12.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-08T05:51:12.601 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-08T05:51:12.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-08T05:51:12.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-08T05:51:12.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-08T05:51:12.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-08T05:51:12.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-08T05:51:12.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-08T05:51:12.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-08T05:51:12.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-08T05:51:12.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-08T05:51:12.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-08T05:51:12.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-08T05:51:12.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-08T05:51:12.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-08T05:51:12.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-08T05:51:12.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-08T05:51:12.602 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-dev.ko 2024-03-08T05:51:12.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-mux.ko 2024-03-08T05:51:12.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-08T05:51:12.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-smbus.ko 2024-03-08T05:51:12.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-stub.ko 2024-03-08T05:51:12.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband 2024-03-08T05:51:12.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core 2024-03-08T05:51:12.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-08T05:51:12.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_core.ko 2024-03-08T05:51:12.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-08T05:51:12.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-08T05:51:12.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-08T05:51:12.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-08T05:51:12.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-08T05:51:12.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw 2024-03-08T05:51:12.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/cxgb4 2024-03-08T05:51:12.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-08T05:51:12.603 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx4 2024-03-08T05:51:12.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-08T05:51:12.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx5 2024-03-08T05:51:12.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-08T05:51:12.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mthca 2024-03-08T05:51:12.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-08T05:51:12.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp 2024-03-08T05:51:12.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ipoib 2024-03-08T05:51:12.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-08T05:51:12.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/iser 2024-03-08T05:51:12.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-08T05:51:12.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/isert 2024-03-08T05:51:12.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-08T05:51:12.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srp 2024-03-08T05:51:12.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-08T05:51:12.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srpt 2024-03-08T05:51:12.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-08T05:51:12.604 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input 2024-03-08T05:51:12.605 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport 2024-03-08T05:51:12.605 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-08T05:51:12.605 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-08T05:51:12.605 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/gameport.ko 2024-03-08T05:51:12.605 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/joydev.ko 2024-03-08T05:51:12.605 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard 2024-03-08T05:51:12.605 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-08T05:51:12.605 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse 2024-03-08T05:51:12.605 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/appletouch.ko 2024-03-08T05:51:12.605 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/bcm5974.ko 2024-03-08T05:51:12.605 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/cyapatp.ko 2024-03-08T05:51:12.605 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-08T05:51:12.605 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/sermouse.ko 2024-03-08T05:51:12.605 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-08T05:51:12.605 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-08T05:51:12.605 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-08T05:51:12.605 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/rmi4 2024-03-08T05:51:12.606 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-08T05:51:12.606 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio 2024-03-08T05:51:12.606 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/altera_ps2.ko 2024-03-08T05:51:12.606 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/arc_ps2.ko 2024-03-08T05:51:12.606 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-08T05:51:12.606 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/serio_raw.ko 2024-03-08T05:51:12.606 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/sparse-keymap.ko 2024-03-08T05:51:12.606 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds 2024-03-08T05:51:12.606 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-blinkm.ko 2024-03-08T05:51:12.606 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm3530.ko 2024-03-08T05:51:12.606 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lp3944.ko 2024-03-08T05:51:12.606 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-ss4200.ko 2024-03-08T05:51:12.606 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger 2024-03-08T05:51:12.606 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-08T05:51:12.606 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-08T05:51:12.606 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-08T05:51:12.607 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-08T05:51:12.607 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-08T05:51:12.607 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-08T05:51:12.607 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-08T05:51:12.607 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-08T05:51:12.607 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-08T05:51:12.607 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md 2024-03-08T05:51:12.607 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/bcache 2024-03-08T05:51:12.607 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/bcache/bcache.ko 2024-03-08T05:51:12.607 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-bio-prison.ko 2024-03-08T05:51:12.607 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-cache-smq.ko 2024-03-08T05:51:12.607 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-cache.ko 2024-03-08T05:51:12.607 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-crypt.ko 2024-03-08T05:51:12.607 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-delay.ko 2024-03-08T05:51:12.607 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-flakey.ko 2024-03-08T05:51:12.608 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-log-userspace.ko 2024-03-08T05:51:12.608 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-multipath.ko 2024-03-08T05:51:12.608 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-queue-length.ko 2024-03-08T05:51:12.608 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-raid.ko 2024-03-08T05:51:12.608 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-round-robin.ko 2024-03-08T05:51:12.608 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-service-time.ko 2024-03-08T05:51:12.608 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-switch.ko 2024-03-08T05:51:12.608 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-thin-pool.ko 2024-03-08T05:51:12.608 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-verity.ko 2024-03-08T05:51:12.608 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/persistent-data 2024-03-08T05:51:12.608 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-08T05:51:12.608 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid0.ko 2024-03-08T05:51:12.608 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid1.ko 2024-03-08T05:51:12.608 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid10.ko 2024-03-08T05:51:12.608 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid456.ko 2024-03-08T05:51:12.609 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message 2024-03-08T05:51:12.609 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion 2024-03-08T05:51:12.609 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptbase.ko 2024-03-08T05:51:12.609 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptctl.ko 2024-03-08T05:51:12.609 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptfc.ko 2024-03-08T05:51:12.609 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptlan.ko 2024-03-08T05:51:12.609 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptsas.ko 2024-03-08T05:51:12.609 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptscsih.ko 2024-03-08T05:51:12.609 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptspi.ko 2024-03-08T05:51:12.609 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd 2024-03-08T05:51:12.609 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lpc_ich.ko 2024-03-08T05:51:12.609 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lpc_sch.ko 2024-03-08T05:51:12.609 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/mfd-core.ko 2024-03-08T05:51:12.609 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/sm501.ko 2024-03-08T05:51:12.609 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/viperboard.ko 2024-03-08T05:51:12.609 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/vx855.ko 2024-03-08T05:51:12.610 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/wl1273-core.ko 2024-03-08T05:51:12.610 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc 2024-03-08T05:51:12.610 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/altera-stapl 2024-03-08T05:51:12.610 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-08T05:51:12.610 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/apds9802als.ko 2024-03-08T05:51:12.610 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/apds990x.ko 2024-03-08T05:51:12.610 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/bh1770glc.ko 2024-03-08T05:51:12.610 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/cb710 2024-03-08T05:51:12.610 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/cb710/cb710.ko 2024-03-08T05:51:12.610 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom 2024-03-08T05:51:12.610 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/at24.ko 2024-03-08T05:51:12.610 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-08T05:51:12.610 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/max6875.ko 2024-03-08T05:51:12.610 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/enclosure.ko 2024-03-08T05:51:12.610 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/hpilo.ko 2024-03-08T05:51:12.610 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/isl29003.ko 2024-03-08T05:51:12.611 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/isl29020.ko 2024-03-08T05:51:12.611 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d 2024-03-08T05:51:12.611 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-08T05:51:12.611 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-08T05:51:12.611 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei 2024-03-08T05:51:12.611 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei-me.ko 2024-03-08T05:51:12.611 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei-txe.ko 2024-03-08T05:51:12.611 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei.ko 2024-03-08T05:51:12.611 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-gru 2024-03-08T05:51:12.611 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-08T05:51:12.611 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp 2024-03-08T05:51:12.611 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-08T05:51:12.611 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-08T05:51:12.611 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-08T05:51:12.611 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tifm_7xx1.ko 2024-03-08T05:51:12.611 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tifm_core.ko 2024-03-08T05:51:12.611 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tsl2550.ko 2024-03-08T05:51:12.612 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_balloon.ko 2024-03-08T05:51:12.612 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_vmci 2024-03-08T05:51:12.612 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-08T05:51:12.612 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net 2024-03-08T05:51:12.612 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/bonding 2024-03-08T05:51:12.612 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/bonding/bonding.ko 2024-03-08T05:51:12.612 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa 2024-03-08T05:51:12.612 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/b53 2024-03-08T05:51:12.612 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-08T05:51:12.612 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-08T05:51:12.612 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-08T05:51:12.612 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6xxx 2024-03-08T05:51:12.612 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-08T05:51:12.612 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dummy.ko 2024-03-08T05:51:12.612 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/eql.ko 2024-03-08T05:51:12.612 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet 2024-03-08T05:51:12.612 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com 2024-03-08T05:51:12.613 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-08T05:51:12.613 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-08T05:51:12.613 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-08T05:51:12.613 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-08T05:51:12.613 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390 2024-03-08T05:51:12.613 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-08T05:51:12.613 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-08T05:51:12.613 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-08T05:51:12.613 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-08T05:51:12.613 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/adaptec 2024-03-08T05:51:12.613 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-08T05:51:12.613 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/agere 2024-03-08T05:51:12.613 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-08T05:51:12.613 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/alteon 2024-03-08T05:51:12.613 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-08T05:51:12.613 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/altera 2024-03-08T05:51:12.613 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-08T05:51:12.614 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd 2024-03-08T05:51:12.614 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-08T05:51:12.614 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-08T05:51:12.614 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-08T05:51:12.614 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros 2024-03-08T05:51:12.614 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/alx 2024-03-08T05:51:12.614 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-08T05:51:12.614 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-08T05:51:12.614 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-08T05:51:12.614 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-08T05:51:12.614 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-08T05:51:12.614 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx 2024-03-08T05:51:12.614 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-08T05:51:12.614 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-08T05:51:12.614 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom 2024-03-08T05:51:12.614 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-08T05:51:12.615 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-08T05:51:12.615 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-08T05:51:12.615 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-08T05:51:12.615 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-08T05:51:12.615 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/genet 2024-03-08T05:51:12.615 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-08T05:51:12.615 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-08T05:51:12.615 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade 2024-03-08T05:51:12.615 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/bna 2024-03-08T05:51:12.615 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-08T05:51:12.615 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio 2024-03-08T05:51:12.615 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-08T05:51:12.615 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-08T05:51:12.615 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-08T05:51:12.615 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-08T05:51:12.615 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-08T05:51:12.616 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-08T05:51:12.616 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-08T05:51:12.616 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-08T05:51:12.616 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-08T05:51:12.616 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-08T05:51:12.616 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco 2024-03-08T05:51:12.616 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/enic 2024-03-08T05:51:12.616 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-08T05:51:12.616 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec 2024-03-08T05:51:12.616 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip 2024-03-08T05:51:12.616 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-08T05:51:12.616 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-08T05:51:12.616 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-08T05:51:12.616 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-08T05:51:12.616 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-08T05:51:12.616 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-08T05:51:12.616 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink 2024-03-08T05:51:12.617 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-08T05:51:12.617 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-08T05:51:12.617 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dnet.ko 2024-03-08T05:51:12.617 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex 2024-03-08T05:51:12.617 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/benet 2024-03-08T05:51:12.617 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-08T05:51:12.617 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ethoc.ko 2024-03-08T05:51:12.617 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/fealnx.ko 2024-03-08T05:51:12.617 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel 2024-03-08T05:51:12.617 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-08T05:51:12.617 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000 2024-03-08T05:51:12.617 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-08T05:51:12.617 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000e 2024-03-08T05:51:12.617 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-08T05:51:12.617 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/fm10k 2024-03-08T05:51:12.617 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-08T05:51:12.617 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/i40e 2024-03-08T05:51:12.617 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-08T05:51:12.618 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/iavf 2024-03-08T05:51:12.618 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-08T05:51:12.618 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igb 2024-03-08T05:51:12.618 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-08T05:51:12.618 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igbvf 2024-03-08T05:51:12.618 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-08T05:51:12.618 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-08T05:51:12.618 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-08T05:51:12.618 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-08T05:51:12.618 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-08T05:51:12.618 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/jme.ko 2024-03-08T05:51:12.618 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell 2024-03-08T05:51:12.618 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-08T05:51:12.618 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-08T05:51:12.618 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-08T05:51:12.619 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox 2024-03-08T05:51:12.619 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-08T05:51:12.619 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-08T05:51:12.619 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-08T05:51:12.619 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-08T05:51:12.619 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-08T05:51:12.619 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-08T05:51:12.619 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel 2024-03-08T05:51:12.619 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-08T05:51:12.619 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom 2024-03-08T05:51:12.619 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-08T05:51:12.619 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-08T05:51:12.619 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi 2024-03-08T05:51:12.619 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-08T05:51:12.619 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-08T05:51:12.620 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/neterion 2024-03-08T05:51:12.620 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-08T05:51:12.620 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/nvidia 2024-03-08T05:51:12.620 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-08T05:51:12.620 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines 2024-03-08T05:51:12.620 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-08T05:51:12.620 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-08T05:51:12.620 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic 2024-03-08T05:51:12.620 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-08T05:51:12.620 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-08T05:51:12.620 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-08T05:51:12.620 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-08T05:51:12.620 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-08T05:51:12.620 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rdc 2024-03-08T05:51:12.620 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-08T05:51:12.620 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek 2024-03-08T05:51:12.620 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-08T05:51:12.621 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-08T05:51:12.621 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-08T05:51:12.621 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-08T05:51:12.621 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rocker 2024-03-08T05:51:12.621 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-08T05:51:12.621 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sfc 2024-03-08T05:51:12.621 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-08T05:51:12.621 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/silan 2024-03-08T05:51:12.621 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-08T05:51:12.621 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis 2024-03-08T05:51:12.621 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-08T05:51:12.621 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-08T05:51:12.621 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc 2024-03-08T05:51:12.621 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-08T05:51:12.621 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-08T05:51:12.621 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-08T05:51:12.622 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-08T05:51:12.622 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro 2024-03-08T05:51:12.622 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-08T05:51:12.622 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-08T05:51:12.622 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-08T05:51:12.622 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun 2024-03-08T05:51:12.622 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-08T05:51:12.622 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-08T05:51:12.622 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-08T05:51:12.622 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-08T05:51:12.622 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/tehuti 2024-03-08T05:51:12.622 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-08T05:51:12.622 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ti 2024-03-08T05:51:12.622 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-08T05:51:12.622 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via 2024-03-08T05:51:12.622 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-08T05:51:12.623 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-08T05:51:12.623 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet 2024-03-08T05:51:12.623 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-08T05:51:12.623 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-08T05:51:12.623 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/xircom 2024-03-08T05:51:12.623 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-08T05:51:12.623 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/geneve.ko 2024-03-08T05:51:12.623 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/hyperv 2024-03-08T05:51:12.623 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-08T05:51:12.623 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ieee802154 2024-03-08T05:51:12.623 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-08T05:51:12.623 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ifb.ko 2024-03-08T05:51:12.623 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ipvlan 2024-03-08T05:51:12.623 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-08T05:51:12.623 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/macvlan.ko 2024-03-08T05:51:12.623 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/macvtap.ko 2024-03-08T05:51:12.623 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio 2024-03-08T05:51:12.624 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio.ko 2024-03-08T05:51:12.624 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-08T05:51:12.624 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-08T05:51:12.624 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-08T05:51:12.624 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mii.ko 2024-03-08T05:51:12.624 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/net_failover.ko 2024-03-08T05:51:12.624 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/netconsole.ko 2024-03-08T05:51:12.624 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/nlmon.ko 2024-03-08T05:51:12.624 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs 2024-03-08T05:51:12.624 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-08T05:51:12.624 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-08T05:51:12.624 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy 2024-03-08T05:51:12.624 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/amd.ko 2024-03-08T05:51:12.624 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-08T05:51:12.624 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-08T05:51:12.624 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-08T05:51:12.624 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm87xx.ko 2024-03-08T05:51:12.625 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/broadcom.ko 2024-03-08T05:51:12.625 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/cicada.ko 2024-03-08T05:51:12.625 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/davicom.ko 2024-03-08T05:51:12.625 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/dp83640.ko 2024-03-08T05:51:12.625 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/et1011c.ko 2024-03-08T05:51:12.625 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/icplus.ko 2024-03-08T05:51:12.625 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/lxt.ko 2024-03-08T05:51:12.625 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/marvell.ko 2024-03-08T05:51:12.625 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/micrel.ko 2024-03-08T05:51:12.625 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/national.ko 2024-03-08T05:51:12.625 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/phylink.ko 2024-03-08T05:51:12.625 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/qsemi.ko 2024-03-08T05:51:12.625 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/realtek.ko 2024-03-08T05:51:12.625 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/smsc.ko 2024-03-08T05:51:12.625 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/ste10Xp.ko 2024-03-08T05:51:12.625 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/vitesse.ko 2024-03-08T05:51:12.626 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp 2024-03-08T05:51:12.626 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-08T05:51:12.626 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_async.ko 2024-03-08T05:51:12.626 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-08T05:51:12.626 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-08T05:51:12.626 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-08T05:51:12.626 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-08T05:51:12.626 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pppoe.ko 2024-03-08T05:51:12.626 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pppox.ko 2024-03-08T05:51:12.626 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pptp.ko 2024-03-08T05:51:12.626 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip 2024-03-08T05:51:12.626 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip/slhc.ko 2024-03-08T05:51:12.626 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip/slip.ko 2024-03-08T05:51:12.626 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/sungem_phy.ko 2024-03-08T05:51:12.626 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/tap.ko 2024-03-08T05:51:12.627 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team 2024-03-08T05:51:12.627 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team.ko 2024-03-08T05:51:12.627 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-08T05:51:12.627 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-08T05:51:12.627 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-08T05:51:12.627 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_random.ko 2024-03-08T05:51:12.627 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-08T05:51:12.627 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/tun.ko 2024-03-08T05:51:12.627 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/veth.ko 2024-03-08T05:51:12.627 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/virtio_net.ko 2024-03-08T05:51:12.627 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vmxnet3 2024-03-08T05:51:12.627 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-08T05:51:12.627 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vxlan 2024-03-08T05:51:12.627 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vxlan/vxlan.ko 2024-03-08T05:51:12.627 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netback 2024-03-08T05:51:12.627 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-08T05:51:12.627 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netfront.ko 2024-03-08T05:51:12.628 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ntb 2024-03-08T05:51:12.628 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ntb/ntb.ko 2024-03-08T05:51:12.628 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme 2024-03-08T05:51:12.628 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host 2024-03-08T05:51:12.628 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/nvme-core.ko 2024-03-08T05:51:12.628 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/nvme.ko 2024-03-08T05:51:12.628 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport 2024-03-08T05:51:12.628 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport.ko 2024-03-08T05:51:12.628 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_cs.ko 2024-03-08T05:51:12.628 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_pc.ko 2024-03-08T05:51:12.628 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_serial.ko 2024-03-08T05:51:12.628 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci 2024-03-08T05:51:12.628 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug 2024-03-08T05:51:12.628 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-08T05:51:12.628 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/pcie 2024-03-08T05:51:12.628 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-08T05:51:12.629 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/xen-pcifront.ko 2024-03-08T05:51:12.629 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia 2024-03-08T05:51:12.629 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/i82092.ko 2024-03-08T05:51:12.629 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pd6729.ko 2024-03-08T05:51:12.629 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-08T05:51:12.629 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl 2024-03-08T05:51:12.629 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/intel 2024-03-08T05:51:12.629 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-08T05:51:12.629 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform 2024-03-08T05:51:12.629 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86 2024-03-08T05:51:12.629 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-08T05:51:12.629 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/acerhdf.ko 2024-03-08T05:51:12.629 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-08T05:51:12.629 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-08T05:51:12.629 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-08T05:51:12.629 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-08T05:51:12.629 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-08T05:51:12.630 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-08T05:51:12.630 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-08T05:51:12.630 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-08T05:51:12.630 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-08T05:51:12.630 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/hdaps.ko 2024-03-08T05:51:12.630 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel 2024-03-08T05:51:12.630 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-08T05:51:12.630 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel_ips.ko 2024-03-08T05:51:12.630 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-08T05:51:12.630 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-08T05:51:12.630 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-08T05:51:12.630 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-08T05:51:12.630 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-08T05:51:12.630 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-08T05:51:12.630 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-08T05:51:12.630 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-08T05:51:12.631 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-08T05:51:12.631 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/wmi.ko 2024-03-08T05:51:12.631 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap 2024-03-08T05:51:12.631 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-08T05:51:12.631 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-08T05:51:12.631 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps 2024-03-08T05:51:12.631 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients 2024-03-08T05:51:12.631 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-08T05:51:12.631 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-08T05:51:12.631 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps_parport.ko 2024-03-08T05:51:12.631 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/pps_core.ko 2024-03-08T05:51:12.631 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp 2024-03-08T05:51:12.631 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ptp.ko 2024-03-08T05:51:12.631 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ptp_kvm.ko 2024-03-08T05:51:12.631 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc 2024-03-08T05:51:12.631 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-08T05:51:12.631 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-08T05:51:12.632 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-08T05:51:12.632 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-08T05:51:12.632 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-08T05:51:12.632 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-08T05:51:12.632 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-08T05:51:12.632 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-08T05:51:12.632 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-08T05:51:12.632 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-08T05:51:12.632 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-em3027.ko 2024-03-08T05:51:12.632 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-08T05:51:12.632 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-08T05:51:12.632 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-08T05:51:12.632 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-08T05:51:12.632 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-08T05:51:12.632 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-08T05:51:12.632 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max6900.ko 2024-03-08T05:51:12.632 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-08T05:51:12.633 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-08T05:51:12.633 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-08T05:51:12.633 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-08T05:51:12.633 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-08T05:51:12.633 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-08T05:51:12.633 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-08T05:51:12.633 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-08T05:51:12.633 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-08T05:51:12.633 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-08T05:51:12.633 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-08T05:51:12.633 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-08T05:51:12.633 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-x1205.ko 2024-03-08T05:51:12.633 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi 2024-03-08T05:51:12.633 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-9xxx.ko 2024-03-08T05:51:12.633 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-sas.ko 2024-03-08T05:51:12.633 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-xxxx.ko 2024-03-08T05:51:12.633 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/BusLogic.ko 2024-03-08T05:51:12.633 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/a100u2w.ko 2024-03-08T05:51:12.634 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aacraid 2024-03-08T05:51:12.634 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-08T05:51:12.634 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/advansys.ko 2024-03-08T05:51:12.634 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx 2024-03-08T05:51:12.634 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-08T05:51:12.634 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-08T05:51:12.634 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/am53c974.ko 2024-03-08T05:51:12.634 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/arcmsr 2024-03-08T05:51:12.634 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-08T05:51:12.634 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/atp870u.ko 2024-03-08T05:51:12.634 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/be2iscsi 2024-03-08T05:51:12.634 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-08T05:51:12.634 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bfa 2024-03-08T05:51:12.634 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bfa/bfa.ko 2024-03-08T05:51:12.634 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2fc 2024-03-08T05:51:12.634 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-08T05:51:12.634 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2i 2024-03-08T05:51:12.635 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-08T05:51:12.635 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ch.ko 2024-03-08T05:51:12.635 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/csiostor 2024-03-08T05:51:12.635 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-08T05:51:12.635 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi 2024-03-08T05:51:12.635 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-08T05:51:12.635 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-08T05:51:12.635 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-08T05:51:12.635 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-08T05:51:12.635 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-08T05:51:12.635 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/dc395x.ko 2024-03-08T05:51:12.635 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler 2024-03-08T05:51:12.635 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-08T05:51:12.635 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-08T05:51:12.635 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-08T05:51:12.635 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-08T05:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/dmx3191d.ko 2024-03-08T05:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esas2r 2024-03-08T05:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-08T05:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esp_scsi.ko 2024-03-08T05:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe 2024-03-08T05:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-08T05:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-08T05:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fnic 2024-03-08T05:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fnic/fnic.ko 2024-03-08T05:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hpsa.ko 2024-03-08T05:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hptiop.ko 2024-03-08T05:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hv_storvsc.ko 2024-03-08T05:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/initio.ko 2024-03-08T05:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ipr.ko 2024-03-08T05:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ips.ko 2024-03-08T05:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/isci 2024-03-08T05:51:12.636 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/isci/isci.ko 2024-03-08T05:51:12.637 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-08T05:51:12.637 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-08T05:51:12.637 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libfc 2024-03-08T05:51:12.637 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libfc/libfc.ko 2024-03-08T05:51:12.637 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libiscsi.ko 2024-03-08T05:51:12.637 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-08T05:51:12.637 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libsas 2024-03-08T05:51:12.637 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libsas/libsas.ko 2024-03-08T05:51:12.637 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/lpfc 2024-03-08T05:51:12.637 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-08T05:51:12.637 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid 2024-03-08T05:51:12.637 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid.ko 2024-03-08T05:51:12.637 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-08T05:51:12.637 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-08T05:51:12.637 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-08T05:51:12.637 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mpt3sas 2024-03-08T05:51:12.638 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-08T05:51:12.638 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvsas 2024-03-08T05:51:12.638 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-08T05:51:12.638 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvumi.ko 2024-03-08T05:51:12.638 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pm8001 2024-03-08T05:51:12.638 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-08T05:51:12.638 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pmcraid.ko 2024-03-08T05:51:12.638 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla1280.ko 2024-03-08T05:51:12.638 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx 2024-03-08T05:51:12.638 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-08T05:51:12.638 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-08T05:51:12.638 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla4xxx 2024-03-08T05:51:12.638 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-08T05:51:12.638 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/raid_class.ko 2024-03-08T05:51:12.638 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_debug.ko 2024-03-08T05:51:12.638 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-08T05:51:12.639 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-08T05:51:12.639 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-08T05:51:12.639 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-08T05:51:12.639 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-08T05:51:12.639 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ses.ko 2024-03-08T05:51:12.639 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/st.ko 2024-03-08T05:51:12.639 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/stex.ko 2024-03-08T05:51:12.639 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/sym53c8xx_2 2024-03-08T05:51:12.639 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-08T05:51:12.639 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/virtio_scsi.ko 2024-03-08T05:51:12.639 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-08T05:51:12.639 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/wd719x.ko 2024-03-08T05:51:12.639 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ssb 2024-03-08T05:51:12.639 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ssb/ssb.ko 2024-03-08T05:51:12.639 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target 2024-03-08T05:51:12.639 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/iscsi 2024-03-08T05:51:12.639 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-08T05:51:12.640 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/loopback 2024-03-08T05:51:12.640 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-08T05:51:12.640 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_file.ko 2024-03-08T05:51:12.640 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_iblock.ko 2024-03-08T05:51:12.640 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_mod.ko 2024-03-08T05:51:12.640 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_pscsi.ko 2024-03-08T05:51:12.640 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_user.ko 2024-03-08T05:51:12.640 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/tcm_fc 2024-03-08T05:51:12.640 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-08T05:51:12.640 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal 2024-03-08T05:51:12.640 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel 2024-03-08T05:51:12.640 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal 2024-03-08T05:51:12.640 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-08T05:51:12.640 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-08T05:51:12.640 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-08T05:51:12.640 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-08T05:51:12.640 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-08T05:51:12.641 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-08T05:51:12.641 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-08T05:51:12.641 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-08T05:51:12.641 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-08T05:51:12.641 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-08T05:51:12.641 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-08T05:51:12.641 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-08T05:51:12.641 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-08T05:51:12.641 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-08T05:51:12.641 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-08T05:51:12.641 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-08T05:51:12.641 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-08T05:51:12.641 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-08T05:51:12.641 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty 2024-03-08T05:51:12.641 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ipwireless 2024-03-08T05:51:12.641 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-08T05:51:12.642 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/n_gsm.ko 2024-03-08T05:51:12.642 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/n_hdlc.ko 2024-03-08T05:51:12.642 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/nozomi.ko 2024-03-08T05:51:12.642 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial 2024-03-08T05:51:12.642 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250 2024-03-08T05:51:12.642 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-08T05:51:12.642 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/arc_uart.ko 2024-03-08T05:51:12.642 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/jsm 2024-03-08T05:51:12.642 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-08T05:51:12.642 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs 2024-03-08T05:51:12.642 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/core 2024-03-08T05:51:12.642 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-08T05:51:12.642 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host 2024-03-08T05:51:12.642 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-08T05:51:12.642 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio 2024-03-08T05:51:12.642 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio.ko 2024-03-08T05:51:12.642 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_aec.ko 2024-03-08T05:51:12.643 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_cif.ko 2024-03-08T05:51:12.643 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_pci_generic.ko 2024-03-08T05:51:12.643 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_sercos3.ko 2024-03-08T05:51:12.643 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb 2024-03-08T05:51:12.643 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class 2024-03-08T05:51:12.643 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/cdc-acm.ko 2024-03-08T05:51:12.643 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-08T05:51:12.643 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/usblp.ko 2024-03-08T05:51:12.643 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/usbtmc.ko 2024-03-08T05:51:12.643 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host 2024-03-08T05:51:12.643 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-08T05:51:12.643 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image 2024-03-08T05:51:12.643 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/mdc800.ko 2024-03-08T05:51:12.643 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/microtek.ko 2024-03-08T05:51:12.643 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc 2024-03-08T05:51:12.643 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/adutux.ko 2024-03-08T05:51:12.643 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/appledisplay.ko 2024-03-08T05:51:12.644 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/emi26.ko 2024-03-08T05:51:12.644 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/emi62.ko 2024-03-08T05:51:12.644 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ezusb.ko 2024-03-08T05:51:12.644 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/idmouse.ko 2024-03-08T05:51:12.644 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/iowarrior.ko 2024-03-08T05:51:12.644 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-08T05:51:12.644 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ldusb.ko 2024-03-08T05:51:12.644 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/legousbtower.ko 2024-03-08T05:51:12.644 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/sisusbvga 2024-03-08T05:51:12.644 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-08T05:51:12.644 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-08T05:51:12.644 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usb3503.ko 2024-03-08T05:51:12.644 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usblcd.ko 2024-03-08T05:51:12.644 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-08T05:51:12.644 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/uss720.ko 2024-03-08T05:51:12.644 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/yurex.ko 2024-03-08T05:51:12.645 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy 2024-03-08T05:51:12.645 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-generic.ko 2024-03-08T05:51:12.645 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial 2024-03-08T05:51:12.645 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/aircable.ko 2024-03-08T05:51:12.645 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ark3116.ko 2024-03-08T05:51:12.645 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-08T05:51:12.645 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ch341.ko 2024-03-08T05:51:12.645 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cp210x.ko 2024-03-08T05:51:12.645 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cyberjack.ko 2024-03-08T05:51:12.645 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-08T05:51:12.645 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-08T05:51:12.645 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/empeg.ko 2024-03-08T05:51:12.645 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-08T05:51:12.645 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-08T05:51:12.645 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-08T05:51:12.645 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/io_ti.ko 2024-03-08T05:51:12.645 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ipaq.ko 2024-03-08T05:51:12.646 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ipw.ko 2024-03-08T05:51:12.646 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ir-usb.ko 2024-03-08T05:51:12.646 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-08T05:51:12.646 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/keyspan.ko 2024-03-08T05:51:12.646 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-08T05:51:12.646 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-08T05:51:12.646 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-08T05:51:12.646 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mct_u232.ko 2024-03-08T05:51:12.646 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mos7720.ko 2024-03-08T05:51:12.646 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mos7840.ko 2024-03-08T05:51:12.646 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/navman.ko 2024-03-08T05:51:12.646 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/omninet.ko 2024-03-08T05:51:12.646 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/opticon.ko 2024-03-08T05:51:12.646 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/option.ko 2024-03-08T05:51:12.646 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/oti6858.ko 2024-03-08T05:51:12.646 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/pl2303.ko 2024-03-08T05:51:12.647 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/qcaux.ko 2024-03-08T05:51:12.647 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/qcserial.ko 2024-03-08T05:51:12.647 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/quatech2.ko 2024-03-08T05:51:12.647 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/safe_serial.ko 2024-03-08T05:51:12.647 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/sierra.ko 2024-03-08T05:51:12.647 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-08T05:51:12.647 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ssu100.ko 2024-03-08T05:51:12.647 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/symbolserial.ko 2024-03-08T05:51:12.647 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-08T05:51:12.647 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-08T05:51:12.647 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb_debug.ko 2024-03-08T05:51:12.647 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-08T05:51:12.647 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/visor.ko 2024-03-08T05:51:12.647 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/whiteheat.ko 2024-03-08T05:51:12.647 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-08T05:51:12.647 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage 2024-03-08T05:51:12.647 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/uas.ko 2024-03-08T05:51:12.648 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-08T05:51:12.648 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-08T05:51:12.648 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-08T05:51:12.648 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-08T05:51:12.648 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-08T05:51:12.648 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-08T05:51:12.648 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-08T05:51:12.648 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-karma.ko 2024-03-08T05:51:12.648 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-08T05:51:12.648 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-08T05:51:12.648 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-08T05:51:12.648 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-08T05:51:12.648 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-08T05:51:12.648 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/usb-storage.ko 2024-03-08T05:51:12.648 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip 2024-03-08T05:51:12.649 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-08T05:51:12.649 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-08T05:51:12.649 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-08T05:51:12.649 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio 2024-03-08T05:51:12.649 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci 2024-03-08T05:51:12.649 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-08T05:51:12.649 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-08T05:51:12.649 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/vfio.ko 2024-03-08T05:51:12.649 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-08T05:51:12.649 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost 2024-03-08T05:51:12.649 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost.ko 2024-03-08T05:51:12.649 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-08T05:51:12.649 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_net.ko 2024-03-08T05:51:12.649 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_scsi.ko 2024-03-08T05:51:12.649 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video 2024-03-08T05:51:12.649 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight 2024-03-08T05:51:12.650 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/apple_bl.ko 2024-03-08T05:51:12.650 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lcd.ko 2024-03-08T05:51:12.650 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-08T05:51:12.650 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio 2024-03-08T05:51:12.650 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio.ko 2024-03-08T05:51:12.650 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_balloon.ko 2024-03-08T05:51:12.650 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_mmio.ko 2024-03-08T05:51:12.650 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_pci.ko 2024-03-08T05:51:12.650 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-08T05:51:12.650 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-08T05:51:12.650 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_ring.ko 2024-03-08T05:51:12.650 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1 2024-03-08T05:51:12.650 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters 2024-03-08T05:51:12.650 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ds2482.ko 2024-03-08T05:51:12.650 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ds2490.ko 2024-03-08T05:51:12.650 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves 2024-03-08T05:51:12.650 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-08T05:51:12.651 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-08T05:51:12.651 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-08T05:51:12.651 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-08T05:51:12.651 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-08T05:51:12.651 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-08T05:51:12.651 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-08T05:51:12.651 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-08T05:51:12.651 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-08T05:51:12.651 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-08T05:51:12.651 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-08T05:51:12.651 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/wire.ko 2024-03-08T05:51:12.651 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog 2024-03-08T05:51:12.651 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-08T05:51:12.651 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-08T05:51:12.651 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-08T05:51:12.651 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/hpwdt.ko 2024-03-08T05:51:12.651 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/i6300esb.ko 2024-03-08T05:51:12.652 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-08T05:51:12.652 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-08T05:51:12.652 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ib700wdt.ko 2024-03-08T05:51:12.652 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ibmasr.ko 2024-03-08T05:51:12.652 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-08T05:51:12.652 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-08T05:51:12.652 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/it87_wdt.ko 2024-03-08T05:51:12.652 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/machzwd.ko 2024-03-08T05:51:12.652 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/nv_tco.ko 2024-03-08T05:51:12.652 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-08T05:51:12.652 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-08T05:51:12.652 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-08T05:51:12.652 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-08T05:51:12.652 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/softdog.ko 2024-03-08T05:51:12.652 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-08T05:51:12.652 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/via_wdt.ko 2024-03-08T05:51:12.652 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-08T05:51:12.653 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-08T05:51:12.653 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-08T05:51:12.653 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wdt_pci.ko 2024-03-08T05:51:12.653 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/xen_wdt.ko 2024-03-08T05:51:12.653 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen 2024-03-08T05:51:12.653 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-08T05:51:12.653 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-evtchn.ko 2024-03-08T05:51:12.653 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-gntalloc.ko 2024-03-08T05:51:12.653 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-gntdev.ko 2024-03-08T05:51:12.653 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-pciback 2024-03-08T05:51:12.653 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-08T05:51:12.653 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-privcmd.ko 2024-03-08T05:51:12.653 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xenfs 2024-03-08T05:51:12.653 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-08T05:51:12.653 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs 2024-03-08T05:51:12.654 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/9p 2024-03-08T05:51:12.654 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/9p/9p.ko 2024-03-08T05:51:12.654 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/affs 2024-03-08T05:51:12.654 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/affs/affs.ko 2024-03-08T05:51:12.654 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/befs 2024-03-08T05:51:12.654 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/befs/befs.ko 2024-03-08T05:51:12.654 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/binfmt_misc.ko 2024-03-08T05:51:12.654 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/btrfs 2024-03-08T05:51:12.654 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/btrfs/btrfs.ko 2024-03-08T05:51:12.654 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cachefiles 2024-03-08T05:51:12.654 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cachefiles/cachefiles.ko 2024-03-08T05:51:12.654 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ceph 2024-03-08T05:51:12.654 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ceph/ceph.ko 2024-03-08T05:51:12.654 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/coda 2024-03-08T05:51:12.654 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/coda/coda.ko 2024-03-08T05:51:12.654 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cramfs 2024-03-08T05:51:12.655 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cramfs/cramfs.ko 2024-03-08T05:51:12.655 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/dlm 2024-03-08T05:51:12.655 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/dlm/dlm.ko 2024-03-08T05:51:12.655 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ecryptfs 2024-03-08T05:51:12.655 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-08T05:51:12.655 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/f2fs 2024-03-08T05:51:12.655 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/f2fs/f2fs.ko 2024-03-08T05:51:12.655 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat 2024-03-08T05:51:12.655 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/fat.ko 2024-03-08T05:51:12.655 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/msdos.ko 2024-03-08T05:51:12.655 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/vfat.ko 2024-03-08T05:51:12.655 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse 2024-03-08T05:51:12.655 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse/cuse.ko 2024-03-08T05:51:12.655 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse/fuse.ko 2024-03-08T05:51:12.655 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/gfs2 2024-03-08T05:51:12.655 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/gfs2/gfs2.ko 2024-03-08T05:51:12.655 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfs 2024-03-08T05:51:12.656 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfs/hfs.ko 2024-03-08T05:51:12.656 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfsplus 2024-03-08T05:51:12.656 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfsplus/hfsplus.ko 2024-03-08T05:51:12.656 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/isofs 2024-03-08T05:51:12.656 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/isofs/isofs.ko 2024-03-08T05:51:12.656 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/jfs 2024-03-08T05:51:12.656 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/jfs/jfs.ko 2024-03-08T05:51:12.656 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/lockd 2024-03-08T05:51:12.656 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/lockd/lockd.ko 2024-03-08T05:51:12.656 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/minix 2024-03-08T05:51:12.656 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/minix/minix.ko 2024-03-08T05:51:12.656 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/netfs 2024-03-08T05:51:12.656 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/netfs/netfs.ko 2024-03-08T05:51:12.656 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs 2024-03-08T05:51:12.656 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/blocklayout 2024-03-08T05:51:12.656 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-08T05:51:12.656 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/filelayout 2024-03-08T05:51:12.657 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-08T05:51:12.657 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/flexfilelayout 2024-03-08T05:51:12.657 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-08T05:51:12.657 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfs.ko 2024-03-08T05:51:12.657 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv3.ko 2024-03-08T05:51:12.657 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv4.ko 2024-03-08T05:51:12.657 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common 2024-03-08T05:51:12.657 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/grace.ko 2024-03-08T05:51:12.657 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/nfs_acl.ko 2024-03-08T05:51:12.657 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfsd 2024-03-08T05:51:12.657 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfsd/nfsd.ko 2024-03-08T05:51:12.657 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nilfs2 2024-03-08T05:51:12.657 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nilfs2/nilfs2.ko 2024-03-08T05:51:12.657 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls 2024-03-08T05:51:12.657 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-celtic.ko 2024-03-08T05:51:12.657 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-centeuro.ko 2024-03-08T05:51:12.657 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-croatian.ko 2024-03-08T05:51:12.658 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-cyrillic.ko 2024-03-08T05:51:12.658 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-gaelic.ko 2024-03-08T05:51:12.658 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-greek.ko 2024-03-08T05:51:12.658 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-iceland.ko 2024-03-08T05:51:12.658 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-inuit.ko 2024-03-08T05:51:12.658 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-roman.ko 2024-03-08T05:51:12.658 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-romanian.ko 2024-03-08T05:51:12.658 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-turkish.ko 2024-03-08T05:51:12.658 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1250.ko 2024-03-08T05:51:12.658 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1251.ko 2024-03-08T05:51:12.658 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1255.ko 2024-03-08T05:51:12.658 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp737.ko 2024-03-08T05:51:12.658 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp775.ko 2024-03-08T05:51:12.658 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp850.ko 2024-03-08T05:51:12.658 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp852.ko 2024-03-08T05:51:12.658 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp855.ko 2024-03-08T05:51:12.659 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp857.ko 2024-03-08T05:51:12.659 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp860.ko 2024-03-08T05:51:12.659 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp861.ko 2024-03-08T05:51:12.659 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp862.ko 2024-03-08T05:51:12.659 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp863.ko 2024-03-08T05:51:12.659 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp864.ko 2024-03-08T05:51:12.659 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp865.ko 2024-03-08T05:51:12.659 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp866.ko 2024-03-08T05:51:12.659 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp869.ko 2024-03-08T05:51:12.659 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp874.ko 2024-03-08T05:51:12.659 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp932.ko 2024-03-08T05:51:12.659 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp936.ko 2024-03-08T05:51:12.659 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp949.ko 2024-03-08T05:51:12.659 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp950.ko 2024-03-08T05:51:12.659 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_euc-jp.ko 2024-03-08T05:51:12.659 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-1.ko 2024-03-08T05:51:12.660 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-13.ko 2024-03-08T05:51:12.660 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-14.ko 2024-03-08T05:51:12.660 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-15.ko 2024-03-08T05:51:12.660 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-2.ko 2024-03-08T05:51:12.660 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-3.ko 2024-03-08T05:51:12.660 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-4.ko 2024-03-08T05:51:12.660 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-5.ko 2024-03-08T05:51:12.660 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-6.ko 2024-03-08T05:51:12.660 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-7.ko 2024-03-08T05:51:12.660 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-9.ko 2024-03-08T05:51:12.660 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-r.ko 2024-03-08T05:51:12.660 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-ru.ko 2024-03-08T05:51:12.660 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-u.ko 2024-03-08T05:51:12.660 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-08T05:51:12.660 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_utf8.ko 2024-03-08T05:51:12.660 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2 2024-03-08T05:51:12.660 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/cluster 2024-03-08T05:51:12.660 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-08T05:51:12.661 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlm 2024-03-08T05:51:12.661 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-08T05:51:12.661 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlmfs 2024-03-08T05:51:12.661 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-08T05:51:12.661 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2.ko 2024-03-08T05:51:12.661 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-08T05:51:12.661 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-08T05:51:12.661 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-08T05:51:12.661 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/overlayfs 2024-03-08T05:51:12.661 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/overlayfs/overlay.ko 2024-03-08T05:51:12.661 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/pstore 2024-03-08T05:51:12.661 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/pstore/ramoops.ko 2024-03-08T05:51:12.661 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/reiserfs 2024-03-08T05:51:12.661 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/reiserfs/reiserfs.ko 2024-03-08T05:51:12.661 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/romfs 2024-03-08T05:51:12.661 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/romfs/romfs.ko 2024-03-08T05:51:12.661 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb 2024-03-08T05:51:12.662 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/client 2024-03-08T05:51:12.662 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/client/cifs.ko 2024-03-08T05:51:12.662 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common 2024-03-08T05:51:12.662 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/cifs_arc4.ko 2024-03-08T05:51:12.662 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/cifs_md4.ko 2024-03-08T05:51:12.662 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/squashfs 2024-03-08T05:51:12.662 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/squashfs/squashfs.ko 2024-03-08T05:51:12.662 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/sysv 2024-03-08T05:51:12.662 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/sysv/sysv.ko 2024-03-08T05:51:12.662 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/udf 2024-03-08T05:51:12.662 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/udf/udf.ko 2024-03-08T05:51:12.662 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ufs 2024-03-08T05:51:12.662 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ufs/ufs.ko 2024-03-08T05:51:12.662 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/xfs 2024-03-08T05:51:12.662 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/xfs/xfs.ko 2024-03-08T05:51:12.662 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel 2024-03-08T05:51:12.662 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/rcu 2024-03-08T05:51:12.663 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/rcu/rcutorture.ko 2024-03-08T05:51:12.663 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/torture.ko 2024-03-08T05:51:12.663 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/trace 2024-03-08T05:51:12.663 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-08T05:51:12.663 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib 2024-03-08T05:51:12.663 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/asn1_encoder.ko 2024-03-08T05:51:12.663 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc-itu-t.ko 2024-03-08T05:51:12.663 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc8.ko 2024-03-08T05:51:12.663 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto 2024-03-08T05:51:12.663 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/libarc4.ko 2024-03-08T05:51:12.663 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/libdes.ko 2024-03-08T05:51:12.663 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/libcrc32c.ko 2024-03-08T05:51:12.663 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lru_cache.ko 2024-03-08T05:51:12.663 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4 2024-03-08T05:51:12.663 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/lz4_compress.ko 2024-03-08T05:51:12.663 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/lz4hc_compress.ko 2024-03-08T05:51:12.663 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/math 2024-03-08T05:51:12.664 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/math/cordic.ko 2024-03-08T05:51:12.664 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/raid6 2024-03-08T05:51:12.664 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/raid6/raid6_pq.ko 2024-03-08T05:51:12.664 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/reed_solomon 2024-03-08T05:51:12.664 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-08T05:51:12.664 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_bm.ko 2024-03-08T05:51:12.664 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_fsm.ko 2024-03-08T05:51:12.664 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_kmp.ko 2024-03-08T05:51:12.664 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/zstd 2024-03-08T05:51:12.664 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/zstd/zstd_compress.ko 2024-03-08T05:51:12.664 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/mm 2024-03-08T05:51:12.664 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/mm/hwpoison-inject.ko 2024-03-08T05:51:12.664 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net 2024-03-08T05:51:12.664 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan 2024-03-08T05:51:12.664 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/6lowpan.ko 2024-03-08T05:51:12.664 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_dest.ko 2024-03-08T05:51:12.664 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_fragment.ko 2024-03-08T05:51:12.665 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_hop.ko 2024-03-08T05:51:12.665 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-08T05:51:12.665 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_mobility.ko 2024-03-08T05:51:12.665 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_routing.ko 2024-03-08T05:51:12.665 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_udp.ko 2024-03-08T05:51:12.665 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802 2024-03-08T05:51:12.665 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/garp.ko 2024-03-08T05:51:12.665 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/mrp.ko 2024-03-08T05:51:12.665 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/p8022.ko 2024-03-08T05:51:12.665 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/psnap.ko 2024-03-08T05:51:12.665 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/stp.ko 2024-03-08T05:51:12.665 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/8021q 2024-03-08T05:51:12.665 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/8021q/8021q.ko 2024-03-08T05:51:12.665 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p 2024-03-08T05:51:12.665 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet.ko 2024-03-08T05:51:12.665 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_fd.ko 2024-03-08T05:51:12.665 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_rdma.ko 2024-03-08T05:51:12.666 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_virtio.ko 2024-03-08T05:51:12.666 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/batman-adv 2024-03-08T05:51:12.666 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/batman-adv/batman-adv.ko 2024-03-08T05:51:12.666 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge 2024-03-08T05:51:12.666 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/br_netfilter.ko 2024-03-08T05:51:12.666 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/bridge.ko 2024-03-08T05:51:12.666 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter 2024-03-08T05:51:12.666 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-08T05:51:12.666 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-08T05:51:12.666 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-08T05:51:12.666 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-08T05:51:12.666 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-08T05:51:12.666 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-08T05:51:12.666 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-08T05:51:12.666 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-08T05:51:12.666 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-08T05:51:12.666 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-08T05:51:12.667 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-08T05:51:12.667 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-08T05:51:12.667 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-08T05:51:12.667 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-08T05:51:12.667 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-08T05:51:12.667 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-08T05:51:12.667 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-08T05:51:12.667 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-08T05:51:12.667 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-08T05:51:12.667 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-08T05:51:12.667 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtables.ko 2024-03-08T05:51:12.667 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-08T05:51:12.667 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-08T05:51:12.667 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-08T05:51:12.667 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ceph 2024-03-08T05:51:12.667 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ceph/libceph.ko 2024-03-08T05:51:12.668 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core 2024-03-08T05:51:12.668 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core/failover.ko 2024-03-08T05:51:12.668 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core/pktgen.ko 2024-03-08T05:51:12.668 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp 2024-03-08T05:51:12.668 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp.ko 2024-03-08T05:51:12.668 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_diag.ko 2024-03-08T05:51:12.668 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_ipv4.ko 2024-03-08T05:51:12.668 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_ipv6.ko 2024-03-08T05:51:12.668 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dns_resolver 2024-03-08T05:51:12.668 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dns_resolver/dns_resolver.ko 2024-03-08T05:51:12.668 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa 2024-03-08T05:51:12.668 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/dsa_core.ko 2024-03-08T05:51:12.668 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_brcm.ko 2024-03-08T05:51:12.668 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_dsa.ko 2024-03-08T05:51:12.668 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_none.ko 2024-03-08T05:51:12.668 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_trailer.ko 2024-03-08T05:51:12.669 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154 2024-03-08T05:51:12.669 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/6lowpan 2024-03-08T05:51:12.669 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-08T05:51:12.669 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ieee802154.ko 2024-03-08T05:51:12.669 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-08T05:51:12.669 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4 2024-03-08T05:51:12.669 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ah4.ko 2024-03-08T05:51:12.669 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/esp4.ko 2024-03-08T05:51:12.669 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/fou.ko 2024-03-08T05:51:12.669 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/gre.ko 2024-03-08T05:51:12.669 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/inet_diag.ko 2024-03-08T05:51:12.669 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_gre.ko 2024-03-08T05:51:12.669 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_tunnel.ko 2024-03-08T05:51:12.669 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_vti.ko 2024-03-08T05:51:12.669 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ipcomp.ko 2024-03-08T05:51:12.670 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ipip.ko 2024-03-08T05:51:12.670 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter 2024-03-08T05:51:12.670 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-08T05:51:12.670 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-08T05:51:12.670 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-08T05:51:12.670 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-08T05:51:12.670 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-08T05:51:12.670 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-08T05:51:12.670 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-08T05:51:12.670 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-08T05:51:12.670 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-08T05:51:12.670 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-08T05:51:12.670 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-08T05:51:12.670 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-08T05:51:12.670 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-08T05:51:12.670 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-08T05:51:12.671 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-08T05:51:12.671 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-08T05:51:12.671 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-08T05:51:12.671 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-08T05:51:12.671 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-08T05:51:12.671 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-08T05:51:12.671 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-08T05:51:12.671 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_bic.ko 2024-03-08T05:51:12.671 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_dctcp.ko 2024-03-08T05:51:12.671 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_diag.ko 2024-03-08T05:51:12.671 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_highspeed.ko 2024-03-08T05:51:12.671 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_htcp.ko 2024-03-08T05:51:12.671 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_hybla.ko 2024-03-08T05:51:12.671 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_illinois.ko 2024-03-08T05:51:12.671 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_lp.ko 2024-03-08T05:51:12.671 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_scalable.ko 2024-03-08T05:51:12.672 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_vegas.ko 2024-03-08T05:51:12.672 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_veno.ko 2024-03-08T05:51:12.672 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_westwood.ko 2024-03-08T05:51:12.672 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_yeah.ko 2024-03-08T05:51:12.672 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tunnel4.ko 2024-03-08T05:51:12.672 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/udp_diag.ko 2024-03-08T05:51:12.672 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/udp_tunnel.ko 2024-03-08T05:51:12.672 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-08T05:51:12.672 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6 2024-03-08T05:51:12.672 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ah6.ko 2024-03-08T05:51:12.672 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/esp6.ko 2024-03-08T05:51:12.672 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/fou6.ko 2024-03-08T05:51:12.672 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_tunnel.ko 2024-03-08T05:51:12.672 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-08T05:51:12.672 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_vti.ko 2024-03-08T05:51:12.672 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ipcomp6.ko 2024-03-08T05:51:12.672 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter 2024-03-08T05:51:12.673 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-08T05:51:12.673 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-08T05:51:12.673 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-08T05:51:12.673 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-08T05:51:12.673 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-08T05:51:12.673 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-08T05:51:12.673 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-08T05:51:12.673 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-08T05:51:12.673 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-08T05:51:12.673 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-08T05:51:12.673 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-08T05:51:12.673 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-08T05:51:12.673 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-08T05:51:12.673 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-08T05:51:12.673 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-08T05:51:12.673 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-08T05:51:12.674 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-08T05:51:12.674 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-08T05:51:12.674 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-08T05:51:12.674 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-08T05:51:12.674 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-08T05:51:12.674 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-08T05:51:12.674 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-08T05:51:12.674 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-08T05:51:12.674 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/sit.ko 2024-03-08T05:51:12.674 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/tunnel6.ko 2024-03-08T05:51:12.674 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-08T05:51:12.674 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/key 2024-03-08T05:51:12.674 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/key/af_key.ko 2024-03-08T05:51:12.674 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp 2024-03-08T05:51:12.674 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_core.ko 2024-03-08T05:51:12.674 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-08T05:51:12.675 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_eth.ko 2024-03-08T05:51:12.675 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ip.ko 2024-03-08T05:51:12.675 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ip6.ko 2024-03-08T05:51:12.675 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_netlink.ko 2024-03-08T05:51:12.675 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ppp.ko 2024-03-08T05:51:12.675 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc 2024-03-08T05:51:12.675 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc/llc.ko 2024-03-08T05:51:12.675 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mac802154 2024-03-08T05:51:12.675 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mac802154/mac802154.ko 2024-03-08T05:51:12.675 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mpls 2024-03-08T05:51:12.675 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mpls/mpls_gso.ko 2024-03-08T05:51:12.675 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter 2024-03-08T05:51:12.675 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset 2024-03-08T05:51:12.675 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set.ko 2024-03-08T05:51:12.675 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-08T05:51:12.675 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-08T05:51:12.675 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-08T05:51:12.676 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-08T05:51:12.676 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-08T05:51:12.676 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-08T05:51:12.676 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-08T05:51:12.676 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-08T05:51:12.676 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-08T05:51:12.676 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-08T05:51:12.676 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-08T05:51:12.676 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-08T05:51:12.676 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-08T05:51:12.676 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-08T05:51:12.676 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-08T05:51:12.676 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs 2024-03-08T05:51:12.676 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-08T05:51:12.676 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-08T05:51:12.676 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-08T05:51:12.676 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-08T05:51:12.677 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-08T05:51:12.677 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-08T05:51:12.677 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-08T05:51:12.677 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-08T05:51:12.677 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-08T05:51:12.677 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-08T05:51:12.677 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-08T05:51:12.677 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-08T05:51:12.677 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-08T05:51:12.677 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-08T05:51:12.677 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conncount.ko 2024-03-08T05:51:12.677 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack.ko 2024-03-08T05:51:12.677 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-08T05:51:12.677 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-08T05:51:12.677 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-08T05:51:12.677 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-08T05:51:12.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-08T05:51:12.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-08T05:51:12.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-08T05:51:12.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-08T05:51:12.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-08T05:51:12.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-08T05:51:12.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-08T05:51:12.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-08T05:51:12.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-08T05:51:12.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_flow_table.ko 2024-03-08T05:51:12.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-08T05:51:12.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_log_syslog.ko 2024-03-08T05:51:12.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat.ko 2024-03-08T05:51:12.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-08T05:51:12.678 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-08T05:51:12.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_irc.ko 2024-03-08T05:51:12.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_sip.ko 2024-03-08T05:51:12.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-08T05:51:12.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-08T05:51:12.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_tables.ko 2024-03-08T05:51:12.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink.ko 2024-03-08T05:51:12.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-08T05:51:12.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_log.ko 2024-03-08T05:51:12.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-08T05:51:12.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-08T05:51:12.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_chain_nat.ko 2024-03-08T05:51:12.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_compat.ko 2024-03-08T05:51:12.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_ct.ko 2024-03-08T05:51:12.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-08T05:51:12.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_fib.ko 2024-03-08T05:51:12.679 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-08T05:51:12.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_hash.ko 2024-03-08T05:51:12.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_limit.ko 2024-03-08T05:51:12.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_log.ko 2024-03-08T05:51:12.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_masq.ko 2024-03-08T05:51:12.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_nat.ko 2024-03-08T05:51:12.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_numgen.ko 2024-03-08T05:51:12.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_queue.ko 2024-03-08T05:51:12.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_quota.ko 2024-03-08T05:51:12.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_redir.ko 2024-03-08T05:51:12.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_reject.ko 2024-03-08T05:51:12.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_reject_inet.ko 2024-03-08T05:51:12.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_socket.ko 2024-03-08T05:51:12.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_tunnel.ko 2024-03-08T05:51:12.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_AUDIT.ko 2024-03-08T05:51:12.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-08T05:51:12.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-08T05:51:12.680 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-08T05:51:12.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CT.ko 2024-03-08T05:51:12.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_DSCP.ko 2024-03-08T05:51:12.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_HL.ko 2024-03-08T05:51:12.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_HMARK.ko 2024-03-08T05:51:12.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-08T05:51:12.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_LED.ko 2024-03-08T05:51:12.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_LOG.ko 2024-03-08T05:51:12.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-08T05:51:12.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NETMAP.ko 2024-03-08T05:51:12.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NFLOG.ko 2024-03-08T05:51:12.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-08T05:51:12.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_RATEEST.ko 2024-03-08T05:51:12.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-08T05:51:12.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_SECMARK.ko 2024-03-08T05:51:12.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-08T05:51:12.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-08T05:51:12.681 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TEE.ko 2024-03-08T05:51:12.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TPROXY.ko 2024-03-08T05:51:12.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TRACE.ko 2024-03-08T05:51:12.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_addrtype.ko 2024-03-08T05:51:12.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_bpf.ko 2024-03-08T05:51:12.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cgroup.ko 2024-03-08T05:51:12.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cluster.ko 2024-03-08T05:51:12.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_comment.ko 2024-03-08T05:51:12.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connbytes.ko 2024-03-08T05:51:12.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connlabel.ko 2024-03-08T05:51:12.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connlimit.ko 2024-03-08T05:51:12.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connmark.ko 2024-03-08T05:51:12.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_conntrack.ko 2024-03-08T05:51:12.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cpu.ko 2024-03-08T05:51:12.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_dccp.ko 2024-03-08T05:51:12.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_devgroup.ko 2024-03-08T05:51:12.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_dscp.ko 2024-03-08T05:51:12.682 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ecn.ko 2024-03-08T05:51:12.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_esp.ko 2024-03-08T05:51:12.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_hashlimit.ko 2024-03-08T05:51:12.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_helper.ko 2024-03-08T05:51:12.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_hl.ko 2024-03-08T05:51:12.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ipcomp.ko 2024-03-08T05:51:12.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_iprange.ko 2024-03-08T05:51:12.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ipvs.ko 2024-03-08T05:51:12.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_l2tp.ko 2024-03-08T05:51:12.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_length.ko 2024-03-08T05:51:12.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_limit.ko 2024-03-08T05:51:12.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_mac.ko 2024-03-08T05:51:12.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_mark.ko 2024-03-08T05:51:12.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_multiport.ko 2024-03-08T05:51:12.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_nat.ko 2024-03-08T05:51:12.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_nfacct.ko 2024-03-08T05:51:12.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_osf.ko 2024-03-08T05:51:12.683 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_owner.ko 2024-03-08T05:51:12.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_physdev.ko 2024-03-08T05:51:12.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_pkttype.ko 2024-03-08T05:51:12.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_policy.ko 2024-03-08T05:51:12.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_quota.ko 2024-03-08T05:51:12.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_rateest.ko 2024-03-08T05:51:12.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_realm.ko 2024-03-08T05:51:12.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_recent.ko 2024-03-08T05:51:12.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_sctp.ko 2024-03-08T05:51:12.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_set.ko 2024-03-08T05:51:12.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_socket.ko 2024-03-08T05:51:12.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_state.ko 2024-03-08T05:51:12.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_statistic.ko 2024-03-08T05:51:12.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_string.ko 2024-03-08T05:51:12.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_tcpmss.ko 2024-03-08T05:51:12.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_time.ko 2024-03-08T05:51:12.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_u32.ko 2024-03-08T05:51:12.684 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netlink 2024-03-08T05:51:12.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netlink/netlink_diag.ko 2024-03-08T05:51:12.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/nsh 2024-03-08T05:51:12.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/nsh/nsh.ko 2024-03-08T05:51:12.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch 2024-03-08T05:51:12.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/openvswitch.ko 2024-03-08T05:51:12.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-geneve.ko 2024-03-08T05:51:12.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-gre.ko 2024-03-08T05:51:12.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-vxlan.ko 2024-03-08T05:51:12.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/packet 2024-03-08T05:51:12.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/packet/af_packet_diag.ko 2024-03-08T05:51:12.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds 2024-03-08T05:51:12.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds.ko 2024-03-08T05:51:12.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds_rdma.ko 2024-03-08T05:51:12.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds_tcp.ko 2024-03-08T05:51:12.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched 2024-03-08T05:51:12.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_csum.ko 2024-03-08T05:51:12.685 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_gact.ko 2024-03-08T05:51:12.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_mirred.ko 2024-03-08T05:51:12.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_nat.ko 2024-03-08T05:51:12.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_pedit.ko 2024-03-08T05:51:12.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_police.ko 2024-03-08T05:51:12.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_simple.ko 2024-03-08T05:51:12.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_skbedit.ko 2024-03-08T05:51:12.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_vlan.ko 2024-03-08T05:51:12.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_basic.ko 2024-03-08T05:51:12.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_bpf.ko 2024-03-08T05:51:12.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_flow.ko 2024-03-08T05:51:12.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_fw.ko 2024-03-08T05:51:12.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_route.ko 2024-03-08T05:51:12.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_u32.ko 2024-03-08T05:51:12.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_cmp.ko 2024-03-08T05:51:12.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_ipset.ko 2024-03-08T05:51:12.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_meta.ko 2024-03-08T05:51:12.686 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_nbyte.ko 2024-03-08T05:51:12.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_text.ko 2024-03-08T05:51:12.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_u32.ko 2024-03-08T05:51:12.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_choke.ko 2024-03-08T05:51:12.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_codel.ko 2024-03-08T05:51:12.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_drr.ko 2024-03-08T05:51:12.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_fq.ko 2024-03-08T05:51:12.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_gred.ko 2024-03-08T05:51:12.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_hfsc.ko 2024-03-08T05:51:12.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_hhf.ko 2024-03-08T05:51:12.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_htb.ko 2024-03-08T05:51:12.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_ingress.ko 2024-03-08T05:51:12.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_mqprio.ko 2024-03-08T05:51:12.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_mqprio_lib.ko 2024-03-08T05:51:12.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_multiq.ko 2024-03-08T05:51:12.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_netem.ko 2024-03-08T05:51:12.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_pie.ko 2024-03-08T05:51:12.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_plug.ko 2024-03-08T05:51:12.687 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_prio.ko 2024-03-08T05:51:12.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_qfq.ko 2024-03-08T05:51:12.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_red.ko 2024-03-08T05:51:12.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_sfb.ko 2024-03-08T05:51:12.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_sfq.ko 2024-03-08T05:51:12.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_tbf.ko 2024-03-08T05:51:12.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_teql.ko 2024-03-08T05:51:12.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp 2024-03-08T05:51:12.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/sctp.ko 2024-03-08T05:51:12.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/sctp_diag.ko 2024-03-08T05:51:12.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc 2024-03-08T05:51:12.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss 2024-03-08T05:51:12.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-08T05:51:12.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-08T05:51:12.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/sunrpc.ko 2024-03-08T05:51:12.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/xprtrdma 2024-03-08T05:51:12.688 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-08T05:51:12.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc 2024-03-08T05:51:12.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/diag.ko 2024-03-08T05:51:12.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/tipc.ko 2024-03-08T05:51:12.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/unix 2024-03-08T05:51:12.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/unix/unix_diag.ko 2024-03-08T05:51:12.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock 2024-03-08T05:51:12.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-08T05:51:12.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-08T05:51:12.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock.ko 2024-03-08T05:51:12.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-08T05:51:12.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-08T05:51:12.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm 2024-03-08T05:51:12.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-08T05:51:12.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security 2024-03-08T05:51:12.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys 2024-03-08T05:51:12.689 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/encrypted-keys 2024-03-08T05:51:12.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-08T05:51:12.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/trusted-keys 2024-03-08T05:51:12.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/trusted-keys/trusted.ko 2024-03-08T05:51:12.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt 2024-03-08T05:51:12.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/lib 2024-03-08T05:51:12.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/lib/irqbypass.ko 2024-03-08T05:51:12.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.alias 2024-03-08T05:51:12.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.alias.bin 2024-03-08T05:51:12.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin 2024-03-08T05:51:12.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.alias.bin 2024-03-08T05:51:12.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.bin 2024-03-08T05:51:12.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.modinfo 2024-03-08T05:51:12.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.dep 2024-03-08T05:51:12.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.dep.bin 2024-03-08T05:51:12.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.devname 2024-03-08T05:51:12.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.order 2024-03-08T05:51:12.690 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.softdep 2024-03-08T05:51:12.691 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.symbols 2024-03-08T05:51:12.691 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.symbols.bin 2024-03-08T05:51:12.691 INFO:teuthology.orchestra.run.smithi042.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/vmlinuz 2024-03-08T05:51:12.694 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc7-gdd5c1cd17167 2024-03-08T05:51:12.694 DEBUG:teuthology.orchestra.run.smithi042:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-08T05:51:12.718 INFO:teuthology.orchestra.run.smithi042.stdout:postinstall scriptlet (using /bin/sh): 2024-03-08T05:51:12.718 INFO:teuthology.orchestra.run.smithi042.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-08T05:51:12.718 INFO:teuthology.orchestra.run.smithi042.stdout: /usr/bin/kernel-install add 6.8.0-rc7-gdd5c1cd17167 /lib/modules/6.8.0-rc7-gdd5c1cd17167/vmlinuz 2024-03-08T05:51:12.718 INFO:teuthology.orchestra.run.smithi042.stdout:fi 2024-03-08T05:51:12.718 INFO:teuthology.orchestra.run.smithi042.stdout:for file in vmlinuz System.map config; do 2024-03-08T05:51:12.718 INFO:teuthology.orchestra.run.smithi042.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc7-gdd5c1cd17167/${file}" "/boot/${file}-6.8.0-rc7-gdd5c1cd17167"; then 2024-03-08T05:51:12.718 INFO:teuthology.orchestra.run.smithi042.stdout: cp "/lib/modules/6.8.0-rc7-gdd5c1cd17167/${file}" "/boot/${file}-6.8.0-rc7-gdd5c1cd17167" 2024-03-08T05:51:12.718 INFO:teuthology.orchestra.run.smithi042.stdout: fi 2024-03-08T05:51:12.718 INFO:teuthology.orchestra.run.smithi042.stdout:done 2024-03-08T05:51:12.718 INFO:teuthology.orchestra.run.smithi042.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-08T05:51:12.718 INFO:teuthology.orchestra.run.smithi042.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-08T05:51:12.718 INFO:teuthology.orchestra.run.smithi042.stdout:new-kernel-pkg --remove 6.8.0-rc7-gdd5c1cd17167 --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc7-gdd5c1cd17167.img 2024-03-08T05:51:12.719 INFO:teuthology.orchestra.run.smithi042.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-08T05:51:12.719 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-install remove 6.8.0-rc7-gdd5c1cd17167 2024-03-08T05:51:12.719 INFO:teuthology.orchestra.run.smithi042.stdout:fi 2024-03-08T05:51:12.719 INFO:teuthology.orchestra.run.smithi042.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-08T05:51:12.719 INFO:teuthology.orchestra.run.smithi042.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-08T05:51:12.719 INFO:teuthology.orchestra.run.smithi042.stdout:/sbin/update-bootloader --remove 6.8.0-rc7-gdd5c1cd17167 2024-03-08T05:51:12.719 INFO:teuthology.orchestra.run.smithi042.stdout:fi 2024-03-08T05:51:12.720 DEBUG:teuthology.orchestra.run.smithi042:> sudo rpm -qi grub2-tools 2024-03-08T05:51:12.798 INFO:teuthology.orchestra.run.smithi042.stdout:Name : grub2-tools 2024-03-08T05:51:12.798 INFO:teuthology.orchestra.run.smithi042.stdout:Epoch : 1 2024-03-08T05:51:12.799 INFO:teuthology.orchestra.run.smithi042.stdout:Version : 2.06 2024-03-08T05:51:12.799 INFO:teuthology.orchestra.run.smithi042.stdout:Release : 68.el9 2024-03-08T05:51:12.799 INFO:teuthology.orchestra.run.smithi042.stdout:Architecture: x86_64 2024-03-08T05:51:12.799 INFO:teuthology.orchestra.run.smithi042.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-08T05:51:12.799 INFO:teuthology.orchestra.run.smithi042.stdout:Group : Unspecified 2024-03-08T05:51:12.799 INFO:teuthology.orchestra.run.smithi042.stdout:Size : 8264254 2024-03-08T05:51:12.799 INFO:teuthology.orchestra.run.smithi042.stdout:License : GPLv3+ 2024-03-08T05:51:12.799 INFO:teuthology.orchestra.run.smithi042.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-08T05:51:12.799 INFO:teuthology.orchestra.run.smithi042.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-08T05:51:12.799 INFO:teuthology.orchestra.run.smithi042.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-08T05:51:12.799 INFO:teuthology.orchestra.run.smithi042.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-08T05:51:12.799 INFO:teuthology.orchestra.run.smithi042.stdout:Packager : builder@centos.org 2024-03-08T05:51:12.799 INFO:teuthology.orchestra.run.smithi042.stdout:Vendor : CentOS 2024-03-08T05:51:12.799 INFO:teuthology.orchestra.run.smithi042.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-08T05:51:12.800 INFO:teuthology.orchestra.run.smithi042.stdout:Summary : Support tools for GRUB. 2024-03-08T05:51:12.800 INFO:teuthology.orchestra.run.smithi042.stdout:Description : 2024-03-08T05:51:12.800 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T05:51:12.800 INFO:teuthology.orchestra.run.smithi042.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-08T05:51:12.800 INFO:teuthology.orchestra.run.smithi042.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-08T05:51:12.800 INFO:teuthology.orchestra.run.smithi042.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-08T05:51:12.800 INFO:teuthology.orchestra.run.smithi042.stdout:hardware devices. 2024-03-08T05:51:12.800 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T05:51:12.800 INFO:teuthology.orchestra.run.smithi042.stdout:This subpackage provides tools for support of all platforms. 2024-03-08T05:51:12.801 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-08T05:51:12.801 INFO:teuthology.task.kernel:Updating grub on smithi042 to boot 6.8.0-rc7-gdd5c1cd17167 2024-03-08T05:51:12.801 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-08T05:51:13.429 INFO:teuthology.orchestra.run.smithi042.stderr:Generating grub configuration file ... 2024-03-08T05:51:14.885 INFO:teuthology.orchestra.run.smithi042.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-08T05:51:14.913 INFO:teuthology.orchestra.run.smithi042.stderr:done 2024-03-08T05:51:14.916 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-03-08T05:51:14.931 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.8mAEJCf2sJ 2024-03-08T05:51:14.931 DEBUG:teuthology.orchestra.run.smithi042:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8mAEJCf2sJ 2024-03-08T05:51:15.005 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.8mAEJCf2sJ 2024-03-08T05:51:15.144 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.8mAEJCf2sJ is 6KB 2024-03-08T05:51:15.195 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.8mAEJCf2sJ 2024-03-08T05:51:15.211 DEBUG:teuthology.orchestra.run.smithi042:> sudo /bin/ls /boot/loader/entries || true 2024-03-08T05:51:15.279 INFO:teuthology.orchestra.run.smithi042.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-08T05:51:15.279 INFO:teuthology.orchestra.run.smithi042.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-08T05:51:15.279 INFO:teuthology.orchestra.run.smithi042.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-08T05:51:15.279 INFO:teuthology.orchestra.run.smithi042.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc7-gdd5c1cd17167.conf 2024-03-08T05:51:15.281 DEBUG:teuthology.orchestra.run.smithi042:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc7-gdd5c1cd17167 2024-03-08T05:51:15.418 DEBUG:teuthology.orchestra.run.smithi042:> sudo shutdown -r now 2024-03-08T05:51:18.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08 05:51:18 URL:https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/centos/9/flavors/default/x86_64/kernel-6.8.0_rc7_gdd5c1cd17167-1.x86_64.rpm [336216379/336216379] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-08T05:51:18.725 INFO:teuthology.orchestra.run.smithi019.stderr:FINISHED --2024-03-08 05:51:18-- 2024-03-08T05:51:18.726 INFO:teuthology.orchestra.run.smithi019.stderr:Total wall clock time: 38s 2024-03-08T05:51:18.726 INFO:teuthology.orchestra.run.smithi019.stderr:Downloaded: 1 files, 321M in 38s (8.50 MB/s) 2024-03-08T05:51:18.729 INFO:teuthology.task.kernel:Installing kernel dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 on client.0... 2024-03-08T05:51:18.729 DEBUG:teuthology.orchestra.run.smithi019:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-08T05:51:20.757 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying... ######################################## 2024-03-08T05:51:20.820 INFO:teuthology.orchestra.run.smithi019.stdout:Preparing... ######################################## 2024-03-08T05:51:20.904 INFO:teuthology.orchestra.run.smithi019.stdout:Updating / installing... 2024-03-08T05:51:28.745 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-6.8.0_rc7_gdd5c1cd17167-1 ######################################## 2024-03-08T05:51:42.621 INFO:teuthology.orchestra.run.smithi019.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-08T05:51:45.422 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-03-08T05:51:45.422 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-03-08T05:51:45.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T05:52:03.870 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-03-08T05:52:05.833 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi019.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-08T05:52:05.833 DEBUG:teuthology.orchestra.run.smithi019:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-08T05:52:05.932 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167 2024-03-08T05:52:05.932 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/System.map 2024-03-08T05:52:05.932 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/config 2024-03-08T05:52:05.932 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel 2024-03-08T05:52:05.932 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch 2024-03-08T05:52:05.932 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86 2024-03-08T05:52:05.932 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto 2024-03-08T05:52:05.932 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-08T05:52:05.932 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-08T05:52:05.932 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-08T05:52:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-08T05:52:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-08T05:52:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-08T05:52:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-08T05:52:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-08T05:52:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-08T05:52:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-08T05:52:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-08T05:52:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-08T05:52:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-08T05:52:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-08T05:52:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-08T05:52:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-08T05:52:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-08T05:52:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-08T05:52:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-08T05:52:05.933 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-08T05:52:05.934 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel 2024-03-08T05:52:05.934 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu 2024-03-08T05:52:05.934 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/mce 2024-03-08T05:52:05.934 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-08T05:52:05.934 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm 2024-03-08T05:52:05.934 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-08T05:52:05.934 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-08T05:52:05.934 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm.ko 2024-03-08T05:52:05.934 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto 2024-03-08T05:52:05.934 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ansi_cprng.ko 2024-03-08T05:52:05.934 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/anubis.ko 2024-03-08T05:52:05.934 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/arc4.ko 2024-03-08T05:52:05.934 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx 2024-03-08T05:52:05.934 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_memcpy.ko 2024-03-08T05:52:05.934 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_pq.ko 2024-03-08T05:52:05.935 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-08T05:52:05.935 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_tx.ko 2024-03-08T05:52:05.935 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_xor.ko 2024-03-08T05:52:05.935 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/raid6test.ko 2024-03-08T05:52:05.935 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/authenc.ko 2024-03-08T05:52:05.935 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/authencesn.ko 2024-03-08T05:52:05.935 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blake2b_generic.ko 2024-03-08T05:52:05.935 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blowfish_common.ko 2024-03-08T05:52:05.935 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blowfish_generic.ko 2024-03-08T05:52:05.935 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/camellia_generic.ko 2024-03-08T05:52:05.935 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast5_generic.ko 2024-03-08T05:52:05.935 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast6_generic.ko 2024-03-08T05:52:05.935 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast_common.ko 2024-03-08T05:52:05.935 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ccm.ko 2024-03-08T05:52:05.935 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cmac.ko 2024-03-08T05:52:05.935 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crc32_generic.ko 2024-03-08T05:52:05.935 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_engine.ko 2024-03-08T05:52:05.936 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_user.ko 2024-03-08T05:52:05.936 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cts.ko 2024-03-08T05:52:05.936 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/des_generic.ko 2024-03-08T05:52:05.936 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/dh_generic.ko 2024-03-08T05:52:05.936 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/echainiv.ko 2024-03-08T05:52:05.936 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/essiv.ko 2024-03-08T05:52:05.936 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/fcrypt.ko 2024-03-08T05:52:05.936 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/khazad.ko 2024-03-08T05:52:05.936 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lz4.ko 2024-03-08T05:52:05.936 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lz4hc.ko 2024-03-08T05:52:05.936 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/md4.ko 2024-03-08T05:52:05.936 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/michael_mic.ko 2024-03-08T05:52:05.936 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/pcbc.ko 2024-03-08T05:52:05.937 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/pcrypt.ko 2024-03-08T05:52:05.937 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/rmd160.ko 2024-03-08T05:52:05.937 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/seed.ko 2024-03-08T05:52:05.937 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/serpent_generic.ko 2024-03-08T05:52:05.937 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/tcrypt.ko 2024-03-08T05:52:05.937 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/tea.ko 2024-03-08T05:52:05.937 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/twofish_common.ko 2024-03-08T05:52:05.937 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/twofish_generic.ko 2024-03-08T05:52:05.937 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/vmac.ko 2024-03-08T05:52:05.937 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/wp512.ko 2024-03-08T05:52:05.937 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xcbc.ko 2024-03-08T05:52:05.937 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xor.ko 2024-03-08T05:52:05.937 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xxhash_generic.ko 2024-03-08T05:52:05.938 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers 2024-03-08T05:52:05.938 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi 2024-03-08T05:52:05.938 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-08T05:52:05.938 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_pad.ko 2024-03-08T05:52:05.938 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/custom_method.ko 2024-03-08T05:52:05.938 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/ec_sys.ko 2024-03-08T05:52:05.938 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/platform_profile.ko 2024-03-08T05:52:05.938 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/sbs.ko 2024-03-08T05:52:05.938 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/sbshc.ko 2024-03-08T05:52:05.938 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/video.ko 2024-03-08T05:52:05.938 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata 2024-03-08T05:52:05.938 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/acard-ahci.ko 2024-03-08T05:52:05.938 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ahci_platform.ko 2024-03-08T05:52:05.938 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ata_generic.ko 2024-03-08T05:52:05.938 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/libahci_platform.ko 2024-03-08T05:52:05.939 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_acpi.ko 2024-03-08T05:52:05.939 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ali.ko 2024-03-08T05:52:05.939 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_amd.ko 2024-03-08T05:52:05.939 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_artop.ko 2024-03-08T05:52:05.939 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_atiixp.ko 2024-03-08T05:52:05.939 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_atp867x.ko 2024-03-08T05:52:05.939 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cmd640.ko 2024-03-08T05:52:05.939 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cmd64x.ko 2024-03-08T05:52:05.939 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cypress.ko 2024-03-08T05:52:05.939 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_efar.ko 2024-03-08T05:52:05.939 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt366.ko 2024-03-08T05:52:05.939 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt37x.ko 2024-03-08T05:52:05.939 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-08T05:52:05.939 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-08T05:52:05.939 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_it8213.ko 2024-03-08T05:52:05.939 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_it821x.ko 2024-03-08T05:52:05.940 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_jmicron.ko 2024-03-08T05:52:05.940 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_marvell.ko 2024-03-08T05:52:05.940 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_mpiix.ko 2024-03-08T05:52:05.940 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_netcell.ko 2024-03-08T05:52:05.940 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ninja32.ko 2024-03-08T05:52:05.940 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ns87410.ko 2024-03-08T05:52:05.940 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ns87415.ko 2024-03-08T05:52:05.940 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_oldpiix.ko 2024-03-08T05:52:05.940 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_opti.ko 2024-03-08T05:52:05.940 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_optidma.ko 2024-03-08T05:52:05.940 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pcmcia.ko 2024-03-08T05:52:05.940 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-08T05:52:05.940 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-08T05:52:05.940 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_piccolo.ko 2024-03-08T05:52:05.940 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_rdc.ko 2024-03-08T05:52:05.941 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sch.ko 2024-03-08T05:52:05.941 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_serverworks.ko 2024-03-08T05:52:05.941 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sil680.ko 2024-03-08T05:52:05.941 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sis.ko 2024-03-08T05:52:05.941 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sl82c105.ko 2024-03-08T05:52:05.941 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_triflex.ko 2024-03-08T05:52:05.941 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_via.ko 2024-03-08T05:52:05.941 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pdc_adma.ko 2024-03-08T05:52:05.941 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_inic162x.ko 2024-03-08T05:52:05.941 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_mv.ko 2024-03-08T05:52:05.941 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_nv.ko 2024-03-08T05:52:05.941 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_promise.ko 2024-03-08T05:52:05.941 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_qstor.ko 2024-03-08T05:52:05.941 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sil.ko 2024-03-08T05:52:05.941 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sil24.ko 2024-03-08T05:52:05.941 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sis.ko 2024-03-08T05:52:05.941 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_svw.ko 2024-03-08T05:52:05.942 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sx4.ko 2024-03-08T05:52:05.942 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_uli.ko 2024-03-08T05:52:05.942 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_via.ko 2024-03-08T05:52:05.942 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_vsc.ko 2024-03-08T05:52:05.942 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/auxdisplay 2024-03-08T05:52:05.942 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/auxdisplay/ks0108.ko 2024-03-08T05:52:05.942 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base 2024-03-08T05:52:05.942 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base/regmap 2024-03-08T05:52:05.942 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-08T05:52:05.942 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-08T05:52:05.942 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/bcma 2024-03-08T05:52:05.942 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/bcma/bcma.ko 2024-03-08T05:52:05.942 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block 2024-03-08T05:52:05.942 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/aoe 2024-03-08T05:52:05.943 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/aoe/aoe.ko 2024-03-08T05:52:05.943 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/brd.ko 2024-03-08T05:52:05.943 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/drbd 2024-03-08T05:52:05.943 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/drbd/drbd.ko 2024-03-08T05:52:05.943 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/floppy.ko 2024-03-08T05:52:05.943 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/loop.ko 2024-03-08T05:52:05.943 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/mtip32xx 2024-03-08T05:52:05.943 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-08T05:52:05.943 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/nbd.ko 2024-03-08T05:52:05.943 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/null_blk 2024-03-08T05:52:05.943 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/null_blk/null_blk.ko 2024-03-08T05:52:05.943 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/pktcdvd.ko 2024-03-08T05:52:05.943 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/rbd.ko 2024-03-08T05:52:05.943 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/virtio_blk.ko 2024-03-08T05:52:05.943 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkback 2024-03-08T05:52:05.943 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-08T05:52:05.944 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkfront.ko 2024-03-08T05:52:05.944 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/zram 2024-03-08T05:52:05.944 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/zram/zram.ko 2024-03-08T05:52:05.944 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char 2024-03-08T05:52:05.944 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hangcheck-timer.ko 2024-03-08T05:52:05.944 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random 2024-03-08T05:52:05.944 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-08T05:52:05.944 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-08T05:52:05.944 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-08T05:52:05.944 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/via-rng.ko 2024-03-08T05:52:05.944 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-08T05:52:05.944 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi 2024-03-08T05:52:05.944 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-08T05:52:05.944 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-08T05:52:05.944 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-08T05:52:05.944 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-08T05:52:05.944 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-08T05:52:05.945 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-08T05:52:05.945 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/lp.ko 2024-03-08T05:52:05.945 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/mwave 2024-03-08T05:52:05.945 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/mwave/mwave.ko 2024-03-08T05:52:05.945 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ppdev.ko 2024-03-08T05:52:05.945 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tlclk.ko 2024-03-08T05:52:05.945 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm 2024-03-08T05:52:05.945 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm.ko 2024-03-08T05:52:05.945 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-08T05:52:05.945 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-08T05:52:05.945 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-08T05:52:05.945 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-08T05:52:05.945 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-08T05:52:05.945 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/uv_mmtimer.ko 2024-03-08T05:52:05.945 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/virtio_console.ko 2024-03-08T05:52:05.945 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq 2024-03-08T05:52:05.946 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-08T05:52:05.946 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-08T05:52:05.946 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-08T05:52:05.946 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-08T05:52:05.946 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-08T05:52:05.946 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-08T05:52:05.946 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto 2024-03-08T05:52:05.946 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp 2024-03-08T05:52:05.946 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-08T05:52:05.946 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ccp.ko 2024-03-08T05:52:05.946 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel 2024-03-08T05:52:05.946 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat 2024-03-08T05:52:05.946 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_common 2024-03-08T05:52:05.946 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-08T05:52:05.946 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-08T05:52:05.946 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-08T05:52:05.947 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/padlock-aes.ko 2024-03-08T05:52:05.947 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/padlock-sha.ko 2024-03-08T05:52:05.947 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/virtio 2024-03-08T05:52:05.947 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-08T05:52:05.947 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dca 2024-03-08T05:52:05.947 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dca/dca.ko 2024-03-08T05:52:05.947 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/devfreq 2024-03-08T05:52:05.947 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-08T05:52:05.947 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma 2024-03-08T05:52:05.947 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/dw 2024-03-08T05:52:05.947 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-08T05:52:05.947 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ioat 2024-03-08T05:52:05.947 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-08T05:52:05.947 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac 2024-03-08T05:52:05.947 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/amd64_edac.ko 2024-03-08T05:52:05.947 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/e752x_edac.ko 2024-03-08T05:52:05.948 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/edac_mce_amd.ko 2024-03-08T05:52:05.948 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i3000_edac.ko 2024-03-08T05:52:05.948 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i3200_edac.ko 2024-03-08T05:52:05.948 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i5100_edac.ko 2024-03-08T05:52:05.948 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i5400_edac.ko 2024-03-08T05:52:05.948 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i7300_edac.ko 2024-03-08T05:52:05.948 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i7core_edac.ko 2024-03-08T05:52:05.948 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i82975x_edac.ko 2024-03-08T05:52:05.948 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/ie31200_edac.ko 2024-03-08T05:52:05.948 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/sb_edac.ko 2024-03-08T05:52:05.948 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/x38_edac.ko 2024-03-08T05:52:05.948 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware 2024-03-08T05:52:05.948 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/edd.ko 2024-03-08T05:52:05.948 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-08T05:52:05.948 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio 2024-03-08T05:52:05.948 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-ich.ko 2024-03-08T05:52:05.949 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-08T05:52:05.949 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid 2024-03-08T05:52:05.949 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-appleir.ko 2024-03-08T05:52:05.949 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-aureal.ko 2024-03-08T05:52:05.949 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-axff.ko 2024-03-08T05:52:05.949 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-dr.ko 2024-03-08T05:52:05.949 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-elecom.ko 2024-03-08T05:52:05.949 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-elo.ko 2024-03-08T05:52:05.949 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-emsff.ko 2024-03-08T05:52:05.949 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gaff.ko 2024-03-08T05:52:05.949 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gt683r.ko 2024-03-08T05:52:05.949 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gyration.ko 2024-03-08T05:52:05.949 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-08T05:52:05.949 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-08T05:52:05.949 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtekff.ko 2024-03-08T05:52:05.950 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-hyperv.ko 2024-03-08T05:52:05.950 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-icade.ko 2024-03-08T05:52:05.950 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-keytouch.ko 2024-03-08T05:52:05.950 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-kye.ko 2024-03-08T05:52:05.950 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lcpower.ko 2024-03-08T05:52:05.950 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-led.ko 2024-03-08T05:52:05.950 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lenovo.ko 2024-03-08T05:52:05.950 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-08T05:52:05.950 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-08T05:52:05.950 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-multitouch.ko 2024-03-08T05:52:05.950 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-ortek.ko 2024-03-08T05:52:05.950 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-penmount.ko 2024-03-08T05:52:05.950 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-petalynx.ko 2024-03-08T05:52:05.951 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-picolcd.ko 2024-03-08T05:52:05.951 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-pl.ko 2024-03-08T05:52:05.951 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-plantronics.ko 2024-03-08T05:52:05.951 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-primax.ko 2024-03-08T05:52:05.951 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-rmi.ko 2024-03-08T05:52:05.951 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-08T05:52:05.951 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-common.ko 2024-03-08T05:52:05.951 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-08T05:52:05.951 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-08T05:52:05.951 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-08T05:52:05.951 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-08T05:52:05.951 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-08T05:52:05.951 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-08T05:52:05.951 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-08T05:52:05.951 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-08T05:52:05.952 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-08T05:52:05.952 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat.ko 2024-03-08T05:52:05.952 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-saitek.ko 2024-03-08T05:52:05.952 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-samsung.ko 2024-03-08T05:52:05.952 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-08T05:52:05.952 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sjoy.ko 2024-03-08T05:52:05.952 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sony.ko 2024-03-08T05:52:05.952 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-speedlink.ko 2024-03-08T05:52:05.952 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-steelseries.ko 2024-03-08T05:52:05.952 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sunplus.ko 2024-03-08T05:52:05.952 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-08T05:52:05.952 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-tivo.ko 2024-03-08T05:52:05.952 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-tmff.ko 2024-03-08T05:52:05.952 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-topseed.ko 2024-03-08T05:52:05.952 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-twinhan.ko 2024-03-08T05:52:05.953 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-uclogic.ko 2024-03-08T05:52:05.953 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-waltop.ko 2024-03-08T05:52:05.953 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-wiimote.ko 2024-03-08T05:52:05.953 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-xinmo.ko 2024-03-08T05:52:05.953 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-zpff.ko 2024-03-08T05:52:05.953 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-zydacron.ko 2024-03-08T05:52:05.953 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/uhid.ko 2024-03-08T05:52:05.953 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/wacom.ko 2024-03-08T05:52:05.953 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv 2024-03-08T05:52:05.953 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_balloon.ko 2024-03-08T05:52:05.953 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_utils.ko 2024-03-08T05:52:05.953 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_vmbus.ko 2024-03-08T05:52:05.953 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon 2024-03-08T05:52:05.953 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/abituguru.ko 2024-03-08T05:52:05.953 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/abituguru3.ko 2024-03-08T05:52:05.954 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-08T05:52:05.954 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ad7414.ko 2024-03-08T05:52:05.954 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ad7418.ko 2024-03-08T05:52:05.954 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adc128d818.ko 2024-03-08T05:52:05.954 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1025.ko 2024-03-08T05:52:05.954 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1026.ko 2024-03-08T05:52:05.954 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1029.ko 2024-03-08T05:52:05.954 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1031.ko 2024-03-08T05:52:05.954 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm9240.ko 2024-03-08T05:52:05.954 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ads7828.ko 2024-03-08T05:52:05.954 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7410.ko 2024-03-08T05:52:05.954 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7411.ko 2024-03-08T05:52:05.954 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7462.ko 2024-03-08T05:52:05.954 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7470.ko 2024-03-08T05:52:05.954 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7475.ko 2024-03-08T05:52:05.954 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7x10.ko 2024-03-08T05:52:05.955 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/amc6821.ko 2024-03-08T05:52:05.955 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/applesmc.ko 2024-03-08T05:52:05.955 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asb100.ko 2024-03-08T05:52:05.955 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asc7621.ko 2024-03-08T05:52:05.955 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-08T05:52:05.955 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/atxp1.ko 2024-03-08T05:52:05.955 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/coretemp.ko 2024-03-08T05:52:05.955 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-08T05:52:05.955 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/dme1737.ko 2024-03-08T05:52:05.955 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ds1621.ko 2024-03-08T05:52:05.955 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ds620.ko 2024-03-08T05:52:05.955 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc1403.ko 2024-03-08T05:52:05.955 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc6w201.ko 2024-03-08T05:52:05.955 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f71805f.ko 2024-03-08T05:52:05.955 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f71882fg.ko 2024-03-08T05:52:05.955 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f75375s.ko 2024-03-08T05:52:05.956 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/fam15h_power.ko 2024-03-08T05:52:05.956 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/fschmd.ko 2024-03-08T05:52:05.956 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/g760a.ko 2024-03-08T05:52:05.956 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/g762.ko 2024-03-08T05:52:05.956 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/gl518sm.ko 2024-03-08T05:52:05.956 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/gl520sm.ko 2024-03-08T05:52:05.956 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-08T05:52:05.956 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/i5500_temp.ko 2024-03-08T05:52:05.956 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/i5k_amb.ko 2024-03-08T05:52:05.956 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ibmaem.ko 2024-03-08T05:52:05.956 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ibmpex.ko 2024-03-08T05:52:05.956 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ina209.ko 2024-03-08T05:52:05.956 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ina2xx.ko 2024-03-08T05:52:05.956 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/it87.ko 2024-03-08T05:52:05.956 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/k10temp.ko 2024-03-08T05:52:05.956 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/k8temp.ko 2024-03-08T05:52:05.957 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lineage-pem.ko 2024-03-08T05:52:05.957 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm63.ko 2024-03-08T05:52:05.957 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm73.ko 2024-03-08T05:52:05.957 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm75.ko 2024-03-08T05:52:05.957 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm77.ko 2024-03-08T05:52:05.957 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm78.ko 2024-03-08T05:52:05.957 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm80.ko 2024-03-08T05:52:05.957 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm83.ko 2024-03-08T05:52:05.957 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm85.ko 2024-03-08T05:52:05.957 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm87.ko 2024-03-08T05:52:05.957 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm90.ko 2024-03-08T05:52:05.957 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm92.ko 2024-03-08T05:52:05.957 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm93.ko 2024-03-08T05:52:05.957 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95234.ko 2024-03-08T05:52:05.957 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95241.ko 2024-03-08T05:52:05.957 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95245.ko 2024-03-08T05:52:05.957 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc2945.ko 2024-03-08T05:52:05.958 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4151.ko 2024-03-08T05:52:05.958 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4215.ko 2024-03-08T05:52:05.958 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4222.ko 2024-03-08T05:52:05.958 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4245.ko 2024-03-08T05:52:05.958 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4260.ko 2024-03-08T05:52:05.958 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4261.ko 2024-03-08T05:52:05.958 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max16065.ko 2024-03-08T05:52:05.958 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max1619.ko 2024-03-08T05:52:05.958 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max1668.ko 2024-03-08T05:52:05.958 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max197.ko 2024-03-08T05:52:05.958 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6639.ko 2024-03-08T05:52:05.958 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6650.ko 2024-03-08T05:52:05.958 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6697.ko 2024-03-08T05:52:05.958 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/mcp3021.ko 2024-03-08T05:52:05.958 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6683.ko 2024-03-08T05:52:05.958 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6775-core.ko 2024-03-08T05:52:05.959 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6775.ko 2024-03-08T05:52:05.959 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct7802.ko 2024-03-08T05:52:05.959 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pc87360.ko 2024-03-08T05:52:05.959 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pc87427.ko 2024-03-08T05:52:05.959 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pcf8591.ko 2024-03-08T05:52:05.959 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus 2024-03-08T05:52:05.959 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-08T05:52:05.959 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-08T05:52:05.959 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-08T05:52:05.959 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-08T05:52:05.959 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-08T05:52:05.959 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-08T05:52:05.959 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-08T05:52:05.959 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-08T05:52:05.959 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-08T05:52:05.959 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-08T05:52:05.959 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-08T05:52:05.960 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-08T05:52:05.960 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/powr1220.ko 2024-03-08T05:52:05.960 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch5627.ko 2024-03-08T05:52:05.960 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch5636.ko 2024-03-08T05:52:05.960 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-08T05:52:05.960 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sht15.ko 2024-03-08T05:52:05.960 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sht21.ko 2024-03-08T05:52:05.960 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/shtc1.ko 2024-03-08T05:52:05.960 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sis5595.ko 2024-03-08T05:52:05.960 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47b397.ko 2024-03-08T05:52:05.960 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47m1.ko 2024-03-08T05:52:05.960 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47m192.ko 2024-03-08T05:52:05.960 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/thmc50.ko 2024-03-08T05:52:05.960 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp102.ko 2024-03-08T05:52:05.960 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp103.ko 2024-03-08T05:52:05.960 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp401.ko 2024-03-08T05:52:05.960 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp421.ko 2024-03-08T05:52:05.961 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/via-cputemp.ko 2024-03-08T05:52:05.961 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/via686a.ko 2024-03-08T05:52:05.961 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/vt1211.ko 2024-03-08T05:52:05.961 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/vt8231.ko 2024-03-08T05:52:05.961 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83627ehf.ko 2024-03-08T05:52:05.961 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83627hf.ko 2024-03-08T05:52:05.961 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83781d.ko 2024-03-08T05:52:05.961 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83791d.ko 2024-03-08T05:52:05.961 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83792d.ko 2024-03-08T05:52:05.961 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83793.ko 2024-03-08T05:52:05.961 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83795.ko 2024-03-08T05:52:05.961 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83l785ts.ko 2024-03-08T05:52:05.961 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83l786ng.ko 2024-03-08T05:52:05.961 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c 2024-03-08T05:52:05.961 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos 2024-03-08T05:52:05.961 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-08T05:52:05.961 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-08T05:52:05.962 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses 2024-03-08T05:52:05.962 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-08T05:52:05.962 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-08T05:52:05.962 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-08T05:52:05.962 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-08T05:52:05.962 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-08T05:52:05.962 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-08T05:52:05.962 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-08T05:52:05.962 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-08T05:52:05.962 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-08T05:52:05.962 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-08T05:52:05.962 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-08T05:52:05.962 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-08T05:52:05.962 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-08T05:52:05.962 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-08T05:52:05.962 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-08T05:52:05.963 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-08T05:52:05.963 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-08T05:52:05.963 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-08T05:52:05.963 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-08T05:52:05.963 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-08T05:52:05.963 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-08T05:52:05.963 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-08T05:52:05.963 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-08T05:52:05.963 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-dev.ko 2024-03-08T05:52:05.963 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-mux.ko 2024-03-08T05:52:05.963 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-08T05:52:05.963 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-smbus.ko 2024-03-08T05:52:05.963 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-stub.ko 2024-03-08T05:52:05.963 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband 2024-03-08T05:52:05.963 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core 2024-03-08T05:52:05.963 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-08T05:52:05.963 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_core.ko 2024-03-08T05:52:05.964 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-08T05:52:05.964 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-08T05:52:05.964 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-08T05:52:05.964 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-08T05:52:05.964 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-08T05:52:05.964 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw 2024-03-08T05:52:05.964 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/cxgb4 2024-03-08T05:52:05.964 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-08T05:52:05.964 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx4 2024-03-08T05:52:05.964 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-08T05:52:05.964 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx5 2024-03-08T05:52:05.964 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-08T05:52:05.964 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mthca 2024-03-08T05:52:05.964 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-08T05:52:05.964 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp 2024-03-08T05:52:05.964 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ipoib 2024-03-08T05:52:05.964 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-08T05:52:05.965 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/iser 2024-03-08T05:52:05.965 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-08T05:52:05.965 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/isert 2024-03-08T05:52:05.965 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-08T05:52:05.965 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srp 2024-03-08T05:52:05.965 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-08T05:52:05.965 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srpt 2024-03-08T05:52:05.965 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-08T05:52:05.965 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input 2024-03-08T05:52:05.965 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport 2024-03-08T05:52:05.965 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-08T05:52:05.965 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-08T05:52:05.965 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/gameport.ko 2024-03-08T05:52:05.965 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/joydev.ko 2024-03-08T05:52:05.965 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard 2024-03-08T05:52:05.965 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-08T05:52:05.965 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse 2024-03-08T05:52:05.966 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/appletouch.ko 2024-03-08T05:52:05.966 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/bcm5974.ko 2024-03-08T05:52:05.966 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/cyapatp.ko 2024-03-08T05:52:05.966 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-08T05:52:05.966 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/sermouse.ko 2024-03-08T05:52:05.966 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-08T05:52:05.966 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-08T05:52:05.966 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-08T05:52:05.966 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/rmi4 2024-03-08T05:52:05.966 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-08T05:52:05.966 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio 2024-03-08T05:52:05.966 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/altera_ps2.ko 2024-03-08T05:52:05.966 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/arc_ps2.ko 2024-03-08T05:52:05.966 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-08T05:52:05.966 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/serio_raw.ko 2024-03-08T05:52:05.966 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/sparse-keymap.ko 2024-03-08T05:52:05.967 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds 2024-03-08T05:52:05.967 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-blinkm.ko 2024-03-08T05:52:05.967 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm3530.ko 2024-03-08T05:52:05.967 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lp3944.ko 2024-03-08T05:52:05.967 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-ss4200.ko 2024-03-08T05:52:05.967 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger 2024-03-08T05:52:05.967 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-08T05:52:05.967 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-08T05:52:05.967 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-08T05:52:05.967 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-08T05:52:05.967 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-08T05:52:05.967 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-08T05:52:05.967 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-08T05:52:05.967 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-08T05:52:05.967 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-08T05:52:05.967 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md 2024-03-08T05:52:05.967 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/bcache 2024-03-08T05:52:05.968 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/bcache/bcache.ko 2024-03-08T05:52:05.968 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-bio-prison.ko 2024-03-08T05:52:05.968 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-cache-smq.ko 2024-03-08T05:52:05.968 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-cache.ko 2024-03-08T05:52:05.968 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-crypt.ko 2024-03-08T05:52:05.968 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-delay.ko 2024-03-08T05:52:05.968 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-flakey.ko 2024-03-08T05:52:05.968 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-log-userspace.ko 2024-03-08T05:52:05.968 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-multipath.ko 2024-03-08T05:52:05.968 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-queue-length.ko 2024-03-08T05:52:05.968 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-raid.ko 2024-03-08T05:52:05.968 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-round-robin.ko 2024-03-08T05:52:05.968 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-service-time.ko 2024-03-08T05:52:05.968 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-switch.ko 2024-03-08T05:52:05.968 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-thin-pool.ko 2024-03-08T05:52:05.968 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-verity.ko 2024-03-08T05:52:05.968 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/persistent-data 2024-03-08T05:52:05.969 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-08T05:52:05.969 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid0.ko 2024-03-08T05:52:05.969 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid1.ko 2024-03-08T05:52:05.969 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid10.ko 2024-03-08T05:52:05.969 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid456.ko 2024-03-08T05:52:05.969 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message 2024-03-08T05:52:05.969 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion 2024-03-08T05:52:05.969 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptbase.ko 2024-03-08T05:52:05.969 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptctl.ko 2024-03-08T05:52:05.969 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptfc.ko 2024-03-08T05:52:05.969 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptlan.ko 2024-03-08T05:52:05.969 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptsas.ko 2024-03-08T05:52:05.969 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptscsih.ko 2024-03-08T05:52:05.969 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptspi.ko 2024-03-08T05:52:05.969 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd 2024-03-08T05:52:05.969 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lpc_ich.ko 2024-03-08T05:52:05.970 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lpc_sch.ko 2024-03-08T05:52:05.970 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/mfd-core.ko 2024-03-08T05:52:05.970 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/sm501.ko 2024-03-08T05:52:05.970 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/viperboard.ko 2024-03-08T05:52:05.970 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/vx855.ko 2024-03-08T05:52:05.970 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/wl1273-core.ko 2024-03-08T05:52:05.970 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc 2024-03-08T05:52:05.970 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/altera-stapl 2024-03-08T05:52:05.970 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-08T05:52:05.970 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/apds9802als.ko 2024-03-08T05:52:05.970 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/apds990x.ko 2024-03-08T05:52:05.970 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/bh1770glc.ko 2024-03-08T05:52:05.970 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/cb710 2024-03-08T05:52:05.970 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/cb710/cb710.ko 2024-03-08T05:52:05.970 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom 2024-03-08T05:52:05.971 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/at24.ko 2024-03-08T05:52:05.971 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-08T05:52:05.971 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/max6875.ko 2024-03-08T05:52:05.971 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/enclosure.ko 2024-03-08T05:52:05.971 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/hpilo.ko 2024-03-08T05:52:05.971 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/isl29003.ko 2024-03-08T05:52:05.971 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/isl29020.ko 2024-03-08T05:52:05.971 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d 2024-03-08T05:52:05.971 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-08T05:52:05.971 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-08T05:52:05.971 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei 2024-03-08T05:52:05.971 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei-me.ko 2024-03-08T05:52:05.971 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei-txe.ko 2024-03-08T05:52:05.971 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei.ko 2024-03-08T05:52:05.971 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-gru 2024-03-08T05:52:05.971 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-08T05:52:05.971 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp 2024-03-08T05:52:05.972 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-08T05:52:05.972 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-08T05:52:05.972 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-08T05:52:05.972 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tifm_7xx1.ko 2024-03-08T05:52:05.972 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tifm_core.ko 2024-03-08T05:52:05.972 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tsl2550.ko 2024-03-08T05:52:05.972 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_balloon.ko 2024-03-08T05:52:05.972 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_vmci 2024-03-08T05:52:05.972 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-08T05:52:05.972 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net 2024-03-08T05:52:05.972 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/bonding 2024-03-08T05:52:05.972 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/bonding/bonding.ko 2024-03-08T05:52:05.972 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa 2024-03-08T05:52:05.972 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/b53 2024-03-08T05:52:05.972 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-08T05:52:05.972 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-08T05:52:05.973 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-08T05:52:05.973 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6xxx 2024-03-08T05:52:05.973 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-08T05:52:05.973 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dummy.ko 2024-03-08T05:52:05.973 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/eql.ko 2024-03-08T05:52:05.973 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet 2024-03-08T05:52:05.973 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com 2024-03-08T05:52:05.973 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-08T05:52:05.973 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-08T05:52:05.973 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-08T05:52:05.973 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-08T05:52:05.973 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390 2024-03-08T05:52:05.973 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-08T05:52:05.973 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-08T05:52:05.973 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-08T05:52:05.973 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-08T05:52:05.974 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/adaptec 2024-03-08T05:52:05.974 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-08T05:52:05.974 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/agere 2024-03-08T05:52:05.974 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-08T05:52:05.974 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/alteon 2024-03-08T05:52:05.974 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-08T05:52:05.974 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/altera 2024-03-08T05:52:05.974 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-08T05:52:05.974 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd 2024-03-08T05:52:05.974 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-08T05:52:05.974 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-08T05:52:05.974 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-08T05:52:05.974 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros 2024-03-08T05:52:05.974 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/alx 2024-03-08T05:52:05.974 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-08T05:52:05.975 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-08T05:52:05.975 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-08T05:52:05.975 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-08T05:52:05.975 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-08T05:52:05.975 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx 2024-03-08T05:52:05.975 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-08T05:52:05.975 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-08T05:52:05.975 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom 2024-03-08T05:52:05.975 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-08T05:52:05.975 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-08T05:52:05.975 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-08T05:52:05.975 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-08T05:52:05.975 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-08T05:52:05.975 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/genet 2024-03-08T05:52:05.975 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-08T05:52:05.975 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-08T05:52:05.975 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade 2024-03-08T05:52:05.976 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/bna 2024-03-08T05:52:05.976 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-08T05:52:05.976 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio 2024-03-08T05:52:05.976 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-08T05:52:05.976 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-08T05:52:05.976 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-08T05:52:05.976 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-08T05:52:05.976 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-08T05:52:05.976 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-08T05:52:05.976 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-08T05:52:05.976 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-08T05:52:05.976 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-08T05:52:05.976 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-08T05:52:05.976 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco 2024-03-08T05:52:05.976 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/enic 2024-03-08T05:52:05.976 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-08T05:52:05.976 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec 2024-03-08T05:52:05.977 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip 2024-03-08T05:52:05.977 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-08T05:52:05.977 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-08T05:52:05.977 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-08T05:52:05.977 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-08T05:52:05.977 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-08T05:52:05.977 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-08T05:52:05.977 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink 2024-03-08T05:52:05.977 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-08T05:52:05.977 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-08T05:52:05.977 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dnet.ko 2024-03-08T05:52:05.977 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex 2024-03-08T05:52:05.977 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/benet 2024-03-08T05:52:05.977 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-08T05:52:05.977 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ethoc.ko 2024-03-08T05:52:05.977 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/fealnx.ko 2024-03-08T05:52:05.977 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel 2024-03-08T05:52:05.978 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-08T05:52:05.978 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000 2024-03-08T05:52:05.978 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-08T05:52:05.978 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000e 2024-03-08T05:52:05.978 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-08T05:52:05.978 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/fm10k 2024-03-08T05:52:05.978 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-08T05:52:05.978 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/i40e 2024-03-08T05:52:05.978 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-08T05:52:05.978 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/iavf 2024-03-08T05:52:05.978 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-08T05:52:05.978 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igb 2024-03-08T05:52:05.978 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-08T05:52:05.978 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igbvf 2024-03-08T05:52:05.979 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-08T05:52:05.979 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-08T05:52:05.979 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-08T05:52:05.979 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-08T05:52:05.979 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-08T05:52:05.979 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/jme.ko 2024-03-08T05:52:05.979 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell 2024-03-08T05:52:05.979 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-08T05:52:05.979 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-08T05:52:05.979 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-08T05:52:05.980 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox 2024-03-08T05:52:05.980 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-08T05:52:05.980 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-08T05:52:05.980 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-08T05:52:05.980 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-08T05:52:05.980 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-08T05:52:05.980 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-08T05:52:05.980 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel 2024-03-08T05:52:05.981 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-08T05:52:05.981 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom 2024-03-08T05:52:05.981 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-08T05:52:05.981 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-08T05:52:05.981 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi 2024-03-08T05:52:05.981 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-08T05:52:05.981 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-08T05:52:05.981 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/neterion 2024-03-08T05:52:05.981 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-08T05:52:05.981 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/nvidia 2024-03-08T05:52:05.982 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-08T05:52:05.982 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines 2024-03-08T05:52:05.982 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-08T05:52:05.982 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-08T05:52:05.982 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic 2024-03-08T05:52:05.982 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-08T05:52:05.982 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-08T05:52:05.982 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-08T05:52:05.982 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-08T05:52:05.982 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-08T05:52:05.982 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rdc 2024-03-08T05:52:05.982 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-08T05:52:05.982 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek 2024-03-08T05:52:05.982 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-08T05:52:05.983 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-08T05:52:05.983 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-08T05:52:05.983 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-08T05:52:05.983 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rocker 2024-03-08T05:52:05.983 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-08T05:52:05.983 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sfc 2024-03-08T05:52:05.983 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-08T05:52:05.983 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/silan 2024-03-08T05:52:05.983 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-08T05:52:05.983 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis 2024-03-08T05:52:05.983 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-08T05:52:05.983 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-08T05:52:05.983 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc 2024-03-08T05:52:05.984 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-08T05:52:05.984 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-08T05:52:05.984 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-08T05:52:05.984 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-08T05:52:05.984 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro 2024-03-08T05:52:05.984 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-08T05:52:05.984 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-08T05:52:05.984 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-08T05:52:05.984 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun 2024-03-08T05:52:05.984 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-08T05:52:05.984 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-08T05:52:05.984 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-08T05:52:05.984 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-08T05:52:05.984 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/tehuti 2024-03-08T05:52:05.985 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-08T05:52:05.985 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ti 2024-03-08T05:52:05.985 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-08T05:52:05.985 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via 2024-03-08T05:52:05.985 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-08T05:52:05.985 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-08T05:52:05.985 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet 2024-03-08T05:52:05.985 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-08T05:52:05.985 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-08T05:52:05.985 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/xircom 2024-03-08T05:52:05.985 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-08T05:52:05.985 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/geneve.ko 2024-03-08T05:52:05.985 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/hyperv 2024-03-08T05:52:05.985 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-08T05:52:05.985 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ieee802154 2024-03-08T05:52:05.985 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-08T05:52:05.986 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ifb.ko 2024-03-08T05:52:05.986 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ipvlan 2024-03-08T05:52:05.986 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-08T05:52:05.986 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/macvlan.ko 2024-03-08T05:52:05.986 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/macvtap.ko 2024-03-08T05:52:05.986 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio 2024-03-08T05:52:05.986 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio.ko 2024-03-08T05:52:05.986 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-08T05:52:05.986 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-08T05:52:05.986 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-08T05:52:05.986 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mii.ko 2024-03-08T05:52:05.986 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/net_failover.ko 2024-03-08T05:52:05.986 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/netconsole.ko 2024-03-08T05:52:05.987 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/nlmon.ko 2024-03-08T05:52:05.987 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs 2024-03-08T05:52:05.987 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-08T05:52:05.987 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-08T05:52:05.987 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy 2024-03-08T05:52:05.987 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/amd.ko 2024-03-08T05:52:05.987 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-08T05:52:05.987 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-08T05:52:05.987 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-08T05:52:05.987 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm87xx.ko 2024-03-08T05:52:05.987 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/broadcom.ko 2024-03-08T05:52:05.987 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/cicada.ko 2024-03-08T05:52:05.987 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/davicom.ko 2024-03-08T05:52:05.987 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/dp83640.ko 2024-03-08T05:52:05.987 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/et1011c.ko 2024-03-08T05:52:05.988 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/icplus.ko 2024-03-08T05:52:05.988 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/lxt.ko 2024-03-08T05:52:05.988 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/marvell.ko 2024-03-08T05:52:05.988 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/micrel.ko 2024-03-08T05:52:05.988 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/national.ko 2024-03-08T05:52:05.988 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/phylink.ko 2024-03-08T05:52:05.988 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/qsemi.ko 2024-03-08T05:52:05.988 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/realtek.ko 2024-03-08T05:52:05.988 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/smsc.ko 2024-03-08T05:52:05.988 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/ste10Xp.ko 2024-03-08T05:52:05.988 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/vitesse.ko 2024-03-08T05:52:05.988 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp 2024-03-08T05:52:05.988 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-08T05:52:05.988 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_async.ko 2024-03-08T05:52:05.988 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-08T05:52:05.988 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-08T05:52:05.989 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-08T05:52:05.989 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-08T05:52:05.989 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pppoe.ko 2024-03-08T05:52:05.989 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pppox.ko 2024-03-08T05:52:05.989 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pptp.ko 2024-03-08T05:52:05.989 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip 2024-03-08T05:52:05.989 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip/slhc.ko 2024-03-08T05:52:05.989 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip/slip.ko 2024-03-08T05:52:05.989 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/sungem_phy.ko 2024-03-08T05:52:05.989 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/tap.ko 2024-03-08T05:52:05.990 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team 2024-03-08T05:52:05.990 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team.ko 2024-03-08T05:52:05.990 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-08T05:52:05.990 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-08T05:52:05.990 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-08T05:52:05.990 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_random.ko 2024-03-08T05:52:05.990 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-08T05:52:05.990 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/tun.ko 2024-03-08T05:52:05.990 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/veth.ko 2024-03-08T05:52:05.990 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/virtio_net.ko 2024-03-08T05:52:05.990 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vmxnet3 2024-03-08T05:52:05.990 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-08T05:52:05.991 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vxlan 2024-03-08T05:52:05.991 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vxlan/vxlan.ko 2024-03-08T05:52:05.991 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netback 2024-03-08T05:52:05.991 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-08T05:52:05.991 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netfront.ko 2024-03-08T05:52:05.991 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ntb 2024-03-08T05:52:05.991 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ntb/ntb.ko 2024-03-08T05:52:05.991 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme 2024-03-08T05:52:05.991 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host 2024-03-08T05:52:05.991 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/nvme-core.ko 2024-03-08T05:52:05.991 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/nvme.ko 2024-03-08T05:52:05.991 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport 2024-03-08T05:52:05.991 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport.ko 2024-03-08T05:52:05.991 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_cs.ko 2024-03-08T05:52:05.991 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_pc.ko 2024-03-08T05:52:05.991 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_serial.ko 2024-03-08T05:52:05.992 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci 2024-03-08T05:52:05.992 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug 2024-03-08T05:52:05.992 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-08T05:52:05.992 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/pcie 2024-03-08T05:52:05.992 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-08T05:52:05.992 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/xen-pcifront.ko 2024-03-08T05:52:05.992 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia 2024-03-08T05:52:05.992 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/i82092.ko 2024-03-08T05:52:05.992 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pd6729.ko 2024-03-08T05:52:05.992 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-08T05:52:05.992 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl 2024-03-08T05:52:05.992 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/intel 2024-03-08T05:52:05.992 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-08T05:52:05.992 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform 2024-03-08T05:52:05.992 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86 2024-03-08T05:52:05.993 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-08T05:52:05.993 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/acerhdf.ko 2024-03-08T05:52:05.993 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-08T05:52:05.993 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-08T05:52:05.993 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-08T05:52:05.993 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-08T05:52:05.993 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-08T05:52:05.993 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-08T05:52:05.993 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-08T05:52:05.993 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-08T05:52:05.993 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-08T05:52:05.993 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/hdaps.ko 2024-03-08T05:52:05.993 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel 2024-03-08T05:52:05.993 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-08T05:52:05.993 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel_ips.ko 2024-03-08T05:52:05.994 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-08T05:52:05.994 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-08T05:52:05.994 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-08T05:52:05.994 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-08T05:52:05.994 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-08T05:52:05.994 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-08T05:52:05.994 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-08T05:52:05.994 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-08T05:52:05.994 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-08T05:52:05.994 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/wmi.ko 2024-03-08T05:52:05.994 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap 2024-03-08T05:52:05.994 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-08T05:52:05.994 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-08T05:52:05.994 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps 2024-03-08T05:52:05.995 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients 2024-03-08T05:52:05.995 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-08T05:52:05.995 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-08T05:52:05.995 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps_parport.ko 2024-03-08T05:52:05.995 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/pps_core.ko 2024-03-08T05:52:05.995 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp 2024-03-08T05:52:05.995 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ptp.ko 2024-03-08T05:52:05.995 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ptp_kvm.ko 2024-03-08T05:52:05.995 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc 2024-03-08T05:52:05.995 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-08T05:52:05.995 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-08T05:52:05.995 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-08T05:52:05.995 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-08T05:52:05.995 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-08T05:52:05.995 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-08T05:52:05.995 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-08T05:52:05.996 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-08T05:52:05.996 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-08T05:52:05.996 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-08T05:52:05.996 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-em3027.ko 2024-03-08T05:52:05.996 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-08T05:52:05.996 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-08T05:52:05.996 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-08T05:52:05.996 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-08T05:52:05.996 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-08T05:52:05.996 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-08T05:52:05.996 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max6900.ko 2024-03-08T05:52:05.996 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-08T05:52:05.996 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-08T05:52:05.996 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-08T05:52:05.996 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-08T05:52:05.996 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-08T05:52:05.997 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-08T05:52:05.997 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-08T05:52:05.997 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-08T05:52:05.997 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-08T05:52:05.997 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-08T05:52:05.997 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-08T05:52:05.997 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-08T05:52:05.997 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-x1205.ko 2024-03-08T05:52:05.997 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi 2024-03-08T05:52:05.997 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-9xxx.ko 2024-03-08T05:52:05.997 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-sas.ko 2024-03-08T05:52:05.997 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-xxxx.ko 2024-03-08T05:52:05.997 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/BusLogic.ko 2024-03-08T05:52:05.997 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/a100u2w.ko 2024-03-08T05:52:05.997 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aacraid 2024-03-08T05:52:05.997 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-08T05:52:05.997 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/advansys.ko 2024-03-08T05:52:05.998 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx 2024-03-08T05:52:05.998 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-08T05:52:05.998 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-08T05:52:05.998 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/am53c974.ko 2024-03-08T05:52:05.998 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/arcmsr 2024-03-08T05:52:05.998 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-08T05:52:05.998 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/atp870u.ko 2024-03-08T05:52:05.998 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/be2iscsi 2024-03-08T05:52:05.998 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-08T05:52:05.998 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bfa 2024-03-08T05:52:05.998 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bfa/bfa.ko 2024-03-08T05:52:05.998 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2fc 2024-03-08T05:52:05.998 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-08T05:52:05.998 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2i 2024-03-08T05:52:05.998 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-08T05:52:05.999 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ch.ko 2024-03-08T05:52:05.999 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/csiostor 2024-03-08T05:52:05.999 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-08T05:52:05.999 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi 2024-03-08T05:52:05.999 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-08T05:52:05.999 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-08T05:52:05.999 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-08T05:52:05.999 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-08T05:52:05.999 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-08T05:52:05.999 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/dc395x.ko 2024-03-08T05:52:05.999 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler 2024-03-08T05:52:05.999 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-08T05:52:05.999 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-08T05:52:05.999 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-08T05:52:05.999 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-08T05:52:06.000 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/dmx3191d.ko 2024-03-08T05:52:06.000 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esas2r 2024-03-08T05:52:06.000 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-08T05:52:06.000 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esp_scsi.ko 2024-03-08T05:52:06.000 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe 2024-03-08T05:52:06.000 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-08T05:52:06.000 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-08T05:52:06.000 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fnic 2024-03-08T05:52:06.000 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fnic/fnic.ko 2024-03-08T05:52:06.000 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hpsa.ko 2024-03-08T05:52:06.000 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hptiop.ko 2024-03-08T05:52:06.000 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hv_storvsc.ko 2024-03-08T05:52:06.000 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/initio.ko 2024-03-08T05:52:06.000 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ipr.ko 2024-03-08T05:52:06.000 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ips.ko 2024-03-08T05:52:06.000 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/isci 2024-03-08T05:52:06.000 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/isci/isci.ko 2024-03-08T05:52:06.001 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-08T05:52:06.001 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-08T05:52:06.001 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libfc 2024-03-08T05:52:06.001 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libfc/libfc.ko 2024-03-08T05:52:06.001 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libiscsi.ko 2024-03-08T05:52:06.001 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-08T05:52:06.001 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libsas 2024-03-08T05:52:06.001 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libsas/libsas.ko 2024-03-08T05:52:06.001 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/lpfc 2024-03-08T05:52:06.001 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-08T05:52:06.001 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid 2024-03-08T05:52:06.001 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid.ko 2024-03-08T05:52:06.001 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-08T05:52:06.001 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-08T05:52:06.001 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-08T05:52:06.001 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mpt3sas 2024-03-08T05:52:06.001 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-08T05:52:06.002 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvsas 2024-03-08T05:52:06.002 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-08T05:52:06.002 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvumi.ko 2024-03-08T05:52:06.002 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pm8001 2024-03-08T05:52:06.002 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-08T05:52:06.002 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pmcraid.ko 2024-03-08T05:52:06.002 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla1280.ko 2024-03-08T05:52:06.002 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx 2024-03-08T05:52:06.002 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-08T05:52:06.002 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-08T05:52:06.002 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla4xxx 2024-03-08T05:52:06.002 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-08T05:52:06.002 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/raid_class.ko 2024-03-08T05:52:06.002 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_debug.ko 2024-03-08T05:52:06.002 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-08T05:52:06.003 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-08T05:52:06.003 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-08T05:52:06.003 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-08T05:52:06.003 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-08T05:52:06.003 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ses.ko 2024-03-08T05:52:06.003 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/st.ko 2024-03-08T05:52:06.003 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/stex.ko 2024-03-08T05:52:06.003 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/sym53c8xx_2 2024-03-08T05:52:06.003 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-08T05:52:06.003 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/virtio_scsi.ko 2024-03-08T05:52:06.003 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-08T05:52:06.003 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/wd719x.ko 2024-03-08T05:52:06.003 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ssb 2024-03-08T05:52:06.003 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ssb/ssb.ko 2024-03-08T05:52:06.003 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target 2024-03-08T05:52:06.003 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/iscsi 2024-03-08T05:52:06.003 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-08T05:52:06.004 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/loopback 2024-03-08T05:52:06.004 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-08T05:52:06.004 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_file.ko 2024-03-08T05:52:06.004 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_iblock.ko 2024-03-08T05:52:06.004 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_mod.ko 2024-03-08T05:52:06.004 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_pscsi.ko 2024-03-08T05:52:06.004 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_user.ko 2024-03-08T05:52:06.004 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/tcm_fc 2024-03-08T05:52:06.004 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-08T05:52:06.004 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal 2024-03-08T05:52:06.004 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel 2024-03-08T05:52:06.004 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal 2024-03-08T05:52:06.004 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-08T05:52:06.004 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-08T05:52:06.004 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-08T05:52:06.004 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-08T05:52:06.004 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-08T05:52:06.005 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-08T05:52:06.005 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-08T05:52:06.005 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-08T05:52:06.005 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-08T05:52:06.005 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-08T05:52:06.005 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-08T05:52:06.005 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-08T05:52:06.005 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-08T05:52:06.005 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-08T05:52:06.005 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-08T05:52:06.005 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-08T05:52:06.005 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-08T05:52:06.005 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-08T05:52:06.005 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty 2024-03-08T05:52:06.005 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ipwireless 2024-03-08T05:52:06.005 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-08T05:52:06.005 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/n_gsm.ko 2024-03-08T05:52:06.006 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/n_hdlc.ko 2024-03-08T05:52:06.006 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/nozomi.ko 2024-03-08T05:52:06.006 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial 2024-03-08T05:52:06.006 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250 2024-03-08T05:52:06.006 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-08T05:52:06.006 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/arc_uart.ko 2024-03-08T05:52:06.006 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/jsm 2024-03-08T05:52:06.006 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-08T05:52:06.006 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs 2024-03-08T05:52:06.006 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/core 2024-03-08T05:52:06.006 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-08T05:52:06.006 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host 2024-03-08T05:52:06.006 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-08T05:52:06.006 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio 2024-03-08T05:52:06.006 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio.ko 2024-03-08T05:52:06.006 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_aec.ko 2024-03-08T05:52:06.007 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_cif.ko 2024-03-08T05:52:06.007 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_pci_generic.ko 2024-03-08T05:52:06.007 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_sercos3.ko 2024-03-08T05:52:06.007 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb 2024-03-08T05:52:06.007 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class 2024-03-08T05:52:06.007 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/cdc-acm.ko 2024-03-08T05:52:06.007 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-08T05:52:06.007 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/usblp.ko 2024-03-08T05:52:06.007 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/usbtmc.ko 2024-03-08T05:52:06.007 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host 2024-03-08T05:52:06.007 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-08T05:52:06.007 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image 2024-03-08T05:52:06.007 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/mdc800.ko 2024-03-08T05:52:06.007 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/microtek.ko 2024-03-08T05:52:06.007 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc 2024-03-08T05:52:06.007 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/adutux.ko 2024-03-08T05:52:06.008 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/appledisplay.ko 2024-03-08T05:52:06.008 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/emi26.ko 2024-03-08T05:52:06.008 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/emi62.ko 2024-03-08T05:52:06.008 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ezusb.ko 2024-03-08T05:52:06.008 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/idmouse.ko 2024-03-08T05:52:06.008 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/iowarrior.ko 2024-03-08T05:52:06.008 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-08T05:52:06.008 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ldusb.ko 2024-03-08T05:52:06.008 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/legousbtower.ko 2024-03-08T05:52:06.008 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/sisusbvga 2024-03-08T05:52:06.008 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-08T05:52:06.008 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-08T05:52:06.008 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usb3503.ko 2024-03-08T05:52:06.008 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usblcd.ko 2024-03-08T05:52:06.008 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-08T05:52:06.008 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/uss720.ko 2024-03-08T05:52:06.008 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/yurex.ko 2024-03-08T05:52:06.009 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy 2024-03-08T05:52:06.009 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-generic.ko 2024-03-08T05:52:06.009 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial 2024-03-08T05:52:06.009 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/aircable.ko 2024-03-08T05:52:06.009 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ark3116.ko 2024-03-08T05:52:06.009 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-08T05:52:06.009 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ch341.ko 2024-03-08T05:52:06.009 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cp210x.ko 2024-03-08T05:52:06.009 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cyberjack.ko 2024-03-08T05:52:06.009 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-08T05:52:06.009 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-08T05:52:06.009 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/empeg.ko 2024-03-08T05:52:06.009 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-08T05:52:06.009 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-08T05:52:06.009 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-08T05:52:06.009 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/io_ti.ko 2024-03-08T05:52:06.010 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ipaq.ko 2024-03-08T05:52:06.010 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ipw.ko 2024-03-08T05:52:06.010 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ir-usb.ko 2024-03-08T05:52:06.010 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-08T05:52:06.010 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/keyspan.ko 2024-03-08T05:52:06.010 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-08T05:52:06.010 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-08T05:52:06.010 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-08T05:52:06.010 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mct_u232.ko 2024-03-08T05:52:06.010 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mos7720.ko 2024-03-08T05:52:06.010 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mos7840.ko 2024-03-08T05:52:06.010 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/navman.ko 2024-03-08T05:52:06.010 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/omninet.ko 2024-03-08T05:52:06.010 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/opticon.ko 2024-03-08T05:52:06.010 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/option.ko 2024-03-08T05:52:06.011 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/oti6858.ko 2024-03-08T05:52:06.011 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/pl2303.ko 2024-03-08T05:52:06.011 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/qcaux.ko 2024-03-08T05:52:06.011 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/qcserial.ko 2024-03-08T05:52:06.011 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/quatech2.ko 2024-03-08T05:52:06.011 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/safe_serial.ko 2024-03-08T05:52:06.011 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/sierra.ko 2024-03-08T05:52:06.011 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-08T05:52:06.011 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ssu100.ko 2024-03-08T05:52:06.011 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/symbolserial.ko 2024-03-08T05:52:06.011 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-08T05:52:06.011 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-08T05:52:06.011 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb_debug.ko 2024-03-08T05:52:06.011 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-08T05:52:06.011 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/visor.ko 2024-03-08T05:52:06.011 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/whiteheat.ko 2024-03-08T05:52:06.011 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-08T05:52:06.012 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage 2024-03-08T05:52:06.012 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/uas.ko 2024-03-08T05:52:06.012 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-08T05:52:06.012 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-08T05:52:06.012 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-08T05:52:06.012 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-08T05:52:06.012 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-08T05:52:06.012 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-08T05:52:06.012 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-08T05:52:06.012 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-karma.ko 2024-03-08T05:52:06.012 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-08T05:52:06.012 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-08T05:52:06.012 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-08T05:52:06.012 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-08T05:52:06.012 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-08T05:52:06.012 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/usb-storage.ko 2024-03-08T05:52:06.012 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip 2024-03-08T05:52:06.013 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-08T05:52:06.013 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-08T05:52:06.013 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-08T05:52:06.013 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio 2024-03-08T05:52:06.013 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci 2024-03-08T05:52:06.013 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-08T05:52:06.013 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-08T05:52:06.013 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/vfio.ko 2024-03-08T05:52:06.013 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-08T05:52:06.013 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost 2024-03-08T05:52:06.013 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost.ko 2024-03-08T05:52:06.013 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-08T05:52:06.013 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_net.ko 2024-03-08T05:52:06.013 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_scsi.ko 2024-03-08T05:52:06.013 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video 2024-03-08T05:52:06.013 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight 2024-03-08T05:52:06.013 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/apple_bl.ko 2024-03-08T05:52:06.014 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lcd.ko 2024-03-08T05:52:06.014 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-08T05:52:06.014 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio 2024-03-08T05:52:06.014 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio.ko 2024-03-08T05:52:06.014 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_balloon.ko 2024-03-08T05:52:06.014 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_mmio.ko 2024-03-08T05:52:06.014 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_pci.ko 2024-03-08T05:52:06.014 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-08T05:52:06.014 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-08T05:52:06.014 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_ring.ko 2024-03-08T05:52:06.014 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1 2024-03-08T05:52:06.014 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters 2024-03-08T05:52:06.014 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ds2482.ko 2024-03-08T05:52:06.014 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ds2490.ko 2024-03-08T05:52:06.014 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves 2024-03-08T05:52:06.014 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-08T05:52:06.015 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-08T05:52:06.015 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-08T05:52:06.015 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-08T05:52:06.015 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-08T05:52:06.015 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-08T05:52:06.015 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-08T05:52:06.015 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-08T05:52:06.015 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-08T05:52:06.015 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-08T05:52:06.015 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-08T05:52:06.015 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/wire.ko 2024-03-08T05:52:06.015 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog 2024-03-08T05:52:06.015 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-08T05:52:06.015 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-08T05:52:06.015 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-08T05:52:06.015 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/hpwdt.ko 2024-03-08T05:52:06.015 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/i6300esb.ko 2024-03-08T05:52:06.016 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-08T05:52:06.016 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-08T05:52:06.016 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ib700wdt.ko 2024-03-08T05:52:06.016 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ibmasr.ko 2024-03-08T05:52:06.016 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-08T05:52:06.016 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-08T05:52:06.016 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/it87_wdt.ko 2024-03-08T05:52:06.016 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/machzwd.ko 2024-03-08T05:52:06.016 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/nv_tco.ko 2024-03-08T05:52:06.016 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-08T05:52:06.016 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-08T05:52:06.016 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-08T05:52:06.016 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-08T05:52:06.016 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/softdog.ko 2024-03-08T05:52:06.016 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-08T05:52:06.016 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/via_wdt.ko 2024-03-08T05:52:06.016 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-08T05:52:06.017 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-08T05:52:06.017 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-08T05:52:06.017 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wdt_pci.ko 2024-03-08T05:52:06.017 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/xen_wdt.ko 2024-03-08T05:52:06.017 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen 2024-03-08T05:52:06.017 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-08T05:52:06.017 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-evtchn.ko 2024-03-08T05:52:06.017 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-gntalloc.ko 2024-03-08T05:52:06.017 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-gntdev.ko 2024-03-08T05:52:06.017 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-pciback 2024-03-08T05:52:06.017 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-08T05:52:06.017 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-privcmd.ko 2024-03-08T05:52:06.017 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xenfs 2024-03-08T05:52:06.017 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-08T05:52:06.017 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs 2024-03-08T05:52:06.017 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/9p 2024-03-08T05:52:06.017 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/9p/9p.ko 2024-03-08T05:52:06.018 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/affs 2024-03-08T05:52:06.018 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/affs/affs.ko 2024-03-08T05:52:06.018 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/befs 2024-03-08T05:52:06.018 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/befs/befs.ko 2024-03-08T05:52:06.018 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/binfmt_misc.ko 2024-03-08T05:52:06.018 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/btrfs 2024-03-08T05:52:06.018 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/btrfs/btrfs.ko 2024-03-08T05:52:06.018 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cachefiles 2024-03-08T05:52:06.018 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cachefiles/cachefiles.ko 2024-03-08T05:52:06.018 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ceph 2024-03-08T05:52:06.018 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ceph/ceph.ko 2024-03-08T05:52:06.018 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/coda 2024-03-08T05:52:06.018 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/coda/coda.ko 2024-03-08T05:52:06.018 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cramfs 2024-03-08T05:52:06.018 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cramfs/cramfs.ko 2024-03-08T05:52:06.019 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/dlm 2024-03-08T05:52:06.019 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/dlm/dlm.ko 2024-03-08T05:52:06.019 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ecryptfs 2024-03-08T05:52:06.019 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-08T05:52:06.019 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/f2fs 2024-03-08T05:52:06.019 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/f2fs/f2fs.ko 2024-03-08T05:52:06.019 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat 2024-03-08T05:52:06.019 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/fat.ko 2024-03-08T05:52:06.019 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/msdos.ko 2024-03-08T05:52:06.019 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/vfat.ko 2024-03-08T05:52:06.019 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse 2024-03-08T05:52:06.019 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse/cuse.ko 2024-03-08T05:52:06.019 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse/fuse.ko 2024-03-08T05:52:06.019 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/gfs2 2024-03-08T05:52:06.019 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/gfs2/gfs2.ko 2024-03-08T05:52:06.019 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfs 2024-03-08T05:52:06.020 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfs/hfs.ko 2024-03-08T05:52:06.020 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfsplus 2024-03-08T05:52:06.020 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfsplus/hfsplus.ko 2024-03-08T05:52:06.020 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/isofs 2024-03-08T05:52:06.020 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/isofs/isofs.ko 2024-03-08T05:52:06.020 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/jfs 2024-03-08T05:52:06.020 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/jfs/jfs.ko 2024-03-08T05:52:06.020 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/lockd 2024-03-08T05:52:06.020 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/lockd/lockd.ko 2024-03-08T05:52:06.020 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/minix 2024-03-08T05:52:06.020 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/minix/minix.ko 2024-03-08T05:52:06.020 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/netfs 2024-03-08T05:52:06.020 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/netfs/netfs.ko 2024-03-08T05:52:06.020 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs 2024-03-08T05:52:06.020 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/blocklayout 2024-03-08T05:52:06.020 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-08T05:52:06.021 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/filelayout 2024-03-08T05:52:06.021 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-08T05:52:06.021 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/flexfilelayout 2024-03-08T05:52:06.021 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-08T05:52:06.021 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfs.ko 2024-03-08T05:52:06.021 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv3.ko 2024-03-08T05:52:06.021 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv4.ko 2024-03-08T05:52:06.021 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common 2024-03-08T05:52:06.021 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/grace.ko 2024-03-08T05:52:06.021 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/nfs_acl.ko 2024-03-08T05:52:06.021 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfsd 2024-03-08T05:52:06.021 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfsd/nfsd.ko 2024-03-08T05:52:06.021 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nilfs2 2024-03-08T05:52:06.021 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nilfs2/nilfs2.ko 2024-03-08T05:52:06.021 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls 2024-03-08T05:52:06.021 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-celtic.ko 2024-03-08T05:52:06.021 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-centeuro.ko 2024-03-08T05:52:06.022 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-croatian.ko 2024-03-08T05:52:06.022 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-cyrillic.ko 2024-03-08T05:52:06.022 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-gaelic.ko 2024-03-08T05:52:06.022 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-greek.ko 2024-03-08T05:52:06.022 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-iceland.ko 2024-03-08T05:52:06.022 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-inuit.ko 2024-03-08T05:52:06.022 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-roman.ko 2024-03-08T05:52:06.022 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-romanian.ko 2024-03-08T05:52:06.022 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-turkish.ko 2024-03-08T05:52:06.022 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1250.ko 2024-03-08T05:52:06.022 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1251.ko 2024-03-08T05:52:06.022 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1255.ko 2024-03-08T05:52:06.022 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp737.ko 2024-03-08T05:52:06.022 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp775.ko 2024-03-08T05:52:06.022 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp850.ko 2024-03-08T05:52:06.023 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp852.ko 2024-03-08T05:52:06.023 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp855.ko 2024-03-08T05:52:06.023 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp857.ko 2024-03-08T05:52:06.023 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp860.ko 2024-03-08T05:52:06.023 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp861.ko 2024-03-08T05:52:06.023 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp862.ko 2024-03-08T05:52:06.023 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp863.ko 2024-03-08T05:52:06.023 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp864.ko 2024-03-08T05:52:06.023 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp865.ko 2024-03-08T05:52:06.023 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp866.ko 2024-03-08T05:52:06.023 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp869.ko 2024-03-08T05:52:06.023 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp874.ko 2024-03-08T05:52:06.023 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp932.ko 2024-03-08T05:52:06.023 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp936.ko 2024-03-08T05:52:06.023 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp949.ko 2024-03-08T05:52:06.023 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp950.ko 2024-03-08T05:52:06.023 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_euc-jp.ko 2024-03-08T05:52:06.024 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-1.ko 2024-03-08T05:52:06.024 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-13.ko 2024-03-08T05:52:06.024 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-14.ko 2024-03-08T05:52:06.024 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-15.ko 2024-03-08T05:52:06.024 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-2.ko 2024-03-08T05:52:06.024 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-3.ko 2024-03-08T05:52:06.024 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-4.ko 2024-03-08T05:52:06.024 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-5.ko 2024-03-08T05:52:06.024 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-6.ko 2024-03-08T05:52:06.024 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-7.ko 2024-03-08T05:52:06.024 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-9.ko 2024-03-08T05:52:06.024 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-r.ko 2024-03-08T05:52:06.024 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-ru.ko 2024-03-08T05:52:06.024 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-u.ko 2024-03-08T05:52:06.024 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-08T05:52:06.024 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_utf8.ko 2024-03-08T05:52:06.024 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2 2024-03-08T05:52:06.025 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/cluster 2024-03-08T05:52:06.025 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-08T05:52:06.025 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlm 2024-03-08T05:52:06.025 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-08T05:52:06.025 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlmfs 2024-03-08T05:52:06.025 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-08T05:52:06.025 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2.ko 2024-03-08T05:52:06.025 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-08T05:52:06.025 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-08T05:52:06.025 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-08T05:52:06.025 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/overlayfs 2024-03-08T05:52:06.025 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/overlayfs/overlay.ko 2024-03-08T05:52:06.025 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/pstore 2024-03-08T05:52:06.025 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/pstore/ramoops.ko 2024-03-08T05:52:06.025 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/reiserfs 2024-03-08T05:52:06.025 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/reiserfs/reiserfs.ko 2024-03-08T05:52:06.025 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/romfs 2024-03-08T05:52:06.026 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/romfs/romfs.ko 2024-03-08T05:52:06.026 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb 2024-03-08T05:52:06.026 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/client 2024-03-08T05:52:06.026 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/client/cifs.ko 2024-03-08T05:52:06.026 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common 2024-03-08T05:52:06.026 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/cifs_arc4.ko 2024-03-08T05:52:06.026 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/cifs_md4.ko 2024-03-08T05:52:06.026 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/squashfs 2024-03-08T05:52:06.026 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/squashfs/squashfs.ko 2024-03-08T05:52:06.026 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/sysv 2024-03-08T05:52:06.026 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/sysv/sysv.ko 2024-03-08T05:52:06.026 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/udf 2024-03-08T05:52:06.026 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/udf/udf.ko 2024-03-08T05:52:06.026 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ufs 2024-03-08T05:52:06.026 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ufs/ufs.ko 2024-03-08T05:52:06.027 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/xfs 2024-03-08T05:52:06.027 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/xfs/xfs.ko 2024-03-08T05:52:06.027 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel 2024-03-08T05:52:06.027 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/rcu 2024-03-08T05:52:06.027 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/rcu/rcutorture.ko 2024-03-08T05:52:06.027 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/torture.ko 2024-03-08T05:52:06.027 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/trace 2024-03-08T05:52:06.027 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-08T05:52:06.027 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib 2024-03-08T05:52:06.027 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/asn1_encoder.ko 2024-03-08T05:52:06.027 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc-itu-t.ko 2024-03-08T05:52:06.027 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc8.ko 2024-03-08T05:52:06.027 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto 2024-03-08T05:52:06.027 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/libarc4.ko 2024-03-08T05:52:06.027 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/libdes.ko 2024-03-08T05:52:06.027 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/libcrc32c.ko 2024-03-08T05:52:06.027 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lru_cache.ko 2024-03-08T05:52:06.027 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4 2024-03-08T05:52:06.028 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/lz4_compress.ko 2024-03-08T05:52:06.028 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/lz4hc_compress.ko 2024-03-08T05:52:06.028 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/math 2024-03-08T05:52:06.028 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/math/cordic.ko 2024-03-08T05:52:06.028 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/raid6 2024-03-08T05:52:06.028 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/raid6/raid6_pq.ko 2024-03-08T05:52:06.028 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/reed_solomon 2024-03-08T05:52:06.028 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-08T05:52:06.028 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_bm.ko 2024-03-08T05:52:06.028 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_fsm.ko 2024-03-08T05:52:06.028 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_kmp.ko 2024-03-08T05:52:06.028 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/zstd 2024-03-08T05:52:06.028 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/zstd/zstd_compress.ko 2024-03-08T05:52:06.028 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/mm 2024-03-08T05:52:06.028 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/mm/hwpoison-inject.ko 2024-03-08T05:52:06.029 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net 2024-03-08T05:52:06.029 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan 2024-03-08T05:52:06.029 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/6lowpan.ko 2024-03-08T05:52:06.029 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_dest.ko 2024-03-08T05:52:06.029 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_fragment.ko 2024-03-08T05:52:06.029 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_hop.ko 2024-03-08T05:52:06.029 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-08T05:52:06.029 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_mobility.ko 2024-03-08T05:52:06.029 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_routing.ko 2024-03-08T05:52:06.029 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_udp.ko 2024-03-08T05:52:06.029 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802 2024-03-08T05:52:06.029 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/garp.ko 2024-03-08T05:52:06.029 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/mrp.ko 2024-03-08T05:52:06.029 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/p8022.ko 2024-03-08T05:52:06.029 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/psnap.ko 2024-03-08T05:52:06.029 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/stp.ko 2024-03-08T05:52:06.030 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/8021q 2024-03-08T05:52:06.030 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/8021q/8021q.ko 2024-03-08T05:52:06.030 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p 2024-03-08T05:52:06.030 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet.ko 2024-03-08T05:52:06.030 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_fd.ko 2024-03-08T05:52:06.030 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_rdma.ko 2024-03-08T05:52:06.030 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_virtio.ko 2024-03-08T05:52:06.030 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/batman-adv 2024-03-08T05:52:06.030 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/batman-adv/batman-adv.ko 2024-03-08T05:52:06.030 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge 2024-03-08T05:52:06.030 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/br_netfilter.ko 2024-03-08T05:52:06.030 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/bridge.ko 2024-03-08T05:52:06.030 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter 2024-03-08T05:52:06.030 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-08T05:52:06.030 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-08T05:52:06.030 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-08T05:52:06.031 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-08T05:52:06.031 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-08T05:52:06.031 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-08T05:52:06.031 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-08T05:52:06.031 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-08T05:52:06.031 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-08T05:52:06.031 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-08T05:52:06.031 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-08T05:52:06.031 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-08T05:52:06.031 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-08T05:52:06.031 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-08T05:52:06.031 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-08T05:52:06.031 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-08T05:52:06.031 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-08T05:52:06.031 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-08T05:52:06.031 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-08T05:52:06.031 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-08T05:52:06.032 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtables.ko 2024-03-08T05:52:06.032 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-08T05:52:06.032 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-08T05:52:06.032 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-08T05:52:06.032 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ceph 2024-03-08T05:52:06.032 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ceph/libceph.ko 2024-03-08T05:52:06.032 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core 2024-03-08T05:52:06.032 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core/failover.ko 2024-03-08T05:52:06.032 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core/pktgen.ko 2024-03-08T05:52:06.032 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp 2024-03-08T05:52:06.032 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp.ko 2024-03-08T05:52:06.032 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_diag.ko 2024-03-08T05:52:06.032 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_ipv4.ko 2024-03-08T05:52:06.032 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_ipv6.ko 2024-03-08T05:52:06.032 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dns_resolver 2024-03-08T05:52:06.032 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dns_resolver/dns_resolver.ko 2024-03-08T05:52:06.032 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa 2024-03-08T05:52:06.033 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/dsa_core.ko 2024-03-08T05:52:06.033 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_brcm.ko 2024-03-08T05:52:06.033 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_dsa.ko 2024-03-08T05:52:06.033 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_none.ko 2024-03-08T05:52:06.033 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_trailer.ko 2024-03-08T05:52:06.033 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154 2024-03-08T05:52:06.033 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/6lowpan 2024-03-08T05:52:06.033 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-08T05:52:06.033 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ieee802154.ko 2024-03-08T05:52:06.033 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-08T05:52:06.033 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4 2024-03-08T05:52:06.033 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ah4.ko 2024-03-08T05:52:06.033 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/esp4.ko 2024-03-08T05:52:06.033 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/fou.ko 2024-03-08T05:52:06.033 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/gre.ko 2024-03-08T05:52:06.033 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/inet_diag.ko 2024-03-08T05:52:06.034 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_gre.ko 2024-03-08T05:52:06.034 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_tunnel.ko 2024-03-08T05:52:06.034 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_vti.ko 2024-03-08T05:52:06.034 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ipcomp.ko 2024-03-08T05:52:06.034 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ipip.ko 2024-03-08T05:52:06.034 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter 2024-03-08T05:52:06.034 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-08T05:52:06.034 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-08T05:52:06.034 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-08T05:52:06.034 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-08T05:52:06.034 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-08T05:52:06.034 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-08T05:52:06.034 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-08T05:52:06.034 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-08T05:52:06.034 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-08T05:52:06.034 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-08T05:52:06.035 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-08T05:52:06.035 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-08T05:52:06.035 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-08T05:52:06.035 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-08T05:52:06.035 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-08T05:52:06.035 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-08T05:52:06.035 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-08T05:52:06.035 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-08T05:52:06.035 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-08T05:52:06.035 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-08T05:52:06.035 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-08T05:52:06.035 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_bic.ko 2024-03-08T05:52:06.035 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_dctcp.ko 2024-03-08T05:52:06.035 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_diag.ko 2024-03-08T05:52:06.035 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_highspeed.ko 2024-03-08T05:52:06.035 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_htcp.ko 2024-03-08T05:52:06.035 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_hybla.ko 2024-03-08T05:52:06.036 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_illinois.ko 2024-03-08T05:52:06.036 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_lp.ko 2024-03-08T05:52:06.036 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_scalable.ko 2024-03-08T05:52:06.036 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_vegas.ko 2024-03-08T05:52:06.036 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_veno.ko 2024-03-08T05:52:06.036 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_westwood.ko 2024-03-08T05:52:06.036 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_yeah.ko 2024-03-08T05:52:06.036 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tunnel4.ko 2024-03-08T05:52:06.036 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/udp_diag.ko 2024-03-08T05:52:06.036 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/udp_tunnel.ko 2024-03-08T05:52:06.036 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-08T05:52:06.036 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6 2024-03-08T05:52:06.036 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ah6.ko 2024-03-08T05:52:06.036 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/esp6.ko 2024-03-08T05:52:06.036 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/fou6.ko 2024-03-08T05:52:06.036 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_tunnel.ko 2024-03-08T05:52:06.036 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-08T05:52:06.037 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_vti.ko 2024-03-08T05:52:06.037 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ipcomp6.ko 2024-03-08T05:52:06.037 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter 2024-03-08T05:52:06.037 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-08T05:52:06.037 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-08T05:52:06.037 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-08T05:52:06.037 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-08T05:52:06.037 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-08T05:52:06.037 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-08T05:52:06.037 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-08T05:52:06.037 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-08T05:52:06.037 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-08T05:52:06.037 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-08T05:52:06.037 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-08T05:52:06.037 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-08T05:52:06.037 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-08T05:52:06.037 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-08T05:52:06.038 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-08T05:52:06.038 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-08T05:52:06.038 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-08T05:52:06.038 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-08T05:52:06.038 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-08T05:52:06.038 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-08T05:52:06.038 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-08T05:52:06.038 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-08T05:52:06.038 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-08T05:52:06.038 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-08T05:52:06.038 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/sit.ko 2024-03-08T05:52:06.038 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/tunnel6.ko 2024-03-08T05:52:06.038 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-08T05:52:06.038 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/key 2024-03-08T05:52:06.038 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/key/af_key.ko 2024-03-08T05:52:06.039 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp 2024-03-08T05:52:06.039 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_core.ko 2024-03-08T05:52:06.039 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-08T05:52:06.039 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_eth.ko 2024-03-08T05:52:06.039 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ip.ko 2024-03-08T05:52:06.039 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ip6.ko 2024-03-08T05:52:06.039 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_netlink.ko 2024-03-08T05:52:06.039 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ppp.ko 2024-03-08T05:52:06.039 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc 2024-03-08T05:52:06.039 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc/llc.ko 2024-03-08T05:52:06.039 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mac802154 2024-03-08T05:52:06.039 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mac802154/mac802154.ko 2024-03-08T05:52:06.039 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mpls 2024-03-08T05:52:06.039 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mpls/mpls_gso.ko 2024-03-08T05:52:06.039 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter 2024-03-08T05:52:06.040 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset 2024-03-08T05:52:06.040 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set.ko 2024-03-08T05:52:06.040 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-08T05:52:06.040 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-08T05:52:06.040 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-08T05:52:06.040 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-08T05:52:06.040 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-08T05:52:06.040 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-08T05:52:06.040 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-08T05:52:06.040 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-08T05:52:06.040 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-08T05:52:06.040 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-08T05:52:06.040 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-08T05:52:06.040 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-08T05:52:06.040 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-08T05:52:06.040 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-08T05:52:06.041 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-08T05:52:06.041 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs 2024-03-08T05:52:06.041 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-08T05:52:06.041 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-08T05:52:06.041 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-08T05:52:06.041 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-08T05:52:06.041 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-08T05:52:06.041 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-08T05:52:06.041 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-08T05:52:06.041 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-08T05:52:06.041 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-08T05:52:06.041 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-08T05:52:06.041 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-08T05:52:06.041 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-08T05:52:06.041 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-08T05:52:06.041 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-08T05:52:06.041 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conncount.ko 2024-03-08T05:52:06.041 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack.ko 2024-03-08T05:52:06.042 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-08T05:52:06.042 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-08T05:52:06.042 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-08T05:52:06.042 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-08T05:52:06.042 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-08T05:52:06.042 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-08T05:52:06.042 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-08T05:52:06.042 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-08T05:52:06.042 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-08T05:52:06.042 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-08T05:52:06.042 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-08T05:52:06.042 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-08T05:52:06.042 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-08T05:52:06.042 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_flow_table.ko 2024-03-08T05:52:06.042 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-08T05:52:06.043 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_log_syslog.ko 2024-03-08T05:52:06.043 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat.ko 2024-03-08T05:52:06.043 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-08T05:52:06.043 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-08T05:52:06.043 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_irc.ko 2024-03-08T05:52:06.043 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_sip.ko 2024-03-08T05:52:06.043 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-08T05:52:06.043 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-08T05:52:06.043 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_tables.ko 2024-03-08T05:52:06.043 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink.ko 2024-03-08T05:52:06.043 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-08T05:52:06.043 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_log.ko 2024-03-08T05:52:06.043 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-08T05:52:06.043 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-08T05:52:06.043 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_chain_nat.ko 2024-03-08T05:52:06.043 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_compat.ko 2024-03-08T05:52:06.043 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_ct.ko 2024-03-08T05:52:06.044 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-08T05:52:06.044 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_fib.ko 2024-03-08T05:52:06.044 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-08T05:52:06.044 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_hash.ko 2024-03-08T05:52:06.044 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_limit.ko 2024-03-08T05:52:06.044 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_log.ko 2024-03-08T05:52:06.044 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_masq.ko 2024-03-08T05:52:06.044 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_nat.ko 2024-03-08T05:52:06.044 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_numgen.ko 2024-03-08T05:52:06.044 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_queue.ko 2024-03-08T05:52:06.044 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_quota.ko 2024-03-08T05:52:06.044 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_redir.ko 2024-03-08T05:52:06.044 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_reject.ko 2024-03-08T05:52:06.044 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_reject_inet.ko 2024-03-08T05:52:06.044 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_socket.ko 2024-03-08T05:52:06.044 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_tunnel.ko 2024-03-08T05:52:06.044 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_AUDIT.ko 2024-03-08T05:52:06.045 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-08T05:52:06.045 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-08T05:52:06.045 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-08T05:52:06.045 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CT.ko 2024-03-08T05:52:06.045 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_DSCP.ko 2024-03-08T05:52:06.045 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_HL.ko 2024-03-08T05:52:06.045 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_HMARK.ko 2024-03-08T05:52:06.045 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-08T05:52:06.045 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_LED.ko 2024-03-08T05:52:06.045 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_LOG.ko 2024-03-08T05:52:06.045 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-08T05:52:06.045 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NETMAP.ko 2024-03-08T05:52:06.045 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NFLOG.ko 2024-03-08T05:52:06.045 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-08T05:52:06.045 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_RATEEST.ko 2024-03-08T05:52:06.045 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-08T05:52:06.046 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_SECMARK.ko 2024-03-08T05:52:06.046 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-08T05:52:06.046 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-08T05:52:06.046 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TEE.ko 2024-03-08T05:52:06.046 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TPROXY.ko 2024-03-08T05:52:06.046 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TRACE.ko 2024-03-08T05:52:06.046 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_addrtype.ko 2024-03-08T05:52:06.046 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_bpf.ko 2024-03-08T05:52:06.046 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cgroup.ko 2024-03-08T05:52:06.046 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cluster.ko 2024-03-08T05:52:06.046 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_comment.ko 2024-03-08T05:52:06.046 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connbytes.ko 2024-03-08T05:52:06.046 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connlabel.ko 2024-03-08T05:52:06.046 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connlimit.ko 2024-03-08T05:52:06.046 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connmark.ko 2024-03-08T05:52:06.047 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_conntrack.ko 2024-03-08T05:52:06.047 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cpu.ko 2024-03-08T05:52:06.047 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_dccp.ko 2024-03-08T05:52:06.047 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_devgroup.ko 2024-03-08T05:52:06.047 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_dscp.ko 2024-03-08T05:52:06.047 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ecn.ko 2024-03-08T05:52:06.047 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_esp.ko 2024-03-08T05:52:06.047 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_hashlimit.ko 2024-03-08T05:52:06.047 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_helper.ko 2024-03-08T05:52:06.047 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_hl.ko 2024-03-08T05:52:06.047 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ipcomp.ko 2024-03-08T05:52:06.047 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_iprange.ko 2024-03-08T05:52:06.047 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ipvs.ko 2024-03-08T05:52:06.047 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_l2tp.ko 2024-03-08T05:52:06.047 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_length.ko 2024-03-08T05:52:06.047 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_limit.ko 2024-03-08T05:52:06.047 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_mac.ko 2024-03-08T05:52:06.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_mark.ko 2024-03-08T05:52:06.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_multiport.ko 2024-03-08T05:52:06.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_nat.ko 2024-03-08T05:52:06.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_nfacct.ko 2024-03-08T05:52:06.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_osf.ko 2024-03-08T05:52:06.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_owner.ko 2024-03-08T05:52:06.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_physdev.ko 2024-03-08T05:52:06.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_pkttype.ko 2024-03-08T05:52:06.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_policy.ko 2024-03-08T05:52:06.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_quota.ko 2024-03-08T05:52:06.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_rateest.ko 2024-03-08T05:52:06.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_realm.ko 2024-03-08T05:52:06.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_recent.ko 2024-03-08T05:52:06.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_sctp.ko 2024-03-08T05:52:06.048 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_set.ko 2024-03-08T05:52:06.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_socket.ko 2024-03-08T05:52:06.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_state.ko 2024-03-08T05:52:06.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_statistic.ko 2024-03-08T05:52:06.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_string.ko 2024-03-08T05:52:06.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_tcpmss.ko 2024-03-08T05:52:06.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_time.ko 2024-03-08T05:52:06.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_u32.ko 2024-03-08T05:52:06.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netlink 2024-03-08T05:52:06.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netlink/netlink_diag.ko 2024-03-08T05:52:06.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/nsh 2024-03-08T05:52:06.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/nsh/nsh.ko 2024-03-08T05:52:06.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch 2024-03-08T05:52:06.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/openvswitch.ko 2024-03-08T05:52:06.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-geneve.ko 2024-03-08T05:52:06.049 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-gre.ko 2024-03-08T05:52:06.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-vxlan.ko 2024-03-08T05:52:06.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/packet 2024-03-08T05:52:06.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/packet/af_packet_diag.ko 2024-03-08T05:52:06.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds 2024-03-08T05:52:06.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds.ko 2024-03-08T05:52:06.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds_rdma.ko 2024-03-08T05:52:06.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds_tcp.ko 2024-03-08T05:52:06.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched 2024-03-08T05:52:06.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_csum.ko 2024-03-08T05:52:06.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_gact.ko 2024-03-08T05:52:06.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_mirred.ko 2024-03-08T05:52:06.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_nat.ko 2024-03-08T05:52:06.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_pedit.ko 2024-03-08T05:52:06.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_police.ko 2024-03-08T05:52:06.050 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_simple.ko 2024-03-08T05:52:06.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_skbedit.ko 2024-03-08T05:52:06.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_vlan.ko 2024-03-08T05:52:06.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_basic.ko 2024-03-08T05:52:06.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_bpf.ko 2024-03-08T05:52:06.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_flow.ko 2024-03-08T05:52:06.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_fw.ko 2024-03-08T05:52:06.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_route.ko 2024-03-08T05:52:06.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_u32.ko 2024-03-08T05:52:06.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_cmp.ko 2024-03-08T05:52:06.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_ipset.ko 2024-03-08T05:52:06.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_meta.ko 2024-03-08T05:52:06.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_nbyte.ko 2024-03-08T05:52:06.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_text.ko 2024-03-08T05:52:06.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_u32.ko 2024-03-08T05:52:06.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_choke.ko 2024-03-08T05:52:06.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_codel.ko 2024-03-08T05:52:06.051 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_drr.ko 2024-03-08T05:52:06.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_fq.ko 2024-03-08T05:52:06.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_gred.ko 2024-03-08T05:52:06.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_hfsc.ko 2024-03-08T05:52:06.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_hhf.ko 2024-03-08T05:52:06.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_htb.ko 2024-03-08T05:52:06.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_ingress.ko 2024-03-08T05:52:06.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_mqprio.ko 2024-03-08T05:52:06.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_mqprio_lib.ko 2024-03-08T05:52:06.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_multiq.ko 2024-03-08T05:52:06.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_netem.ko 2024-03-08T05:52:06.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_pie.ko 2024-03-08T05:52:06.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_plug.ko 2024-03-08T05:52:06.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_prio.ko 2024-03-08T05:52:06.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_qfq.ko 2024-03-08T05:52:06.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_red.ko 2024-03-08T05:52:06.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_sfb.ko 2024-03-08T05:52:06.052 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_sfq.ko 2024-03-08T05:52:06.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_tbf.ko 2024-03-08T05:52:06.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_teql.ko 2024-03-08T05:52:06.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp 2024-03-08T05:52:06.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/sctp.ko 2024-03-08T05:52:06.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/sctp_diag.ko 2024-03-08T05:52:06.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc 2024-03-08T05:52:06.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss 2024-03-08T05:52:06.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-08T05:52:06.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-08T05:52:06.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/sunrpc.ko 2024-03-08T05:52:06.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/xprtrdma 2024-03-08T05:52:06.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-08T05:52:06.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc 2024-03-08T05:52:06.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/diag.ko 2024-03-08T05:52:06.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/tipc.ko 2024-03-08T05:52:06.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/unix 2024-03-08T05:52:06.053 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/unix/unix_diag.ko 2024-03-08T05:52:06.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock 2024-03-08T05:52:06.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-08T05:52:06.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-08T05:52:06.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock.ko 2024-03-08T05:52:06.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-08T05:52:06.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-08T05:52:06.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm 2024-03-08T05:52:06.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-08T05:52:06.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security 2024-03-08T05:52:06.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys 2024-03-08T05:52:06.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/encrypted-keys 2024-03-08T05:52:06.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-08T05:52:06.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/trusted-keys 2024-03-08T05:52:06.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/trusted-keys/trusted.ko 2024-03-08T05:52:06.054 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt 2024-03-08T05:52:06.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/lib 2024-03-08T05:52:06.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/lib/irqbypass.ko 2024-03-08T05:52:06.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.alias 2024-03-08T05:52:06.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.alias.bin 2024-03-08T05:52:06.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin 2024-03-08T05:52:06.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.alias.bin 2024-03-08T05:52:06.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.bin 2024-03-08T05:52:06.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.modinfo 2024-03-08T05:52:06.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.dep 2024-03-08T05:52:06.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.dep.bin 2024-03-08T05:52:06.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.devname 2024-03-08T05:52:06.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.order 2024-03-08T05:52:06.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.softdep 2024-03-08T05:52:06.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.symbols 2024-03-08T05:52:06.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.symbols.bin 2024-03-08T05:52:06.055 INFO:teuthology.orchestra.run.smithi019.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/vmlinuz 2024-03-08T05:52:06.059 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc7-gdd5c1cd17167 2024-03-08T05:52:06.059 DEBUG:teuthology.orchestra.run.smithi019:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-08T05:52:06.083 INFO:teuthology.orchestra.run.smithi019.stdout:postinstall scriptlet (using /bin/sh): 2024-03-08T05:52:06.083 INFO:teuthology.orchestra.run.smithi019.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-08T05:52:06.083 INFO:teuthology.orchestra.run.smithi019.stdout: /usr/bin/kernel-install add 6.8.0-rc7-gdd5c1cd17167 /lib/modules/6.8.0-rc7-gdd5c1cd17167/vmlinuz 2024-03-08T05:52:06.083 INFO:teuthology.orchestra.run.smithi019.stdout:fi 2024-03-08T05:52:06.083 INFO:teuthology.orchestra.run.smithi019.stdout:for file in vmlinuz System.map config; do 2024-03-08T05:52:06.083 INFO:teuthology.orchestra.run.smithi019.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc7-gdd5c1cd17167/${file}" "/boot/${file}-6.8.0-rc7-gdd5c1cd17167"; then 2024-03-08T05:52:06.083 INFO:teuthology.orchestra.run.smithi019.stdout: cp "/lib/modules/6.8.0-rc7-gdd5c1cd17167/${file}" "/boot/${file}-6.8.0-rc7-gdd5c1cd17167" 2024-03-08T05:52:06.083 INFO:teuthology.orchestra.run.smithi019.stdout: fi 2024-03-08T05:52:06.083 INFO:teuthology.orchestra.run.smithi019.stdout:done 2024-03-08T05:52:06.083 INFO:teuthology.orchestra.run.smithi019.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-08T05:52:06.083 INFO:teuthology.orchestra.run.smithi019.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-08T05:52:06.084 INFO:teuthology.orchestra.run.smithi019.stdout:new-kernel-pkg --remove 6.8.0-rc7-gdd5c1cd17167 --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc7-gdd5c1cd17167.img 2024-03-08T05:52:06.084 INFO:teuthology.orchestra.run.smithi019.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-08T05:52:06.084 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-install remove 6.8.0-rc7-gdd5c1cd17167 2024-03-08T05:52:06.084 INFO:teuthology.orchestra.run.smithi019.stdout:fi 2024-03-08T05:52:06.084 INFO:teuthology.orchestra.run.smithi019.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-08T05:52:06.084 INFO:teuthology.orchestra.run.smithi019.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-08T05:52:06.084 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/update-bootloader --remove 6.8.0-rc7-gdd5c1cd17167 2024-03-08T05:52:06.084 INFO:teuthology.orchestra.run.smithi019.stdout:fi 2024-03-08T05:52:06.085 DEBUG:teuthology.orchestra.run.smithi019:> sudo rpm -qi grub2-tools 2024-03-08T05:52:06.172 INFO:teuthology.orchestra.run.smithi019.stdout:Name : grub2-tools 2024-03-08T05:52:06.172 INFO:teuthology.orchestra.run.smithi019.stdout:Epoch : 1 2024-03-08T05:52:06.172 INFO:teuthology.orchestra.run.smithi019.stdout:Version : 2.06 2024-03-08T05:52:06.172 INFO:teuthology.orchestra.run.smithi019.stdout:Release : 68.el9 2024-03-08T05:52:06.172 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: x86_64 2024-03-08T05:52:06.172 INFO:teuthology.orchestra.run.smithi019.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-08T05:52:06.172 INFO:teuthology.orchestra.run.smithi019.stdout:Group : Unspecified 2024-03-08T05:52:06.173 INFO:teuthology.orchestra.run.smithi019.stdout:Size : 8264254 2024-03-08T05:52:06.173 INFO:teuthology.orchestra.run.smithi019.stdout:License : GPLv3+ 2024-03-08T05:52:06.173 INFO:teuthology.orchestra.run.smithi019.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-08T05:52:06.173 INFO:teuthology.orchestra.run.smithi019.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-08T05:52:06.173 INFO:teuthology.orchestra.run.smithi019.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-08T05:52:06.173 INFO:teuthology.orchestra.run.smithi019.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-08T05:52:06.173 INFO:teuthology.orchestra.run.smithi019.stdout:Packager : builder@centos.org 2024-03-08T05:52:06.173 INFO:teuthology.orchestra.run.smithi019.stdout:Vendor : CentOS 2024-03-08T05:52:06.173 INFO:teuthology.orchestra.run.smithi019.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-08T05:52:06.173 INFO:teuthology.orchestra.run.smithi019.stdout:Summary : Support tools for GRUB. 2024-03-08T05:52:06.173 INFO:teuthology.orchestra.run.smithi019.stdout:Description : 2024-03-08T05:52:06.173 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T05:52:06.173 INFO:teuthology.orchestra.run.smithi019.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-08T05:52:06.173 INFO:teuthology.orchestra.run.smithi019.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-08T05:52:06.173 INFO:teuthology.orchestra.run.smithi019.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-08T05:52:06.174 INFO:teuthology.orchestra.run.smithi019.stdout:hardware devices. 2024-03-08T05:52:06.174 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T05:52:06.174 INFO:teuthology.orchestra.run.smithi019.stdout:This subpackage provides tools for support of all platforms. 2024-03-08T05:52:06.174 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-08T05:52:06.175 INFO:teuthology.task.kernel:Updating grub on smithi019 to boot 6.8.0-rc7-gdd5c1cd17167 2024-03-08T05:52:06.175 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-08T05:52:06.699 INFO:teuthology.orchestra.run.smithi019.stderr:Generating grub configuration file ... 2024-03-08T05:52:08.041 INFO:teuthology.orchestra.run.smithi019.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-08T05:52:08.087 INFO:teuthology.orchestra.run.smithi019.stderr:done 2024-03-08T05:52:08.089 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-03-08T05:52:08.104 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.zIjGFrsV36 2024-03-08T05:52:08.104 DEBUG:teuthology.orchestra.run.smithi019:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.zIjGFrsV36 2024-03-08T05:52:08.176 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.zIjGFrsV36 2024-03-08T05:52:08.314 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.zIjGFrsV36 is 6KB 2024-03-08T05:52:08.362 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.zIjGFrsV36 2024-03-08T05:52:08.376 DEBUG:teuthology.orchestra.run.smithi019:> sudo /bin/ls /boot/loader/entries || true 2024-03-08T05:52:08.446 INFO:teuthology.orchestra.run.smithi019.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-08T05:52:08.447 INFO:teuthology.orchestra.run.smithi019.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-08T05:52:08.447 INFO:teuthology.orchestra.run.smithi019.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-08T05:52:08.447 INFO:teuthology.orchestra.run.smithi019.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc7-gdd5c1cd17167.conf 2024-03-08T05:52:08.448 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc7-gdd5c1cd17167 2024-03-08T05:52:08.638 DEBUG:teuthology.orchestra.run.smithi019:> sudo shutdown -r now 2024-03-08T05:52:12.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-03-08T05:52:12.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T05:52:38.658 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-08T05:52:38.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-03-08T05:52:38.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T05:53:12.914 DEBUG:teuthology.orchestra.remote:timed out 2024-03-08T05:53:24.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-03-08T05:53:24.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T05:53:25.322 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-03-08T05:53:25.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-03-08T05:53:25.966 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.8.0-rc7-gdd5c1cd17167"... 2024-03-08T05:53:25.966 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2024-03-08T05:53:26.022 INFO:teuthology.orchestra.run.smithi042.stdout:6.8.0-rc7-gdd5c1cd17167 2024-03-08T05:53:26.022 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc7-gdd5c1cd17167 vs 6.8.0-rc7-gdd5c1cd17167 2024-03-08T05:53:26.022 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-08T05:53:26.022 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-08T05:53:27.023 DEBUG:teuthology.parallel:result is None 2024-03-08T05:53:38.665 DEBUG:teuthology.orchestra.remote:timed out 2024-03-08T05:53:47.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-03-08T05:53:47.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T05:53:51.121 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-03-08T05:53:51.829 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-03-08T05:53:51.830 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-rc7-gdd5c1cd17167"... 2024-03-08T05:53:51.830 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-03-08T05:53:51.886 INFO:teuthology.orchestra.run.smithi019.stdout:6.8.0-rc7-gdd5c1cd17167 2024-03-08T05:53:51.886 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc7-gdd5c1cd17167 vs 6.8.0-rc7-gdd5c1cd17167 2024-03-08T05:53:51.886 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-08T05:53:51.886 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-08T05:53:52.889 DEBUG:teuthology.parallel:result is None 2024-03-08T05:53:52.890 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-08T05:53:52.897 INFO:teuthology.task.internal:Creating test directory... 2024-03-08T05:53:52.897 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-08T05:53:52.904 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-08T05:53:52.964 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-08T05:53:52.971 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-08T05:53:53.039 INFO:teuthology.task.internal:Creating archive directory... 2024-03-08T05:53:53.040 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-08T05:53:53.045 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-08T05:53:53.113 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-08T05:53:53.120 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-08T05:53:53.121 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-08T05:53:53.126 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-08T05:53:53.275 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-08T05:53:53.310 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-08T05:53:53.345 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-08T05:53:53.378 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-08T05:53:53.383 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-08T05:53:53.390 INFO:teuthology.task.internal:Configuring sudo... 2024-03-08T05:53:53.391 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-08T05:53:53.395 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-08T05:53:53.491 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-08T05:53:53.501 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-08T05:53:53.501 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-08T05:53:53.507 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-08T05:53:53.566 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-08T05:53:53.642 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-08T05:53:53.723 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-08T05:53:53.799 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-08T05:53:53.887 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T05:53:53.888 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-08T05:53:53.993 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-08T05:53:54.085 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-08T05:53:54.203 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-08T05:53:54.292 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-08T05:53:54.398 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T05:53:54.398 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-08T05:53:54.501 DEBUG:teuthology.orchestra.run.smithi019:> sudo service rsyslog restart 2024-03-08T05:53:54.506 DEBUG:teuthology.orchestra.run.smithi042:> sudo service rsyslog restart 2024-03-08T05:53:54.597 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-08T05:53:54.679 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-08T05:53:55.041 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-08T05:53:55.049 INFO:teuthology.task.internal:Starting timer... 2024-03-08T05:53:55.049 INFO:teuthology.run_tasks:Running task pcp... 2024-03-08T05:53:55.061 INFO:teuthology.run_tasks:Running task selinux... 2024-03-08T05:53:55.071 DEBUG:teuthology.orchestra.run.smithi019:> sudo service auditd rotate 2024-03-08T05:53:55.187 INFO:teuthology.orchestra.run.smithi019.stdout:Rotating logs: 2024-03-08T05:53:55.191 DEBUG:teuthology.orchestra.run.smithi042:> sudo service auditd rotate 2024-03-08T05:53:55.329 INFO:teuthology.orchestra.run.smithi042.stdout:Rotating logs: 2024-03-08T05:53:55.334 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-08T05:53:55.334 DEBUG:teuthology.orchestra.run.smithi019:> /usr/sbin/getenforce 2024-03-08T05:53:55.390 INFO:teuthology.orchestra.run.smithi019.stdout:Permissive 2024-03-08T05:53:55.390 DEBUG:teuthology.orchestra.run.smithi042:> /usr/sbin/getenforce 2024-03-08T05:53:55.447 INFO:teuthology.orchestra.run.smithi042.stdout:Permissive 2024-03-08T05:53:55.448 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi019.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi042.front.sepia.ceph.com': 'permissive'} 2024-03-08T05:53:55.448 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-08T05:53:55.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T05:53:55.530 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-08T05:53:55.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T05:53:55.617 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-08T05:53:55.617 DEBUG:teuthology.orchestra.run.smithi019:> sudo /usr/sbin/setenforce permissive 2024-03-08T05:53:55.721 DEBUG:teuthology.orchestra.run.smithi042:> sudo /usr/sbin/setenforce permissive 2024-03-08T05:53:55.819 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-08T05:53:55.830 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-08T05:53:55.834 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-08T05:53:55.949 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-08T05:53:55.964 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-08T05:53:55.966 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi019.front.sepia.ceph.com,smithi042.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-08T06:00:03.655 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi019.front.sepia.ceph.com'), Remote(name='ubuntu@smithi042.front.sepia.ceph.com')] 2024-03-08T06:00:03.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-03-08T06:00:03.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T06:00:03.803 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-03-08T06:00:03.963 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-03-08T06:00:03.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-03-08T06:00:03.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-08T06:00:04.103 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-03-08T06:00:04.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-03-08T06:00:04.258 INFO:teuthology.run_tasks:Running task clock... 2024-03-08T06:00:04.270 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-08T06:00:04.270 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-08T06:00:04.271 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-08T06:00:04.278 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-08T06:00:04.279 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-08T06:00:04.382 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-08T06:00:04.385 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-08T06:00:04.439 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-08T06:00:04.440 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-08T06:00:04.535 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: ntpd: command not found 2024-03-08T06:00:04.538 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: ntpd: command not found 2024-03-08T06:00:04.575 INFO:teuthology.orchestra.run.smithi019.stdout:506 Cannot talk to daemon 2024-03-08T06:00:04.586 INFO:teuthology.orchestra.run.smithi042.stdout:506 Cannot talk to daemon 2024-03-08T06:00:04.629 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-08T06:00:04.641 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-08T06:00:04.685 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-08T06:00:04.699 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-08T06:00:04.818 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-03-08T06:00:04.827 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-08T06:00:04.828 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-03-08T06:00:04.828 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-08T06:00:04.828 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-08T06:00:04.828 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-08T06:00:04.828 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-08T06:00:04.835 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-03-08T06:00:04.843 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-08T06:00:04.843 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-03-08T06:00:04.843 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-08T06:00:04.843 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-08T06:00:04.843 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-08T06:00:04.844 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-08T06:00:04.845 INFO:teuthology.run_tasks:Running task install... 2024-03-08T06:00:04.854 DEBUG:teuthology.task.install:project ceph 2024-03-08T06:00:04.854 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'}} 2024-03-08T06:00:04.854 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'} 2024-03-08T06:00:04.854 INFO:teuthology.task.install:Using flavor: default 2024-03-08T06:00:04.860 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-08T06:00:04.860 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-08T06:00:04.860 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'tag': None, 'wait_for_package': False} 2024-03-08T06:00:04.861 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-03-08T06:00:04.863 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'tag': None, 'wait_for_package': False} 2024-03-08T06:00:04.863 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-03-08T06:00:05.089 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/1fb5d10608dccee73edd6ef8a2c7b804a097c324/centos/9/flavors/default/ 2024-03-08T06:00:05.089 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1670.g1fb5d106 2024-03-08T06:00:05.092 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/1fb5d10608dccee73edd6ef8a2c7b804a097c324/centos/9/flavors/default/ 2024-03-08T06:00:05.092 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1670.g1fb5d106 2024-03-08T06:00:05.433 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/1fb5d10608dccee73edd6ef8a2c7b804a097c324/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/1fb5d10608dccee73edd6ef8a2c7b804a097c324/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/1fb5d10608dccee73edd6ef8a2c7b804a097c324/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-08T06:00:05.433 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:00:05.433 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-08T06:00:05.445 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/1fb5d10608dccee73edd6ef8a2c7b804a097c324/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/1fb5d10608dccee73edd6ef8a2c7b804a097c324/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/1fb5d10608dccee73edd6ef8a2c7b804a097c324/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-08T06:00:05.445 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:00:05.445 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-08T06:00:05.538 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-08T06:00:05.539 DEBUG:teuthology.orchestra.run.smithi042:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1fb5d10608dccee73edd6ef8a2c7b804a097c324/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-08T06:00:05.550 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-08T06:00:05.550 DEBUG:teuthology.orchestra.run.smithi019:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1fb5d10608dccee73edd6ef8a2c7b804a097c324/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-08T06:00:05.684 DEBUG:teuthology.orchestra.run.smithi042:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-08T06:00:05.694 DEBUG:teuthology.orchestra.run.smithi019:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-08T06:00:05.823 DEBUG:teuthology.orchestra.run.smithi042:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-08T06:00:05.840 DEBUG:teuthology.orchestra.run.smithi019:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-08T06:00:05.918 INFO:teuthology.orchestra.run.smithi042.stdout:check_obsoletes = 1 2024-03-08T06:00:05.923 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum clean all 2024-03-08T06:00:05.937 INFO:teuthology.orchestra.run.smithi019.stdout:check_obsoletes = 1 2024-03-08T06:00:05.941 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum clean all 2024-03-08T06:00:06.286 INFO:teuthology.orchestra.run.smithi042.stdout:74 files removed 2024-03-08T06:00:06.315 INFO:teuthology.orchestra.run.smithi019.stdout:74 files removed 2024-03-08T06:00:06.325 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-08T06:00:06.355 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-08T06:00:07.551 INFO:teuthology.orchestra.run.smithi042.stdout:ceph packages for x86_64 116 kB/s | 82 kB 00:00 2024-03-08T06:00:07.585 INFO:teuthology.orchestra.run.smithi019.stdout:ceph packages for x86_64 116 kB/s | 82 kB 00:00 2024-03-08T06:00:08.252 INFO:teuthology.orchestra.run.smithi019.stdout:ceph noarch packages 18 kB/s | 10 kB 00:00 2024-03-08T06:00:08.309 INFO:teuthology.orchestra.run.smithi042.stdout:ceph noarch packages 15 kB/s | 10 kB 00:00 2024-03-08T06:00:08.786 INFO:teuthology.orchestra.run.smithi019.stdout:ceph source packages 4.2 kB/s | 1.9 kB 00:00 2024-03-08T06:00:08.810 INFO:teuthology.orchestra.run.smithi042.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2024-03-08T06:00:09.615 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS-9 - AppStream 8.9 MB/s | 6.7 MB 00:00 2024-03-08T06:00:09.622 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS-9 - AppStream 9.1 MB/s | 6.7 MB 00:00 2024-03-08T06:00:11.333 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS-9 - BaseOS 5.6 MB/s | 2.0 MB 00:00 2024-03-08T06:00:11.414 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS-9 - BaseOS 5.1 MB/s | 2.0 MB 00:00 2024-03-08T06:00:12.362 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-03-08T06:00:13.368 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - BaseOS 5.2 MB/s | 8.0 MB 00:01 2024-03-08T06:00:14.711 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-03-08T06:00:16.778 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - AppStream 8.8 MB/s | 19 MB 00:02 2024-03-08T06:00:19.315 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 6.1 MB 00:00 2024-03-08T06:00:20.906 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 15 kB 00:00 2024-03-08T06:00:23.000 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-03-08T06:00:23.062 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.1 MB 00:02 2024-03-08T06:00:24.843 INFO:teuthology.orchestra.run.smithi042.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 15 kB 00:00 2024-03-08T06:00:26.537 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-03-08T06:00:29.000 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-03-08T06:00:31.838 INFO:teuthology.orchestra.run.smithi019.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-08T06:00:31.840 INFO:teuthology.orchestra.run.smithi019.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-08T06:00:31.861 INFO:teuthology.orchestra.run.smithi019.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-08T06:00:31.862 INFO:teuthology.orchestra.run.smithi019.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-08T06:00:31.864 INFO:teuthology.orchestra.run.smithi019.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-08T06:00:31.865 INFO:teuthology.orchestra.run.smithi019.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-08T06:00:31.868 INFO:teuthology.orchestra.run.smithi019.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-08T06:00:31.871 INFO:teuthology.orchestra.run.smithi019.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-08T06:00:31.873 INFO:teuthology.orchestra.run.smithi019.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-08T06:00:31.967 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-03-08T06:00:31.989 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================================ 2024-03-08T06:00:31.989 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-03-08T06:00:31.989 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================================ 2024-03-08T06:00:31.989 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-03-08T06:00:31.989 INFO:teuthology.orchestra.run.smithi019.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-08T06:00:31.989 INFO:teuthology.orchestra.run.smithi019.stdout: ceph x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 6.6 k 2024-03-08T06:00:31.989 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 5.3 M 2024-03-08T06:00:31.989 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 887 k 2024-03-08T06:00:31.989 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 145 k 2024-03-08T06:00:31.989 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 1.5 M 2024-03-08T06:00:31.990 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 138 k 2024-03-08T06:00:31.990 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 1.8 M 2024-03-08T06:00:31.990 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 7.4 M 2024-03-08T06:00:31.990 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 49 k 2024-03-08T06:00:31.990 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 9.8 M 2024-03-08T06:00:31.990 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 47 M 2024-03-08T06:00:31.990 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 264 k 2024-03-08T06:00:31.990 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 748 k 2024-03-08T06:00:31.990 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-mirror x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 220 k 2024-03-08T06:00:31.990 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-shell x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 27 k 2024-03-08T06:00:31.990 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-top noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 18 k 2024-03-08T06:00:31.990 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-08T06:00:31.990 INFO:teuthology.orchestra.run.smithi019.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-08T06:00:31.991 INFO:teuthology.orchestra.run.smithi019.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-08T06:00:31.991 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 31 k 2024-03-08T06:00:31.991 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2 x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 745 k 2024-03-08T06:00:31.991 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 127 k 2024-03-08T06:00:31.991 INFO:teuthology.orchestra.run.smithi019.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-08T06:00:31.991 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-08T06:00:31.991 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-08T06:00:31.991 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-08T06:00:31.991 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-08T06:00:31.991 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-08T06:00:31.991 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 162 k 2024-03-08T06:00:31.991 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 320 k 2024-03-08T06:00:31.991 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 298 k 2024-03-08T06:00:31.991 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 99 k 2024-03-08T06:00:31.991 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 85 k 2024-03-08T06:00:31.992 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 3.1 M 2024-03-08T06:00:31.992 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 170 k 2024-03-08T06:00:31.992 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-08T06:00:31.992 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrading: 2024-03-08T06:00:31.992 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-08T06:00:31.992 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-08T06:00:31.992 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-08T06:00:31.992 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-08T06:00:31.992 INFO:teuthology.orchestra.run.smithi019.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-08T06:00:31.992 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-08T06:00:31.992 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-08T06:00:31.992 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-08T06:00:31.992 INFO:teuthology.orchestra.run.smithi019.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-08T06:00:31.992 INFO:teuthology.orchestra.run.smithi019.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-08T06:00:31.992 INFO:teuthology.orchestra.run.smithi019.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-08T06:00:31.992 INFO:teuthology.orchestra.run.smithi019.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-08T06:00:31.993 INFO:teuthology.orchestra.run.smithi019.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-08T06:00:31.993 INFO:teuthology.orchestra.run.smithi019.stdout: librados2 x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 3.4 M 2024-03-08T06:00:31.993 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1 x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 3.1 M 2024-03-08T06:00:31.993 INFO:teuthology.orchestra.run.smithi019.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-08T06:00:31.993 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-08T06:00:31.993 INFO:teuthology.orchestra.run.smithi019.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-08T06:00:31.993 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-08T06:00:31.993 INFO:teuthology.orchestra.run.smithi019.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-08T06:00:31.993 INFO:teuthology.orchestra.run.smithi019.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-08T06:00:31.993 INFO:teuthology.orchestra.run.smithi019.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-08T06:00:31.993 INFO:teuthology.orchestra.run.smithi019.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-08T06:00:31.993 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-08T06:00:31.993 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-03-08T06:00:31.993 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-08T06:00:31.993 INFO:teuthology.orchestra.run.smithi019.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-08T06:00:31.994 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-08T06:00:31.994 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 20 M 2024-03-08T06:00:31.994 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 31 k 2024-03-08T06:00:31.994 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 2.1 M 2024-03-08T06:00:31.994 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 248 k 2024-03-08T06:00:31.994 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 4.7 M 2024-03-08T06:00:31.994 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 17 M 2024-03-08T06:00:31.994 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 15 k 2024-03-08T06:00:31.994 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 25 k 2024-03-08T06:00:31.994 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-08T06:00:31.994 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-08T06:00:31.994 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-08T06:00:31.994 INFO:teuthology.orchestra.run.smithi019.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-08T06:00:31.994 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-08T06:00:31.994 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-08T06:00:31.994 INFO:teuthology.orchestra.run.smithi019.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-08T06:00:31.995 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-08T06:00:31.995 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-08T06:00:31.995 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 163 k 2024-03-08T06:00:31.995 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-08T06:00:31.995 INFO:teuthology.orchestra.run.smithi019.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-08T06:00:31.995 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-08T06:00:31.995 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-08T06:00:31.995 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-08T06:00:31.995 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1 x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 501 k 2024-03-08T06:00:31.995 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-08T06:00:31.995 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2 x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 5.1 M 2024-03-08T06:00:31.995 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-08T06:00:31.995 INFO:teuthology.orchestra.run.smithi019.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-08T06:00:31.995 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-08T06:00:31.995 INFO:teuthology.orchestra.run.smithi019.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-08T06:00:31.995 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-08T06:00:31.996 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-08T06:00:31.996 INFO:teuthology.orchestra.run.smithi019.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-08T06:00:31.996 INFO:teuthology.orchestra.run.smithi019.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-08T06:00:31.996 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-08T06:00:31.996 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-08T06:00:31.996 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-08T06:00:31.996 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-08T06:00:31.996 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-08T06:00:31.996 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-08T06:00:31.996 INFO:teuthology.orchestra.run.smithi019.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-08T06:00:31.996 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-08T06:00:31.996 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-08T06:00:31.996 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-08T06:00:31.996 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 45 k 2024-03-08T06:00:31.996 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 131 k 2024-03-08T06:00:31.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-08T06:00:31.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-08T06:00:31.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-08T06:00:31.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-08T06:00:31.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-08T06:00:31.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-08T06:00:31.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-08T06:00:31.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-08T06:00:31.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-08T06:00:31.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-08T06:00:31.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-08T06:00:31.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-08T06:00:31.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-08T06:00:31.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-08T06:00:31.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-08T06:00:31.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-08T06:00:31.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-08T06:00:31.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-08T06:00:31.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-08T06:00:31.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-08T06:00:31.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-08T06:00:31.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-08T06:00:31.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-08T06:00:31.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-08T06:00:31.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-08T06:00:31.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-08T06:00:31.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-08T06:00:31.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-08T06:00:31.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-08T06:00:31.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-08T06:00:31.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-08T06:00:31.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-08T06:00:31.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-08T06:00:31.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-08T06:00:31.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-08T06:00:31.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-08T06:00:31.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-08T06:00:31.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-08T06:00:31.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-08T06:00:31.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-08T06:00:31.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-08T06:00:31.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-08T06:00:31.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-08T06:00:31.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-08T06:00:31.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-08T06:00:31.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-08T06:00:32.000 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-08T06:00:32.000 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-08T06:00:32.000 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-08T06:00:32.000 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-08T06:00:32.000 INFO:teuthology.orchestra.run.smithi019.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-08T06:00:32.000 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-08T06:00:32.000 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-08T06:00:32.000 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-08T06:00:32.000 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-08T06:00:32.000 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-08T06:00:32.000 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-08T06:00:32.000 INFO:teuthology.orchestra.run.smithi019.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-08T06:00:32.000 INFO:teuthology.orchestra.run.smithi019.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-08T06:00:32.000 INFO:teuthology.orchestra.run.smithi019.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-08T06:00:32.001 INFO:teuthology.orchestra.run.smithi019.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-08T06:00:32.001 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-08T06:00:32.001 INFO:teuthology.orchestra.run.smithi019.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-08T06:00:32.001 INFO:teuthology.orchestra.run.smithi019.stdout:Installing weak dependencies: 2024-03-08T06:00:32.001 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-08T06:00:32.001 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:00:32.001 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-03-08T06:00:32.001 INFO:teuthology.orchestra.run.smithi019.stdout:============================================================================================ 2024-03-08T06:00:32.001 INFO:teuthology.orchestra.run.smithi019.stdout:Install 150 Packages 2024-03-08T06:00:32.001 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrade 24 Packages 2024-03-08T06:00:32.001 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:00:32.002 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 223 M 2024-03-08T06:00:32.002 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-03-08T06:00:32.448 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-03-08T06:00:33.152 INFO:teuthology.orchestra.run.smithi019.stdout:(1/174): ceph-19.0.0-1670.g1fb5d106.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-03-08T06:00:34.227 INFO:teuthology.orchestra.run.smithi019.stdout:(2/174): ceph-fuse-19.0.0-1670.g1fb5d106.el9.x8 826 kB/s | 887 kB 00:01 2024-03-08T06:00:34.435 INFO:teuthology.orchestra.run.smithi019.stdout:(3/174): ceph-immutable-object-cache-19.0.0-167 700 kB/s | 145 kB 00:00 2024-03-08T06:00:35.277 INFO:teuthology.orchestra.run.smithi019.stdout:(4/174): ceph-mds-19.0.0-1670.g1fb5d106.el9.x86 2.5 MB/s | 2.1 MB 00:00 2024-03-08T06:00:35.360 INFO:teuthology.orchestra.run.smithi042.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-08T06:00:35.362 INFO:teuthology.orchestra.run.smithi042.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-08T06:00:35.388 INFO:teuthology.orchestra.run.smithi042.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-08T06:00:35.389 INFO:teuthology.orchestra.run.smithi042.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-08T06:00:35.391 INFO:teuthology.orchestra.run.smithi042.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-08T06:00:35.393 INFO:teuthology.orchestra.run.smithi042.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-08T06:00:35.396 INFO:teuthology.orchestra.run.smithi042.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-08T06:00:35.400 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-08T06:00:35.401 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-08T06:00:35.499 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2024-03-08T06:00:35.517 INFO:teuthology.orchestra.run.smithi042.stdout:============================================================================================ 2024-03-08T06:00:35.518 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2024-03-08T06:00:35.518 INFO:teuthology.orchestra.run.smithi042.stdout:============================================================================================ 2024-03-08T06:00:35.518 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2024-03-08T06:00:35.518 INFO:teuthology.orchestra.run.smithi042.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-08T06:00:35.518 INFO:teuthology.orchestra.run.smithi042.stdout: ceph x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 6.6 k 2024-03-08T06:00:35.518 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 5.3 M 2024-03-08T06:00:35.518 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 887 k 2024-03-08T06:00:35.518 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 145 k 2024-03-08T06:00:35.518 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 1.5 M 2024-03-08T06:00:35.518 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 138 k 2024-03-08T06:00:35.518 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 1.8 M 2024-03-08T06:00:35.518 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 7.4 M 2024-03-08T06:00:35.518 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 49 k 2024-03-08T06:00:35.519 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 9.8 M 2024-03-08T06:00:35.519 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 47 M 2024-03-08T06:00:35.519 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 264 k 2024-03-08T06:00:35.519 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 748 k 2024-03-08T06:00:35.519 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-mirror x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 220 k 2024-03-08T06:00:35.519 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-shell x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 27 k 2024-03-08T06:00:35.519 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-top noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 18 k 2024-03-08T06:00:35.519 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-08T06:00:35.519 INFO:teuthology.orchestra.run.smithi042.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-08T06:00:35.519 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-08T06:00:35.519 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 31 k 2024-03-08T06:00:35.519 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2 x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 745 k 2024-03-08T06:00:35.519 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 127 k 2024-03-08T06:00:35.519 INFO:teuthology.orchestra.run.smithi042.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-08T06:00:35.520 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-08T06:00:35.520 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-08T06:00:35.520 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-08T06:00:35.520 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-08T06:00:35.520 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-08T06:00:35.520 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 162 k 2024-03-08T06:00:35.520 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 320 k 2024-03-08T06:00:35.520 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 298 k 2024-03-08T06:00:35.520 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 99 k 2024-03-08T06:00:35.520 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 85 k 2024-03-08T06:00:35.520 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 3.1 M 2024-03-08T06:00:35.520 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 170 k 2024-03-08T06:00:35.521 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-08T06:00:35.521 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrading: 2024-03-08T06:00:35.521 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-08T06:00:35.521 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-08T06:00:35.521 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-08T06:00:35.521 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-08T06:00:35.521 INFO:teuthology.orchestra.run.smithi042.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-08T06:00:35.521 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-08T06:00:35.521 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-08T06:00:35.521 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-08T06:00:35.521 INFO:teuthology.orchestra.run.smithi042.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-08T06:00:35.521 INFO:teuthology.orchestra.run.smithi042.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-08T06:00:35.521 INFO:teuthology.orchestra.run.smithi042.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-08T06:00:35.521 INFO:teuthology.orchestra.run.smithi042.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-08T06:00:35.522 INFO:teuthology.orchestra.run.smithi042.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-08T06:00:35.522 INFO:teuthology.orchestra.run.smithi042.stdout: librados2 x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 3.4 M 2024-03-08T06:00:35.522 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1 x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 3.1 M 2024-03-08T06:00:35.522 INFO:teuthology.orchestra.run.smithi042.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-08T06:00:35.522 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-08T06:00:35.522 INFO:teuthology.orchestra.run.smithi042.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-08T06:00:35.522 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-08T06:00:35.522 INFO:teuthology.orchestra.run.smithi042.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-08T06:00:35.522 INFO:teuthology.orchestra.run.smithi042.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-08T06:00:35.522 INFO:teuthology.orchestra.run.smithi042.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-08T06:00:35.522 INFO:teuthology.orchestra.run.smithi042.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-08T06:00:35.522 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-08T06:00:35.522 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2024-03-08T06:00:35.523 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-08T06:00:35.523 INFO:teuthology.orchestra.run.smithi042.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-08T06:00:35.523 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-08T06:00:35.523 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 20 M 2024-03-08T06:00:35.523 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 31 k 2024-03-08T06:00:35.523 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 2.1 M 2024-03-08T06:00:35.523 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 248 k 2024-03-08T06:00:35.523 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 4.7 M 2024-03-08T06:00:35.523 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 17 M 2024-03-08T06:00:35.523 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1670.g1fb5d106.el9 ceph-noarch 15 k 2024-03-08T06:00:35.523 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 25 k 2024-03-08T06:00:35.523 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-08T06:00:35.523 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-08T06:00:35.523 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-08T06:00:35.523 INFO:teuthology.orchestra.run.smithi042.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-08T06:00:35.524 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-08T06:00:35.524 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-08T06:00:35.524 INFO:teuthology.orchestra.run.smithi042.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-08T06:00:35.524 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-08T06:00:35.524 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-08T06:00:35.524 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 163 k 2024-03-08T06:00:35.524 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-08T06:00:35.524 INFO:teuthology.orchestra.run.smithi042.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-08T06:00:35.524 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-08T06:00:35.524 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-08T06:00:35.524 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-08T06:00:35.524 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1 x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 501 k 2024-03-08T06:00:35.524 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-08T06:00:35.524 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2 x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 5.1 M 2024-03-08T06:00:35.524 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-08T06:00:35.525 INFO:teuthology.orchestra.run.smithi042.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-08T06:00:35.525 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-08T06:00:35.525 INFO:teuthology.orchestra.run.smithi042.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-08T06:00:35.525 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-08T06:00:35.525 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-08T06:00:35.525 INFO:teuthology.orchestra.run.smithi042.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-08T06:00:35.525 INFO:teuthology.orchestra.run.smithi042.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-08T06:00:35.525 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-08T06:00:35.525 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-08T06:00:35.525 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-08T06:00:35.525 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-08T06:00:35.525 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-08T06:00:35.525 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-08T06:00:35.525 INFO:teuthology.orchestra.run.smithi042.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-08T06:00:35.526 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-08T06:00:35.526 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-08T06:00:35.526 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-08T06:00:35.526 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 45 k 2024-03-08T06:00:35.526 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common x86_64 2:19.0.0-1670.g1fb5d106.el9 ceph 131 k 2024-03-08T06:00:35.526 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-08T06:00:35.526 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-08T06:00:35.526 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-08T06:00:35.526 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-08T06:00:35.526 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-08T06:00:35.526 INFO:teuthology.orchestra.run.smithi042.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-08T06:00:35.526 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-08T06:00:35.526 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-08T06:00:35.526 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-08T06:00:35.527 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-08T06:00:35.527 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-08T06:00:35.527 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-08T06:00:35.527 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-08T06:00:35.527 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-08T06:00:35.527 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-08T06:00:35.527 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-08T06:00:35.527 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-08T06:00:35.527 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-08T06:00:35.527 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-08T06:00:35.527 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-08T06:00:35.527 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-08T06:00:35.527 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-08T06:00:35.527 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-08T06:00:35.527 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-08T06:00:35.528 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-08T06:00:35.528 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-08T06:00:35.528 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-08T06:00:35.528 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-08T06:00:35.528 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-08T06:00:35.528 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-08T06:00:35.528 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-08T06:00:35.528 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-08T06:00:35.528 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-08T06:00:35.528 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-08T06:00:35.528 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-08T06:00:35.528 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-08T06:00:35.528 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-08T06:00:35.528 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-08T06:00:35.528 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-08T06:00:35.529 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-08T06:00:35.529 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-08T06:00:35.529 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-08T06:00:35.529 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-08T06:00:35.529 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-08T06:00:35.529 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-08T06:00:35.529 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-08T06:00:35.529 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-08T06:00:35.529 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-08T06:00:35.529 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-08T06:00:35.529 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-08T06:00:35.529 INFO:teuthology.orchestra.run.smithi042.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-08T06:00:35.529 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-08T06:00:35.529 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-08T06:00:35.529 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-08T06:00:35.529 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-08T06:00:35.530 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-08T06:00:35.530 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-08T06:00:35.530 INFO:teuthology.orchestra.run.smithi042.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-08T06:00:35.530 INFO:teuthology.orchestra.run.smithi042.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-08T06:00:35.530 INFO:teuthology.orchestra.run.smithi042.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-08T06:00:35.530 INFO:teuthology.orchestra.run.smithi042.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-08T06:00:35.530 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-08T06:00:35.530 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-08T06:00:35.530 INFO:teuthology.orchestra.run.smithi042.stdout:Installing weak dependencies: 2024-03-08T06:00:35.530 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-08T06:00:35.530 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:00:35.530 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2024-03-08T06:00:35.531 INFO:teuthology.orchestra.run.smithi042.stdout:============================================================================================ 2024-03-08T06:00:35.531 INFO:teuthology.orchestra.run.smithi042.stdout:Install 150 Packages 2024-03-08T06:00:35.531 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrade 24 Packages 2024-03-08T06:00:35.531 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:00:35.531 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 223 M 2024-03-08T06:00:35.531 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2024-03-08T06:00:35.578 INFO:teuthology.orchestra.run.smithi019.stdout:(5/174): ceph-base-19.0.0-1670.g1fb5d106.el9.x8 1.9 MB/s | 5.3 MB 00:02 2024-03-08T06:00:35.636 INFO:teuthology.orchestra.run.smithi019.stdout:(6/174): ceph-mgr-19.0.0-1670.g1fb5d106.el9.x86 4.2 MB/s | 1.5 MB 00:00 2024-03-08T06:00:36.374 INFO:teuthology.orchestra.run.smithi042.stdout:(1/174): ceph-19.0.0-1670.g1fb5d106.el9.x86_64. 15 kB/s | 6.6 kB 00:00 2024-03-08T06:00:36.595 INFO:teuthology.orchestra.run.smithi019.stdout:(7/174): ceph-mon-19.0.0-1670.g1fb5d106.el9.x86 4.6 MB/s | 4.7 MB 00:01 2024-03-08T06:00:36.716 INFO:teuthology.orchestra.run.smithi042.stdout:(2/174): ceph-fuse-19.0.0-1670.g1fb5d106.el9.x8 2.5 MB/s | 887 kB 00:00 2024-03-08T06:00:36.816 INFO:teuthology.orchestra.run.smithi042.stdout:(3/174): ceph-immutable-object-cache-19.0.0-167 1.4 MB/s | 145 kB 00:00 2024-03-08T06:00:37.567 INFO:teuthology.orchestra.run.smithi042.stdout:(4/174): ceph-mds-19.0.0-1670.g1fb5d106.el9.x86 2.8 MB/s | 2.1 MB 00:00 2024-03-08T06:00:38.134 INFO:teuthology.orchestra.run.smithi042.stdout:(5/174): ceph-mgr-19.0.0-1670.g1fb5d106.el9.x86 2.6 MB/s | 1.5 MB 00:00 2024-03-08T06:00:38.745 INFO:teuthology.orchestra.run.smithi042.stdout:(6/174): ceph-base-19.0.0-1670.g1fb5d106.el9.x8 1.9 MB/s | 5.3 MB 00:02 2024-03-08T06:00:39.242 INFO:teuthology.orchestra.run.smithi042.stdout:(7/174): ceph-mon-19.0.0-1670.g1fb5d106.el9.x86 4.2 MB/s | 4.7 MB 00:01 2024-03-08T06:00:39.320 INFO:teuthology.orchestra.run.smithi019.stdout:(8/174): ceph-radosgw-19.0.0-1670.g1fb5d106.el9 3.6 MB/s | 9.8 MB 00:02 2024-03-08T06:00:39.395 INFO:teuthology.orchestra.run.smithi019.stdout:(9/174): ceph-selinux-19.0.0-1670.g1fb5d106.el9 340 kB/s | 25 kB 00:00 2024-03-08T06:00:39.996 INFO:teuthology.orchestra.run.smithi019.stdout:(10/174): ceph-osd-19.0.0-1670.g1fb5d106.el9.x8 3.9 MB/s | 17 MB 00:04 2024-03-08T06:00:40.112 INFO:teuthology.orchestra.run.smithi019.stdout:(11/174): cephfs-mirror-19.0.0-1670.g1fb5d106.e 1.9 MB/s | 220 kB 00:00 2024-03-08T06:00:40.179 INFO:teuthology.orchestra.run.smithi019.stdout:(12/174): cephfs-shell-19.0.0-1670.g1fb5d106.el 412 kB/s | 27 kB 00:00 2024-03-08T06:00:40.263 INFO:teuthology.orchestra.run.smithi019.stdout:(13/174): libcephfs-devel-19.0.0-1670.g1fb5d106 378 kB/s | 31 kB 00:00 2024-03-08T06:00:40.463 INFO:teuthology.orchestra.run.smithi019.stdout:(14/174): libcephfs2-19.0.0-1670.g1fb5d106.el9. 3.7 MB/s | 745 kB 00:00 2024-03-08T06:00:40.538 INFO:teuthology.orchestra.run.smithi019.stdout:(15/174): libcephsqlite-19.0.0-1670.g1fb5d106.e 2.2 MB/s | 163 kB 00:00 2024-03-08T06:00:40.568 INFO:teuthology.orchestra.run.smithi042.stdout:(8/174): ceph-radosgw-19.0.0-1670.g1fb5d106.el9 7.4 MB/s | 9.8 MB 00:01 2024-03-08T06:00:40.609 INFO:teuthology.orchestra.run.smithi042.stdout:(9/174): ceph-selinux-19.0.0-1670.g1fb5d106.el9 622 kB/s | 25 kB 00:00 2024-03-08T06:00:40.614 INFO:teuthology.orchestra.run.smithi019.stdout:(16/174): librados-devel-19.0.0-1670.g1fb5d106. 1.7 MB/s | 127 kB 00:00 2024-03-08T06:00:40.789 INFO:teuthology.orchestra.run.smithi019.stdout:(17/174): libradosstriper1-19.0.0-1670.g1fb5d10 2.8 MB/s | 501 kB 00:00 2024-03-08T06:00:41.990 INFO:teuthology.orchestra.run.smithi019.stdout:(18/174): librgw2-19.0.0-1670.g1fb5d106.el9.x86 4.3 MB/s | 5.1 MB 00:01 2024-03-08T06:00:42.056 INFO:teuthology.orchestra.run.smithi019.stdout:(19/174): python3-ceph-argparse-19.0.0-1670.g1f 688 kB/s | 45 kB 00:00 2024-03-08T06:00:42.123 INFO:teuthology.orchestra.run.smithi019.stdout:(20/174): python3-ceph-common-19.0.0-1670.g1fb5 2.0 MB/s | 131 kB 00:00 2024-03-08T06:00:42.185 INFO:teuthology.orchestra.run.smithi042.stdout:(10/174): ceph-osd-19.0.0-1670.g1fb5d106.el9.x8 4.9 MB/s | 17 MB 00:03 2024-03-08T06:00:42.190 INFO:teuthology.orchestra.run.smithi019.stdout:(21/174): python3-cephfs-19.0.0-1670.g1fb5d106. 2.4 MB/s | 162 kB 00:00 2024-03-08T06:00:42.285 INFO:teuthology.orchestra.run.smithi042.stdout:(11/174): cephfs-mirror-19.0.0-1670.g1fb5d106.e 2.2 MB/s | 220 kB 00:00 2024-03-08T06:00:42.299 INFO:teuthology.orchestra.run.smithi019.stdout:(22/174): python3-rados-19.0.0-1670.g1fb5d106.e 2.9 MB/s | 320 kB 00:00 2024-03-08T06:00:42.335 INFO:teuthology.orchestra.run.smithi042.stdout:(12/174): cephfs-shell-19.0.0-1670.g1fb5d106.el 553 kB/s | 27 kB 00:00 2024-03-08T06:00:42.385 INFO:teuthology.orchestra.run.smithi042.stdout:(13/174): libcephfs-devel-19.0.0-1670.g1fb5d106 640 kB/s | 31 kB 00:00 2024-03-08T06:00:42.416 INFO:teuthology.orchestra.run.smithi019.stdout:(23/174): python3-rbd-19.0.0-1670.g1fb5d106.el9 2.5 MB/s | 298 kB 00:00 2024-03-08T06:00:42.491 INFO:teuthology.orchestra.run.smithi019.stdout:(24/174): python3-rgw-19.0.0-1670.g1fb5d106.el9 1.3 MB/s | 99 kB 00:00 2024-03-08T06:00:42.535 INFO:teuthology.orchestra.run.smithi042.stdout:(14/174): libcephfs2-19.0.0-1670.g1fb5d106.el9. 4.9 MB/s | 745 kB 00:00 2024-03-08T06:00:42.558 INFO:teuthology.orchestra.run.smithi019.stdout:(25/174): rbd-fuse-19.0.0-1670.g1fb5d106.el9.x8 1.3 MB/s | 85 kB 00:00 2024-03-08T06:00:42.602 INFO:teuthology.orchestra.run.smithi042.stdout:(15/174): libcephsqlite-19.0.0-1670.g1fb5d106.e 2.4 MB/s | 163 kB 00:00 2024-03-08T06:00:42.661 INFO:teuthology.orchestra.run.smithi042.stdout:(16/174): librados-devel-19.0.0-1670.g1fb5d106. 2.2 MB/s | 127 kB 00:00 2024-03-08T06:00:42.820 INFO:teuthology.orchestra.run.smithi042.stdout:(17/174): libradosstriper1-19.0.0-1670.g1fb5d10 3.1 MB/s | 501 kB 00:00 2024-03-08T06:00:43.234 INFO:teuthology.orchestra.run.smithi019.stdout:(26/174): rbd-mirror-19.0.0-1670.g1fb5d106.el9. 4.6 MB/s | 3.1 MB 00:00 2024-03-08T06:00:43.350 INFO:teuthology.orchestra.run.smithi019.stdout:(27/174): rbd-nbd-19.0.0-1670.g1fb5d106.el9.x86 1.4 MB/s | 170 kB 00:00 2024-03-08T06:00:43.459 INFO:teuthology.orchestra.run.smithi019.stdout:(28/174): ceph-grafana-dashboards-19.0.0-1670.g 292 kB/s | 31 kB 00:00 2024-03-08T06:00:43.585 INFO:teuthology.orchestra.run.smithi019.stdout:(29/174): ceph-mgr-cephadm-19.0.0-1670.g1fb5d10 1.1 MB/s | 138 kB 00:00 2024-03-08T06:00:44.301 INFO:teuthology.orchestra.run.smithi019.stdout:(30/174): ceph-mgr-dashboard-19.0.0-1670.g1fb5d 2.5 MB/s | 1.8 MB 00:00 2024-03-08T06:00:44.378 INFO:teuthology.orchestra.run.smithi042.stdout:(18/174): librgw2-19.0.0-1670.g1fb5d106.el9.x86 3.3 MB/s | 5.1 MB 00:01 2024-03-08T06:00:44.470 INFO:teuthology.orchestra.run.smithi042.stdout:(19/174): python3-ceph-argparse-19.0.0-1670.g1f 498 kB/s | 45 kB 00:00 2024-03-08T06:00:44.570 INFO:teuthology.orchestra.run.smithi042.stdout:(20/174): python3-ceph-common-19.0.0-1670.g1fb5 1.3 MB/s | 131 kB 00:00 2024-03-08T06:00:44.829 INFO:teuthology.orchestra.run.smithi042.stdout:(21/174): ceph-common-19.0.0-1670.g1fb5d106.el9 2.2 MB/s | 20 MB 00:08 2024-03-08T06:00:44.863 INFO:teuthology.orchestra.run.smithi042.stdout:(22/174): python3-cephfs-19.0.0-1670.g1fb5d106. 556 kB/s | 162 kB 00:00 2024-03-08T06:00:45.138 INFO:teuthology.orchestra.run.smithi042.stdout:(23/174): python3-rbd-19.0.0-1670.g1fb5d106.el9 1.1 MB/s | 298 kB 00:00 2024-03-08T06:00:45.180 INFO:teuthology.orchestra.run.smithi042.stdout:(24/174): python3-rados-19.0.0-1670.g1fb5d106.e 916 kB/s | 320 kB 00:00 2024-03-08T06:00:45.221 INFO:teuthology.orchestra.run.smithi042.stdout:(25/174): python3-rgw-19.0.0-1670.g1fb5d106.el9 1.2 MB/s | 99 kB 00:00 2024-03-08T06:00:45.260 INFO:teuthology.orchestra.run.smithi019.stdout:(31/174): ceph-common-19.0.0-1670.g1fb5d106.el9 1.6 MB/s | 20 MB 00:12 2024-03-08T06:00:45.280 INFO:teuthology.orchestra.run.smithi042.stdout:(26/174): rbd-fuse-19.0.0-1670.g1fb5d106.el9.x8 855 kB/s | 85 kB 00:00 2024-03-08T06:00:45.436 INFO:teuthology.orchestra.run.smithi019.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1670.g1f 1.4 MB/s | 248 kB 00:00 2024-03-08T06:00:45.448 INFO:teuthology.orchestra.run.smithi042.stdout:(27/174): rbd-nbd-19.0.0-1670.g1fb5d106.el9.x86 1.0 MB/s | 170 kB 00:00 2024-03-08T06:00:45.536 INFO:teuthology.orchestra.run.smithi019.stdout:(33/174): ceph-mgr-rook-19.0.0-1670.g1fb5d106.e 498 kB/s | 49 kB 00:00 2024-03-08T06:00:45.564 INFO:teuthology.orchestra.run.smithi042.stdout:(28/174): ceph-grafana-dashboards-19.0.0-1670.g 271 kB/s | 31 kB 00:00 2024-03-08T06:00:45.644 INFO:teuthology.orchestra.run.smithi019.stdout:(34/174): ceph-prometheus-alerts-19.0.0-1670.g1 143 kB/s | 15 kB 00:00 2024-03-08T06:00:45.681 INFO:teuthology.orchestra.run.smithi042.stdout:(29/174): ceph-mgr-cephadm-19.0.0-1670.g1fb5d10 1.2 MB/s | 138 kB 00:00 2024-03-08T06:00:46.345 INFO:teuthology.orchestra.run.smithi019.stdout:(35/174): ceph-volume-19.0.0-1670.g1fb5d106.el9 377 kB/s | 264 kB 00:00 2024-03-08T06:00:46.515 INFO:teuthology.orchestra.run.smithi042.stdout:(30/174): rbd-mirror-19.0.0-1670.g1fb5d106.el9. 2.4 MB/s | 3.1 MB 00:01 2024-03-08T06:00:46.828 INFO:teuthology.orchestra.run.smithi019.stdout:(36/174): cephadm-19.0.0-1670.g1fb5d106.el9.noa 1.5 MB/s | 748 kB 00:00 2024-03-08T06:00:46.920 INFO:teuthology.orchestra.run.smithi019.stdout:(37/174): cephfs-top-19.0.0-1670.g1fb5d106.el9. 201 kB/s | 18 kB 00:00 2024-03-08T06:00:47.187 INFO:teuthology.orchestra.run.smithi019.stdout:(38/174): ceph-mgr-diskprediction-local-19.0.0- 2.6 MB/s | 7.4 MB 00:02 2024-03-08T06:00:47.229 INFO:teuthology.orchestra.run.smithi019.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 662 kB 00:00 2024-03-08T06:00:47.249 INFO:teuthology.orchestra.run.smithi042.stdout:(31/174): ceph-mgr-dashboard-19.0.0-1670.g1fb5d 1.1 MB/s | 1.8 MB 00:01 2024-03-08T06:00:47.298 INFO:teuthology.orchestra.run.smithi019.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 8.5 MB/s | 920 kB 00:00 2024-03-08T06:00:47.330 INFO:teuthology.orchestra.run.smithi019.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 106 kB 00:00 2024-03-08T06:00:47.372 INFO:teuthology.orchestra.run.smithi019.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 4.2 MB/s | 307 kB 00:00 2024-03-08T06:00:47.398 INFO:teuthology.orchestra.run.smithi019.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 501 kB/s | 32 kB 00:00 2024-03-08T06:00:47.432 INFO:teuthology.orchestra.run.smithi042.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1670.g1f 1.3 MB/s | 248 kB 00:00 2024-03-08T06:00:47.497 INFO:teuthology.orchestra.run.smithi019.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-03-08T06:00:47.522 INFO:teuthology.orchestra.run.smithi019.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 159 kB/s | 17 kB 00:00 2024-03-08T06:00:47.532 INFO:teuthology.orchestra.run.smithi042.stdout:(33/174): ceph-mgr-rook-19.0.0-1670.g1fb5d106.e 495 kB/s | 49 kB 00:00 2024-03-08T06:00:47.564 INFO:teuthology.orchestra.run.smithi019.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 249 kB/s | 10 kB 00:00 2024-03-08T06:00:47.590 INFO:teuthology.orchestra.run.smithi019.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 159 kB 00:00 2024-03-08T06:00:47.616 INFO:teuthology.orchestra.run.smithi042.stdout:(34/174): ceph-prometheus-alerts-19.0.0-1670.g1 186 kB/s | 15 kB 00:00 2024-03-08T06:00:47.640 INFO:teuthology.orchestra.run.smithi019.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 44 kB 00:00 2024-03-08T06:00:47.674 INFO:teuthology.orchestra.run.smithi019.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 7.9 MB/s | 661 kB 00:00 2024-03-08T06:00:47.724 INFO:teuthology.orchestra.run.smithi019.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 12 MB/s | 578 kB 00:00 2024-03-08T06:00:47.749 INFO:teuthology.orchestra.run.smithi019.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 629 kB/s | 46 kB 00:00 2024-03-08T06:00:47.791 INFO:teuthology.orchestra.run.smithi019.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 282 kB 00:00 2024-03-08T06:00:47.816 INFO:teuthology.orchestra.run.smithi019.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 187 kB 00:00 2024-03-08T06:00:47.841 INFO:teuthology.orchestra.run.smithi042.stdout:(35/174): ceph-volume-19.0.0-1670.g1fb5d106.el9 1.1 MB/s | 264 kB 00:00 2024-03-08T06:00:47.858 INFO:teuthology.orchestra.run.smithi019.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.2 MB/s | 217 kB 00:00 2024-03-08T06:00:47.883 INFO:teuthology.orchestra.run.smithi019.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 521 kB/s | 34 kB 00:00 2024-03-08T06:00:47.992 INFO:teuthology.orchestra.run.smithi019.stdout:(56/174): postgresql-13.11-1.el9.x86_64.rpm 14 MB/s | 1.5 MB 00:00 2024-03-08T06:00:48.092 INFO:teuthology.orchestra.run.smithi019.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 23 MB/s | 4.7 MB 00:00 2024-03-08T06:00:48.134 INFO:teuthology.orchestra.run.smithi019.stdout:(58/174): postgresql-contrib-13.11-1.el9.x86_64 6.2 MB/s | 811 kB 00:00 2024-03-08T06:00:48.159 INFO:teuthology.orchestra.run.smithi019.stdout:(59/174): postgresql-private-libs-13.11-1.el9.x 2.2 MB/s | 134 kB 00:00 2024-03-08T06:00:48.301 INFO:teuthology.orchestra.run.smithi019.stdout:(60/174): postgresql-server-13.11-1.el9.x86_64. 34 MB/s | 5.7 MB 00:00 2024-03-08T06:00:48.343 INFO:teuthology.orchestra.run.smithi019.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 6.1 MB/s | 1.0 MB 00:00 2024-03-08T06:00:48.385 INFO:teuthology.orchestra.run.smithi019.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.9 MB/s | 78 kB 00:00 2024-03-08T06:00:48.392 INFO:teuthology.orchestra.run.smithi042.stdout:(36/174): cephadm-19.0.0-1670.g1fb5d106.el9.noa 1.3 MB/s | 748 kB 00:00 2024-03-08T06:00:48.475 INFO:teuthology.orchestra.run.smithi042.stdout:(37/174): cephfs-top-19.0.0-1670.g1fb5d106.el9. 222 kB/s | 18 kB 00:00 2024-03-08T06:00:48.544 INFO:teuthology.orchestra.run.smithi019.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 5.8 MB 00:00 2024-03-08T06:00:48.561 INFO:teuthology.orchestra.run.smithi019.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 155 kB/s | 24 kB 00:00 2024-03-08T06:00:48.586 INFO:teuthology.orchestra.run.smithi019.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 763 kB/s | 18 kB 00:00 2024-03-08T06:00:48.612 INFO:teuthology.orchestra.run.smithi019.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 144 kB 00:00 2024-03-08T06:00:48.653 INFO:teuthology.orchestra.run.smithi019.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 488 kB/s | 32 kB 00:00 2024-03-08T06:00:48.667 INFO:teuthology.orchestra.run.smithi042.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 662 kB 00:00 2024-03-08T06:00:48.742 INFO:teuthology.orchestra.run.smithi042.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 920 kB 00:00 2024-03-08T06:00:48.784 INFO:teuthology.orchestra.run.smithi042.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 106 kB 00:00 2024-03-08T06:00:48.787 INFO:teuthology.orchestra.run.smithi019.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 4.8 MB 00:00 2024-03-08T06:00:48.812 INFO:teuthology.orchestra.run.smithi019.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 217 kB 00:00 2024-03-08T06:00:48.835 INFO:teuthology.orchestra.run.smithi042.stdout:(41/174): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 307 kB 00:00 2024-03-08T06:00:48.854 INFO:teuthology.orchestra.run.smithi019.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 4.2 MB/s | 174 kB 00:00 2024-03-08T06:00:48.868 INFO:teuthology.orchestra.run.smithi042.stdout:(42/174): flexiblas-3.0.4-8.el9.x86_64.rpm 978 kB/s | 32 kB 00:00 2024-03-08T06:00:48.879 INFO:teuthology.orchestra.run.smithi019.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 69 kB 00:00 2024-03-08T06:00:48.921 INFO:teuthology.orchestra.run.smithi019.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2024-03-08T06:00:48.955 INFO:teuthology.orchestra.run.smithi019.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 238 kB 00:00 2024-03-08T06:00:48.980 INFO:teuthology.orchestra.run.smithi019.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 132 kB 00:00 2024-03-08T06:00:48.985 INFO:teuthology.orchestra.run.smithi042.stdout:(43/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-03-08T06:00:49.014 INFO:teuthology.orchestra.run.smithi019.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.7 MB/s | 211 kB 00:00 2024-03-08T06:00:49.019 INFO:teuthology.orchestra.run.smithi042.stdout:(44/174): flexiblas-openblas-openmp-3.0.4-8.el9 529 kB/s | 17 kB 00:00 2024-03-08T06:00:49.039 INFO:teuthology.orchestra.run.smithi019.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 850 kB/s | 47 kB 00:00 2024-03-08T06:00:49.052 INFO:teuthology.orchestra.run.smithi042.stdout:(45/174): libaio-devel-0.3.111-13.el9.x86_64.rp 310 kB/s | 10 kB 00:00 2024-03-08T06:00:49.064 INFO:teuthology.orchestra.run.smithi019.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 878 kB/s | 43 kB 00:00 2024-03-08T06:00:49.094 INFO:teuthology.orchestra.run.smithi042.stdout:(46/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 159 kB 00:00 2024-03-08T06:00:49.136 INFO:teuthology.orchestra.run.smithi042.stdout:(47/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-03-08T06:00:49.203 INFO:teuthology.orchestra.run.smithi042.stdout:(48/174): librdkafka-1.6.1-102.el9.x86_64.rpm 9.8 MB/s | 661 kB 00:00 2024-03-08T06:00:49.303 INFO:teuthology.orchestra.run.smithi042.stdout:(49/174): libtool-2.4.6-45.el9.x86_64.rpm 5.8 MB/s | 578 kB 00:00 2024-03-08T06:00:49.346 INFO:teuthology.orchestra.run.smithi042.stdout:(50/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 46 kB 00:00 2024-03-08T06:00:49.396 INFO:teuthology.orchestra.run.smithi042.stdout:(51/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.6 MB/s | 282 kB 00:00 2024-03-08T06:00:49.429 INFO:teuthology.orchestra.run.smithi042.stdout:(52/174): lua-5.4.4-4.el9.x86_64.rpm 5.7 MB/s | 187 kB 00:00 2024-03-08T06:00:49.431 INFO:teuthology.orchestra.run.smithi019.stdout:(78/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-03-08T06:00:49.456 INFO:teuthology.orchestra.run.smithi019.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 103 kB/s | 39 kB 00:00 2024-03-08T06:00:49.471 INFO:teuthology.orchestra.run.smithi042.stdout:(53/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.2 MB/s | 217 kB 00:00 2024-03-08T06:00:49.498 INFO:teuthology.orchestra.run.smithi019.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 41 kB 00:00 2024-03-08T06:00:49.505 INFO:teuthology.orchestra.run.smithi042.stdout:(54/174): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-03-08T06:00:49.524 INFO:teuthology.orchestra.run.smithi019.stdout:(81/174): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 300 kB 00:00 2024-03-08T06:00:49.574 INFO:teuthology.orchestra.run.smithi019.stdout:(82/174): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-03-08T06:00:49.599 INFO:teuthology.orchestra.run.smithi019.stdout:(83/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 848 kB/s | 63 kB 00:00 2024-03-08T06:00:49.641 INFO:teuthology.orchestra.run.smithi019.stdout:(84/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.1 MB/s | 44 kB 00:00 2024-03-08T06:00:49.658 INFO:teuthology.orchestra.run.smithi019.stdout:(85/174): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-03-08T06:00:49.672 INFO:teuthology.orchestra.run.smithi042.stdout:(55/174): openblas-openmp-0.3.21-2.el9.x86_64.r 29 MB/s | 4.7 MB 00:00 2024-03-08T06:00:49.725 INFO:teuthology.orchestra.run.smithi019.stdout:(86/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.6 MB/s | 241 kB 00:00 2024-03-08T06:00:49.767 INFO:teuthology.orchestra.run.smithi019.stdout:(87/174): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2024-03-08T06:00:49.772 INFO:teuthology.orchestra.run.smithi042.stdout:(56/174): postgresql-13.11-1.el9.x86_64.rpm 15 MB/s | 1.5 MB 00:00 2024-03-08T06:00:49.809 INFO:teuthology.orchestra.run.smithi019.stdout:(88/174): python3-ply-3.11-14.el9.noarch.rpm 2.4 MB/s | 103 kB 00:00 2024-03-08T06:00:49.834 INFO:teuthology.orchestra.run.smithi019.stdout:(89/174): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 124 kB 00:00 2024-03-08T06:00:49.856 INFO:teuthology.orchestra.run.smithi042.stdout:(57/174): postgresql-contrib-13.11-1.el9.x86_64 9.6 MB/s | 811 kB 00:00 2024-03-08T06:00:49.876 INFO:teuthology.orchestra.run.smithi019.stdout:(90/174): python3-urllib3-1.26.5-5.el9.noarch.r 4.5 MB/s | 187 kB 00:00 2024-03-08T06:00:49.915 INFO:teuthology.orchestra.run.smithi042.stdout:(58/174): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2024-03-08T06:00:50.090 INFO:teuthology.orchestra.run.smithi042.stdout:(59/174): postgresql-server-13.11-1.el9.x86_64. 33 MB/s | 5.7 MB 00:00 2024-03-08T06:00:50.093 INFO:teuthology.orchestra.run.smithi019.stdout:(91/174): jq-1.6-16.el9.x86_64.rpm 728 kB/s | 187 kB 00:00 2024-03-08T06:00:50.160 INFO:teuthology.orchestra.run.smithi019.stdout:(92/174): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2024-03-08T06:00:50.224 INFO:teuthology.orchestra.run.smithi042.stdout:(60/174): ceph-mgr-diskprediction-local-19.0.0- 2.0 MB/s | 7.4 MB 00:03 2024-03-08T06:00:50.236 INFO:teuthology.orchestra.run.smithi019.stdout:(93/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.2 MB/s | 803 kB 00:00 2024-03-08T06:00:50.269 INFO:teuthology.orchestra.run.smithi019.stdout:(94/174): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-03-08T06:00:50.274 INFO:teuthology.orchestra.run.smithi042.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-03-08T06:00:50.300 INFO:teuthology.orchestra.run.smithi042.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.2 MB/s | 78 kB 00:00 2024-03-08T06:00:50.336 INFO:teuthology.orchestra.run.smithi019.stdout:(95/174): elfutils-libelf-devel-0.190-2.el9.x86 216 kB/s | 21 kB 00:00 2024-03-08T06:00:50.361 INFO:teuthology.orchestra.run.smithi019.stdout:(96/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 279 kB/s | 25 kB 00:00 2024-03-08T06:00:50.450 INFO:teuthology.orchestra.run.smithi042.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 33 MB/s | 5.8 MB 00:00 2024-03-08T06:00:50.462 INFO:teuthology.orchestra.run.smithi019.stdout:(97/174): python3-devel-3.9.17-2.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-03-08T06:00:50.475 INFO:teuthology.orchestra.run.smithi042.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 161 kB/s | 24 kB 00:00 2024-03-08T06:00:50.517 INFO:teuthology.orchestra.run.smithi042.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 449 kB/s | 18 kB 00:00 2024-03-08T06:00:50.520 INFO:teuthology.orchestra.run.smithi019.stdout:(98/174): python3-jinja2-2.11.3-5.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-03-08T06:00:50.542 INFO:teuthology.orchestra.run.smithi042.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 144 kB 00:00 2024-03-08T06:00:50.571 INFO:teuthology.orchestra.run.smithi019.stdout:(99/174): qatlib-23.11.0-1.el9.x86_64.rpm 4.3 MB/s | 216 kB 00:00 2024-03-08T06:00:50.617 INFO:teuthology.orchestra.run.smithi042.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 427 kB/s | 32 kB 00:00 2024-03-08T06:00:50.688 INFO:teuthology.orchestra.run.smithi019.stdout:(100/174): openssl-devel-3.0.7-27.el9.x86_64.rp 12 MB/s | 4.1 MB 00:00 2024-03-08T06:00:50.713 INFO:teuthology.orchestra.run.smithi019.stdout:(101/174): qatlib-service-23.11.0-1.el9.x86_64. 247 kB/s | 35 kB 00:00 2024-03-08T06:00:50.738 INFO:teuthology.orchestra.run.smithi019.stdout:(102/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 904 kB/s | 44 kB 00:00 2024-03-08T06:00:50.751 INFO:teuthology.orchestra.run.smithi042.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 4.8 MB 00:00 2024-03-08T06:00:50.772 INFO:teuthology.orchestra.run.smithi019.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-03-08T06:00:50.784 INFO:teuthology.orchestra.run.smithi042.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2024-03-08T06:00:50.818 INFO:teuthology.orchestra.run.smithi042.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.7 MB/s | 174 kB 00:00 2024-03-08T06:00:50.843 INFO:teuthology.orchestra.run.smithi042.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.2 MB/s | 69 kB 00:00 2024-03-08T06:00:50.869 INFO:teuthology.orchestra.run.smithi042.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 41 kB 00:00 2024-03-08T06:00:50.889 INFO:teuthology.orchestra.run.smithi019.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 149 kB/s | 22 kB 00:00 2024-03-08T06:00:50.902 INFO:teuthology.orchestra.run.smithi042.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 4.1 MB/s | 238 kB 00:00 2024-03-08T06:00:50.928 INFO:teuthology.orchestra.run.smithi042.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 132 kB 00:00 2024-03-08T06:00:50.961 INFO:teuthology.orchestra.run.smithi042.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2024-03-08T06:00:50.986 INFO:teuthology.orchestra.run.smithi042.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 847 kB/s | 47 kB 00:00 2024-03-08T06:00:51.012 INFO:teuthology.orchestra.run.smithi042.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 875 kB/s | 43 kB 00:00 2024-03-08T06:00:51.014 INFO:teuthology.orchestra.run.smithi019.stdout:(105/174): abseil-cpp-20211102.0-3.el9.x86_64.r 4.3 MB/s | 548 kB 00:00 2024-03-08T06:00:51.056 INFO:teuthology.orchestra.run.smithi019.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 3.0 MB/s | 863 kB 00:00 2024-03-08T06:00:51.082 INFO:teuthology.orchestra.run.smithi019.stdout:(107/174): gperftools-libs-2.9.1-2.el9.x86_64.r 4.6 MB/s | 309 kB 00:00 2024-03-08T06:00:51.132 INFO:teuthology.orchestra.run.smithi019.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 262 kB/s | 19 kB 00:00 2024-03-08T06:00:51.174 INFO:teuthology.orchestra.run.smithi019.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 637 kB/s | 26 kB 00:00 2024-03-08T06:00:51.224 INFO:teuthology.orchestra.run.smithi019.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 991 kB/s | 49 kB 00:00 2024-03-08T06:00:51.266 INFO:teuthology.orchestra.run.smithi019.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-03-08T06:00:51.338 INFO:teuthology.orchestra.run.smithi019.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 2.1 MB/s | 151 kB 00:00 2024-03-08T06:00:51.346 INFO:teuthology.orchestra.run.smithi042.stdout:(78/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 44 MB/s | 16 MB 00:00 2024-03-08T06:00:51.371 INFO:teuthology.orchestra.run.smithi042.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 117 kB/s | 39 kB 00:00 2024-03-08T06:00:51.433 INFO:teuthology.orchestra.run.smithi019.stdout:(113/174): libarrow-9.0.0-10.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-03-08T06:00:51.492 INFO:teuthology.orchestra.run.smithi019.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.4 MB/s | 838 kB 00:00 2024-03-08T06:00:51.525 INFO:teuthology.orchestra.run.smithi019.stdout:(115/174): python3-asyncssh-2.13.2-4.el9.noarch 5.9 MB/s | 548 kB 00:00 2024-03-08T06:00:51.551 INFO:teuthology.orchestra.run.smithi019.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 752 kB/s | 43 kB 00:00 2024-03-08T06:00:51.793 INFO:teuthology.orchestra.run.smithi019.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 121 kB/s | 32 kB 00:00 2024-03-08T06:00:51.843 INFO:teuthology.orchestra.run.smithi019.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 51 kB/s | 15 kB 00:00 2024-03-08T06:00:51.879 INFO:teuthology.orchestra.run.smithi042.stdout:(80/174): ceph-test-19.0.0-1670.g1fb5d106.el9.x 4.2 MB/s | 47 MB 00:11 2024-03-08T06:00:51.902 INFO:teuthology.orchestra.run.smithi019.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.6 MB/s | 172 kB 00:00 2024-03-08T06:00:51.946 INFO:teuthology.orchestra.run.smithi042.stdout:(81/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 71 kB/s | 41 kB 00:00 2024-03-08T06:00:52.088 INFO:teuthology.orchestra.run.smithi042.stdout:(82/174): socat-1.7.4.1-5.el9.x86_64.rpm 419 kB/s | 300 kB 00:00 2024-03-08T06:00:52.130 INFO:teuthology.orchestra.run.smithi042.stdout:(83/174): uuid-1.6.2-55.el9.x86_64.rpm 226 kB/s | 56 kB 00:00 2024-03-08T06:00:52.155 INFO:teuthology.orchestra.run.smithi042.stdout:(84/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 960 kB/s | 63 kB 00:00 2024-03-08T06:00:52.180 INFO:teuthology.orchestra.run.smithi042.stdout:(85/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 488 kB/s | 44 kB 00:00 2024-03-08T06:00:52.206 INFO:teuthology.orchestra.run.smithi042.stdout:(86/174): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-03-08T06:00:52.248 INFO:teuthology.orchestra.run.smithi042.stdout:(87/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.6 MB/s | 241 kB 00:00 2024-03-08T06:00:52.289 INFO:teuthology.orchestra.run.smithi042.stdout:(88/174): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2024-03-08T06:00:52.315 INFO:teuthology.orchestra.run.smithi042.stdout:(89/174): python3-ply-3.11-14.el9.noarch.rpm 958 kB/s | 103 kB 00:00 2024-03-08T06:00:52.357 INFO:teuthology.orchestra.run.smithi042.stdout:(90/174): python3-pycparser-2.20-6.el9.noarch.r 3.0 MB/s | 124 kB 00:00 2024-03-08T06:00:52.391 INFO:teuthology.orchestra.run.smithi042.stdout:(91/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 187 kB 00:00 2024-03-08T06:00:52.411 INFO:teuthology.orchestra.run.smithi019.stdout:(120/174): ceph-test-19.0.0-1670.g1fb5d106.el9. 3.6 MB/s | 47 MB 00:13 2024-03-08T06:00:52.445 INFO:teuthology.orchestra.run.smithi019.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 597 kB/s | 358 kB 00:00 2024-03-08T06:00:52.478 INFO:teuthology.orchestra.run.smithi019.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 527 kB/s | 303 kB 00:00 2024-03-08T06:00:52.503 INFO:teuthology.orchestra.run.smithi019.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 388 kB/s | 35 kB 00:00 2024-03-08T06:00:52.537 INFO:teuthology.orchestra.run.smithi019.stdout:(124/174): python3-google-auth-2.28.0-1.el9.noa 2.2 MB/s | 203 kB 00:00 2024-03-08T06:00:52.549 INFO:teuthology.orchestra.run.smithi042.stdout:(92/174): jq-1.6-16.el9.x86_64.rpm 806 kB/s | 187 kB 00:00 2024-03-08T06:00:52.571 INFO:teuthology.orchestra.run.smithi019.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 330 kB/s | 11 kB 00:00 2024-03-08T06:00:52.596 INFO:teuthology.orchestra.run.smithi019.stdout:(126/174): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-03-08T06:00:52.616 INFO:teuthology.orchestra.run.smithi042.stdout:(93/174): libquadmath-11.4.1-3.el9.x86_64.rpm 871 kB/s | 195 kB 00:00 2024-03-08T06:00:52.621 INFO:teuthology.orchestra.run.smithi019.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 357 kB/s | 18 kB 00:00 2024-03-08T06:00:52.641 INFO:teuthology.orchestra.run.smithi042.stdout:(94/174): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-03-08T06:00:52.646 INFO:teuthology.orchestra.run.smithi019.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 468 kB/s | 23 kB 00:00 2024-03-08T06:00:52.688 INFO:teuthology.orchestra.run.smithi019.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 294 kB/s | 19 kB 00:00 2024-03-08T06:00:52.694 INFO:teuthology.orchestra.run.smithi042.stdout:(95/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.4 MB/s | 803 kB 00:00 2024-03-08T06:00:52.714 INFO:teuthology.orchestra.run.smithi019.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 297 kB/s | 20 kB 00:00 2024-03-08T06:00:52.756 INFO:teuthology.orchestra.run.smithi019.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-03-08T06:00:52.823 INFO:teuthology.orchestra.run.smithi019.stdout:(132/174): python3-grpcio-1.46.7-10.el9.x86_64. 5.9 MB/s | 2.0 MB 00:00 2024-03-08T06:00:52.865 INFO:teuthology.orchestra.run.smithi019.stdout:(133/174): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-03-08T06:00:52.890 INFO:teuthology.orchestra.run.smithi019.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 592 kB/s | 79 kB 00:00 2024-03-08T06:00:52.915 INFO:teuthology.orchestra.run.smithi019.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 630 kB/s | 58 kB 00:00 2024-03-08T06:00:52.940 INFO:teuthology.orchestra.run.smithi019.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 332 kB/s | 16 kB 00:00 2024-03-08T06:00:52.966 INFO:teuthology.orchestra.run.smithi019.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-03-08T06:00:52.983 INFO:teuthology.orchestra.run.smithi019.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 686 kB/s | 28 kB 00:00 2024-03-08T06:00:52.984 INFO:teuthology.orchestra.run.smithi042.stdout:(96/174): elfutils-libelf-devel-0.190-2.el9.x86 59 kB/s | 21 kB 00:00 2024-03-08T06:00:53.000 INFO:teuthology.orchestra.run.smithi019.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 935 kB/s | 31 kB 00:00 2024-03-08T06:00:53.009 INFO:teuthology.orchestra.run.smithi042.stdout:(97/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 69 kB/s | 25 kB 00:00 2024-03-08T06:00:53.033 INFO:teuthology.orchestra.run.smithi019.stdout:(140/174): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-03-08T06:00:53.050 INFO:teuthology.orchestra.run.smithi019.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-03-08T06:00:53.067 INFO:teuthology.orchestra.run.smithi019.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 1.1 MB/s | 36 kB 00:00 2024-03-08T06:00:53.101 INFO:teuthology.orchestra.run.smithi019.stdout:(143/174): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-03-08T06:00:53.109 INFO:teuthology.orchestra.run.smithi042.stdout:(98/174): python3-devel-3.9.17-2.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-03-08T06:00:53.117 INFO:teuthology.orchestra.run.smithi019.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 771 kB/s | 51 kB 00:00 2024-03-08T06:00:53.143 INFO:teuthology.orchestra.run.smithi042.stdout:(99/174): python3-jinja2-2.11.3-5.el9.noarch.rp 1.8 MB/s | 248 kB 00:00 2024-03-08T06:00:53.143 INFO:teuthology.orchestra.run.smithi019.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-03-08T06:00:53.177 INFO:teuthology.orchestra.run.smithi019.stdout:(146/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-03-08T06:00:53.201 INFO:teuthology.orchestra.run.smithi042.stdout:(100/174): qatlib-23.11.0-1.el9.x86_64.rpm 2.3 MB/s | 216 kB 00:00 2024-03-08T06:00:53.202 INFO:teuthology.orchestra.run.smithi019.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 343 kB/s | 20 kB 00:00 2024-03-08T06:00:53.218 INFO:teuthology.orchestra.run.smithi042.stdout:(101/174): qatlib-service-23.11.0-1.el9.x86_64. 469 kB/s | 35 kB 00:00 2024-03-08T06:00:53.236 INFO:teuthology.orchestra.run.smithi019.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-03-08T06:00:53.260 INFO:teuthology.orchestra.run.smithi042.stdout:(102/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 770 kB/s | 44 kB 00:00 2024-03-08T06:00:53.269 INFO:teuthology.orchestra.run.smithi019.stdout:(149/174): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-03-08T06:00:53.294 INFO:teuthology.orchestra.run.smithi042.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.2 MB/s | 94 kB 00:00 2024-03-08T06:00:53.345 INFO:teuthology.orchestra.run.smithi019.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-03-08T06:00:53.352 INFO:teuthology.orchestra.run.smithi042.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 245 kB/s | 22 kB 00:00 2024-03-08T06:00:53.387 INFO:teuthology.orchestra.run.smithi019.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 7.7 MB/s | 321 kB 00:00 2024-03-08T06:00:53.453 INFO:teuthology.orchestra.run.smithi042.stdout:(105/174): openssl-devel-3.0.7-27.el9.x86_64.rp 5.4 MB/s | 4.1 MB 00:00 2024-03-08T06:00:53.595 INFO:teuthology.orchestra.run.smithi042.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 2.8 MB/s | 863 kB 00:00 2024-03-08T06:00:53.779 INFO:teuthology.orchestra.run.smithi019.stdout:(152/174): NetworkManager-1.46.0-1.el9.x86_64.r 5.9 MB/s | 2.3 MB 00:00 2024-03-08T06:00:53.929 INFO:teuthology.orchestra.run.smithi019.stdout:(153/174): librbd1-19.0.0-1670.g1fb5d106.el9.x8 4.8 MB/s | 3.1 MB 00:00 2024-03-08T06:00:53.962 INFO:teuthology.orchestra.run.smithi042.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 65 kB/s | 19 kB 00:00 2024-03-08T06:00:53.995 INFO:teuthology.orchestra.run.smithi042.stdout:(108/174): abseil-cpp-20211102.0-3.el9.x86_64.r 855 kB/s | 548 kB 00:00 2024-03-08T06:00:54.018 INFO:teuthology.orchestra.run.smithi019.stdout:(154/174): NetworkManager-libnm-1.46.0-1.el9.x8 7.6 MB/s | 1.8 MB 00:00 2024-03-08T06:00:54.063 INFO:teuthology.orchestra.run.smithi019.stdout:(155/174): NetworkManager-team-1.46.0-1.el9.x86 319 kB/s | 42 kB 00:00 2024-03-08T06:00:54.079 INFO:teuthology.orchestra.run.smithi042.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 314 kB/s | 26 kB 00:00 2024-03-08T06:00:54.122 INFO:teuthology.orchestra.run.smithi042.stdout:(110/174): gperftools-libs-2.9.1-2.el9.x86_64.r 517 kB/s | 309 kB 00:00 2024-03-08T06:00:54.147 INFO:teuthology.orchestra.run.smithi019.stdout:(156/174): librados2-19.0.0-1670.g1fb5d106.el9. 3.7 MB/s | 3.4 MB 00:00 2024-03-08T06:00:54.154 INFO:teuthology.orchestra.run.smithi042.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 653 kB/s | 49 kB 00:00 2024-03-08T06:00:54.180 INFO:teuthology.orchestra.run.smithi019.stdout:(157/174): NetworkManager-tui-1.46.0-1.el9.x86_ 1.5 MB/s | 248 kB 00:00 2024-03-08T06:00:54.214 INFO:teuthology.orchestra.run.smithi019.stdout:(158/174): acl-2.3.1-4.el9.x86_64.rpm 476 kB/s | 71 kB 00:00 2024-03-08T06:00:54.230 INFO:teuthology.orchestra.run.smithi042.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 621 kB/s | 67 kB 00:00 2024-03-08T06:00:54.248 INFO:teuthology.orchestra.run.smithi019.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 192 kB 00:00 2024-03-08T06:00:54.263 INFO:teuthology.orchestra.run.smithi042.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-03-08T06:00:54.282 INFO:teuthology.orchestra.run.smithi019.stdout:(160/174): elfutils-debuginfod-client-0.190-2.e 273 kB/s | 36 kB 00:00 2024-03-08T06:00:54.307 INFO:teuthology.orchestra.run.smithi019.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 396 kB/s | 23 kB 00:00 2024-03-08T06:00:54.340 INFO:teuthology.orchestra.run.smithi019.stdout:(162/174): elfutils-libs-0.190-2.el9.x86_64.rpm 2.0 MB/s | 256 kB 00:00 2024-03-08T06:00:54.374 INFO:teuthology.orchestra.run.smithi019.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 155 kB 00:00 2024-03-08T06:00:54.388 INFO:teuthology.orchestra.run.smithi042.stdout:(114/174): python3-asyncssh-2.13.2-4.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-03-08T06:00:54.399 INFO:teuthology.orchestra.run.smithi019.stdout:(164/174): libblkid-2.37.4-18.el9.x86_64.rpm 931 kB/s | 108 kB 00:00 2024-03-08T06:00:54.424 INFO:teuthology.orchestra.run.smithi019.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 1.6 MB/s | 136 kB 00:00 2024-03-08T06:00:54.430 INFO:teuthology.orchestra.run.smithi042.stdout:(115/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.1 MB/s | 838 kB 00:00 2024-03-08T06:00:54.449 INFO:teuthology.orchestra.run.smithi019.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 858 kB/s | 64 kB 00:00 2024-03-08T06:00:54.464 INFO:teuthology.orchestra.run.smithi042.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 584 kB/s | 43 kB 00:00 2024-03-08T06:00:54.475 INFO:teuthology.orchestra.run.smithi019.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 383 kB/s | 29 kB 00:00 2024-03-08T06:00:54.506 INFO:teuthology.orchestra.run.smithi042.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 432 kB/s | 32 kB 00:00 2024-03-08T06:00:54.540 INFO:teuthology.orchestra.run.smithi042.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 201 kB/s | 15 kB 00:00 2024-03-08T06:00:54.617 INFO:teuthology.orchestra.run.smithi019.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 6.3 MB/s | 1.2 MB 00:00 2024-03-08T06:00:54.648 INFO:teuthology.orchestra.run.smithi042.stdout:(119/174): libarrow-9.0.0-10.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2024-03-08T06:00:54.675 INFO:teuthology.orchestra.run.smithi019.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 9.6 MB/s | 2.2 MB 00:00 2024-03-08T06:00:54.682 INFO:teuthology.orchestra.run.smithi042.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 982 kB/s | 172 kB 00:00 2024-03-08T06:00:54.724 INFO:teuthology.orchestra.run.smithi042.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 1.9 MB/s | 358 kB 00:00 2024-03-08T06:00:54.726 INFO:teuthology.orchestra.run.smithi019.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 4.2 MB/s | 465 kB 00:00 2024-03-08T06:00:54.751 INFO:teuthology.orchestra.run.smithi019.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 419 kB/s | 31 kB 00:00 2024-03-08T06:00:54.758 INFO:teuthology.orchestra.run.smithi042.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-03-08T06:00:54.783 INFO:teuthology.orchestra.run.smithi042.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 353 kB/s | 35 kB 00:00 2024-03-08T06:00:54.816 INFO:teuthology.orchestra.run.smithi042.stdout:(124/174): python3-google-auth-2.28.0-1.el9.noa 2.2 MB/s | 203 kB 00:00 2024-03-08T06:00:54.860 INFO:teuthology.orchestra.run.smithi019.stdout:(172/174): util-linux-2.37.4-18.el9.x86_64.rpm 6.0 MB/s | 2.3 MB 00:00 2024-03-08T06:00:54.866 INFO:teuthology.orchestra.run.smithi042.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-03-08T06:00:54.885 INFO:teuthology.orchestra.run.smithi019.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 559 kB/s | 74 kB 00:00 2024-03-08T06:00:54.892 INFO:teuthology.orchestra.run.smithi042.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 143 kB/s | 11 kB 00:00 2024-03-08T06:00:54.943 INFO:teuthology.orchestra.run.smithi019.stdout:(174/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 5.0 MB/s | 1.1 MB 00:00 2024-03-08T06:00:54.952 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-03-08T06:00:54.952 INFO:teuthology.orchestra.run.smithi019.stdout:Total 9.7 MB/s | 223 MB 00:22 2024-03-08T06:00:54.975 INFO:teuthology.orchestra.run.smithi042.stdout:(127/174): python3-grpcio-1.46.7-10.el9.x86_64. 9.4 MB/s | 2.0 MB 00:00 2024-03-08T06:00:55.001 INFO:teuthology.orchestra.run.smithi042.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 133 kB/s | 18 kB 00:00 2024-03-08T06:00:55.026 INFO:teuthology.orchestra.run.smithi042.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 174 kB/s | 23 kB 00:00 2024-03-08T06:00:55.051 INFO:teuthology.orchestra.run.smithi042.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 261 kB/s | 19 kB 00:00 2024-03-08T06:00:55.102 INFO:teuthology.orchestra.run.smithi042.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 265 kB/s | 20 kB 00:00 2024-03-08T06:00:55.160 INFO:teuthology.orchestra.run.smithi042.stdout:(132/174): python3-kubernetes-26.1.0-2.el9.noar 7.7 MB/s | 1.0 MB 00:00 2024-03-08T06:00:55.185 INFO:teuthology.orchestra.run.smithi042.stdout:(133/174): python3-logutils-0.3.5-21.el9.noarch 347 kB/s | 46 kB 00:00 2024-03-08T06:00:55.202 INFO:teuthology.orchestra.run.smithi042.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 791 kB/s | 79 kB 00:00 2024-03-08T06:00:55.236 INFO:teuthology.orchestra.run.smithi042.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 775 kB/s | 58 kB 00:00 2024-03-08T06:00:55.278 INFO:teuthology.orchestra.run.smithi042.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-03-08T06:00:55.303 INFO:teuthology.orchestra.run.smithi042.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-03-08T06:00:55.328 INFO:teuthology.orchestra.run.smithi042.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 981 kB/s | 90 kB 00:00 2024-03-08T06:00:55.354 INFO:teuthology.orchestra.run.smithi042.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 376 kB/s | 28 kB 00:00 2024-03-08T06:00:55.379 INFO:teuthology.orchestra.run.smithi042.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 411 kB/s | 31 kB 00:00 2024-03-08T06:00:55.412 INFO:teuthology.orchestra.run.smithi042.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-03-08T06:00:55.438 INFO:teuthology.orchestra.run.smithi042.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 711 kB/s | 59 kB 00:00 2024-03-08T06:00:55.463 INFO:teuthology.orchestra.run.smithi042.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 430 kB/s | 36 kB 00:00 2024-03-08T06:00:55.555 INFO:teuthology.orchestra.run.smithi042.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 359 kB/s | 51 kB 00:00 2024-03-08T06:00:55.664 INFO:teuthology.orchestra.run.smithi042.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 449 kB/s | 90 kB 00:00 2024-03-08T06:00:55.697 INFO:teuthology.orchestra.run.smithi042.stdout:(146/174): python3-webob-1.8.7-6.el9.noarch.rpm 888 kB/s | 230 kB 00:00 2024-03-08T06:00:55.730 INFO:teuthology.orchestra.run.smithi042.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 2.4 MB/s | 427 kB 00:00 2024-03-08T06:00:55.756 INFO:teuthology.orchestra.run.smithi042.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 219 kB/s | 20 kB 00:00 2024-03-08T06:00:55.790 INFO:teuthology.orchestra.run.smithi042.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-03-08T06:00:55.974 INFO:teuthology.orchestra.run.smithi042.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 6.5 MB/s | 1.6 MB 00:00 2024-03-08T06:00:56.140 INFO:teuthology.orchestra.run.smithi042.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 1.9 MB/s | 321 kB 00:00 2024-03-08T06:00:56.452 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-03-08T06:00:56.474 INFO:teuthology.orchestra.run.smithi042.stdout:(152/174): librbd1-19.0.0-1670.g1fb5d106.el9.x8 4.6 MB/s | 3.1 MB 00:00 2024-03-08T06:00:56.642 INFO:teuthology.orchestra.run.smithi042.stdout:(153/174): NetworkManager-1.46.0-1.el9.x86_64.r 4.6 MB/s | 2.3 MB 00:00 2024-03-08T06:00:56.725 INFO:teuthology.orchestra.run.smithi042.stdout:(154/174): librados2-19.0.0-1670.g1fb5d106.el9. 3.5 MB/s | 3.4 MB 00:00 2024-03-08T06:00:56.750 INFO:teuthology.orchestra.run.smithi042.stdout:(155/174): NetworkManager-team-1.46.0-1.el9.x86 396 kB/s | 42 kB 00:00 2024-03-08T06:00:56.817 INFO:teuthology.orchestra.run.smithi042.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 1.1 MB/s | 71 kB 00:00 2024-03-08T06:00:56.848 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-03-08T06:00:56.848 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-03-08T06:00:56.875 INFO:teuthology.orchestra.run.smithi042.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 635 kB/s | 36 kB 00:00 2024-03-08T06:00:56.934 INFO:teuthology.orchestra.run.smithi042.stdout:(158/174): NetworkManager-libnm-1.46.0-1.el9.x8 4.0 MB/s | 1.8 MB 00:00 2024-03-08T06:00:56.967 INFO:teuthology.orchestra.run.smithi042.stdout:(159/174): NetworkManager-tui-1.46.0-1.el9.x86_ 1.0 MB/s | 248 kB 00:00 2024-03-08T06:00:56.993 INFO:teuthology.orchestra.run.smithi042.stdout:(160/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.6 MB/s | 192 kB 00:00 2024-03-08T06:00:57.059 INFO:teuthology.orchestra.run.smithi042.stdout:(161/174): elfutils-libs-0.190-2.el9.x86_64.rpm 2.0 MB/s | 256 kB 00:00 2024-03-08T06:00:57.135 INFO:teuthology.orchestra.run.smithi042.stdout:(162/174): libacl-2.3.1-4.el9.x86_64.rpm 138 kB/s | 23 kB 00:00 2024-03-08T06:00:57.161 INFO:teuthology.orchestra.run.smithi042.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 648 kB/s | 108 kB 00:00 2024-03-08T06:00:57.202 INFO:teuthology.orchestra.run.smithi042.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 155 kB 00:00 2024-03-08T06:00:57.228 INFO:teuthology.orchestra.run.smithi042.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 973 kB/s | 64 kB 00:00 2024-03-08T06:00:57.253 INFO:teuthology.orchestra.run.smithi042.stdout:(166/174): libmount-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 136 kB 00:00 2024-03-08T06:00:57.278 INFO:teuthology.orchestra.run.smithi042.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 385 kB/s | 29 kB 00:00 2024-03-08T06:00:57.370 INFO:teuthology.orchestra.run.smithi042.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 8.6 MB/s | 1.2 MB 00:00 2024-03-08T06:00:57.459 INFO:teuthology.orchestra.run.smithi042.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 5.1 MB/s | 465 kB 00:00 2024-03-08T06:00:57.551 INFO:teuthology.orchestra.run.smithi042.stdout:(170/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 7.3 MB/s | 2.2 MB 00:00 2024-03-08T06:00:57.576 INFO:teuthology.orchestra.run.smithi042.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 268 kB/s | 31 kB 00:00 2024-03-08T06:00:57.635 INFO:teuthology.orchestra.run.smithi042.stdout:(172/174): util-linux-2.37.4-18.el9.x86_64.rpm 6.4 MB/s | 2.3 MB 00:00 2024-03-08T06:00:57.702 INFO:teuthology.orchestra.run.smithi042.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 7.2 MB/s | 1.1 MB 00:00 2024-03-08T06:00:57.886 INFO:teuthology.orchestra.run.smithi042.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 241 kB/s | 74 kB 00:00 2024-03-08T06:00:57.900 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2024-03-08T06:00:57.901 INFO:teuthology.orchestra.run.smithi042.stdout:Total 10 MB/s | 223 MB 00:22 2024-03-08T06:00:59.312 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-03-08T06:00:59.312 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-03-08T06:00:59.410 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2024-03-08T06:00:59.804 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2024-03-08T06:00:59.804 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2024-03-08T06:01:02.207 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2024-03-08T06:01:02.226 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2024-03-08T06:01:06.692 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-03-08T06:01:06.843 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-08T06:01:06.892 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-08T06:01:06.930 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-08T06:01:06.975 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-08T06:01:07.068 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-08T06:01:07.172 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-08T06:01:07.235 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-08T06:01:07.274 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-08T06:01:07.373 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-08T06:01:07.780 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-08T06:01:07.821 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librados2-2:19.0.0-1670.g1fb5d106.el9.x86_64 10/198 2024-03-08T06:01:07.987 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:19.0.0-1670.g1fb5d106.el9.x86_64 10/198 2024-03-08T06:01:08.014 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs2-2:19.0.0-1670.g1fb5d106.el9.x86_64 11/198 2024-03-08T06:01:08.135 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephfs2-2:19.0.0-1670.g1fb5d106.el9.x86_64 11/198 2024-03-08T06:01:08.182 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rados-2:19.0.0-1670.g1fb5d106.el9.x86_64 12/198 2024-03-08T06:01:08.253 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-08T06:01:08.572 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-08T06:01:08.627 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-08T06:01:08.652 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephsqlite-2:19.0.0-1670.g1fb5d106.el9.x86_64 16/198 2024-03-08T06:01:08.813 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1670.g1fb5d106.el9.x86_64 16/198 2024-03-08T06:01:08.845 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libradosstriper1-2:19.0.0-1670.g1fb5d106.el9.x86 17/198 2024-03-08T06:01:08.944 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1670.g1fb5d106.el9.x86 17/198 2024-03-08T06:01:08.989 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-08T06:01:09.022 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-08T06:01:09.087 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-08T06:01:09.363 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-08T06:01:09.413 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-08T06:01:09.464 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-08T06:01:09.810 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-08T06:01:09.857 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2024-03-08T06:01:09.952 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-08T06:01:10.001 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-08T06:01:10.021 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-08T06:01:10.047 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-08T06:01:10.092 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-08T06:01:10.111 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-08T06:01:10.180 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-08T06:01:10.327 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-08T06:01:10.389 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-08T06:01:10.412 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-08T06:01:10.477 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-08T06:01:10.513 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-08T06:01:10.602 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-08T06:01:10.745 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-08T06:01:10.938 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-08T06:01:11.020 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-08T06:01:11.060 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librados2-2:19.0.0-1670.g1fb5d106.el9.x86_64 10/198 2024-03-08T06:01:11.067 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-08T06:01:11.113 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-08T06:01:11.151 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-08T06:01:11.212 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-08T06:01:11.247 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:19.0.0-1670.g1fb5d106.el9.x86_64 10/198 2024-03-08T06:01:11.278 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs2-2:19.0.0-1670.g1fb5d106.el9.x86_64 11/198 2024-03-08T06:01:11.324 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-08T06:01:11.392 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-08T06:01:11.401 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephfs2-2:19.0.0-1670.g1fb5d106.el9.x86_64 11/198 2024-03-08T06:01:11.440 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-08T06:01:11.443 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rados-2:19.0.0-1670.g1fb5d106.el9.x86_64 12/198 2024-03-08T06:01:11.525 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-08T06:01:11.565 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-08T06:01:11.611 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-08T06:01:11.675 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-08T06:01:11.724 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-08T06:01:11.764 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-08T06:01:11.827 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-08T06:01:11.865 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-08T06:01:11.884 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-08T06:01:11.909 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephsqlite-2:19.0.0-1670.g1fb5d106.el9.x86_64 16/198 2024-03-08T06:01:11.917 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-common-2:19.0.0-1670.g1fb5d106.el9. 39/198 2024-03-08T06:01:11.970 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-argparse-2:19.0.0-1670.g1fb5d106.el 40/198 2024-03-08T06:01:12.000 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cephfs-2:19.0.0-1670.g1fb5d106.el9.x86_6 41/198 2024-03-08T06:01:12.060 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1670.g1fb5d106.el9.x86_64 16/198 2024-03-08T06:01:12.093 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libradosstriper1-2:19.0.0-1670.g1fb5d106.el9.x86 17/198 2024-03-08T06:01:12.122 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-08T06:01:12.180 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-08T06:01:12.193 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1670.g1fb5d106.el9.x86 17/198 2024-03-08T06:01:12.238 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-08T06:01:12.271 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-08T06:01:12.292 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-08T06:01:12.344 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-08T06:01:12.480 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-08T06:01:12.539 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-08T06:01:12.653 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-08T06:01:12.704 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-08T06:01:12.746 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-08T06:01:13.070 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-08T06:01:13.248 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-08T06:01:13.260 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-08T06:01:13.350 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-08T06:01:13.353 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-08T06:01:13.454 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-08T06:01:13.495 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-08T06:01:13.520 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-08T06:01:13.546 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-08T06:01:13.594 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-08T06:01:13.613 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-08T06:01:13.649 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-08T06:01:13.668 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librados-devel-2:19.0.0-1670.g1fb5d106.el9.x86_6 53/198 2024-03-08T06:01:13.710 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-08T06:01:14.021 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-08T06:01:14.096 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-08T06:01:14.211 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-08T06:01:14.328 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-08T06:01:14.348 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-08T06:01:14.388 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-08T06:01:14.407 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-08T06:01:14.425 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-08T06:01:14.463 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-08T06:01:14.488 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-08T06:01:14.613 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-08T06:01:14.664 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-08T06:01:14.710 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-08T06:01:14.720 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-08T06:01:14.758 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-08T06:01:14.784 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-08T06:01:14.863 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-08T06:01:14.872 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-08T06:01:14.912 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-08T06:01:14.912 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-08T06:01:14.952 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-08T06:01:14.977 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-08T06:01:15.020 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-08T06:01:15.026 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-08T06:01:15.060 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-08T06:01:15.065 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-08T06:01:15.125 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-08T06:01:15.187 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-08T06:01:15.193 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-08T06:01:15.226 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-common-2:19.0.0-1670.g1fb5d106.el9. 39/198 2024-03-08T06:01:15.278 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-argparse-2:19.0.0-1670.g1fb5d106.el 40/198 2024-03-08T06:01:15.308 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cephfs-2:19.0.0-1670.g1fb5d106.el9.x86_6 41/198 2024-03-08T06:01:15.396 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-08T06:01:15.449 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-08T06:01:15.470 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-08T06:01:15.488 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-08T06:01:15.539 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-08T06:01:15.548 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-08T06:01:15.660 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-08T06:01:15.673 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-08T06:01:15.711 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 74/198 2024-03-08T06:01:15.754 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-08T06:01:15.785 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-08T06:01:15.817 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-08T06:01:15.839 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-08T06:01:15.906 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-08T06:01:15.970 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-08T06:01:16.148 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-08T06:01:16.291 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-08T06:01:16.354 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-08T06:01:16.420 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-08T06:01:16.493 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-08T06:01:16.625 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-08T06:01:16.734 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-08T06:01:16.747 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-08T06:01:16.808 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-08T06:01:16.862 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-08T06:01:16.911 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-08T06:01:16.936 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-08T06:01:16.985 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-08T06:01:16.988 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-08T06:01:17.039 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 87/198 2024-03-08T06:01:17.054 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-08T06:01:17.079 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-08T06:01:17.114 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librados-devel-2:19.0.0-1670.g1fb5d106.el9.x86_6 53/198 2024-03-08T06:01:17.126 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-08T06:01:17.168 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-08T06:01:17.178 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-08T06:01:17.214 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-08T06:01:17.282 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-08T06:01:17.332 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-08T06:01:17.379 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-08T06:01:17.513 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-08T06:01:17.558 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-08T06:01:17.574 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-08T06:01:17.590 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-08T06:01:17.646 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-08T06:01:17.688 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-08T06:01:17.834 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-08T06:01:17.836 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-08T06:01:17.919 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-08T06:01:17.957 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-08T06:01:17.991 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-08T06:01:18.018 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-08T06:01:18.054 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-08T06:01:18.113 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-08T06:01:18.230 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-08T06:01:18.256 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-08T06:01:18.296 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-08T06:01:18.320 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-08T06:01:18.379 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-08T06:01:18.483 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-08T06:01:18.530 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-08T06:01:18.577 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-08T06:01:18.652 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-08T06:01:18.694 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-08T06:01:18.760 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-08T06:01:18.827 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-08T06:01:19.061 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-08T06:01:19.116 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-08T06:01:19.152 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-08T06:01:19.201 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-08T06:01:19.331 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-08T06:01:19.335 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-08T06:01:19.377 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 74/198 2024-03-08T06:01:19.385 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-08T06:01:19.419 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-08T06:01:19.422 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-08T06:01:19.459 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-08T06:01:19.477 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-08T06:01:19.493 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-08T06:01:19.592 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-08T06:01:19.644 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-08T06:01:19.666 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-08T06:01:19.851 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-08T06:01:19.882 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-08T06:01:19.916 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-08T06:01:20.000 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-08T06:01:20.016 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-08T06:01:20.062 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-08T06:01:20.136 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-08T06:01:20.212 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-08T06:01:20.462 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-08T06:01:20.642 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-08T06:01:20.831 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-08T06:01:20.859 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-08T06:01:20.880 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 87/198 2024-03-08T06:01:20.921 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-08T06:01:20.960 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-08T06:01:21.008 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-08T06:01:21.017 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-08T06:01:21.066 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-08T06:01:21.136 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-08T06:01:21.190 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-08T06:01:21.239 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-08T06:01:21.384 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-08T06:01:21.426 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-08T06:01:21.469 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-08T06:01:21.537 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-08T06:01:21.582 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-08T06:01:21.733 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-08T06:01:21.850 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-08T06:01:21.910 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-08T06:01:21.946 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-08T06:01:22.004 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-08T06:01:22.146 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-08T06:01:22.211 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-08T06:01:22.621 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-08T06:01:22.704 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-08T06:01:22.741 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-08T06:01:22.772 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-08T06:01:22.812 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-08T06:01:23.199 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-08T06:01:23.227 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librbd1-2:19.0.0-1670.g1fb5d106.el9.x86_64 124/198 2024-03-08T06:01:23.238 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-08T06:01:23.302 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-08T06:01:23.332 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:19.0.0-1670.g1fb5d106.el9.x86_64 124/198 2024-03-08T06:01:23.336 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-08T06:01:23.367 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 125/198 2024-03-08T06:01:23.397 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-08T06:01:23.426 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-08T06:01:23.521 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-08T06:01:23.561 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-08T06:01:23.809 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-08T06:01:23.841 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-08T06:01:23.941 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-08T06:01:23.966 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-08T06:01:23.997 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librgw2-2:19.0.0-1670.g1fb5d106.el9.x86_64 128/198 2024-03-08T06:01:24.097 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librgw2-2:19.0.0-1670.g1fb5d106.el9.x86_64 128/198 2024-03-08T06:01:24.124 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 129/198 2024-03-08T06:01:24.777 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-08T06:01:24.909 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-08T06:01:26.530 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-08T06:01:26.645 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 130/198 2024-03-08T06:01:26.687 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 130/198 2024-03-08T06:01:26.938 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-08T06:01:26.986 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-08T06:01:27.027 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-08T06:01:27.078 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-08T06:01:27.343 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 130/198 2024-03-08T06:01:27.382 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-base-2:19.0.0-1670.g1fb5d106.el9.x86_64 131/198 2024-03-08T06:01:27.492 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-08T06:01:27.519 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librbd1-2:19.0.0-1670.g1fb5d106.el9.x86_64 124/198 2024-03-08T06:01:27.547 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-base-2:19.0.0-1670.g1fb5d106.el9.x86_64 131/198 2024-03-08T06:01:27.547 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-08T06:01:27.547 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-08T06:01:27.547 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:01:27.591 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-selinux-2:19.0.0-1670.g1fb5d106.el9.x86_64 132/198 2024-03-08T06:01:27.643 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:19.0.0-1670.g1fb5d106.el9.x86_64 124/198 2024-03-08T06:01:27.676 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 125/198 2024-03-08T06:01:27.742 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-08T06:01:28.303 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-08T06:01:28.330 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librgw2-2:19.0.0-1670.g1fb5d106.el9.x86_64 128/198 2024-03-08T06:01:28.431 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librgw2-2:19.0.0-1670.g1fb5d106.el9.x86_64 128/198 2024-03-08T06:01:28.457 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 129/198 2024-03-08T06:01:31.079 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 130/198 2024-03-08T06:01:31.112 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 130/198 2024-03-08T06:01:31.765 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 130/198 2024-03-08T06:01:31.806 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-base-2:19.0.0-1670.g1fb5d106.el9.x86_64 131/198 2024-03-08T06:01:31.968 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-base-2:19.0.0-1670.g1fb5d106.el9.x86_64 131/198 2024-03-08T06:01:32.035 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-08T06:01:32.035 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-08T06:01:32.035 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:01:32.036 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-selinux-2:19.0.0-1670.g1fb5d106.el9.x86_64 132/198 2024-03-08T06:01:41.027 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1670.g1fb5d106.el9.x86_64 132/198 2024-03-08T06:01:41.027 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /sys 2024-03-08T06:01:41.027 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /proc 2024-03-08T06:01:41.027 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /mnt 2024-03-08T06:01:41.027 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /var/tmp 2024-03-08T06:01:41.027 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /home 2024-03-08T06:01:41.027 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /root 2024-03-08T06:01:41.027 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /tmp 2024-03-08T06:01:41.027 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:01:41.280 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-volume-2:19.0.0-1670.g1fb5d106.el9.noarch 133/198 2024-03-08T06:01:41.331 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-volume-2:19.0.0-1670.g1fb5d106.el9.noarch 133/198 2024-03-08T06:01:41.331 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T06:01:41.331 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-08T06:01:41.331 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:01:43.035 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-osd-2:19.0.0-1670.g1fb5d106.el9.x86_64 134/198 2024-03-08T06:01:43.114 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-osd-2:19.0.0-1670.g1fb5d106.el9.x86_64 134/198 2024-03-08T06:01:43.115 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T06:01:43.115 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-08T06:01:43.115 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-08T06:01:43.115 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-08T06:01:43.115 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:01:43.360 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mds-2:19.0.0-1670.g1fb5d106.el9.x86_64 135/198 2024-03-08T06:01:43.432 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mds-2:19.0.0-1670.g1fb5d106.el9.x86_64 135/198 2024-03-08T06:01:43.432 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T06:01:43.432 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-08T06:01:43.432 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-08T06:01:43.432 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-08T06:01:43.432 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:01:43.944 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mon-2:19.0.0-1670.g1fb5d106.el9.x86_64 136/198 2024-03-08T06:01:44.015 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mon-2:19.0.0-1670.g1fb5d106.el9.x86_64 136/198 2024-03-08T06:01:44.015 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T06:01:44.015 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-08T06:01:44.015 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-08T06:01:44.015 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-08T06:01:44.015 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:01:44.138 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-08T06:01:44.789 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephadm-2:19.0.0-1670.g1fb5d106.el9.noarch 138/198 2024-03-08T06:01:44.826 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephadm-2:19.0.0-1670.g1fb5d106.el9.noarch 138/198 2024-03-08T06:01:44.882 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1670.g1fb5d106.e 139/198 2024-03-08T06:01:44.984 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1670.g1fb5d106. 140/198 2024-03-08T06:01:45.017 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1670.g1fb5d106.el9.noa 141/198 2024-03-08T06:01:45.357 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1670.g1fb5d106.el9.noa 141/198 2024-03-08T06:01:45.393 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1670.g1fb5d106.el9.n 142/198 2024-03-08T06:01:45.536 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1670.g1fb5d106.el9.x86_64 132/198 2024-03-08T06:01:45.536 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /sys 2024-03-08T06:01:45.536 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /proc 2024-03-08T06:01:45.536 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /mnt 2024-03-08T06:01:45.536 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /var/tmp 2024-03-08T06:01:45.536 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /home 2024-03-08T06:01:45.536 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /root 2024-03-08T06:01:45.537 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /tmp 2024-03-08T06:01:45.537 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:01:45.772 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-volume-2:19.0.0-1670.g1fb5d106.el9.noarch 133/198 2024-03-08T06:01:45.823 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-volume-2:19.0.0-1670.g1fb5d106.el9.noarch 133/198 2024-03-08T06:01:45.823 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T06:01:45.823 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-08T06:01:45.823 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:01:46.543 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1670.g1fb5d106.el9.n 142/198 2024-03-08T06:01:46.577 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1670.g1fb 143/198 2024-03-08T06:01:46.727 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1670.g1fb 143/198 2024-03-08T06:01:46.908 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1670.g1fb5d106.el 144/198 2024-03-08T06:01:46.946 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-2:19.0.0-1670.g1fb5d106.el9.x86_64 145/198 2024-03-08T06:01:47.017 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1670.g1fb5d106.el9.x86_64 145/198 2024-03-08T06:01:47.017 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T06:01:47.017 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-08T06:01:47.017 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-08T06:01:47.017 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-08T06:01:47.018 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:01:47.072 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-rook-2:19.0.0-1670.g1fb5d106.el9.noarch 146/198 2024-03-08T06:01:47.112 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1670.g1fb5d106.el9.noarch 146/198 2024-03-08T06:01:47.180 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-2:19.0.0-1670.g1fb5d106.el9.x86_64 147/198 2024-03-08T06:01:47.505 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-osd-2:19.0.0-1670.g1fb5d106.el9.x86_64 134/198 2024-03-08T06:01:47.587 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-osd-2:19.0.0-1670.g1fb5d106.el9.x86_64 134/198 2024-03-08T06:01:47.587 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T06:01:47.587 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-08T06:01:47.587 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-08T06:01:47.587 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-08T06:01:47.587 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:01:47.822 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mds-2:19.0.0-1670.g1fb5d106.el9.x86_64 135/198 2024-03-08T06:01:47.894 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mds-2:19.0.0-1670.g1fb5d106.el9.x86_64 135/198 2024-03-08T06:01:47.894 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T06:01:47.894 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-08T06:01:47.895 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-08T06:01:47.895 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-08T06:01:47.895 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:01:48.179 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-08T06:01:48.207 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-radosgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 149/198 2024-03-08T06:01:48.284 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 149/198 2024-03-08T06:01:48.284 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T06:01:48.284 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-08T06:01:48.285 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-08T06:01:48.285 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-08T06:01:48.285 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:01:48.333 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1670.g1fb5d 150/198 2024-03-08T06:01:48.406 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mon-2:19.0.0-1670.g1fb5d106.el9.x86_64 136/198 2024-03-08T06:01:48.423 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1670.g1fb5d 150/198 2024-03-08T06:01:48.423 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T06:01:48.423 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-08T06:01:48.423 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:01:48.477 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mon-2:19.0.0-1670.g1fb5d106.el9.x86_64 136/198 2024-03-08T06:01:48.477 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T06:01:48.477 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-08T06:01:48.477 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-08T06:01:48.477 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-08T06:01:48.477 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:01:48.508 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 151/198 2024-03-08T06:01:48.592 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-08T06:01:48.614 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 151/198 2024-03-08T06:01:48.614 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T06:01:48.615 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-08T06:01:48.615 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-08T06:01:48.615 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-08T06:01:48.615 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:01:49.001 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 152/198 2024-03-08T06:01:49.085 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 152/198 2024-03-08T06:01:49.085 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T06:01:49.085 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-08T06:01:49.085 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-08T06:01:49.085 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-08T06:01:49.085 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:01:49.243 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephadm-2:19.0.0-1670.g1fb5d106.el9.noarch 138/198 2024-03-08T06:01:49.276 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephadm-2:19.0.0-1670.g1fb5d106.el9.noarch 138/198 2024-03-08T06:01:49.326 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1670.g1fb5d106.e 139/198 2024-03-08T06:01:49.431 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1670.g1fb5d106. 140/198 2024-03-08T06:01:49.463 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1670.g1fb5d106.el9.noa 141/198 2024-03-08T06:01:49.800 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1670.g1fb5d106.el9.noa 141/198 2024-03-08T06:01:49.839 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1670.g1fb5d106.el9.n 142/198 2024-03-08T06:01:51.026 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1670.g1fb5d106.el9.n 142/198 2024-03-08T06:01:51.064 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1670.g1fb 143/198 2024-03-08T06:01:51.216 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1670.g1fb 143/198 2024-03-08T06:01:51.411 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1670.g1fb5d106.el 144/198 2024-03-08T06:01:51.441 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-2:19.0.0-1670.g1fb5d106.el9.x86_64 145/198 2024-03-08T06:01:51.515 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1670.g1fb5d106.el9.x86_64 145/198 2024-03-08T06:01:51.516 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T06:01:51.516 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-08T06:01:51.516 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-08T06:01:51.516 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-08T06:01:51.516 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:01:51.575 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-rook-2:19.0.0-1670.g1fb5d106.el9.noarch 146/198 2024-03-08T06:01:51.615 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1670.g1fb5d106.el9.noarch 146/198 2024-03-08T06:01:51.684 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-2:19.0.0-1670.g1fb5d106.el9.x86_64 147/198 2024-03-08T06:01:52.666 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-08T06:01:52.702 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-radosgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 149/198 2024-03-08T06:01:52.776 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 149/198 2024-03-08T06:01:52.776 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T06:01:52.776 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-08T06:01:52.776 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-08T06:01:52.776 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-08T06:01:52.776 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:01:52.828 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1670.g1fb5d 150/198 2024-03-08T06:01:52.924 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1670.g1fb5d 150/198 2024-03-08T06:01:52.925 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T06:01:52.925 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-08T06:01:52.925 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:01:52.996 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 151/198 2024-03-08T06:01:53.104 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 151/198 2024-03-08T06:01:53.104 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T06:01:53.104 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-08T06:01:53.104 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-08T06:01:53.104 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-08T06:01:53.104 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:01:53.504 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 152/198 2024-03-08T06:01:53.607 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 152/198 2024-03-08T06:01:53.607 INFO:teuthology.orchestra.run.smithi042.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-08T06:01:53.607 INFO:teuthology.orchestra.run.smithi042.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-08T06:01:53.607 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-08T06:01:53.607 INFO:teuthology.orchestra.run.smithi042.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-08T06:01:53.607 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:01:54.167 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-test-2:19.0.0-1670.g1fb5d106.el9.x86_64 153/198 2024-03-08T06:01:54.228 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 154/198 2024-03-08T06:01:54.266 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-nbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 155/198 2024-03-08T06:01:54.313 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-08T06:01:54.619 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-shell-2:19.0.0-1670.g1fb5d106.el9.x86_64 157/198 2024-03-08T06:01:54.753 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-08T06:01:54.799 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 159/198 2024-03-08T06:01:54.861 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-08T06:01:54.923 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-08T06:01:54.977 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-08T06:01:55.021 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs-devel-2:19.0.0-1670.g1fb5d106.el9.x86_ 163/198 2024-03-08T06:01:55.065 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-08T06:01:55.117 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 165/198 2024-03-08T06:01:55.206 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 166/198 2024-03-08T06:01:55.319 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-08T06:01:55.356 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-08T06:01:56.328 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-08T06:01:56.378 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-08T06:01:56.447 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-08T06:01:57.871 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-top-2:19.0.0-1670.g1fb5d106.el9.noarch 170/198 2024-03-08T06:01:57.967 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-08T06:01:58.016 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-08T06:01:58.155 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-08T06:01:58.211 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-08T06:01:58.244 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-08T06:01:58.279 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-08T06:01:58.321 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-08T06:01:58.322 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-08T06:01:58.466 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-08T06:01:58.507 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-08T06:01:58.508 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-08T06:01:58.654 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-08T06:01:58.678 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-test-2:19.0.0-1670.g1fb5d106.el9.x86_64 153/198 2024-03-08T06:01:58.707 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-08T06:01:58.735 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 154/198 2024-03-08T06:01:58.752 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-08T06:01:58.776 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-nbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 155/198 2024-03-08T06:01:58.786 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-08T06:01:58.816 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-08T06:01:58.818 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-08T06:01:58.888 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-08T06:01:58.966 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-08T06:01:59.023 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-08T06:01:59.056 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-08T06:01:59.090 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-08T06:01:59.122 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-shell-2:19.0.0-1670.g1fb5d106.el9.x86_64 157/198 2024-03-08T06:01:59.123 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-08T06:01:59.157 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-08T06:01:59.194 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-08T06:01:59.195 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-08T06:01:59.250 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-08T06:01:59.303 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 159/198 2024-03-08T06:01:59.375 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-08T06:01:59.435 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-08T06:01:59.481 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-08T06:01:59.524 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs-devel-2:19.0.0-1670.g1fb5d106.el9.x86_ 163/198 2024-03-08T06:01:59.541 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-08T06:01:59.541 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-08T06:01:59.577 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-08T06:01:59.629 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 165/198 2024-03-08T06:01:59.688 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-08T06:01:59.726 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-08T06:01:59.727 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 166/198 2024-03-08T06:01:59.760 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-08T06:01:59.819 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-08T06:01:59.842 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-08T06:01:59.861 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-08T06:01:59.876 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-08T06:01:59.984 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-08T06:02:00.248 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-08T06:02:00.248 INFO:teuthology.orchestra.run.smithi019.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-08T06:02:00.248 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:00.798 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-08T06:02:00.840 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-08T06:02:00.899 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-08T06:02:02.330 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-top-2:19.0.0-1670.g1fb5d106.el9.noarch 170/198 2024-03-08T06:02:02.423 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-08T06:02:02.480 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-08T06:02:02.610 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-08T06:02:02.649 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-08T06:02:02.683 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-08T06:02:02.717 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-08T06:02:02.789 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-08T06:02:02.789 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-08T06:02:02.938 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-08T06:02:02.980 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-08T06:02:02.980 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-08T06:02:03.135 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-08T06:02:03.186 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-08T06:02:03.233 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-08T06:02:03.266 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-08T06:02:03.299 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-08T06:02:03.368 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-08T06:02:03.446 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-08T06:02:03.504 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-08T06:02:03.536 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-08T06:02:03.570 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-08T06:02:03.612 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-08T06:02:03.645 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-08T06:02:03.683 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-08T06:02:03.684 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-08T06:02:04.021 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-08T06:02:04.021 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-08T06:02:04.192 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-08T06:02:04.232 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-08T06:02:04.265 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-08T06:02:04.324 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-08T06:02:04.367 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-08T06:02:04.488 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-08T06:02:04.755 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-08T06:02:04.755 INFO:teuthology.orchestra.run.smithi042.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-08T06:02:04.755 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-2:19.0.0-1670.g1fb5d106.el9.x86_64 1/198 2024-03-08T06:02:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-base-2:19.0.0-1670.g1fb5d106.el9.x86_64 2/198 2024-03-08T06:02:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 3/198 2024-03-08T06:02:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 4/198 2024-03-08T06:02:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1670.g1fb5d 5/198 2024-03-08T06:02:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mds-2:19.0.0-1670.g1fb5d106.el9.x86_64 6/198 2024-03-08T06:02:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-2:19.0.0-1670.g1fb5d106.el9.x86_64 7/198 2024-03-08T06:02:05.045 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mon-2:19.0.0-1670.g1fb5d106.el9.x86_64 8/198 2024-03-08T06:02:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-osd-2:19.0.0-1670.g1fb5d106.el9.x86_64 9/198 2024-03-08T06:02:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-radosgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 10/198 2024-03-08T06:02:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-selinux-2:19.0.0-1670.g1fb5d106.el9.x86_64 11/198 2024-03-08T06:02:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-test-2:19.0.0-1670.g1fb5d106.el9.x86_64 12/198 2024-03-08T06:02:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 13/198 2024-03-08T06:02:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-shell-2:19.0.0-1670.g1fb5d106.el9.x86_64 14/198 2024-03-08T06:02:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs-devel-2:19.0.0-1670.g1fb5d106.el9.x86_ 15/198 2024-03-08T06:02:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs2-2:19.0.0-1670.g1fb5d106.el9.x86_64 16/198 2024-03-08T06:02:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephsqlite-2:19.0.0-1670.g1fb5d106.el9.x86_64 17/198 2024-03-08T06:02:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados-devel-2:19.0.0-1670.g1fb5d106.el9.x86_6 18/198 2024-03-08T06:02:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libradosstriper1-2:19.0.0-1670.g1fb5d106.el9.x86 19/198 2024-03-08T06:02:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librgw2-2:19.0.0-1670.g1fb5d106.el9.x86_64 20/198 2024-03-08T06:02:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1670.g1fb5d106.el 21/198 2024-03-08T06:02:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-common-2:19.0.0-1670.g1fb5d106.el9. 22/198 2024-03-08T06:02:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cephfs-2:19.0.0-1670.g1fb5d106.el9.x86_6 23/198 2024-03-08T06:02:05.046 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rados-2:19.0.0-1670.g1fb5d106.el9.x86_64 24/198 2024-03-08T06:02:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 25/198 2024-03-08T06:02:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 26/198 2024-03-08T06:02:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 27/198 2024-03-08T06:02:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 28/198 2024-03-08T06:02:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-nbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 29/198 2024-03-08T06:02:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1670.g1fb5d106. 30/198 2024-03-08T06:02:05.047 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1670.g1fb5d106.el9.noa 31/198 2024-03-08T06:02:05.066 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1670.g1fb5d106.el9.n 32/198 2024-03-08T06:02:05.067 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1670.g1fb 33/198 2024-03-08T06:02:05.067 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1670.g1fb5d106.el 34/198 2024-03-08T06:02:05.067 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1670.g1fb5d106.el9.noarch 35/198 2024-03-08T06:02:05.067 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1670.g1fb5d106.e 36/198 2024-03-08T06:02:05.067 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-volume-2:19.0.0-1670.g1fb5d106.el9.noarch 37/198 2024-03-08T06:02:05.067 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephadm-2:19.0.0-1670.g1fb5d106.el9.noarch 38/198 2024-03-08T06:02:05.067 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-top-2:19.0.0-1670.g1fb5d106.el9.noarch 39/198 2024-03-08T06:02:05.067 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-08T06:02:05.067 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-08T06:02:05.067 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-08T06:02:05.067 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-08T06:02:05.067 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-08T06:02:05.067 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-08T06:02:05.067 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-08T06:02:05.068 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-08T06:02:05.068 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-08T06:02:05.068 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-08T06:02:05.068 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-08T06:02:05.068 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-08T06:02:05.068 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-08T06:02:05.068 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-08T06:02:05.068 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-08T06:02:05.068 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-08T06:02:05.068 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-08T06:02:05.068 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-08T06:02:05.068 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-08T06:02:05.068 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-08T06:02:05.068 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-08T06:02:05.068 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-08T06:02:05.069 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-08T06:02:05.069 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-08T06:02:05.069 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-08T06:02:05.069 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-08T06:02:05.069 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-08T06:02:05.069 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-08T06:02:05.069 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-08T06:02:05.069 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-08T06:02:05.069 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-08T06:02:05.069 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-08T06:02:05.069 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-08T06:02:05.069 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-08T06:02:05.069 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-08T06:02:05.069 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-08T06:02:05.070 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-08T06:02:05.070 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-08T06:02:05.070 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-08T06:02:05.070 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-08T06:02:05.070 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-08T06:02:05.070 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-08T06:02:05.070 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-08T06:02:05.070 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-08T06:02:05.070 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-08T06:02:05.070 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-08T06:02:05.070 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-08T06:02:05.070 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-08T06:02:05.070 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-08T06:02:05.070 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-08T06:02:05.071 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-08T06:02:05.071 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-08T06:02:05.071 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-08T06:02:05.071 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-08T06:02:05.071 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-08T06:02:05.071 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-08T06:02:05.071 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-08T06:02:05.071 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-08T06:02:05.071 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-08T06:02:05.071 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-08T06:02:05.071 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-08T06:02:05.071 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-08T06:02:05.071 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-08T06:02:05.071 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-08T06:02:05.071 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-08T06:02:05.072 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-08T06:02:05.072 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-08T06:02:05.072 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-08T06:02:05.072 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-08T06:02:05.072 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-08T06:02:05.072 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-08T06:02:05.072 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-08T06:02:05.072 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-08T06:02:05.072 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-08T06:02:05.072 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-08T06:02:05.072 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-08T06:02:05.072 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/198 2024-03-08T06:02:05.072 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-08T06:02:05.072 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-08T06:02:05.072 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-08T06:02:05.073 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-08T06:02:05.073 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-08T06:02:05.073 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-08T06:02:05.073 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-08T06:02:05.073 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/198 2024-03-08T06:02:05.073 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-08T06:02:05.073 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-08T06:02:05.073 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-08T06:02:05.073 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-08T06:02:05.073 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-08T06:02:05.073 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-08T06:02:05.073 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-08T06:02:05.073 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-08T06:02:05.073 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-08T06:02:05.073 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-08T06:02:05.074 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-08T06:02:05.074 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-08T06:02:05.074 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-08T06:02:05.074 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-08T06:02:05.074 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-08T06:02:05.074 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-08T06:02:05.074 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-08T06:02:05.074 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-08T06:02:05.074 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-08T06:02:05.074 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-08T06:02:05.074 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-08T06:02:05.074 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-08T06:02:05.074 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-08T06:02:05.074 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-08T06:02:05.075 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-08T06:02:05.075 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-08T06:02:05.075 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:19.0.0-1670.g1fb5d106.el9.x86_64 151/198 2024-03-08T06:02:05.075 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-08T06:02:05.075 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:19.0.0-1670.g1fb5d106.el9.x86_64 153/198 2024-03-08T06:02:05.075 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-08T06:02:05.075 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-08T06:02:05.075 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-08T06:02:05.075 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/198 2024-03-08T06:02:05.075 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-08T06:02:05.075 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/198 2024-03-08T06:02:05.075 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-08T06:02:05.075 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/198 2024-03-08T06:02:05.075 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-08T06:02:05.075 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/198 2024-03-08T06:02:05.076 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-08T06:02:05.076 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-08T06:02:05.076 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-08T06:02:05.076 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-08T06:02:05.076 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-08T06:02:05.076 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-08T06:02:05.076 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-08T06:02:05.076 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-08T06:02:05.076 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-08T06:02:05.076 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-08T06:02:05.076 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-08T06:02:05.076 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-08T06:02:05.076 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-08T06:02:05.076 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-08T06:02:05.076 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-08T06:02:05.077 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-08T06:02:05.077 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-08T06:02:05.077 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-08T06:02:05.077 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-08T06:02:05.077 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-08T06:02:05.077 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-08T06:02:05.077 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-08T06:02:05.077 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-08T06:02:05.077 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-08T06:02:05.077 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-08T06:02:05.077 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-08T06:02:05.077 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-08T06:02:05.077 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-08T06:02:05.077 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-08T06:02:05.077 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-08T06:02:05.078 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-08T06:02:05.078 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-08T06:02:05.078 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-08T06:02:05.078 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-08T06:02:07.608 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-08T06:02:07.609 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:07.609 INFO:teuthology.orchestra.run.smithi019.stdout:Upgraded: 2024-03-08T06:02:07.609 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-08T06:02:07.609 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-08T06:02:07.609 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-08T06:02:07.609 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-08T06:02:07.609 INFO:teuthology.orchestra.run.smithi019.stdout: acl-2.3.1-4.el9.x86_64 2024-03-08T06:02:07.609 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-08T06:02:07.609 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-08T06:02:07.609 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-08T06:02:07.609 INFO:teuthology.orchestra.run.smithi019.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-08T06:02:07.609 INFO:teuthology.orchestra.run.smithi019.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-08T06:02:07.610 INFO:teuthology.orchestra.run.smithi019.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-08T06:02:07.610 INFO:teuthology.orchestra.run.smithi019.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-08T06:02:07.610 INFO:teuthology.orchestra.run.smithi019.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-08T06:02:07.610 INFO:teuthology.orchestra.run.smithi019.stdout: librados2-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.610 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.610 INFO:teuthology.orchestra.run.smithi019.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-08T06:02:07.610 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-08T06:02:07.610 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-08T06:02:07.610 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-08T06:02:07.610 INFO:teuthology.orchestra.run.smithi019.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-08T06:02:07.610 INFO:teuthology.orchestra.run.smithi019.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-08T06:02:07.610 INFO:teuthology.orchestra.run.smithi019.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-08T06:02:07.610 INFO:teuthology.orchestra.run.smithi019.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-08T06:02:07.610 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-08T06:02:07.611 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-03-08T06:02:07.611 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-08T06:02:07.611 INFO:teuthology.orchestra.run.smithi019.stdout: automake-1.16.2-8.el9.noarch 2024-03-08T06:02:07.611 INFO:teuthology.orchestra.run.smithi019.stdout: bison-3.7.4-5.el9.x86_64 2024-03-08T06:02:07.611 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-08T06:02:07.611 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.611 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.611 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.611 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.611 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-03-08T06:02:07.611 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.611 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.611 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.611 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-03-08T06:02:07.611 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-03-08T06:02:07.611 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-03-08T06:02:07.612 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-03-08T06:02:07.612 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-03-08T06:02:07.612 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.612 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.612 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-03-08T06:02:07.612 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.612 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.612 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.612 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-03-08T06:02:07.612 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-03-08T06:02:07.612 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.612 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-shell-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.612 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-top-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-03-08T06:02:07.612 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-08T06:02:07.613 INFO:teuthology.orchestra.run.smithi019.stdout: flex-2.6.4-9.el9.x86_64 2024-03-08T06:02:07.613 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-08T06:02:07.613 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-08T06:02:07.613 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-08T06:02:07.613 INFO:teuthology.orchestra.run.smithi019.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-08T06:02:07.613 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-08T06:02:07.613 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-08T06:02:07.613 INFO:teuthology.orchestra.run.smithi019.stdout: jq-1.6-16.el9.x86_64 2024-03-08T06:02:07.613 INFO:teuthology.orchestra.run.smithi019.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-08T06:02:07.613 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-08T06:02:07.613 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-08T06:02:07.613 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.613 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.613 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.613 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-08T06:02:07.613 INFO:teuthology.orchestra.run.smithi019.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-08T06:02:07.614 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-08T06:02:07.614 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-08T06:02:07.614 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-08T06:02:07.614 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.614 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.614 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-08T06:02:07.614 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.614 INFO:teuthology.orchestra.run.smithi019.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-08T06:02:07.614 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-08T06:02:07.614 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-08T06:02:07.614 INFO:teuthology.orchestra.run.smithi019.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-08T06:02:07.614 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-08T06:02:07.614 INFO:teuthology.orchestra.run.smithi019.stdout: lua-5.4.4-4.el9.x86_64 2024-03-08T06:02:07.614 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-08T06:02:07.614 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-08T06:02:07.615 INFO:teuthology.orchestra.run.smithi019.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-08T06:02:07.615 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-08T06:02:07.615 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-08T06:02:07.615 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-08T06:02:07.615 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-08T06:02:07.615 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-13.11-1.el9.x86_64 2024-03-08T06:02:07.615 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-08T06:02:07.615 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-08T06:02:07.615 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-08T06:02:07.615 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-08T06:02:07.615 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-08T06:02:07.615 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-08T06:02:07.615 INFO:teuthology.orchestra.run.smithi019.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-08T06:02:07.615 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-08T06:02:07.615 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-08T06:02:07.615 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-08T06:02:07.615 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.616 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.616 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.616 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-08T06:02:07.616 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-08T06:02:07.616 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-08T06:02:07.616 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-08T06:02:07.616 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-08T06:02:07.616 INFO:teuthology.orchestra.run.smithi019.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-08T06:02:07.616 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-08T06:02:07.616 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-08T06:02:07.616 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-08T06:02:07.616 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-08T06:02:07.616 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-08T06:02:07.616 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-08T06:02:07.616 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-08T06:02:07.616 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-08T06:02:07.617 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-08T06:02:07.617 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-08T06:02:07.617 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-08T06:02:07.617 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-08T06:02:07.617 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-08T06:02:07.617 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-08T06:02:07.617 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-08T06:02:07.617 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-08T06:02:07.617 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-08T06:02:07.617 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-08T06:02:07.617 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-08T06:02:07.617 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-08T06:02:07.617 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-08T06:02:07.617 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-08T06:02:07.617 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-08T06:02:07.617 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-08T06:02:07.618 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply-3.11-14.el9.noarch 2024-03-08T06:02:07.618 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-08T06:02:07.618 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-08T06:02:07.618 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-08T06:02:07.618 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-08T06:02:07.618 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-08T06:02:07.618 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-08T06:02:07.618 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-08T06:02:07.618 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-08T06:02:07.618 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-08T06:02:07.618 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.618 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.618 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-08T06:02:07.618 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-08T06:02:07.618 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-08T06:02:07.619 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.619 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-08T06:02:07.619 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-08T06:02:07.619 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-08T06:02:07.619 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-08T06:02:07.619 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-08T06:02:07.619 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-08T06:02:07.619 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-08T06:02:07.619 INFO:teuthology.orchestra.run.smithi019.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-08T06:02:07.619 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-08T06:02:07.619 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-08T06:02:07.619 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-08T06:02:07.619 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-08T06:02:07.619 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-08T06:02:07.619 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-08T06:02:07.619 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-08T06:02:07.619 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.620 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.620 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:07.620 INFO:teuthology.orchestra.run.smithi019.stdout: re2-1:20211101-3.el9.x86_64 2024-03-08T06:02:07.620 INFO:teuthology.orchestra.run.smithi019.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-08T06:02:07.620 INFO:teuthology.orchestra.run.smithi019.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-08T06:02:07.620 INFO:teuthology.orchestra.run.smithi019.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-08T06:02:07.620 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-08T06:02:07.620 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-08T06:02:07.620 INFO:teuthology.orchestra.run.smithi019.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-08T06:02:07.620 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:07.620 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-03-08T06:02:08.445 DEBUG:teuthology.parallel:result is None 2024-03-08T06:02:09.712 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-2:19.0.0-1670.g1fb5d106.el9.x86_64 1/198 2024-03-08T06:02:09.712 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-base-2:19.0.0-1670.g1fb5d106.el9.x86_64 2/198 2024-03-08T06:02:09.712 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 3/198 2024-03-08T06:02:09.712 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 4/198 2024-03-08T06:02:09.712 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1670.g1fb5d 5/198 2024-03-08T06:02:09.712 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mds-2:19.0.0-1670.g1fb5d106.el9.x86_64 6/198 2024-03-08T06:02:09.712 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-2:19.0.0-1670.g1fb5d106.el9.x86_64 7/198 2024-03-08T06:02:09.712 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mon-2:19.0.0-1670.g1fb5d106.el9.x86_64 8/198 2024-03-08T06:02:09.712 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-osd-2:19.0.0-1670.g1fb5d106.el9.x86_64 9/198 2024-03-08T06:02:09.712 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-radosgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 10/198 2024-03-08T06:02:09.712 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-selinux-2:19.0.0-1670.g1fb5d106.el9.x86_64 11/198 2024-03-08T06:02:09.712 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-test-2:19.0.0-1670.g1fb5d106.el9.x86_64 12/198 2024-03-08T06:02:09.713 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 13/198 2024-03-08T06:02:09.713 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-shell-2:19.0.0-1670.g1fb5d106.el9.x86_64 14/198 2024-03-08T06:02:09.713 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs-devel-2:19.0.0-1670.g1fb5d106.el9.x86_ 15/198 2024-03-08T06:02:09.713 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs2-2:19.0.0-1670.g1fb5d106.el9.x86_64 16/198 2024-03-08T06:02:09.713 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephsqlite-2:19.0.0-1670.g1fb5d106.el9.x86_64 17/198 2024-03-08T06:02:09.713 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados-devel-2:19.0.0-1670.g1fb5d106.el9.x86_6 18/198 2024-03-08T06:02:09.713 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libradosstriper1-2:19.0.0-1670.g1fb5d106.el9.x86 19/198 2024-03-08T06:02:09.713 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librgw2-2:19.0.0-1670.g1fb5d106.el9.x86_64 20/198 2024-03-08T06:02:09.713 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1670.g1fb5d106.el 21/198 2024-03-08T06:02:09.713 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-common-2:19.0.0-1670.g1fb5d106.el9. 22/198 2024-03-08T06:02:09.713 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cephfs-2:19.0.0-1670.g1fb5d106.el9.x86_6 23/198 2024-03-08T06:02:09.713 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rados-2:19.0.0-1670.g1fb5d106.el9.x86_64 24/198 2024-03-08T06:02:09.713 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 25/198 2024-03-08T06:02:09.713 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 26/198 2024-03-08T06:02:09.713 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 27/198 2024-03-08T06:02:09.714 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 28/198 2024-03-08T06:02:09.714 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-nbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 29/198 2024-03-08T06:02:09.714 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1670.g1fb5d106. 30/198 2024-03-08T06:02:09.714 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1670.g1fb5d106.el9.noa 31/198 2024-03-08T06:02:09.714 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1670.g1fb5d106.el9.n 32/198 2024-03-08T06:02:09.714 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1670.g1fb 33/198 2024-03-08T06:02:09.714 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1670.g1fb5d106.el 34/198 2024-03-08T06:02:09.714 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1670.g1fb5d106.el9.noarch 35/198 2024-03-08T06:02:09.714 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1670.g1fb5d106.e 36/198 2024-03-08T06:02:09.714 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-volume-2:19.0.0-1670.g1fb5d106.el9.noarch 37/198 2024-03-08T06:02:09.714 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephadm-2:19.0.0-1670.g1fb5d106.el9.noarch 38/198 2024-03-08T06:02:09.714 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-top-2:19.0.0-1670.g1fb5d106.el9.noarch 39/198 2024-03-08T06:02:09.714 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-08T06:02:09.714 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-08T06:02:09.714 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-08T06:02:09.715 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-08T06:02:09.715 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-08T06:02:09.715 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-08T06:02:09.715 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-08T06:02:09.715 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-08T06:02:09.715 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-08T06:02:09.715 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-08T06:02:09.715 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-08T06:02:09.715 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-08T06:02:09.715 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-08T06:02:09.715 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-08T06:02:09.715 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-08T06:02:09.715 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-08T06:02:09.715 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-08T06:02:09.715 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-08T06:02:09.715 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-08T06:02:09.716 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-08T06:02:09.716 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-08T06:02:09.716 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-08T06:02:09.716 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-08T06:02:09.716 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-08T06:02:09.716 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-08T06:02:09.716 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-08T06:02:09.716 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-08T06:02:09.716 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-08T06:02:09.716 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-08T06:02:09.716 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-08T06:02:09.716 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-08T06:02:09.716 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-08T06:02:09.716 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-08T06:02:09.717 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-08T06:02:09.717 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-08T06:02:09.717 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-08T06:02:09.717 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-08T06:02:09.717 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-08T06:02:09.717 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-08T06:02:09.717 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-08T06:02:09.717 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-08T06:02:09.717 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-08T06:02:09.717 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-08T06:02:09.717 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-08T06:02:09.717 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-08T06:02:09.717 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-08T06:02:09.717 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-08T06:02:09.717 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-08T06:02:09.717 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-08T06:02:09.718 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-08T06:02:09.718 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-08T06:02:09.718 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-08T06:02:09.718 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-08T06:02:09.718 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-08T06:02:09.718 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-08T06:02:09.718 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-08T06:02:09.718 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-08T06:02:09.718 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-08T06:02:09.718 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-08T06:02:09.718 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-08T06:02:09.718 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-08T06:02:09.718 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-08T06:02:09.718 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-08T06:02:09.719 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-08T06:02:09.719 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-08T06:02:09.719 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-08T06:02:09.719 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-08T06:02:09.719 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-08T06:02:09.719 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-08T06:02:09.719 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-08T06:02:09.719 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-08T06:02:09.719 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-08T06:02:09.719 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-08T06:02:09.719 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-08T06:02:09.719 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-08T06:02:09.719 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-08T06:02:09.719 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/198 2024-03-08T06:02:09.719 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-08T06:02:09.720 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-08T06:02:09.720 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-08T06:02:09.720 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-08T06:02:09.720 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-08T06:02:09.720 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-08T06:02:09.720 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-08T06:02:09.720 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/198 2024-03-08T06:02:09.720 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-08T06:02:09.720 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-08T06:02:09.720 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-08T06:02:09.720 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-08T06:02:09.720 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-08T06:02:09.720 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-08T06:02:09.720 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-08T06:02:09.720 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-08T06:02:09.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-08T06:02:09.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-08T06:02:09.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-08T06:02:09.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-08T06:02:09.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-08T06:02:09.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-08T06:02:09.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-08T06:02:09.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-08T06:02:09.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-08T06:02:09.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-08T06:02:09.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-08T06:02:09.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-08T06:02:09.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-08T06:02:09.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-08T06:02:09.721 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-08T06:02:09.722 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-08T06:02:09.722 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-08T06:02:09.722 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-08T06:02:09.722 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:19.0.0-1670.g1fb5d106.el9.x86_64 151/198 2024-03-08T06:02:09.722 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-08T06:02:09.722 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:19.0.0-1670.g1fb5d106.el9.x86_64 153/198 2024-03-08T06:02:09.722 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-08T06:02:09.722 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-08T06:02:09.722 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-08T06:02:09.722 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/198 2024-03-08T06:02:09.722 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-08T06:02:09.722 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/198 2024-03-08T06:02:09.722 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-08T06:02:09.722 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/198 2024-03-08T06:02:09.723 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-08T06:02:09.723 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/198 2024-03-08T06:02:09.723 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-08T06:02:09.723 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-08T06:02:09.723 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-08T06:02:09.723 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-08T06:02:09.723 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-08T06:02:09.723 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-08T06:02:09.723 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-08T06:02:09.723 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-08T06:02:09.723 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-08T06:02:09.723 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-08T06:02:09.723 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-08T06:02:09.723 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-08T06:02:09.723 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-08T06:02:09.723 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-08T06:02:09.724 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-08T06:02:09.724 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-08T06:02:09.724 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-08T06:02:09.724 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-08T06:02:09.724 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-08T06:02:09.724 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-08T06:02:09.724 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-08T06:02:09.724 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-08T06:02:09.724 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-08T06:02:09.724 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-08T06:02:09.724 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-08T06:02:09.724 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-08T06:02:09.724 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-08T06:02:09.724 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-08T06:02:09.724 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-08T06:02:09.724 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-08T06:02:09.725 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-08T06:02:09.725 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-08T06:02:09.725 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-08T06:02:09.725 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-08T06:02:12.250 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-08T06:02:12.250 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:12.250 INFO:teuthology.orchestra.run.smithi042.stdout:Upgraded: 2024-03-08T06:02:12.250 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-08T06:02:12.250 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-08T06:02:12.250 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-08T06:02:12.250 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-08T06:02:12.250 INFO:teuthology.orchestra.run.smithi042.stdout: acl-2.3.1-4.el9.x86_64 2024-03-08T06:02:12.250 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-08T06:02:12.251 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-08T06:02:12.251 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-08T06:02:12.251 INFO:teuthology.orchestra.run.smithi042.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-08T06:02:12.251 INFO:teuthology.orchestra.run.smithi042.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-08T06:02:12.251 INFO:teuthology.orchestra.run.smithi042.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-08T06:02:12.251 INFO:teuthology.orchestra.run.smithi042.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-08T06:02:12.251 INFO:teuthology.orchestra.run.smithi042.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-08T06:02:12.251 INFO:teuthology.orchestra.run.smithi042.stdout: librados2-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.251 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.251 INFO:teuthology.orchestra.run.smithi042.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-08T06:02:12.251 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-08T06:02:12.251 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-08T06:02:12.251 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-08T06:02:12.251 INFO:teuthology.orchestra.run.smithi042.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-08T06:02:12.252 INFO:teuthology.orchestra.run.smithi042.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-08T06:02:12.252 INFO:teuthology.orchestra.run.smithi042.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-08T06:02:12.252 INFO:teuthology.orchestra.run.smithi042.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-08T06:02:12.252 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-08T06:02:12.252 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2024-03-08T06:02:12.252 INFO:teuthology.orchestra.run.smithi042.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-08T06:02:12.252 INFO:teuthology.orchestra.run.smithi042.stdout: automake-1.16.2-8.el9.noarch 2024-03-08T06:02:12.252 INFO:teuthology.orchestra.run.smithi042.stdout: bison-3.7.4-5.el9.x86_64 2024-03-08T06:02:12.252 INFO:teuthology.orchestra.run.smithi042.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-08T06:02:12.252 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.252 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.252 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.252 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.252 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-03-08T06:02:12.252 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.253 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.253 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.253 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-03-08T06:02:12.253 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-03-08T06:02:12.253 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-03-08T06:02:12.253 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-03-08T06:02:12.253 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-03-08T06:02:12.253 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.253 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.253 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-03-08T06:02:12.253 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.253 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.253 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.254 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-03-08T06:02:12.254 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-03-08T06:02:12.254 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.254 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-shell-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.254 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-top-2:19.0.0-1670.g1fb5d106.el9.noarch 2024-03-08T06:02:12.254 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-08T06:02:12.254 INFO:teuthology.orchestra.run.smithi042.stdout: flex-2.6.4-9.el9.x86_64 2024-03-08T06:02:12.254 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-08T06:02:12.254 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-08T06:02:12.254 INFO:teuthology.orchestra.run.smithi042.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-08T06:02:12.254 INFO:teuthology.orchestra.run.smithi042.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-08T06:02:12.254 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-08T06:02:12.254 INFO:teuthology.orchestra.run.smithi042.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-08T06:02:12.254 INFO:teuthology.orchestra.run.smithi042.stdout: jq-1.6-16.el9.x86_64 2024-03-08T06:02:12.255 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-08T06:02:12.255 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-08T06:02:12.255 INFO:teuthology.orchestra.run.smithi042.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-08T06:02:12.255 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.255 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.255 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.255 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-08T06:02:12.255 INFO:teuthology.orchestra.run.smithi042.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-08T06:02:12.255 INFO:teuthology.orchestra.run.smithi042.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-08T06:02:12.255 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-08T06:02:12.255 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-08T06:02:12.255 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.255 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.255 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-08T06:02:12.256 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.256 INFO:teuthology.orchestra.run.smithi042.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-08T06:02:12.256 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-08T06:02:12.256 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-08T06:02:12.256 INFO:teuthology.orchestra.run.smithi042.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-08T06:02:12.256 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-08T06:02:12.256 INFO:teuthology.orchestra.run.smithi042.stdout: lua-5.4.4-4.el9.x86_64 2024-03-08T06:02:12.256 INFO:teuthology.orchestra.run.smithi042.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-08T06:02:12.256 INFO:teuthology.orchestra.run.smithi042.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-08T06:02:12.256 INFO:teuthology.orchestra.run.smithi042.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-08T06:02:12.256 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-08T06:02:12.256 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-08T06:02:12.256 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-08T06:02:12.256 INFO:teuthology.orchestra.run.smithi042.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-08T06:02:12.256 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-13.11-1.el9.x86_64 2024-03-08T06:02:12.257 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-08T06:02:12.257 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-08T06:02:12.257 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-08T06:02:12.257 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-08T06:02:12.257 INFO:teuthology.orchestra.run.smithi042.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-08T06:02:12.257 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-08T06:02:12.257 INFO:teuthology.orchestra.run.smithi042.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-08T06:02:12.257 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-08T06:02:12.257 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-08T06:02:12.257 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-08T06:02:12.257 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.257 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.257 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.257 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-08T06:02:12.258 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-08T06:02:12.258 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-08T06:02:12.258 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-08T06:02:12.258 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-08T06:02:12.258 INFO:teuthology.orchestra.run.smithi042.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-08T06:02:12.258 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-08T06:02:12.258 INFO:teuthology.orchestra.run.smithi042.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-08T06:02:12.258 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-08T06:02:12.258 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-08T06:02:12.258 INFO:teuthology.orchestra.run.smithi042.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-08T06:02:12.258 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-08T06:02:12.258 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-08T06:02:12.258 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-08T06:02:12.258 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-08T06:02:12.259 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-08T06:02:12.259 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-08T06:02:12.259 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-08T06:02:12.259 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-08T06:02:12.259 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-08T06:02:12.259 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-08T06:02:12.259 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-08T06:02:12.259 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-08T06:02:12.259 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-08T06:02:12.259 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-08T06:02:12.259 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-08T06:02:12.259 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-08T06:02:12.259 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-08T06:02:12.259 INFO:teuthology.orchestra.run.smithi042.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-08T06:02:12.259 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-08T06:02:12.260 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ply-3.11-14.el9.noarch 2024-03-08T06:02:12.260 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-08T06:02:12.260 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-08T06:02:12.260 INFO:teuthology.orchestra.run.smithi042.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-08T06:02:12.260 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-08T06:02:12.260 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-08T06:02:12.260 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-08T06:02:12.260 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-08T06:02:12.260 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-08T06:02:12.260 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-08T06:02:12.260 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.260 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.260 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-08T06:02:12.260 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-08T06:02:12.261 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-08T06:02:12.261 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.261 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-08T06:02:12.261 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-08T06:02:12.261 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-08T06:02:12.261 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-08T06:02:12.261 INFO:teuthology.orchestra.run.smithi042.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-08T06:02:12.261 INFO:teuthology.orchestra.run.smithi042.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-08T06:02:12.261 INFO:teuthology.orchestra.run.smithi042.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-08T06:02:12.261 INFO:teuthology.orchestra.run.smithi042.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-08T06:02:12.261 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-08T06:02:12.261 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-08T06:02:12.261 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-08T06:02:12.261 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-08T06:02:12.261 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-08T06:02:12.262 INFO:teuthology.orchestra.run.smithi042.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-08T06:02:12.262 INFO:teuthology.orchestra.run.smithi042.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-08T06:02:12.262 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.262 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.262 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd-2:19.0.0-1670.g1fb5d106.el9.x86_64 2024-03-08T06:02:12.262 INFO:teuthology.orchestra.run.smithi042.stdout: re2-1:20211101-3.el9.x86_64 2024-03-08T06:02:12.262 INFO:teuthology.orchestra.run.smithi042.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-08T06:02:12.262 INFO:teuthology.orchestra.run.smithi042.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-08T06:02:12.262 INFO:teuthology.orchestra.run.smithi042.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-08T06:02:12.262 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-08T06:02:12.262 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-08T06:02:12.263 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-08T06:02:12.263 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:12.263 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2024-03-08T06:02:12.873 DEBUG:teuthology.parallel:result is None 2024-03-08T06:02:12.874 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-03-08T06:02:13.092 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-08T06:02:13.154 INFO:teuthology.orchestra.run.smithi019.stdout:19.0.0-1670.g1fb5d106.el9 2024-03-08T06:02:13.155 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1670.g1fb5d106.el9 2024-03-08T06:02:13.155 INFO:teuthology.task.install:The correct ceph version 19.0.0-1670.g1fb5d106 is installed. 2024-03-08T06:02:13.156 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-03-08T06:02:13.374 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-08T06:02:13.438 INFO:teuthology.orchestra.run.smithi042.stdout:19.0.0-1670.g1fb5d106.el9 2024-03-08T06:02:13.439 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1670.g1fb5d106.el9 2024-03-08T06:02:13.439 INFO:teuthology.task.install:The correct ceph version 19.0.0-1670.g1fb5d106 is installed. 2024-03-08T06:02:13.440 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-08T06:02:13.441 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:02:13.441 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-08T06:02:13.525 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:02:13.525 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-08T06:02:13.604 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-08T06:02:13.604 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:02:13.604 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/daemon-helper 2024-03-08T06:02:13.689 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-08T06:02:13.804 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:02:13.804 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/daemon-helper 2024-03-08T06:02:13.887 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-08T06:02:14.001 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-08T06:02:14.001 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:02:14.001 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-08T06:02:14.083 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-08T06:02:14.203 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:02:14.204 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-08T06:02:14.283 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-08T06:02:14.398 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-08T06:02:14.399 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:02:14.399 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/stdin-killer 2024-03-08T06:02:14.489 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-08T06:02:14.621 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:02:14.621 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/stdin-killer 2024-03-08T06:02:14.697 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-08T06:02:14.813 INFO:teuthology.run_tasks:Running task ceph... 2024-03-08T06:02:14.889 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-08T06:02:14.889 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 777 /var/log/ceph 2024-03-08T06:02:14.896 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 777 /var/log/ceph 2024-03-08T06:02:14.978 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-08T06:02:14.979 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-08T06:02:14.984 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-08T06:02:15.053 INFO:tasks.ceph:Creating extra log directories... 2024-03-08T06:02:15.054 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-08T06:02:15.058 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-08T06:02:15.159 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-08T06:02:15.160 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-08T06:02:15.160 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-08T06:02:15.160 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:02:15.160 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-08T06:02:15.207 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-08T06:02:15.453 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-08T06:02:15.536 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:02:15.536 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-08T06:02:15.581 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-08T06:02:15.800 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-08T06:02:15.896 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-08T06:02:15.896 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'lockdep': True, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'missing required features'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-08T06:02:15.897 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/jcollin-2024-03-08_05:43:46-fs:functional-main-distro-default-smithi/7585422', 'branch': 'main', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/admin}', 'email': 'jcollin@redhat.com', 'first_in_suite': False, 'job_id': '7585422', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'jcollin-2024-03-08_05:43:46-fs:functional-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'lockdep': True, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'missing required features'], 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'}}, 'kclient': {'syntax': 'v2'}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-jcollin-test_per-client-perf-counters', 'sha1': 'de7a7e179fbee9e314fa702f8f6c09d121c5e1a7'}}, 'owner': 'scheduled_jcollin@teuthology', 'priority': 10, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7313, 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-jcollin-test_per-client-perf-counters', 'suite_path': '/home/teuthworker/src/github.com_joscollin_ceph_de7a7e179fbee9e314fa702f8f6c09d121c5e1a7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/joscollin/ceph.git', 'suite_sha1': 'de7a7e179fbee9e314fa702f8f6c09d121c5e1a7', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi019.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMhnua1Zs1mj8A8D1cRc/Y4IbjMxhfVpRiF2YnqmWvfyeRD6YF16t4DA+rwJyXknzLMp+oC1PbiygfStBraqs7s=', 'smithi042.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO0gN7+Sd6N91IoieoXLBfcsav/9+icq+TOZQmNNpWZeaMPPLM5qUZCadPCqlXC4aaBVccfnykxjiaVAvHI1Qz0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'lockdep': True, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'missing required features'], 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_admin.TestLabeledPerfCounters']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-08_05:43:46', 'tube': 'smithi', 'user': 'jcollin', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-08T06:02:15.897 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-08T06:02:15.905 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-08T06:02:15.956 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/run/ceph 2024-03-08T06:02:15.963 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/run/ceph 2024-03-08T06:02:16.061 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:02:16.061 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/scratch_devs of=/dev/stdout 2024-03-08T06:02:16.118 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-08T06:02:16.118 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_1 2024-03-08T06:02:16.174 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-08T06:02:16.174 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T06:02:16.174 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 634 Links: 1 2024-03-08T06:02:16.174 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T06:02:16.174 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-03-08T06:02:16.174 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-03-08 06:02:00.751418553 +0000 2024-03-08T06:02:16.174 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-03-08 05:59:30.785642676 +0000 2024-03-08T06:02:16.174 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-03-08 05:59:30.785642676 +0000 2024-03-08T06:02:16.174 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-03-08 05:59:30.785642676 +0000 2024-03-08T06:02:16.174 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-08T06:02:16.269 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-03-08T06:02:16.269 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-03-08T06:02:16.269 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.00040599 s, 1.3 MB/s 2024-03-08T06:02:16.273 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-08T06:02:16.332 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_2 2024-03-08T06:02:16.383 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-08T06:02:16.383 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T06:02:16.383 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 651 Links: 1 2024-03-08T06:02:16.383 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T06:02:16.383 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-03-08T06:02:16.383 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-03-08 06:02:00.752418543 +0000 2024-03-08T06:02:16.384 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-03-08 05:59:31.365636852 +0000 2024-03-08T06:02:16.384 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-03-08 05:59:31.365636852 +0000 2024-03-08T06:02:16.384 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-03-08 05:59:31.365636852 +0000 2024-03-08T06:02:16.384 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-08T06:02:16.475 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-03-08T06:02:16.475 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-03-08T06:02:16.475 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.00036884 s, 1.4 MB/s 2024-03-08T06:02:16.480 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-08T06:02:16.539 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_3 2024-03-08T06:02:16.592 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-08T06:02:16.592 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T06:02:16.592 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-03-08T06:02:16.593 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T06:02:16.593 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-03-08T06:02:16.593 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-03-08 06:02:00.753418533 +0000 2024-03-08T06:02:16.593 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-03-08 05:59:31.950630977 +0000 2024-03-08T06:02:16.593 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-03-08 05:59:31.950630977 +0000 2024-03-08T06:02:16.593 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-03-08 05:59:31.950630977 +0000 2024-03-08T06:02:16.593 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-08T06:02:16.689 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-03-08T06:02:16.689 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-03-08T06:02:16.689 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000348274 s, 1.5 MB/s 2024-03-08T06:02:16.694 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-08T06:02:16.755 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_4 2024-03-08T06:02:16.809 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-08T06:02:16.809 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T06:02:16.809 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 689 Links: 1 2024-03-08T06:02:16.809 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T06:02:16.810 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-03-08T06:02:16.810 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-03-08 06:02:00.754418523 +0000 2024-03-08T06:02:16.810 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-03-08 05:59:32.552624925 +0000 2024-03-08T06:02:16.810 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-03-08 05:59:32.552624925 +0000 2024-03-08T06:02:16.810 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-03-08 05:59:32.552624925 +0000 2024-03-08T06:02:16.811 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-08T06:02:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-03-08T06:02:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-03-08T06:02:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000321932 s, 1.6 MB/s 2024-03-08T06:02:16.904 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-08T06:02:16.961 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-08T06:02:16.961 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:02:16.961 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/scratch_devs of=/dev/stdout 2024-03-08T06:02:17.022 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-08T06:02:17.023 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_1 2024-03-08T06:02:17.078 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-08T06:02:17.078 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T06:02:17.079 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 633 Links: 1 2024-03-08T06:02:17.079 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T06:02:17.079 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-03-08T06:02:17.079 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-03-08 06:02:05.247457694 +0000 2024-03-08T06:02:17.079 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-03-08 05:59:30.753517848 +0000 2024-03-08T06:02:17.079 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-03-08 05:59:30.753517848 +0000 2024-03-08T06:02:17.079 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-03-08 05:59:30.753517848 +0000 2024-03-08T06:02:17.080 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-08T06:02:17.172 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-03-08T06:02:17.172 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-03-08T06:02:17.172 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000332546 s, 1.5 MB/s 2024-03-08T06:02:17.177 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-08T06:02:17.236 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_2 2024-03-08T06:02:17.288 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-08T06:02:17.288 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T06:02:17.288 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 653 Links: 1 2024-03-08T06:02:17.288 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T06:02:17.288 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-03-08T06:02:17.289 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-03-08 06:02:05.248457686 +0000 2024-03-08T06:02:17.289 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-03-08 05:59:31.332513124 +0000 2024-03-08T06:02:17.289 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-03-08 05:59:31.332513124 +0000 2024-03-08T06:02:17.289 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-03-08 05:59:31.332513124 +0000 2024-03-08T06:02:17.289 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-08T06:02:17.376 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-03-08T06:02:17.376 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-03-08T06:02:17.376 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000216384 s, 2.4 MB/s 2024-03-08T06:02:17.381 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-08T06:02:17.441 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_3 2024-03-08T06:02:17.492 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-08T06:02:17.492 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T06:02:17.492 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 672 Links: 1 2024-03-08T06:02:17.493 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T06:02:17.493 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-03-08T06:02:17.493 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-03-08 06:02:05.249457677 +0000 2024-03-08T06:02:17.493 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-03-08 05:59:31.892508555 +0000 2024-03-08T06:02:17.493 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-03-08 05:59:31.892508555 +0000 2024-03-08T06:02:17.493 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-03-08 05:59:31.892508555 +0000 2024-03-08T06:02:17.493 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-08T06:02:17.578 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-03-08T06:02:17.578 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-03-08T06:02:17.578 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000249475 s, 2.1 MB/s 2024-03-08T06:02:17.582 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-08T06:02:17.639 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_4 2024-03-08T06:02:17.686 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-08T06:02:17.687 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-08T06:02:17.687 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-03-08T06:02:17.687 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-08T06:02:17.687 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2024-03-08T06:02:17.687 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2024-03-08 06:02:05.250457669 +0000 2024-03-08T06:02:17.687 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2024-03-08 05:59:32.474503806 +0000 2024-03-08T06:02:17.687 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2024-03-08 05:59:32.474503806 +0000 2024-03-08T06:02:17.687 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2024-03-08 05:59:32.474503806 +0000 2024-03-08T06:02:17.687 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-08T06:02:17.780 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2024-03-08T06:02:17.780 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2024-03-08T06:02:17.780 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000238879 s, 2.1 MB/s 2024-03-08T06:02:17.785 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-08T06:02:17.841 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-08T06:02:17.842 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-08T06:02:17.842 INFO:tasks.ceph:Generating config... 2024-03-08T06:02:17.843 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-08T06:02:17.843 INFO:tasks.ceph:[client] debug client = 20 2024-03-08T06:02:17.843 INFO:tasks.ceph:[client] debug ms = 1 2024-03-08T06:02:17.843 INFO:tasks.ceph:[client] pid file = 2024-03-08T06:02:17.843 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-08T06:02:17.843 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-08T06:02:17.843 INFO:tasks.ceph:[global] lockdep = True 2024-03-08T06:02:17.843 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-08T06:02:17.843 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-08T06:02:17.843 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-08T06:02:17.844 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-08T06:02:17.844 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-08T06:02:17.844 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-08T06:02:17.844 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-08T06:02:17.844 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-08T06:02:17.844 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-08T06:02:17.844 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-08T06:02:17.844 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-08T06:02:17.844 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-08T06:02:17.844 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-08T06:02:17.844 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-08T06:02:17.844 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-08T06:02:17.845 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-08T06:02:17.845 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-08T06:02:17.845 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-08T06:02:17.845 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-08T06:02:17.845 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-08T06:02:17.845 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-08T06:02:17.845 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-08T06:02:17.845 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-08T06:02:17.845 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-08T06:02:17.845 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-08T06:02:17.845 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-08T06:02:17.845 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-08T06:02:17.845 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-08T06:02:17.845 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-08T06:02:17.845 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-08T06:02:17.845 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-08T06:02:17.846 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-08T06:02:17.846 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-08T06:02:17.846 INFO:tasks.ceph:Setting up mon.a... 2024-03-08T06:02:17.846 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-08T06:02:17.991 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.keyring 2024-03-08T06:02:17.998 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-08T06:02:18.134 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-08T06:02:18.233 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.19'), ('mon.b', '172.21.15.42'), ('mon.c', '[v2:172.21.15.42:3301,v1:172.21.15.42:6790]')] 2024-03-08T06:02:18.234 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.19,172.21.15.42,[v2:172.21.15.42:3301,v1:172.21.15.42:6790]', 'lockdep': True, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-08T06:02:18.234 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:02:18.234 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-08T06:02:18.294 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.19 --add b 172.21.15.42 --addv c '[v2:172.21.15.42:3301,v1:172.21.15.42:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-08T06:02:18.443 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-08T06:02:18.443 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: generated fsid d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd 2024-03-08T06:02:18.443 INFO:teuthology.orchestra.run.smithi019.stdout:setting min_mon_release = quincy 2024-03-08T06:02:18.443 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 0 2024-03-08T06:02:18.443 INFO:teuthology.orchestra.run.smithi019.stdout:fsid d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd 2024-03-08T06:02:18.444 INFO:teuthology.orchestra.run.smithi019.stdout:last_changed 2024-03-08T06:02:18.443735+0000 2024-03-08T06:02:18.444 INFO:teuthology.orchestra.run.smithi019.stdout:created 2024-03-08T06:02:18.443735+0000 2024-03-08T06:02:18.444 INFO:teuthology.orchestra.run.smithi019.stdout:min_mon_release 17 (quincy) 2024-03-08T06:02:18.444 INFO:teuthology.orchestra.run.smithi019.stdout:election_strategy: 1 2024-03-08T06:02:18.444 INFO:teuthology.orchestra.run.smithi019.stdout:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-03-08T06:02:18.444 INFO:teuthology.orchestra.run.smithi019.stdout:1: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.b 2024-03-08T06:02:18.444 INFO:teuthology.orchestra.run.smithi019.stdout:2: [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] mon.c 2024-03-08T06:02:18.444 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-08T06:02:18.447 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-08T06:02:18.500 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd... 2024-03-08T06:02:18.501 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-08T06:02:18.506 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-08T06:02:18.670 INFO:teuthology.orchestra.run.smithi019.stdout:[global] 2024-03-08T06:02:18.670 INFO:teuthology.orchestra.run.smithi019.stdout: chdir = "" 2024-03-08T06:02:18.670 INFO:teuthology.orchestra.run.smithi019.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-08T06:02:18.670 INFO:teuthology.orchestra.run.smithi019.stdout: auth supported = cephx 2024-03-08T06:02:18.670 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.670 INFO:teuthology.orchestra.run.smithi019.stdout: filestore xattr use omap = true 2024-03-08T06:02:18.671 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.671 INFO:teuthology.orchestra.run.smithi019.stdout: mon clock drift allowed = 1.000 2024-03-08T06:02:18.671 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.671 INFO:teuthology.orchestra.run.smithi019.stdout: osd crush chooseleaf type = 0 2024-03-08T06:02:18.671 INFO:teuthology.orchestra.run.smithi019.stdout: auth debug = true 2024-03-08T06:02:18.671 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.671 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on old message = true 2024-03-08T06:02:18.671 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on bug = true 2024-03-08T06:02:18.671 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.671 INFO:teuthology.orchestra.run.smithi019.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-08T06:02:18.671 INFO:teuthology.orchestra.run.smithi019.stdout: mon pg warn max object skew = 0 2024-03-08T06:02:18.671 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.671 INFO:teuthology.orchestra.run.smithi019.stdout: # disable pg_autoscaler by default for new pools 2024-03-08T06:02:18.671 INFO:teuthology.orchestra.run.smithi019.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-08T06:02:18.671 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.672 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default size = 2 2024-03-08T06:02:18.672 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.672 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow primary affinity = true 2024-03-08T06:02:18.672 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow pg remap = true 2024-03-08T06:02:18.672 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on legacy crush tunables = false 2024-03-08T06:02:18.672 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on crush straw calc version zero = false 2024-03-08T06:02:18.672 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on no sortbitwise = false 2024-03-08T06:02:18.672 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on osd down out interval zero = false 2024-03-08T06:02:18.672 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on too few osds = false 2024-03-08T06:02:18.672 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-08T06:02:18.672 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-08T06:02:18.672 INFO:teuthology.orchestra.run.smithi019.stdout: mon_allow_pool_size_one = true 2024-03-08T06:02:18.672 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.672 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-08T06:02:18.673 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.673 INFO:teuthology.orchestra.run.smithi019.stdout: osd default data pool replay window = 5 2024-03-08T06:02:18.673 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.673 INFO:teuthology.orchestra.run.smithi019.stdout: mon allow pool delete = true 2024-03-08T06:02:18.673 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.673 INFO:teuthology.orchestra.run.smithi019.stdout: mon cluster log file level = debug 2024-03-08T06:02:18.673 INFO:teuthology.orchestra.run.smithi019.stdout: debug asserts on shutdown = true 2024-03-08T06:02:18.673 INFO:teuthology.orchestra.run.smithi019.stdout: mon health detail to clog = false 2024-03-08T06:02:18.673 INFO:teuthology.orchestra.run.smithi019.stdout: mon host = "172.21.15.19,172.21.15.42,[v2:172.21.15.42:3301,v1:172.21.15.42:6790]" 2024-03-08T06:02:18.673 INFO:teuthology.orchestra.run.smithi019.stdout: lockdep = True 2024-03-08T06:02:18.673 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on skipped message = False 2024-03-08T06:02:18.673 INFO:teuthology.orchestra.run.smithi019.stdout: fsid = d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd 2024-03-08T06:02:18.673 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.673 INFO:teuthology.orchestra.run.smithi019.stdout:[osd] 2024-03-08T06:02:18.674 INFO:teuthology.orchestra.run.smithi019.stdout: osd journal size = 100 2024-03-08T06:02:18.674 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.674 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub load threshold = 5.0 2024-03-08T06:02:18.674 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub max interval = 600 2024-03-08T06:02:18.674 INFO:teuthology.orchestra.run.smithi019.stdout: osd mclock profile = high_recovery_ops 2024-03-08T06:02:18.674 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.674 INFO:teuthology.orchestra.run.smithi019.stdout: osd recover clone overlap = true 2024-03-08T06:02:18.674 INFO:teuthology.orchestra.run.smithi019.stdout: osd recovery max chunk = 1048576 2024-03-08T06:02:18.674 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.674 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug shutdown = true 2024-03-08T06:02:18.674 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug op order = true 2024-03-08T06:02:18.674 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug verify stray on activate = true 2024-03-08T06:02:18.674 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug trim objects = true 2024-03-08T06:02:18.674 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.674 INFO:teuthology.orchestra.run.smithi019.stdout: osd open classes on start = true 2024-03-08T06:02:18.675 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug pg log writeout = true 2024-03-08T06:02:18.675 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.675 INFO:teuthology.orchestra.run.smithi019.stdout: osd deep scrub update digest min age = 30 2024-03-08T06:02:18.675 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.675 INFO:teuthology.orchestra.run.smithi019.stdout: osd map max advance = 10 2024-03-08T06:02:18.675 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.675 INFO:teuthology.orchestra.run.smithi019.stdout: journal zero on create = true 2024-03-08T06:02:18.675 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.675 INFO:teuthology.orchestra.run.smithi019.stdout: filestore ondisk finisher threads = 3 2024-03-08T06:02:18.675 INFO:teuthology.orchestra.run.smithi019.stdout: filestore apply finisher threads = 3 2024-03-08T06:02:18.675 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.675 INFO:teuthology.orchestra.run.smithi019.stdout: bdev debug aio = true 2024-03-08T06:02:18.675 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug misdirected ops = true 2024-03-08T06:02:18.675 INFO:teuthology.orchestra.run.smithi019.stdout: bdev async discard = True 2024-03-08T06:02:18.675 INFO:teuthology.orchestra.run.smithi019.stdout: bdev enable discard = True 2024-03-08T06:02:18.675 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore allocator = bitmap 2024-03-08T06:02:18.676 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore block size = 96636764160 2024-03-08T06:02:18.676 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore fsck on mount = True 2024-03-08T06:02:18.676 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluefs = 1/20 2024-03-08T06:02:18.676 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluestore = 1/20 2024-03-08T06:02:18.676 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-03-08T06:02:18.676 INFO:teuthology.orchestra.run.smithi019.stdout: debug osd = 20 2024-03-08T06:02:18.676 INFO:teuthology.orchestra.run.smithi019.stdout: debug rocksdb = 4/10 2024-03-08T06:02:18.676 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd backfillfull_ratio = 0.85 2024-03-08T06:02:18.676 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd full ratio = 0.9 2024-03-08T06:02:18.676 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd nearfull ratio = 0.8 2024-03-08T06:02:18.676 INFO:teuthology.orchestra.run.smithi019.stdout: osd failsafe full ratio = 0.95 2024-03-08T06:02:18.676 INFO:teuthology.orchestra.run.smithi019.stdout: osd objectstore = bluestore 2024-03-08T06:02:18.676 INFO:teuthology.orchestra.run.smithi019.stdout: osd op complaint time = 180 2024-03-08T06:02:18.676 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.676 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr] 2024-03-08T06:02:18.676 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-03-08T06:02:18.677 INFO:teuthology.orchestra.run.smithi019.stdout: debug mgr = 20 2024-03-08T06:02:18.677 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2024-03-08T06:02:18.677 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2024-03-08T06:02:18.677 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2024-03-08T06:02:18.677 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2024-03-08T06:02:18.677 INFO:teuthology.orchestra.run.smithi019.stdout: mgr/telemetry/nag = false 2024-03-08T06:02:18.677 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.677 INFO:teuthology.orchestra.run.smithi019.stdout:[mon] 2024-03-08T06:02:18.677 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-03-08T06:02:18.677 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2024-03-08T06:02:18.677 INFO:teuthology.orchestra.run.smithi019.stdout: debug paxos = 20 2024-03-08T06:02:18.677 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2024-03-08T06:02:18.677 INFO:teuthology.orchestra.run.smithi019.stdout: mon data avail warn = 5 2024-03-08T06:02:18.677 INFO:teuthology.orchestra.run.smithi019.stdout: mon mgr mkfs grace = 240 2024-03-08T06:02:18.677 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2024-03-08T06:02:18.677 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd reporter subtree level = osd 2024-03-08T06:02:18.677 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd prime pg temp = true 2024-03-08T06:02:18.678 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2024-03-08T06:02:18.678 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.678 INFO:teuthology.orchestra.run.smithi019.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-08T06:02:18.678 INFO:teuthology.orchestra.run.smithi019.stdout: auth mon ticket ttl = 660 # 11m 2024-03-08T06:02:18.678 INFO:teuthology.orchestra.run.smithi019.stdout: auth service ticket ttl = 240 # 4m 2024-03-08T06:02:18.678 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.678 INFO:teuthology.orchestra.run.smithi019.stdout: # don't complain about insecure global_id in the test suite 2024-03-08T06:02:18.678 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-08T06:02:18.678 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-08T06:02:18.678 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.678 INFO:teuthology.orchestra.run.smithi019.stdout: # 1m isn't quite enough 2024-03-08T06:02:18.678 INFO:teuthology.orchestra.run.smithi019.stdout: mon_down_mkfs_grace = 2m 2024-03-08T06:02:18.678 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.678 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_filestore_osds = false 2024-03-08T06:02:18.678 INFO:teuthology.orchestra.run.smithi019.stdout: mon op complaint time = 120 2024-03-08T06:02:18.679 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:02:18.679 INFO:teuthology.orchestra.run.smithi019.stdout:[client] 2024-03-08T06:02:18.679 INFO:teuthology.orchestra.run.smithi019.stdout: rgw cache enabled = true 2024-03-08T06:02:18.679 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable ops log = true 2024-03-08T06:02:18.679 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable usage log = true 2024-03-08T06:02:18.679 INFO:teuthology.orchestra.run.smithi019.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-08T06:02:18.679 INFO:teuthology.orchestra.run.smithi019.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-08T06:02:18.679 INFO:teuthology.orchestra.run.smithi019.stdout: client mount timeout = 600 2024-03-08T06:02:18.679 INFO:teuthology.orchestra.run.smithi019.stdout: debug client = 20 2024-03-08T06:02:18.679 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-03-08T06:02:18.679 INFO:teuthology.orchestra.run.smithi019.stdout: pid file = "" 2024-03-08T06:02:18.679 INFO:teuthology.orchestra.run.smithi019.stdout: rados mon op timeout = 900 2024-03-08T06:02:18.679 INFO:teuthology.orchestra.run.smithi019.stdout: rados osd op timeout = 900 2024-03-08T06:02:18.679 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.a] 2024-03-08T06:02:18.679 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.b] 2024-03-08T06:02:18.679 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.c] 2024-03-08T06:02:18.680 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a] 2024-03-08T06:02:18.680 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.c] 2024-03-08T06:02:18.680 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.b] 2024-03-08T06:02:18.680 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.d] 2024-03-08T06:02:18.680 INFO:teuthology.orchestra.run.smithi019.stdout:[mds] 2024-03-08T06:02:18.680 INFO:teuthology.orchestra.run.smithi019.stdout: debug mds = 20 2024-03-08T06:02:18.680 INFO:teuthology.orchestra.run.smithi019.stdout: debug mds balancer = 20 2024-03-08T06:02:18.680 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-03-08T06:02:18.680 INFO:teuthology.orchestra.run.smithi019.stdout: mds debug frag = True 2024-03-08T06:02:18.680 INFO:teuthology.orchestra.run.smithi019.stdout: mds debug scatterstat = True 2024-03-08T06:02:18.680 INFO:teuthology.orchestra.run.smithi019.stdout: mds op complaint time = 180 2024-03-08T06:02:18.680 INFO:teuthology.orchestra.run.smithi019.stdout: mds verify scatter = True 2024-03-08T06:02:18.680 INFO:teuthology.orchestra.run.smithi019.stdout: osd op complaint time = 180 2024-03-08T06:02:18.680 INFO:teuthology.orchestra.run.smithi019.stdout: rados mon op timeout = 900 2024-03-08T06:02:18.680 INFO:teuthology.orchestra.run.smithi019.stdout: rados osd op timeout = 900 2024-03-08T06:02:18.681 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2024-03-08T06:02:18.681 INFO:teuthology.orchestra.run.smithi042.stdout: chdir = "" 2024-03-08T06:02:18.681 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-08T06:02:18.681 INFO:teuthology.orchestra.run.smithi042.stdout: auth supported = cephx 2024-03-08T06:02:18.681 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.681 INFO:teuthology.orchestra.run.smithi042.stdout: filestore xattr use omap = true 2024-03-08T06:02:18.681 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.681 INFO:teuthology.orchestra.run.smithi042.stdout: mon clock drift allowed = 1.000 2024-03-08T06:02:18.681 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.681 INFO:teuthology.orchestra.run.smithi042.stdout: osd crush chooseleaf type = 0 2024-03-08T06:02:18.682 INFO:teuthology.orchestra.run.smithi042.stdout: auth debug = true 2024-03-08T06:02:18.682 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.682 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on old message = true 2024-03-08T06:02:18.682 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on bug = true 2024-03-08T06:02:18.682 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.682 INFO:teuthology.orchestra.run.smithi042.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-08T06:02:18.682 INFO:teuthology.orchestra.run.smithi042.stdout: mon pg warn max object skew = 0 2024-03-08T06:02:18.682 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.682 INFO:teuthology.orchestra.run.smithi042.stdout: # disable pg_autoscaler by default for new pools 2024-03-08T06:02:18.682 INFO:teuthology.orchestra.run.smithi042.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-08T06:02:18.682 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.682 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default size = 2 2024-03-08T06:02:18.682 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.682 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow primary affinity = true 2024-03-08T06:02:18.683 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow pg remap = true 2024-03-08T06:02:18.683 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on legacy crush tunables = false 2024-03-08T06:02:18.683 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on crush straw calc version zero = false 2024-03-08T06:02:18.683 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on no sortbitwise = false 2024-03-08T06:02:18.683 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on osd down out interval zero = false 2024-03-08T06:02:18.683 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on too few osds = false 2024-03-08T06:02:18.683 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-08T06:02:18.683 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-08T06:02:18.683 INFO:teuthology.orchestra.run.smithi042.stdout: mon_allow_pool_size_one = true 2024-03-08T06:02:18.683 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.683 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-08T06:02:18.683 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.683 INFO:teuthology.orchestra.run.smithi042.stdout: osd default data pool replay window = 5 2024-03-08T06:02:18.683 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.683 INFO:teuthology.orchestra.run.smithi042.stdout: mon allow pool delete = true 2024-03-08T06:02:18.683 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.684 INFO:teuthology.orchestra.run.smithi042.stdout: mon cluster log file level = debug 2024-03-08T06:02:18.684 INFO:teuthology.orchestra.run.smithi042.stdout: debug asserts on shutdown = true 2024-03-08T06:02:18.684 INFO:teuthology.orchestra.run.smithi042.stdout: mon health detail to clog = false 2024-03-08T06:02:18.684 INFO:teuthology.orchestra.run.smithi042.stdout: mon host = "172.21.15.19,172.21.15.42,[v2:172.21.15.42:3301,v1:172.21.15.42:6790]" 2024-03-08T06:02:18.684 INFO:teuthology.orchestra.run.smithi042.stdout: lockdep = True 2024-03-08T06:02:18.684 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on skipped message = False 2024-03-08T06:02:18.684 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd 2024-03-08T06:02:18.684 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.684 INFO:teuthology.orchestra.run.smithi042.stdout:[osd] 2024-03-08T06:02:18.684 INFO:teuthology.orchestra.run.smithi042.stdout: osd journal size = 100 2024-03-08T06:02:18.684 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.684 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub load threshold = 5.0 2024-03-08T06:02:18.684 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub max interval = 600 2024-03-08T06:02:18.684 INFO:teuthology.orchestra.run.smithi042.stdout: osd mclock profile = high_recovery_ops 2024-03-08T06:02:18.684 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.684 INFO:teuthology.orchestra.run.smithi042.stdout: osd recover clone overlap = true 2024-03-08T06:02:18.684 INFO:teuthology.orchestra.run.smithi042.stdout: osd recovery max chunk = 1048576 2024-03-08T06:02:18.685 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.685 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug shutdown = true 2024-03-08T06:02:18.685 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug op order = true 2024-03-08T06:02:18.685 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug verify stray on activate = true 2024-03-08T06:02:18.685 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug trim objects = true 2024-03-08T06:02:18.685 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.685 INFO:teuthology.orchestra.run.smithi042.stdout: osd open classes on start = true 2024-03-08T06:02:18.685 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug pg log writeout = true 2024-03-08T06:02:18.685 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.685 INFO:teuthology.orchestra.run.smithi042.stdout: osd deep scrub update digest min age = 30 2024-03-08T06:02:18.685 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.685 INFO:teuthology.orchestra.run.smithi042.stdout: osd map max advance = 10 2024-03-08T06:02:18.685 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.685 INFO:teuthology.orchestra.run.smithi042.stdout: journal zero on create = true 2024-03-08T06:02:18.685 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.685 INFO:teuthology.orchestra.run.smithi042.stdout: filestore ondisk finisher threads = 3 2024-03-08T06:02:18.686 INFO:teuthology.orchestra.run.smithi042.stdout: filestore apply finisher threads = 3 2024-03-08T06:02:18.686 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.686 INFO:teuthology.orchestra.run.smithi042.stdout: bdev debug aio = true 2024-03-08T06:02:18.686 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug misdirected ops = true 2024-03-08T06:02:18.686 INFO:teuthology.orchestra.run.smithi042.stdout: bdev async discard = True 2024-03-08T06:02:18.686 INFO:teuthology.orchestra.run.smithi042.stdout: bdev enable discard = True 2024-03-08T06:02:18.686 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore allocator = bitmap 2024-03-08T06:02:18.686 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore block size = 96636764160 2024-03-08T06:02:18.686 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore fsck on mount = True 2024-03-08T06:02:18.686 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluefs = 1/20 2024-03-08T06:02:18.686 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluestore = 1/20 2024-03-08T06:02:18.686 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-03-08T06:02:18.686 INFO:teuthology.orchestra.run.smithi042.stdout: debug osd = 20 2024-03-08T06:02:18.686 INFO:teuthology.orchestra.run.smithi042.stdout: debug rocksdb = 4/10 2024-03-08T06:02:18.686 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd backfillfull_ratio = 0.85 2024-03-08T06:02:18.687 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd full ratio = 0.9 2024-03-08T06:02:18.687 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd nearfull ratio = 0.8 2024-03-08T06:02:18.687 INFO:teuthology.orchestra.run.smithi042.stdout: osd failsafe full ratio = 0.95 2024-03-08T06:02:18.687 INFO:teuthology.orchestra.run.smithi042.stdout: osd objectstore = bluestore 2024-03-08T06:02:18.687 INFO:teuthology.orchestra.run.smithi042.stdout: osd op complaint time = 180 2024-03-08T06:02:18.687 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.687 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr] 2024-03-08T06:02:18.687 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-03-08T06:02:18.687 INFO:teuthology.orchestra.run.smithi042.stdout: debug mgr = 20 2024-03-08T06:02:18.687 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-03-08T06:02:18.687 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-03-08T06:02:18.687 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-03-08T06:02:18.687 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-03-08T06:02:18.687 INFO:teuthology.orchestra.run.smithi042.stdout: mgr/telemetry/nag = false 2024-03-08T06:02:18.687 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.687 INFO:teuthology.orchestra.run.smithi042.stdout:[mon] 2024-03-08T06:02:18.688 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-03-08T06:02:18.688 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2024-03-08T06:02:18.688 INFO:teuthology.orchestra.run.smithi042.stdout: debug paxos = 20 2024-03-08T06:02:18.688 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2024-03-08T06:02:18.688 INFO:teuthology.orchestra.run.smithi042.stdout: mon data avail warn = 5 2024-03-08T06:02:18.688 INFO:teuthology.orchestra.run.smithi042.stdout: mon mgr mkfs grace = 240 2024-03-08T06:02:18.688 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2024-03-08T06:02:18.688 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd reporter subtree level = osd 2024-03-08T06:02:18.688 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd prime pg temp = true 2024-03-08T06:02:18.688 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2024-03-08T06:02:18.688 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.688 INFO:teuthology.orchestra.run.smithi042.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-08T06:02:18.688 INFO:teuthology.orchestra.run.smithi042.stdout: auth mon ticket ttl = 660 # 11m 2024-03-08T06:02:18.688 INFO:teuthology.orchestra.run.smithi042.stdout: auth service ticket ttl = 240 # 4m 2024-03-08T06:02:18.688 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.688 INFO:teuthology.orchestra.run.smithi042.stdout: # don't complain about insecure global_id in the test suite 2024-03-08T06:02:18.689 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-08T06:02:18.689 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-08T06:02:18.689 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.689 INFO:teuthology.orchestra.run.smithi042.stdout: # 1m isn't quite enough 2024-03-08T06:02:18.689 INFO:teuthology.orchestra.run.smithi042.stdout: mon_down_mkfs_grace = 2m 2024-03-08T06:02:18.689 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.689 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_filestore_osds = false 2024-03-08T06:02:18.689 INFO:teuthology.orchestra.run.smithi042.stdout: mon op complaint time = 120 2024-03-08T06:02:18.689 INFO:teuthology.orchestra.run.smithi042.stdout: 2024-03-08T06:02:18.689 INFO:teuthology.orchestra.run.smithi042.stdout:[client] 2024-03-08T06:02:18.689 INFO:teuthology.orchestra.run.smithi042.stdout: rgw cache enabled = true 2024-03-08T06:02:18.689 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable ops log = true 2024-03-08T06:02:18.689 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable usage log = true 2024-03-08T06:02:18.689 INFO:teuthology.orchestra.run.smithi042.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-08T06:02:18.689 INFO:teuthology.orchestra.run.smithi042.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-08T06:02:18.689 INFO:teuthology.orchestra.run.smithi042.stdout: client mount timeout = 600 2024-03-08T06:02:18.689 INFO:teuthology.orchestra.run.smithi042.stdout: debug client = 20 2024-03-08T06:02:18.690 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-03-08T06:02:18.690 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = "" 2024-03-08T06:02:18.690 INFO:teuthology.orchestra.run.smithi042.stdout: rados mon op timeout = 900 2024-03-08T06:02:18.690 INFO:teuthology.orchestra.run.smithi042.stdout: rados osd op timeout = 900 2024-03-08T06:02:18.690 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.a] 2024-03-08T06:02:18.690 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.b] 2024-03-08T06:02:18.690 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.c] 2024-03-08T06:02:18.690 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a] 2024-03-08T06:02:18.690 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.c] 2024-03-08T06:02:18.690 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b] 2024-03-08T06:02:18.690 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.d] 2024-03-08T06:02:18.690 INFO:teuthology.orchestra.run.smithi042.stdout:[mds] 2024-03-08T06:02:18.690 INFO:teuthology.orchestra.run.smithi042.stdout: debug mds = 20 2024-03-08T06:02:18.690 INFO:teuthology.orchestra.run.smithi042.stdout: debug mds balancer = 20 2024-03-08T06:02:18.690 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2024-03-08T06:02:18.691 INFO:teuthology.orchestra.run.smithi042.stdout: mds debug frag = True 2024-03-08T06:02:18.691 INFO:teuthology.orchestra.run.smithi042.stdout: mds debug scatterstat = True 2024-03-08T06:02:18.691 INFO:teuthology.orchestra.run.smithi042.stdout: mds op complaint time = 180 2024-03-08T06:02:18.691 INFO:teuthology.orchestra.run.smithi042.stdout: mds verify scatter = True 2024-03-08T06:02:18.691 INFO:teuthology.orchestra.run.smithi042.stdout: osd op complaint time = 180 2024-03-08T06:02:18.691 INFO:teuthology.orchestra.run.smithi042.stdout: rados mon op timeout = 900 2024-03-08T06:02:18.691 INFO:teuthology.orchestra.run.smithi042.stdout: rados osd op timeout = 900 2024-03-08T06:02:18.719 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-08T06:02:18.719 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-08T06:02:18.873 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-08T06:02:18.873 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:02:18.873 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-08T06:02:18.928 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:02:18.928 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-08T06:02:18.981 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi019.front.sepia.ceph.com 2024-03-08T06:02:18.981 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:02:18.981 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-08T06:02:18.981 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-08T06:02:19.133 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:02:19.133 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-08T06:02:19.232 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi042.front.sepia.ceph.com 2024-03-08T06:02:19.232 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:02:19.232 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-08T06:02:19.232 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-08T06:02:19.398 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:02:19.398 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-08T06:02:19.498 INFO:tasks.ceph:Setting up mon nodes... 2024-03-08T06:02:19.499 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-08T06:02:19.499 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-08T06:02:19.692 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-08T06:02:19.701 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-08T06:02:19.902 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-08T06:02:19.914 INFO:tasks.ceph:Setting up mds nodes... 2024-03-08T06:02:19.914 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-08T06:02:20.111 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-08T06:02:20.120 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-08T06:02:20.223 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-08T06:02:20.422 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-08T06:02:20.431 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-08T06:02:20.526 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-08T06:02:20.726 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-08T06:02:20.735 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-08T06:02:20.835 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-08T06:02:21.028 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-08T06:02:21.037 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-08T06:02:21.137 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-08T06:02:21.137 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-08T06:02:21.272 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-08T06:02:21.328 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-08T06:02:21.462 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-03-08T06:02:21.520 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-08T06:02:21.655 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-08T06:02:21.716 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-08T06:02:21.851 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-03-08T06:02:21.912 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-08T06:02:21.912 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-08T06:02:21.912 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-08T06:02:22.017 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-08T06:02:22.017 INFO:tasks.ceph:role: osd.0 2024-03-08T06:02:22.018 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com 2024-03-08T06:02:22.018 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-08T06:02:22.122 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T06:02:22.122 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T06:02:22.122 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T06:02:22.122 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-08T06:02:22.122 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T06:02:22.122 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-03-08T06:02:22.123 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T06:02:22.123 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-08T06:02:22.123 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T06:02:22.123 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T06:02:22.639 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-03-08T06:02:22.646 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-03-08T06:02:22.646 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-08T06:02:22.840 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-08T06:02:22.948 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-08T06:02:23.043 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-08T06:02:23.043 INFO:tasks.ceph:role: osd.1 2024-03-08T06:02:23.043 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com 2024-03-08T06:02:23.044 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-08T06:02:23.146 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T06:02:23.147 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T06:02:23.147 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T06:02:23.147 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-08T06:02:23.147 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T06:02:23.147 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-03-08T06:02:23.147 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T06:02:23.147 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-08T06:02:23.147 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T06:02:23.147 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T06:02:23.644 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-03-08T06:02:23.652 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-03-08T06:02:23.652 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-08T06:02:23.800 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-08T06:02:23.907 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-08T06:02:24.008 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-08T06:02:24.008 INFO:tasks.ceph:role: osd.2 2024-03-08T06:02:24.008 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com 2024-03-08T06:02:24.008 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-08T06:02:24.112 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T06:02:24.112 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T06:02:24.112 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T06:02:24.112 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-08T06:02:24.112 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T06:02:24.112 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-03-08T06:02:24.112 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T06:02:24.113 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-08T06:02:24.113 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T06:02:24.113 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T06:02:24.639 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-03-08T06:02:24.647 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-03-08T06:02:24.647 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-08T06:02:24.819 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-08T06:02:24.923 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-08T06:02:25.024 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-08T06:02:25.024 INFO:tasks.ceph:role: osd.3 2024-03-08T06:02:25.024 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com 2024-03-08T06:02:25.024 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-08T06:02:25.130 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T06:02:25.130 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T06:02:25.130 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T06:02:25.130 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-08T06:02:25.130 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T06:02:25.130 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-03-08T06:02:25.131 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T06:02:25.131 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-08T06:02:25.131 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T06:02:25.131 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T06:02:25.604 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-03-08T06:02:25.612 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-03-08T06:02:25.612 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-08T06:02:25.777 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-08T06:02:25.883 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T06:02:26.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:26.040+0000 7f99326c6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-08T06:02:26.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:26.046+0000 7f99326c6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-08T06:02:26.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:26.046+0000 7f99326c6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-08T06:02:26.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:26.046+0000 7f99326c6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-08T06:02:26.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:26.046+0000 7f99326c6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-08T06:02:26.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:26.056+0000 7f99326c6640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-08T06:02:29.232 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-08T06:02:29.332 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T06:02:29.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:29.477+0000 7fcb61e1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-08T06:02:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:29.478+0000 7fcb61e1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-08T06:02:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:29.478+0000 7fcb61e1c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-08T06:02:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:29.478+0000 7fcb61e1c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-08T06:02:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:29.478+0000 7fcb61e1c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-08T06:02:29.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:29.480+0000 7fcb61e1c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-08T06:02:32.656 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-08T06:02:32.758 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T06:02:32.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:32.905+0000 7f098ca1d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-08T06:02:32.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:32.905+0000 7f098ca1d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-08T06:02:32.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:32.906+0000 7f098ca1d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-08T06:02:32.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:32.906+0000 7f098ca1d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-08T06:02:32.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:32.906+0000 7f098ca1d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-08T06:02:32.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:32.908+0000 7f098ca1d640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-08T06:02:36.084 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-08T06:02:36.189 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T06:02:36.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:36.337+0000 7fc96fde1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-08T06:02:36.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:36.337+0000 7fc96fde1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-08T06:02:36.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:36.337+0000 7fc96fde1640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-08T06:02:36.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:36.338+0000 7fc96fde1640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-08T06:02:36.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:36.338+0000 7fc96fde1640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-08T06:02:36.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:02:36.340+0000 7fc96fde1640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-08T06:02:39.517 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-08T06:02:39.619 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-08T06:02:39.727 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-08T06:02:39.727 INFO:tasks.ceph:role: osd.4 2024-03-08T06:02:39.727 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com 2024-03-08T06:02:39.727 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-08T06:02:39.828 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T06:02:39.828 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T06:02:39.828 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T06:02:39.828 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-08T06:02:39.828 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T06:02:39.828 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-03-08T06:02:39.828 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T06:02:39.828 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-08T06:02:39.829 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T06:02:39.829 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T06:02:39.862 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-03-08T06:02:39.869 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-03-08T06:02:39.869 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-08T06:02:39.982 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-08T06:02:40.074 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-08T06:02:40.165 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-08T06:02:40.165 INFO:tasks.ceph:role: osd.5 2024-03-08T06:02:40.165 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com 2024-03-08T06:02:40.165 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-08T06:02:40.260 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T06:02:40.260 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T06:02:40.260 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T06:02:40.260 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-08T06:02:40.260 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T06:02:40.260 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-03-08T06:02:40.260 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T06:02:40.260 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-08T06:02:40.260 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T06:02:40.260 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T06:02:40.296 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-03-08T06:02:40.301 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-03-08T06:02:40.302 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-08T06:02:40.412 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-08T06:02:40.505 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-08T06:02:40.602 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-08T06:02:40.603 INFO:tasks.ceph:role: osd.6 2024-03-08T06:02:40.603 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com 2024-03-08T06:02:40.603 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-08T06:02:40.696 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T06:02:40.696 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T06:02:40.696 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T06:02:40.696 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-08T06:02:40.696 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T06:02:40.696 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-03-08T06:02:40.697 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T06:02:40.697 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-08T06:02:40.697 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T06:02:40.697 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T06:02:40.730 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-03-08T06:02:40.736 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-03-08T06:02:40.736 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-08T06:02:40.857 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-08T06:02:40.946 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-08T06:02:41.039 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-08T06:02:41.039 INFO:tasks.ceph:role: osd.7 2024-03-08T06:02:41.039 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi042.front.sepia.ceph.com 2024-03-08T06:02:41.039 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-08T06:02:41.136 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-08T06:02:41.136 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-08T06:02:41.136 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-08T06:02:41.136 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-08T06:02:41.136 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-08T06:02:41.136 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2024-03-08T06:02:41.136 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-08T06:02:41.136 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-08T06:02:41.136 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-08T06:02:41.136 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-08T06:02:41.170 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2024-03-08T06:02:41.175 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2024-03-08T06:02:41.175 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-08T06:02:41.289 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-08T06:02:41.380 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T06:02:41.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:41.537+0000 7fb8bb726640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-08T06:02:41.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:41.538+0000 7fb8bb726640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-08T06:02:41.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:41.538+0000 7fb8bb726640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-08T06:02:41.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:41.538+0000 7fb8bb726640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-08T06:02:41.538 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:41.538+0000 7fb8bb726640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-08T06:02:41.541 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:41.541+0000 7fb8bb726640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-08T06:02:44.719 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-08T06:02:44.821 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T06:02:44.967 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:44.967+0000 7fe30288b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-08T06:02:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:44.968+0000 7fe30288b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-08T06:02:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:44.968+0000 7fe30288b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-08T06:02:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:44.968+0000 7fe30288b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-08T06:02:44.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:44.968+0000 7fe30288b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-08T06:02:44.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:44.970+0000 7fe30288b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-08T06:02:45.898 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T06:02:45.906 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T06:02:48.148 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-08T06:02:48.247 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T06:02:48.384 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:48.384+0000 7fb56efbd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-08T06:02:48.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:48.385+0000 7fb56efbd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-08T06:02:48.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:48.385+0000 7fb56efbd640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-08T06:02:48.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:48.385+0000 7fb56efbd640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-08T06:02:48.385 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:48.385+0000 7fb56efbd640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-08T06:02:48.387 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:48.387+0000 7fb56efbd640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-08T06:02:51.324 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-08T06:02:51.424 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-08T06:02:51.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:51.567+0000 7f2837c8b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-08T06:02:51.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:51.568+0000 7f2837c8b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-08T06:02:51.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:51.568+0000 7f2837c8b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-08T06:02:51.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:51.568+0000 7f2837c8b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-08T06:02:51.568 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:51.568+0000 7f2837c8b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-08T06:02:51.570 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:02:51.570+0000 7f2837c8b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-08T06:02:54.751 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-08T06:02:54.849 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-08T06:02:54.849 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:02:54.849 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-08T06:02:54.956 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:02:54.957 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-08T06:02:55.058 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:02:55.058 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-08T06:02:55.163 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:02:55.163 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-08T06:02:55.263 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:02:55.263 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-08T06:02:55.362 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:02:55.362 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-08T06:02:55.461 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:02:55.462 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-08T06:02:55.558 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:02:55.558 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-08T06:02:55.649 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:02:55.649 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-08T06:02:55.744 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:02:55.744 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-08T06:02:55.842 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:02:55.842 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-08T06:02:55.945 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:02:55.945 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-08T06:02:56.046 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:02:56.046 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-08T06:02:56.153 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:02:56.153 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-08T06:02:56.253 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:02:56.253 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-08T06:02:56.313 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:02:56.313 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-03-08T06:02:56.366 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:02:56.366 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-08T06:02:56.426 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:02:56.427 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-03-08T06:02:56.481 INFO:tasks.ceph:Adding keys to all mons... 2024-03-08T06:02:56.481 DEBUG:teuthology.orchestra.run.smithi019:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-08T06:02:56.489 DEBUG:teuthology.orchestra.run.smithi042:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-08T06:02:56.579 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.y] 2024-03-08T06:02:56.579 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDrqeplO6tRKRAADpUxnXO4aOI46p3Nj+IoYA== 2024-03-08T06:02:56.579 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a] 2024-03-08T06:02:56.579 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDsqeplKkCoBhAAWAHNLMLkOgmZmUQ5UebQyQ== 2024-03-08T06:02:56.579 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.c] 2024-03-08T06:02:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDsqeplW4Y0GRAAA2Y7mS6G/TNtF0VeYH1Pbw== 2024-03-08T06:02:56.580 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.0] 2024-03-08T06:02:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDyqeplsbpyAhAASWXUKkoo3ofYJgxs0VJBwA== 2024-03-08T06:02:56.580 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.1] 2024-03-08T06:02:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQD1qepl0O15HBAAJLTI/lhb1OLK4nSucYdLTw== 2024-03-08T06:02:56.580 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.2] 2024-03-08T06:02:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQD4qeplcmn5NRAA2uStK5nHy0M0oJaTtiQnIQ== 2024-03-08T06:02:56.580 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.3] 2024-03-08T06:02:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQD8qeplaxEfFBAAIqmIYDTw1RwTuYm9S4U6+A== 2024-03-08T06:02:56.580 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.x] 2024-03-08T06:02:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDrqepl91zZNRAAPpk79q/hQlHVlBAlRkfMqw== 2024-03-08T06:02:56.580 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.b] 2024-03-08T06:02:56.580 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDsqeplLbFRKxAASPAxedYvCTCVFSq1wJ9cDQ== 2024-03-08T06:02:56.580 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.d] 2024-03-08T06:02:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDtqeplkfy1ARAASyTwWF5gP2Ii2MS6VMIzsg== 2024-03-08T06:02:56.581 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.4] 2024-03-08T06:02:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQABqupl/84VIBAAlKEAn3insYJCsfOdBzMpDg== 2024-03-08T06:02:56.581 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.5] 2024-03-08T06:02:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAEquplJC2yORAADO2Ns5v10pVd1URxrrXXTQ== 2024-03-08T06:02:56.581 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.6] 2024-03-08T06:02:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQAIqupl2in8FhAAO0CvJlSoeBd2P5FZMEwnEw== 2024-03-08T06:02:56.581 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.7] 2024-03-08T06:02:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQALquplb7ThIRAA1UAjvaXdx98vtrkDMNwyPQ== 2024-03-08T06:02:56.581 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-03-08T06:02:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDtqeplzcxPEBAABnbNLSY0GpjUgDT5bL7o6Q== 2024-03-08T06:02:56.581 INFO:teuthology.orchestra.run.smithi019.stdout:[client.2] 2024-03-08T06:02:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDtqeplwziUGxAAe2xdJV24WAgJHVuQiZs3FQ== 2024-03-08T06:02:56.581 INFO:teuthology.orchestra.run.smithi019.stdout:[client.1] 2024-03-08T06:02:56.581 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDtqeplk60ZJxAAk7o4/2EY7GuHmcQ169jw1g== 2024-03-08T06:02:56.582 INFO:teuthology.orchestra.run.smithi019.stdout:[client.3] 2024-03-08T06:02:56.582 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDtqeplxb3HMhAARfd2LQh6/j7gQxkx4NnmYA== 2024-03-08T06:02:56.584 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr.y] 2024-03-08T06:02:56.584 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDrqeplO6tRKRAADpUxnXO4aOI46p3Nj+IoYA== 2024-03-08T06:02:56.584 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a] 2024-03-08T06:02:56.584 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDsqeplKkCoBhAAWAHNLMLkOgmZmUQ5UebQyQ== 2024-03-08T06:02:56.584 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.c] 2024-03-08T06:02:56.584 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDsqeplW4Y0GRAAA2Y7mS6G/TNtF0VeYH1Pbw== 2024-03-08T06:02:56.584 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.0] 2024-03-08T06:02:56.584 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDyqeplsbpyAhAASWXUKkoo3ofYJgxs0VJBwA== 2024-03-08T06:02:56.584 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.1] 2024-03-08T06:02:56.585 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQD1qepl0O15HBAAJLTI/lhb1OLK4nSucYdLTw== 2024-03-08T06:02:56.585 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.2] 2024-03-08T06:02:56.585 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQD4qeplcmn5NRAA2uStK5nHy0M0oJaTtiQnIQ== 2024-03-08T06:02:56.585 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.3] 2024-03-08T06:02:56.585 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQD8qeplaxEfFBAAIqmIYDTw1RwTuYm9S4U6+A== 2024-03-08T06:02:56.585 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr.x] 2024-03-08T06:02:56.585 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDrqepl91zZNRAAPpk79q/hQlHVlBAlRkfMqw== 2024-03-08T06:02:56.585 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b] 2024-03-08T06:02:56.585 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDsqeplLbFRKxAASPAxedYvCTCVFSq1wJ9cDQ== 2024-03-08T06:02:56.585 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.d] 2024-03-08T06:02:56.585 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDtqeplkfy1ARAASyTwWF5gP2Ii2MS6VMIzsg== 2024-03-08T06:02:56.585 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.4] 2024-03-08T06:02:56.585 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQABqupl/84VIBAAlKEAn3insYJCsfOdBzMpDg== 2024-03-08T06:02:56.585 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.5] 2024-03-08T06:02:56.585 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQAEquplJC2yORAADO2Ns5v10pVd1URxrrXXTQ== 2024-03-08T06:02:56.585 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.6] 2024-03-08T06:02:56.585 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQAIqupl2in8FhAAO0CvJlSoeBd2P5FZMEwnEw== 2024-03-08T06:02:56.586 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.7] 2024-03-08T06:02:56.586 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQALquplb7ThIRAA1UAjvaXdx98vtrkDMNwyPQ== 2024-03-08T06:02:56.586 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2024-03-08T06:02:56.586 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDtqeplzcxPEBAABnbNLSY0GpjUgDT5bL7o6Q== 2024-03-08T06:02:56.586 INFO:teuthology.orchestra.run.smithi042.stdout:[client.2] 2024-03-08T06:02:56.586 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDtqeplwziUGxAAe2xdJV24WAgJHVuQiZs3FQ== 2024-03-08T06:02:56.586 INFO:teuthology.orchestra.run.smithi042.stdout:[client.1] 2024-03-08T06:02:56.586 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDtqeplk60ZJxAAk7o4/2EY7GuHmcQ169jw1g== 2024-03-08T06:02:56.586 INFO:teuthology.orchestra.run.smithi042.stdout:[client.3] 2024-03-08T06:02:56.586 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQDtqeplxb3HMhAARfd2LQh6/j7gQxkx4NnmYA== 2024-03-08T06:02:56.589 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-08T06:02:56.596 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-08T06:02:56.748 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-08T06:02:56.754 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-08T06:02:56.912 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-08T06:02:56.917 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-08T06:02:57.074 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T06:02:57.080 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T06:02:57.233 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T06:02:57.238 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T06:02:57.387 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T06:02:57.394 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T06:02:57.553 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T06:02:57.560 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T06:02:57.710 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-08T06:02:57.717 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-08T06:02:57.869 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-08T06:02:57.874 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-08T06:02:58.028 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-08T06:02:58.036 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-08T06:02:58.193 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T06:02:58.199 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T06:02:58.352 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T06:02:58.359 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T06:02:58.509 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T06:02:58.514 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T06:02:58.665 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T06:02:58.672 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-08T06:02:58.828 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-08T06:02:58.834 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-08T06:02:58.988 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-08T06:02:58.996 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-08T06:02:59.146 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-08T06:02:59.154 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-08T06:02:59.307 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-08T06:02:59.314 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-08T06:02:59.468 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-08T06:02:59.469 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-08T06:02:59.570 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-08T06:02:59.736 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-08T06:02:59.829 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-08T06:02:59.937 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-08T06:03:00.101 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-08T06:03:00.194 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-08T06:03:00.294 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-08T06:03:00.457 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-08T06:03:00.552 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-08T06:03:00.559 DEBUG:teuthology.orchestra.run.smithi042:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-08T06:03:00.616 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-08T06:03:00.616 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-08T06:03:00.616 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-08T06:03:00.622 INFO:tasks.ceph.mon.a:Started 2024-03-08T06:03:00.622 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-08T06:03:00.622 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-08T06:03:00.628 INFO:tasks.ceph.mon.b:Started 2024-03-08T06:03:00.628 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-08T06:03:00.628 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-08T06:03:00.633 INFO:tasks.ceph.mon.c:Started 2024-03-08T06:03:00.633 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-08T06:03:00.633 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-08T06:03:00.633 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-08T06:03:00.639 INFO:tasks.ceph.mgr.y:Started 2024-03-08T06:03:00.639 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-08T06:03:00.639 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-08T06:03:00.643 INFO:tasks.ceph.mgr.x:Started 2024-03-08T06:03:00.643 INFO:tasks.ceph:Setting crush tunables to default 2024-03-08T06:03:00.644 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd crush tunables default 2024-03-08T06:03:00.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.825+0000 7f011f800640 1 Processor -- start 2024-03-08T06:03:00.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.826+0000 7f011f800640 1 -- start start 2024-03-08T06:03:00.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.827+0000 7f011f800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f01180ccc70 0x7f01180cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:00.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.827+0000 7f011f800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f01180b2bc0 0x7f01180b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:00.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.827+0000 7f011f800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0118071990 con 0x7f0118145590 2024-03-08T06:03:00.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.827+0000 7f011f800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01180cf8b0 con 0x7f01180b2bc0 2024-03-08T06:03:00.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.827+0000 7f011f800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01180cd5f0 con 0x7f01180ccc70 2024-03-08T06:03:00.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.827+0000 7f011ce00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f0118145590 0x7f01180cf1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.19:46392/0 (socket says 172.21.15.19:46392) 2024-03-08T06:03:00.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.827+0000 7f011ce00640 1 -- 172.21.15.19:0/1389802693 learned_addr learned my addr 172.21.15.19:0/1389802693 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:00.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.827+0000 7f0117e00640 1 --2- 172.21.15.19:0/1389802693 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f01180ccc70 0x7f01180cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:00.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.828+0000 7f0117e00640 1 -- 172.21.15.19:0/1389802693 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f01180ccc70 msgr2=0x7f01180cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-08T06:03:00.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.828+0000 7f0117e00640 1 -- 172.21.15.19:0/1389802693 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f01180ccc70 msgr2=0x7f01180cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-08T06:03:00.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.828+0000 7f0117e00640 1 --2- 172.21.15.19:0/1389802693 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f01180ccc70 0x7f01180cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-08T06:03:00.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.828+0000 7f0117e00640 1 --2- 172.21.15.19:0/1389802693 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f01180ccc70 0x7f01180cd0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-08T06:03:00.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.828+0000 7f011d800640 1 --2- 172.21.15.19:0/1389802693 >> v2:172.21.15.19:3300/0 conn(0x7f01180b2bc0 0x7f01180b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:00.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.828+0000 7f011d800640 1 -- 172.21.15.19:0/1389802693 >> v2:172.21.15.19:3300/0 conn(0x7f01180b2bc0 msgr2=0x7f01180b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-08T06:03:00.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.828+0000 7f011d800640 1 -- 172.21.15.19:0/1389802693 >> v2:172.21.15.19:3300/0 conn(0x7f01180b2bc0 msgr2=0x7f01180b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-08T06:03:00.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.828+0000 7f011d800640 1 --2- 172.21.15.19:0/1389802693 >> v2:172.21.15.19:3300/0 conn(0x7f01180b2bc0 0x7f01180b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-08T06:03:00.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.828+0000 7f011d800640 1 --2- 172.21.15.19:0/1389802693 >> v2:172.21.15.19:3300/0 conn(0x7f01180b2bc0 0x7f01180b3010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-08T06:03:00.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.847+0000 7f0117400640 1 -- 172.21.15.19:0/1389802693 <== mon.1 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092237466 0 0) 0x7f0118071990 con 0x7f0118145590 2024-03-08T06:03:00.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.847+0000 7f0117400640 1 -- 172.21.15.19:0/1389802693 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0100003520 con 0x7f0118145590 2024-03-08T06:03:00.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.849+0000 7f0117400640 1 -- 172.21.15.19:0/1389802693 <== mon.1 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3987018479 0 0) 0x7f0100003520 con 0x7f0118145590 2024-03-08T06:03:00.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.849+0000 7f0117400640 1 -- 172.21.15.19:0/1389802693 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f01180ccc70 msgr2=0x7f01180cd0b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-08T06:03:00.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.849+0000 7f0117400640 1 --2- 172.21.15.19:0/1389802693 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f01180ccc70 0x7f01180cd0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:00.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.849+0000 7f0117400640 1 -- 172.21.15.19:0/1389802693 >> v2:172.21.15.19:3300/0 conn(0x7f01180b2bc0 msgr2=0x7f01180b3010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-08T06:03:00.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.849+0000 7f0117400640 1 --2- 172.21.15.19:0/1389802693 >> v2:172.21.15.19:3300/0 conn(0x7f01180b2bc0 0x7f01180b3010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:00.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.849+0000 7f0117400640 1 -- 172.21.15.19:0/1389802693 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0118071c70 con 0x7f0118145590 2024-03-08T06:03:00.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.849+0000 7f0117400640 1 -- 172.21.15.19:0/1389802693 <== mon.1 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f010c001670 con 0x7f0118145590 2024-03-08T06:03:00.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.849+0000 7f0117400640 1 -- 172.21.15.19:0/1389802693 >> v1:172.21.15.42:6789/0 conn(0x7f0118145590 legacy=0x7f01180cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:00.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.849+0000 7f0117400640 1 --2- 172.21.15.19:0/1389802693 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f01180ccc70 0x7f01000039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:00.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.849+0000 7f0117400640 1 --2- 172.21.15.19:0/1389802693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0100004030 0x7f0100004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:00.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.849+0000 7f0117400640 1 --2- 172.21.15.19:0/1389802693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0100004d40 0x7f01000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:00.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.849+0000 7f0117400640 1 -- 172.21.15.19:0/1389802693 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01180cf8b0 con 0x7f0100004d40 2024-03-08T06:03:00.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.849+0000 7f0117400640 1 -- 172.21.15.19:0/1389802693 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01180cd5f0 con 0x7f0100004030 2024-03-08T06:03:00.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.849+0000 7f0117400640 1 -- 172.21.15.19:0/1389802693 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010000bb20 con 0x7f01180ccc70 2024-03-08T06:03:00.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.849+0000 7f011ce00640 1 --2- 172.21.15.19:0/1389802693 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f01180ccc70 0x7f01000039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:00.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.849+0000 7f011d800640 1 --2- 172.21.15.19:0/1389802693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0100004d40 0x7f01000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:00.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.849+0000 7f0117e00640 1 --2- 172.21.15.19:0/1389802693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0100004030 0x7f0100004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:00.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.850+0000 7f011d800640 1 -- 172.21.15.19:0/1389802693 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f01180ccc70 msgr2=0x7f01000039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:00.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.850+0000 7f011d800640 1 --2- 172.21.15.19:0/1389802693 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f01180ccc70 0x7f01000039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:00.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.850+0000 7f011d800640 1 -- 172.21.15.19:0/1389802693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0100004030 msgr2=0x7f0100004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:00.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.850+0000 7f011d800640 1 --2- 172.21.15.19:0/1389802693 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0100004030 0x7f0100004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:00.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.850+0000 7f011d800640 1 -- 172.21.15.19:0/1389802693 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0100003520 con 0x7f0100004d40 2024-03-08T06:03:00.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.851+0000 7f011d800640 1 --2- 172.21.15.19:0/1389802693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0100004d40 0x7f01000051c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0110010470 tx=0x7f0100005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a0f0f5d9d59f27 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:00.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.851+0000 7f0117400640 1 -- 172.21.15.19:0/1389802693 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011003c070 con 0x7f0100004d40 2024-03-08T06:03:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.851+0000 7f0117400640 1 -- 172.21.15.19:0/1389802693 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011000e450 con 0x7f0100004d40 2024-03-08T06:03:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.851+0000 7f0117400640 1 -- 172.21.15.19:0/1389802693 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0110009c60 con 0x7f0100004d40 2024-03-08T06:03:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.852+0000 7f011f800640 1 -- 172.21.15.19:0/1389802693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0100004d40 msgr2=0x7f01000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.852+0000 7f011f800640 1 --2- 172.21.15.19:0/1389802693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0100004d40 0x7f01000051c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0110010470 tx=0x7f0100005830 comp rx=0 tx=0).stop 2024-03-08T06:03:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.852+0000 7f011d800640 1 -- 172.21.15.19:0/1389802693 reap_dead start 2024-03-08T06:03:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.852+0000 7f011f800640 1 -- 172.21.15.19:0/1389802693 shutdown_connections 2024-03-08T06:03:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.852+0000 7f011f800640 1 -- 172.21.15.19:0/1389802693 >> 172.21.15.19:0/1389802693 conn(0x7f01180cfaa0 msgr2=0x7f01180cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.852+0000 7f011f800640 1 -- 172.21.15.19:0/1389802693 shutdown_connections 2024-03-08T06:03:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.852+0000 7f011f800640 1 -- 172.21.15.19:0/1389802693 wait complete. 2024-03-08T06:03:00.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.854+0000 7f011f800640 1 Processor -- start 2024-03-08T06:03:00.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.854+0000 7f011f800640 1 -- start start 2024-03-08T06:03:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.855+0000 7f011f800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0100004d40 0x7f01181ef240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.855+0000 7f011f800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0118153130 0x7f01181414c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.855+0000 7f011f800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f01181430f0 0x7f0118143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.855+0000 7f011f800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0118072510 con 0x7f0118153130 2024-03-08T06:03:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.855+0000 7f011f800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0118072230 con 0x7f0100004d40 2024-03-08T06:03:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.855+0000 7f011f800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0118145970 con 0x7f01181430f0 2024-03-08T06:03:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.856+0000 7f0117e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0118153130 0x7f01181414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.856+0000 7f0117e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0118153130 0x7f01181414c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59594/0 (socket says 172.21.15.19:59594) 2024-03-08T06:03:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.856+0000 7f0117e00640 1 -- 172.21.15.19:0/3932776894 learned_addr learned my addr 172.21.15.19:0/3932776894 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.856+0000 7f011d800640 1 --2- 172.21.15.19:0/3932776894 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f01181430f0 0x7f0118143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.856+0000 7f011ce00640 1 --2- 172.21.15.19:0/3932776894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0100004d40 0x7f01181ef240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.856+0000 7f0117e00640 1 -- 172.21.15.19:0/3932776894 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f01181430f0 msgr2=0x7f0118143570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.856+0000 7f0117e00640 1 --2- 172.21.15.19:0/3932776894 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f01181430f0 0x7f0118143570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.856+0000 7f0117e00640 1 -- 172.21.15.19:0/3932776894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0100004d40 msgr2=0x7f01181ef240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.856+0000 7f0117e00640 1 --2- 172.21.15.19:0/3932776894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0100004d40 0x7f01181ef240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.856+0000 7f0117e00640 1 -- 172.21.15.19:0/3932776894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01181ef850 con 0x7f0118153130 2024-03-08T06:03:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.856+0000 7f0117e00640 1 --2- 172.21.15.19:0/3932776894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0118153130 0x7f01181414c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f01040108d0 tx=0x7f0104010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.857+0000 7f0114c00640 1 -- 172.21.15.19:0/3932776894 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010401a020 con 0x7f0118153130 2024-03-08T06:03:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.857+0000 7f0114c00640 1 -- 172.21.15.19:0/3932776894 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010400e9c0 con 0x7f0118153130 2024-03-08T06:03:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.857+0000 7f0114c00640 1 -- 172.21.15.19:0/3932776894 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010400edb0 con 0x7f0118153130 2024-03-08T06:03:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.857+0000 7f011f800640 1 -- 172.21.15.19:0/3932776894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01181efb30 con 0x7f0118153130 2024-03-08T06:03:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.857+0000 7f011f800640 1 -- 172.21.15.19:0/3932776894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01181f00f0 con 0x7f0118153130 2024-03-08T06:03:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.857+0000 7f0114c00640 1 -- 172.21.15.19:0/3932776894 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f010401d020 con 0x7f0118153130 2024-03-08T06:03:00.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.857+0000 7f0114c00640 1 -- 172.21.15.19:0/3932776894 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0104014970 con 0x7f0118153130 2024-03-08T06:03:00.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.858+0000 7f011f800640 1 -- 172.21.15.19:0/3932776894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0118067cb0 con 0x7f0118153130 2024-03-08T06:03:00.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.861+0000 7f0114c00640 1 -- 172.21.15.19:0/3932776894 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f0104024020 con 0x7f0118153130 2024-03-08T06:03:00.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.934+0000 7f011f800640 1 -- 172.21.15.19:0/3932776894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f01180b3ce0 con 0x7f0118153130 2024-03-08T06:03:00.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.938+0000 7f0114c00640 1 -- 172.21.15.19:0/3932776894 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0104014430 con 0x7f0118153130 2024-03-08T06:03:00.939 INFO:teuthology.orchestra.run.smithi019.stderr:adjusted tunables profile to default 2024-03-08T06:03:00.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.940+0000 7f011f800640 1 -- 172.21.15.19:0/3932776894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0118153130 msgr2=0x7f01181414c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:00.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.940+0000 7f011f800640 1 --2- 172.21.15.19:0/3932776894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0118153130 0x7f01181414c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f01040108d0 tx=0x7f0104010d90 comp rx=0 tx=0).stop 2024-03-08T06:03:00.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.940+0000 7f011f800640 1 -- 172.21.15.19:0/3932776894 shutdown_connections 2024-03-08T06:03:00.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.940+0000 7f011f800640 1 --2- 172.21.15.19:0/3932776894 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f01181430f0 0x7f0118143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:00.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.940+0000 7f011f800640 1 --2- 172.21.15.19:0/3932776894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0118153130 0x7f01181414c0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:00.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.940+0000 7f011f800640 1 --2- 172.21.15.19:0/3932776894 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0100004d40 0x7f01181ef240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:00.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.940+0000 7f011f800640 1 -- 172.21.15.19:0/3932776894 >> 172.21.15.19:0/3932776894 conn(0x7f01180cfaa0 msgr2=0x7f0118144610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:00.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.940+0000 7f011f800640 1 -- 172.21.15.19:0/3932776894 shutdown_connections 2024-03-08T06:03:00.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:00.940+0000 7f011f800640 1 -- 172.21.15.19:0/3932776894 wait complete. 2024-03-08T06:03:00.959 INFO:tasks.ceph:check_enable_crimson: False 2024-03-08T06:03:00.959 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-08T06:03:00.959 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:03:00.959 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-08T06:03:01.039 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:03:01.039 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-08T06:03:01.166 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:03:01.166 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-08T06:03:01.297 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:03:01.297 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-08T06:03:01.385 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:03:01.385 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-08T06:03:01.481 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:03:01.481 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-08T06:03:01.564 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:03:01.564 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-08T06:03:01.574 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:01.573+0000 7fe619c0e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-08T06:03:01.639 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:01.638+0000 7fe619c0e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-08T06:03:01.650 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:03:01.650 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-08T06:03:01.665 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:01.664+0000 7f4528046040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-08T06:03:01.738 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:01.737+0000 7f4528046040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-08T06:03:01.757 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 86177ddf-4ef4-455b-81bf-0f6a924fe71e 0 2024-03-08T06:03:01.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.965+0000 7fad25600640 1 Processor -- start 2024-03-08T06:03:01.966 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.965+0000 7fad25600640 1 -- start start 2024-03-08T06:03:01.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.967+0000 7fad25600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fad2015aaf0 0x7fad200cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:01.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.967+0000 7fad25600640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fad200ce420 0x7fad200ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:01.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.967+0000 7fad25600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad200cb590 con 0x7fad200b0070 2024-03-08T06:03:01.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.967+0000 7fad25600640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad200cb360 con 0x7fad200ce420 2024-03-08T06:03:01.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.967+0000 7fad25600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad200b0be0 con 0x7fad2015aaf0 2024-03-08T06:03:01.968 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.967+0000 7fad1fe00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fad2015aaf0 0x7fad200cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:01.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.967+0000 7fad17e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fad200b0070 0x7fad200b04d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:44702/0 (socket says 172.21.15.42:44702) 2024-03-08T06:03:01.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.967+0000 7fad17e00640 1 -- 172.21.15.42:0/711201323 learned_addr learned my addr 172.21.15.42:0/711201323 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-03-08T06:03:01.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.967+0000 7fad24c00640 1 --2- 172.21.15.42:0/711201323 >> v2:172.21.15.19:3300/0 conn(0x7fad200ce420 0x7fad200ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:01.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.968+0000 7fad1f400640 1 -- 172.21.15.42:0/711201323 <== mon.1 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637279972 0 0) 0x7fad200cb590 con 0x7fad200b0070 2024-03-08T06:03:01.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.968+0000 7fad1f400640 1 -- 172.21.15.42:0/711201323 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad04003520 con 0x7fad200b0070 2024-03-08T06:03:01.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.968+0000 7fad1fe00640 1 -- 172.21.15.42:0/711201323 >> v2:172.21.15.19:3300/0 conn(0x7fad200ce420 msgr2=0x7fad200ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:01.969 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.968+0000 7fad1fe00640 1 --2- 172.21.15.42:0/711201323 >> v2:172.21.15.19:3300/0 conn(0x7fad200ce420 0x7fad200ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:01.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.968+0000 7fad1fe00640 1 -- 172.21.15.42:0/711201323 >> v1:172.21.15.42:6789/0 conn(0x7fad200b0070 legacy=0x7fad200b04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:01.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.968+0000 7fad1fe00640 1 -- 172.21.15.42:0/711201323 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad200cb870 con 0x7fad2015aaf0 2024-03-08T06:03:01.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.969+0000 7fad1fe00640 1 --2- 172.21.15.42:0/711201323 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fad2015aaf0 0x7fad200cc630 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fad100097a0 tx=0x7fad1002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ff8bcdc468d38c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:01.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.969+0000 7fad1f400640 1 -- 172.21.15.42:0/711201323 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad10035020 con 0x7fad2015aaf0 2024-03-08T06:03:01.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.969+0000 7fad1f400640 1 -- 172.21.15.42:0/711201323 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad10031830 con 0x7fad2015aaf0 2024-03-08T06:03:01.970 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.969+0000 7fad1f400640 1 -- 172.21.15.42:0/711201323 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad10031be0 con 0x7fad2015aaf0 2024-03-08T06:03:01.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.970+0000 7fad25600640 1 -- 172.21.15.42:0/711201323 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fad2015aaf0 msgr2=0x7fad200cc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:01.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.970+0000 7fad25600640 1 --2- 172.21.15.42:0/711201323 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fad2015aaf0 0x7fad200cc630 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fad100097a0 tx=0x7fad1002b8d0 comp rx=0 tx=0).stop 2024-03-08T06:03:01.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.970+0000 7fad25600640 1 -- 172.21.15.42:0/711201323 shutdown_connections 2024-03-08T06:03:01.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.970+0000 7fad25600640 1 --2- 172.21.15.42:0/711201323 >> v2:172.21.15.19:3300/0 conn(0x7fad200ce420 0x7fad200ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:01.971 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.970+0000 7fad25600640 1 --2- 172.21.15.42:0/711201323 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fad2015aaf0 0x7fad200cc630 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:01.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.970+0000 7fad25600640 1 -- 172.21.15.42:0/711201323 >> 172.21.15.42:0/711201323 conn(0x7fad20099a70 msgr2=0x7fad20099e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:01.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.970+0000 7fad25600640 1 -- 172.21.15.42:0/711201323 shutdown_connections 2024-03-08T06:03:01.972 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.970+0000 7fad25600640 1 -- 172.21.15.42:0/711201323 wait complete. 2024-03-08T06:03:01.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.972+0000 7fad25600640 1 Processor -- start 2024-03-08T06:03:01.973 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.972+0000 7fad25600640 1 -- start start 2024-03-08T06:03:01.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.973+0000 7fad25600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fad200b0070 0x7fad201521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:01.975 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.973+0000 7fad25600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad200ce420 0x7fad200c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:01.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.973+0000 7fad25600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad2015aaf0 0x7fad20153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:01.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.973+0000 7fad25600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad200cc110 con 0x7fad200ce420 2024-03-08T06:03:01.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.973+0000 7fad25600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad200cbe30 con 0x7fad2015aaf0 2024-03-08T06:03:01.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.973+0000 7fad25600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad200ccb70 con 0x7fad200b0070 2024-03-08T06:03:01.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.973+0000 7fad1fe00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fad200b0070 0x7fad201521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:01.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.973+0000 7fad1fe00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fad200b0070 0x7fad201521e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:46212/0 (socket says 172.21.15.42:46212) 2024-03-08T06:03:01.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.973+0000 7fad1fe00640 1 -- 172.21.15.42:0/2218183716 learned_addr learned my addr 172.21.15.42:0/2218183716 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-08T06:03:01.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.973+0000 7fad24c00640 1 --2- 172.21.15.42:0/2218183716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad2015aaf0 0x7fad20153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:01.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.973+0000 7fad17e00640 1 --2- 172.21.15.42:0/2218183716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad200ce420 0x7fad200c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:01.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.974+0000 7fad1fe00640 1 -- 172.21.15.42:0/2218183716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad2015aaf0 msgr2=0x7fad20153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:01.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.974+0000 7fad1fe00640 1 --2- 172.21.15.42:0/2218183716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad2015aaf0 0x7fad20153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:01.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.974+0000 7fad1fe00640 1 -- 172.21.15.42:0/2218183716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad200ce420 msgr2=0x7fad200c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:01.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.974+0000 7fad1fe00640 1 --2- 172.21.15.42:0/2218183716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad200ce420 0x7fad200c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:01.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.974+0000 7fad1fe00640 1 -- 172.21.15.42:0/2218183716 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad200b35b0 con 0x7fad200b0070 2024-03-08T06:03:01.976 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.974+0000 7fad24c00640 1 --2- 172.21.15.42:0/2218183716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad2015aaf0 0x7fad20153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:03:01.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.974+0000 7fad1fe00640 1 --2- 172.21.15.42:0/2218183716 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fad200b0070 0x7fad201521e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fad1002b910 tx=0x7fad100046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:01.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.974+0000 7fad1cc00640 1 -- 172.21.15.42:0/2218183716 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad10035040 con 0x7fad200b0070 2024-03-08T06:03:01.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.974+0000 7fad1cc00640 1 -- 172.21.15.42:0/2218183716 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1003b840 con 0x7fad200b0070 2024-03-08T06:03:01.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.974+0000 7fad1cc00640 1 -- 172.21.15.42:0/2218183716 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1003bc10 con 0x7fad200b0070 2024-03-08T06:03:01.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.974+0000 7fad25600640 1 -- 172.21.15.42:0/2218183716 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad20152880 con 0x7fad200b0070 2024-03-08T06:03:01.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.975+0000 7fad25600640 1 -- 172.21.15.42:0/2218183716 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad200b3b30 con 0x7fad200b0070 2024-03-08T06:03:01.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.975+0000 7fad1cc00640 1 -- 172.21.15.42:0/2218183716 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fad10038020 con 0x7fad200b0070 2024-03-08T06:03:01.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.975+0000 7fad1cc00640 1 -- 172.21.15.42:0/2218183716 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fad1003a4c0 con 0x7fad200b0070 2024-03-08T06:03:01.977 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.976+0000 7fad25600640 1 -- 172.21.15.42:0/2218183716 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad20075100 con 0x7fad200b0070 2024-03-08T06:03:01.979 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:01.978+0000 7fad1cc00640 1 -- 172.21.15.42:0/2218183716 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fad1003bdb0 con 0x7fad200b0070 2024-03-08T06:03:02.058 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.058+0000 7fad25600640 1 -- 172.21.15.42:0/2218183716 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd new", "uuid": "86177ddf-4ef4-455b-81bf-0f6a924fe71e", "id": 0} v 0) v1 -- 0x7fad200c8960 con 0x7fad200b0070 2024-03-08T06:03:02.066 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.065+0000 7fad1cc00640 1 -- 172.21.15.42:0/2218183716 <== mon.2 v2:172.21.15.42:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "86177ddf-4ef4-455b-81bf-0f6a924fe71e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fad10046810 con 0x7fad200b0070 2024-03-08T06:03:02.066 INFO:teuthology.orchestra.run.smithi042.stdout:0 2024-03-08T06:03:02.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.066+0000 7fad25600640 1 -- 172.21.15.42:0/2218183716 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fad200b0070 msgr2=0x7fad201521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:02.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.066+0000 7fad25600640 1 --2- 172.21.15.42:0/2218183716 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fad200b0070 0x7fad201521e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fad1002b910 tx=0x7fad100046c0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.067+0000 7fad25600640 1 -- 172.21.15.42:0/2218183716 shutdown_connections 2024-03-08T06:03:02.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.067+0000 7fad25600640 1 --2- 172.21.15.42:0/2218183716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad2015aaf0 0x7fad20153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.067+0000 7fad25600640 1 --2- 172.21.15.42:0/2218183716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad200ce420 0x7fad200c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.067+0000 7fad25600640 1 --2- 172.21.15.42:0/2218183716 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fad200b0070 0x7fad201521e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.067+0000 7fad25600640 1 -- 172.21.15.42:0/2218183716 >> 172.21.15.42:0/2218183716 conn(0x7fad20099a70 msgr2=0x7fad2006ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:02.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.067+0000 7fad25600640 1 -- 172.21.15.42:0/2218183716 shutdown_connections 2024-03-08T06:03:02.068 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.067+0000 7fad25600640 1 -- 172.21.15.42:0/2218183716 wait complete. 2024-03-08T06:03:02.085 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 111afd04-dee7-4b38-b734-67796dfd3bb8 1 2024-03-08T06:03:02.254 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:02.253+0000 7fe619c0e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-08T06:03:02.279 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.278+0000 7fd575400640 1 Processor -- start 2024-03-08T06:03:02.280 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.279+0000 7fd575400640 1 -- start start 2024-03-08T06:03:02.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.280+0000 7fd575400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd57015df20 0x7fd570161bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:02.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.280+0000 7fd575400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd57015e300 0x7fd5700ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:02.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.280+0000 7fd575400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5701622f0 con 0x7fd5700d0720 2024-03-08T06:03:02.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.280+0000 7fd575400640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5701625d0 con 0x7fd57015e300 2024-03-08T06:03:02.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.280+0000 7fd575400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5701628b0 con 0x7fd57015df20 2024-03-08T06:03:02.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.280+0000 7fd56e800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd57015df20 0x7fd570161bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:02.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.280+0000 7fd56e800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd57015df20 0x7fd570161bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:46214/0 (socket says 172.21.15.42:46214) 2024-03-08T06:03:02.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.280+0000 7fd56e800640 1 -- 172.21.15.42:0/2013525575 learned_addr learned my addr 172.21.15.42:0/2013525575 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-08T06:03:02.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.280+0000 7fd56de00640 1 --2- 172.21.15.42:0/2013525575 >> v2:172.21.15.19:3300/0 conn(0x7fd57015e300 0x7fd5700ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:02.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.281+0000 7fd56e800640 1 -- 172.21.15.42:0/2013525575 >> v2:172.21.15.19:3300/0 conn(0x7fd57015e300 msgr2=0x7fd5700ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:02.282 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.281+0000 7fd56e800640 1 --2- 172.21.15.42:0/2013525575 >> v2:172.21.15.19:3300/0 conn(0x7fd57015e300 0x7fd5700ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.281+0000 7fd56e800640 1 -- 172.21.15.42:0/2013525575 >> v1:172.21.15.19:6789/0 conn(0x7fd5700d0720 legacy=0x7fd5700b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:02.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.281+0000 7fd56e800640 1 -- 172.21.15.42:0/2013525575 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5700d2080 con 0x7fd57015df20 2024-03-08T06:03:02.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.282+0000 7fd56e800640 1 --2- 172.21.15.42:0/2013525575 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd57015df20 0x7fd570161bf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd560009870 tx=0x7fd56002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba7835826a240baf server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:02.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.282+0000 7fd56d400640 1 -- 172.21.15.42:0/2013525575 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560034070 con 0x7fd57015df20 2024-03-08T06:03:02.283 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.282+0000 7fd56d400640 1 -- 172.21.15.42:0/2013525575 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd560030840 con 0x7fd57015df20 2024-03-08T06:03:02.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.282+0000 7fd56d400640 1 -- 172.21.15.42:0/2013525575 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560030c10 con 0x7fd57015df20 2024-03-08T06:03:02.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.283+0000 7fd575400640 1 -- 172.21.15.42:0/2013525575 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd57015df20 msgr2=0x7fd570161bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:02.284 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.283+0000 7fd575400640 1 --2- 172.21.15.42:0/2013525575 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd57015df20 0x7fd570161bf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd560009870 tx=0x7fd56002b980 comp rx=0 tx=0).stop 2024-03-08T06:03:02.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.283+0000 7fd575400640 1 -- 172.21.15.42:0/2013525575 shutdown_connections 2024-03-08T06:03:02.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.283+0000 7fd575400640 1 --2- 172.21.15.42:0/2013525575 >> v2:172.21.15.19:3300/0 conn(0x7fd57015e300 0x7fd5700ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.283+0000 7fd575400640 1 --2- 172.21.15.42:0/2013525575 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd57015df20 0x7fd570161bf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.283+0000 7fd575400640 1 -- 172.21.15.42:0/2013525575 >> 172.21.15.42:0/2013525575 conn(0x7fd57006c470 msgr2=0x7fd57006c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:02.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.283+0000 7fd575400640 1 -- 172.21.15.42:0/2013525575 shutdown_connections 2024-03-08T06:03:02.285 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.283+0000 7fd575400640 1 -- 172.21.15.42:0/2013525575 wait complete. 2024-03-08T06:03:02.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.285+0000 7fd575400640 1 Processor -- start 2024-03-08T06:03:02.286 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.285+0000 7fd575400640 1 -- start start 2024-03-08T06:03:02.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.286+0000 7fd575400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5700d0720 0x7fd5700cc840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:02.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.286+0000 7fd575400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd57015df20 0x7fd570152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:02.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.286+0000 7fd575400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd5700cce20 0x7fd57015aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:02.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.286+0000 7fd575400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5700d0b70 con 0x7fd5700d0720 2024-03-08T06:03:02.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.286+0000 7fd575400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5700d3840 con 0x7fd57015df20 2024-03-08T06:03:02.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.286+0000 7fd575400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5700d0cf0 con 0x7fd5700cce20 2024-03-08T06:03:02.288 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.286+0000 7fd56de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd57015df20 0x7fd570152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:02.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.286+0000 7fd56f200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd5700cce20 0x7fd57015aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:02.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.286+0000 7fd56de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd57015df20 0x7fd570152540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39512/0 (socket says 172.21.15.42:39512) 2024-03-08T06:03:02.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.286+0000 7fd56de00640 1 -- 172.21.15.42:0/2721591993 learned_addr learned my addr 172.21.15.42:0/2721591993 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-08T06:03:02.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.286+0000 7fd56e800640 1 --2- 172.21.15.42:0/2721591993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5700d0720 0x7fd5700cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:02.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.287+0000 7fd56f200640 1 -- 172.21.15.42:0/2721591993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd57015df20 msgr2=0x7fd570152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:02.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.287+0000 7fd56f200640 1 --2- 172.21.15.42:0/2721591993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd57015df20 0x7fd570152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.287+0000 7fd56f200640 1 -- 172.21.15.42:0/2721591993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5700d0720 msgr2=0x7fd5700cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:02.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.287+0000 7fd56f200640 1 --2- 172.21.15.42:0/2721591993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5700d0720 0x7fd5700cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.289 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.287+0000 7fd56f200640 1 -- 172.21.15.42:0/2721591993 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5700b3da0 con 0x7fd5700cce20 2024-03-08T06:03:02.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.287+0000 7fd56f200640 1 --2- 172.21.15.42:0/2721591993 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd5700cce20 0x7fd57015aba0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd56800c6c0 tx=0x7fd56800cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:02.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.288+0000 7fd566a00640 1 -- 172.21.15.42:0/2721591993 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd568003b70 con 0x7fd5700cce20 2024-03-08T06:03:02.290 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.288+0000 7fd566a00640 1 -- 172.21.15.42:0/2721591993 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd568003d10 con 0x7fd5700cce20 2024-03-08T06:03:02.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.288+0000 7fd566a00640 1 -- 172.21.15.42:0/2721591993 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5680052f0 con 0x7fd5700cce20 2024-03-08T06:03:02.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.288+0000 7fd575400640 1 -- 172.21.15.42:0/2721591993 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5700c79e0 con 0x7fd5700cce20 2024-03-08T06:03:02.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.288+0000 7fd575400640 1 -- 172.21.15.42:0/2721591993 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5700c7fa0 con 0x7fd5700cce20 2024-03-08T06:03:02.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.288+0000 7fd566a00640 1 -- 172.21.15.42:0/2721591993 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd568005490 con 0x7fd5700cce20 2024-03-08T06:03:02.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.288+0000 7fd566a00640 1 -- 172.21.15.42:0/2721591993 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fd568012540 con 0x7fd5700cce20 2024-03-08T06:03:02.291 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.289+0000 7fd575400640 1 -- 172.21.15.42:0/2721591993 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5700683c0 con 0x7fd5700cce20 2024-03-08T06:03:02.295 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.294+0000 7fd566a00640 1 -- 172.21.15.42:0/2721591993 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd5700b3da0 con 0x7fd5700cce20 2024-03-08T06:03:02.321 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:02.321+0000 7fe619c0e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-08T06:03:02.372 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.371+0000 7fd575400640 1 -- 172.21.15.42:0/2721591993 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd new", "uuid": "111afd04-dee7-4b38-b734-67796dfd3bb8", "id": 1} v 0) v1 -- 0x7fd5700d1a90 con 0x7fd5700cce20 2024-03-08T06:03:02.375 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:02.374+0000 7fe619c0e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-08T06:03:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.379+0000 7fd566a00640 1 -- 172.21.15.42:0/2721591993 <== mon.2 v2:172.21.15.42:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "111afd04-dee7-4b38-b734-67796dfd3bb8", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd56800a5e0 con 0x7fd5700cce20 2024-03-08T06:03:02.380 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-03-08T06:03:02.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.380+0000 7fd575400640 1 -- 172.21.15.42:0/2721591993 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd5700cce20 msgr2=0x7fd57015aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:02.381 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.380+0000 7fd575400640 1 --2- 172.21.15.42:0/2721591993 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd5700cce20 0x7fd57015aba0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd56800c6c0 tx=0x7fd56800cb80 comp rx=0 tx=0).stop 2024-03-08T06:03:02.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.380+0000 7fd575400640 1 -- 172.21.15.42:0/2721591993 shutdown_connections 2024-03-08T06:03:02.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.380+0000 7fd575400640 1 --2- 172.21.15.42:0/2721591993 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd5700cce20 0x7fd57015aba0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.380+0000 7fd575400640 1 --2- 172.21.15.42:0/2721591993 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd57015df20 0x7fd570152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.380+0000 7fd575400640 1 --2- 172.21.15.42:0/2721591993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5700d0720 0x7fd5700cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.380+0000 7fd575400640 1 -- 172.21.15.42:0/2721591993 >> 172.21.15.42:0/2721591993 conn(0x7fd57006c470 msgr2=0x7fd5700b6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:02.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.381+0000 7fd575400640 1 -- 172.21.15.42:0/2721591993 shutdown_connections 2024-03-08T06:03:02.382 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.381+0000 7fd575400640 1 -- 172.21.15.42:0/2721591993 wait complete. 2024-03-08T06:03:02.397 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 6712819c-7483-49fe-880b-1c8311c19f54 2 2024-03-08T06:03:02.419 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:02.418+0000 7f4528046040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-08T06:03:02.441 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:02.440+0000 7fe619c0e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-08T06:03:02.489 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:02.488+0000 7f4528046040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-08T06:03:02.493 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:02.492+0000 7fe619c0e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-08T06:03:02.544 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:02.543+0000 7f4528046040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-08T06:03:02.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.584+0000 7f96db200640 1 Processor -- start 2024-03-08T06:03:02.585 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.584+0000 7f96db200640 1 -- start start 2024-03-08T06:03:02.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.586+0000 7f96db200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f96d415dd50 0x7f96d406d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:02.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.586+0000 7f96db200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f96d40d2110 0x7f96d40cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:02.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.586+0000 7f96db200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d40cc430 con 0x7f96d415e130 2024-03-08T06:03:02.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.586+0000 7f96db200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d4161c10 con 0x7f96d415dd50 2024-03-08T06:03:02.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.586+0000 7f96db200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d4161ef0 con 0x7f96d40d2110 2024-03-08T06:03:02.587 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.586+0000 7f96d9400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f96d40d2110 0x7f96d40cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:02.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.586+0000 7f96d9400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f96d40d2110 0x7f96d40cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:46240/0 (socket says 172.21.15.42:46240) 2024-03-08T06:03:02.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.586+0000 7f96d9400640 1 -- 172.21.15.42:0/1990120229 learned_addr learned my addr 172.21.15.42:0/1990120229 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-08T06:03:02.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.586+0000 7f96d9e00640 1 --2- 172.21.15.42:0/1990120229 >> v2:172.21.15.19:3300/0 conn(0x7f96d415dd50 0x7f96d406d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:02.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.587+0000 7f96d9400640 1 -- 172.21.15.42:0/1990120229 >> v2:172.21.15.19:3300/0 conn(0x7f96d415dd50 msgr2=0x7f96d406d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:02.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.587+0000 7f96d9400640 1 --2- 172.21.15.42:0/1990120229 >> v2:172.21.15.19:3300/0 conn(0x7f96d415dd50 0x7f96d406d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.587+0000 7f96d9400640 1 -- 172.21.15.42:0/1990120229 >> v1:172.21.15.19:6789/0 conn(0x7f96d415e130 legacy=0x7f96d40ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:02.588 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.587+0000 7f96d9400640 1 -- 172.21.15.42:0/1990120229 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d41621d0 con 0x7f96d40d2110 2024-03-08T06:03:02.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.588+0000 7f96d9400640 1 --2- 172.21.15.42:0/1990120229 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f96d40d2110 0x7f96d40cfcd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f96c4009870 tx=0x7f96c402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2176f9d98e7339b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:02.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.588+0000 7f96d8a00640 1 -- 172.21.15.42:0/1990120229 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c4034070 con 0x7f96d40d2110 2024-03-08T06:03:02.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.588+0000 7f96d8a00640 1 -- 172.21.15.42:0/1990120229 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c4030840 con 0x7f96d40d2110 2024-03-08T06:03:02.589 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.588+0000 7f96d8a00640 1 -- 172.21.15.42:0/1990120229 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c4030c10 con 0x7f96d40d2110 2024-03-08T06:03:02.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.589+0000 7f96db200640 1 -- 172.21.15.42:0/1990120229 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f96d40d2110 msgr2=0x7f96d40cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:02.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.589+0000 7f96db200640 1 --2- 172.21.15.42:0/1990120229 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f96d40d2110 0x7f96d40cfcd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f96c4009870 tx=0x7f96c402b980 comp rx=0 tx=0).stop 2024-03-08T06:03:02.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.589+0000 7f96db200640 1 -- 172.21.15.42:0/1990120229 shutdown_connections 2024-03-08T06:03:02.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.589+0000 7f96db200640 1 --2- 172.21.15.42:0/1990120229 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f96d40d2110 0x7f96d40cfcd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.590 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.589+0000 7f96db200640 1 --2- 172.21.15.42:0/1990120229 >> v2:172.21.15.19:3300/0 conn(0x7f96d415dd50 0x7f96d406d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.589+0000 7f96db200640 1 -- 172.21.15.42:0/1990120229 >> 172.21.15.42:0/1990120229 conn(0x7f96d406f5d0 msgr2=0x7f96d406f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:02.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.589+0000 7f96db200640 1 -- 172.21.15.42:0/1990120229 shutdown_connections 2024-03-08T06:03:02.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.589+0000 7f96db200640 1 -- 172.21.15.42:0/1990120229 wait complete. 2024-03-08T06:03:02.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.591+0000 7f96db200640 1 Processor -- start 2024-03-08T06:03:02.591 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.591+0000 7f96db200640 1 -- start start 2024-03-08T06:03:02.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.592+0000 7f96db200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f96d40d2110 0x7f96d4160410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:02.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.592+0000 7f96db200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96d415dd50 0x7f96d415ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:02.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.592+0000 7f96db200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96d415e130 0x7f96d414f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:02.593 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.592+0000 7f96db200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d406dce0 con 0x7f96d415e130 2024-03-08T06:03:02.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.592+0000 7f96db200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d4162790 con 0x7f96d415dd50 2024-03-08T06:03:02.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.592+0000 7f96db200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d406d190 con 0x7f96d40d2110 2024-03-08T06:03:02.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.592+0000 7f96d9e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f96d40d2110 0x7f96d4160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:02.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.592+0000 7f96d9e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f96d40d2110 0x7f96d4160410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:46242/0 (socket says 172.21.15.42:46242) 2024-03-08T06:03:02.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.592+0000 7f96d9e00640 1 -- 172.21.15.42:0/3331093011 learned_addr learned my addr 172.21.15.42:0/3331093011 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-08T06:03:02.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.592+0000 7f96d9400640 1 --2- 172.21.15.42:0/3331093011 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96d415dd50 0x7f96d415ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:02.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.592+0000 7f96da800640 1 --2- 172.21.15.42:0/3331093011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96d415e130 0x7f96d414f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:02.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.592+0000 7f96d9e00640 1 -- 172.21.15.42:0/3331093011 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96d415dd50 msgr2=0x7f96d415ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:02.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.592+0000 7f96d9e00640 1 --2- 172.21.15.42:0/3331093011 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96d415dd50 0x7f96d415ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.592+0000 7f96d9e00640 1 -- 172.21.15.42:0/3331093011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96d415e130 msgr2=0x7f96d414f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:02.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.592+0000 7f96d9e00640 1 --2- 172.21.15.42:0/3331093011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96d415e130 0x7f96d414f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.594 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.592+0000 7f96d9e00640 1 -- 172.21.15.42:0/3331093011 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d4160950 con 0x7f96d40d2110 2024-03-08T06:03:02.595 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.593+0000 7f96d9e00640 1 --2- 172.21.15.42:0/3331093011 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f96d40d2110 0x7f96d4160410 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f96c800d800 tx=0x7f96c800dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:02.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.593+0000 7f96ce000640 1 -- 172.21.15.42:0/3331093011 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c800b6c0 con 0x7f96d40d2110 2024-03-08T06:03:02.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.593+0000 7f96ce000640 1 -- 172.21.15.42:0/3331093011 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c8019070 con 0x7f96d40d2110 2024-03-08T06:03:02.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.593+0000 7f96ce000640 1 -- 172.21.15.42:0/3331093011 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c800ba80 con 0x7f96d40d2110 2024-03-08T06:03:02.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.593+0000 7f96db200640 1 -- 172.21.15.42:0/3331093011 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d40caa90 con 0x7f96d40d2110 2024-03-08T06:03:02.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.593+0000 7f96db200640 1 -- 172.21.15.42:0/3331093011 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d40cb050 con 0x7f96d40d2110 2024-03-08T06:03:02.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.593+0000 7f96ce000640 1 -- 172.21.15.42:0/3331093011 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f96c800bc20 con 0x7f96d40d2110 2024-03-08T06:03:02.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.593+0000 7f96ce000640 1 -- 172.21.15.42:0/3331093011 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f96c801e880 con 0x7f96d40d2110 2024-03-08T06:03:02.596 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.594+0000 7f96db200640 1 -- 172.21.15.42:0/3331093011 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d4075100 con 0x7f96d40d2110 2024-03-08T06:03:02.598 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.597+0000 7f96ce000640 1 -- 172.21.15.42:0/3331093011 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f96c801ea80 con 0x7f96d40d2110 2024-03-08T06:03:02.613 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:02.612+0000 7f4528046040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-08T06:03:02.630 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:02.629+0000 7fe619c0e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-08T06:03:02.666 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:02.665+0000 7f4528046040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-08T06:03:02.678 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.677+0000 7f96db200640 1 -- 172.21.15.42:0/3331093011 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6712819c-7483-49fe-880b-1c8311c19f54", "id": 2} v 0) v1 -- 0x7f96d406be60 con 0x7f96d40d2110 2024-03-08T06:03:02.685 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.684+0000 7f96ce000640 1 -- 172.21.15.42:0/3331093011 <== mon.2 v2:172.21.15.42:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6712819c-7483-49fe-880b-1c8311c19f54", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f96c801e460 con 0x7f96d40d2110 2024-03-08T06:03:02.686 INFO:teuthology.orchestra.run.smithi042.stdout:2 2024-03-08T06:03:02.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.686+0000 7f96db200640 1 -- 172.21.15.42:0/3331093011 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f96d40d2110 msgr2=0x7f96d4160410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:02.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.686+0000 7f96db200640 1 --2- 172.21.15.42:0/3331093011 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f96d40d2110 0x7f96d4160410 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f96c800d800 tx=0x7f96c800dcc0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.686+0000 7f96db200640 1 -- 172.21.15.42:0/3331093011 shutdown_connections 2024-03-08T06:03:02.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.686+0000 7f96db200640 1 --2- 172.21.15.42:0/3331093011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96d415e130 0x7f96d414f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.686+0000 7f96db200640 1 --2- 172.21.15.42:0/3331093011 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f96d415dd50 0x7f96d415ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.686+0000 7f96db200640 1 --2- 172.21.15.42:0/3331093011 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f96d40d2110 0x7f96d4160410 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.686+0000 7f96db200640 1 -- 172.21.15.42:0/3331093011 >> 172.21.15.42:0/3331093011 conn(0x7f96d406f5d0 msgr2=0x7f96d415b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:02.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.686+0000 7f96db200640 1 -- 172.21.15.42:0/3331093011 shutdown_connections 2024-03-08T06:03:02.688 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.686+0000 7f96db200640 1 -- 172.21.15.42:0/3331093011 wait complete. 2024-03-08T06:03:02.704 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f 3 2024-03-08T06:03:02.715 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:02.714+0000 7fe619c0e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-08T06:03:02.772 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:02.771+0000 7fe619c0e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-08T06:03:02.810 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:02.809+0000 7f4528046040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-08T06:03:02.835 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:02.834+0000 7fe619c0e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-08T06:03:02.894 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:02.893+0000 7fe619c0e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-08T06:03:02.898 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:02.897+0000 7f4528046040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-08T06:03:02.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.942+0000 7f89a9200640 1 Processor -- start 2024-03-08T06:03:02.943 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.942+0000 7f89a9200640 1 -- start start 2024-03-08T06:03:02.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.943+0000 7f89a9200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89a4166860 0x7f89a4168c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:02.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.943+0000 7f89a9200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a40ade80 con 0x7f89a406ac50 2024-03-08T06:03:02.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.944+0000 7f89a9200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a406b230 con 0x7f89a406f8f0 2024-03-08T06:03:02.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.944+0000 7f89a9200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a406b510 con 0x7f89a4166860 2024-03-08T06:03:02.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.944+0000 7f89a3400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f89a406f8f0 0x7f89a406fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:44710/0 (socket says 172.21.15.42:44710) 2024-03-08T06:03:02.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.944+0000 7f89a3400640 1 -- 172.21.15.42:0/2194478545 learned_addr learned my addr 172.21.15.42:0/2194478545 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-03-08T06:03:02.945 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.944+0000 7f89a3e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89a4166860 0x7f89a4168c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:02.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.944+0000 7f89a2a00640 1 -- 172.21.15.42:0/2194478545 <== mon.1 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1626686812 0 0) 0x7f89a406b230 con 0x7f89a406f8f0 2024-03-08T06:03:02.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.944+0000 7f89a3e00640 1 -- 172.21.15.42:0/2194478545 >> v1:172.21.15.42:6789/0 conn(0x7f89a406f8f0 legacy=0x7f89a406fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:02.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.944+0000 7f89a3e00640 1 -- 172.21.15.42:0/2194478545 >> v1:172.21.15.19:6789/0 conn(0x7f89a406ac50 legacy=0x7f89a415eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:02.946 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.944+0000 7f89a3e00640 1 -- 172.21.15.42:0/2194478545 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a406b7f0 con 0x7f89a4166860 2024-03-08T06:03:02.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.946+0000 7f89a3e00640 1 --2- 172.21.15.42:0/2194478545 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89a4166860 0x7f89a4168c50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f899c0097d0 tx=0x7f899c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d5f0e2521b7a71f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:02.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.946+0000 7f89a2a00640 1 -- 172.21.15.42:0/2194478545 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c035020 con 0x7f89a4166860 2024-03-08T06:03:02.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.946+0000 7f89a2a00640 1 -- 172.21.15.42:0/2194478545 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899c031890 con 0x7f89a4166860 2024-03-08T06:03:02.947 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.946+0000 7f89a2a00640 1 -- 172.21.15.42:0/2194478545 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c031c60 con 0x7f89a4166860 2024-03-08T06:03:02.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.947+0000 7f89a9200640 1 -- 172.21.15.42:0/2194478545 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89a4166860 msgr2=0x7f89a4168c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:02.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.947+0000 7f89a9200640 1 --2- 172.21.15.42:0/2194478545 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89a4166860 0x7f89a4168c50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f899c0097d0 tx=0x7f899c02b930 comp rx=0 tx=0).stop 2024-03-08T06:03:02.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.947+0000 7f89a9200640 1 -- 172.21.15.42:0/2194478545 shutdown_connections 2024-03-08T06:03:02.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.947+0000 7f89a9200640 1 --2- 172.21.15.42:0/2194478545 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89a4166860 0x7f89a4168c50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.947+0000 7f89a9200640 1 -- 172.21.15.42:0/2194478545 >> 172.21.15.42:0/2194478545 conn(0x7f89a406ead0 msgr2=0x7f89a406f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:02.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.947+0000 7f89a9200640 1 -- 172.21.15.42:0/2194478545 shutdown_connections 2024-03-08T06:03:02.948 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.947+0000 7f89a9200640 1 -- 172.21.15.42:0/2194478545 wait complete. 2024-03-08T06:03:02.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.948+0000 7f89a9200640 1 Processor -- start 2024-03-08T06:03:02.949 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.949+0000 7f89a9200640 1 -- start start 2024-03-08T06:03:02.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.949+0000 7f89a9200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89a406ac50 0x7f89a414a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:02.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.949+0000 7f89a9200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89a406f8f0 0x7f89a414f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:02.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.950+0000 7f89a9200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a4166860 0x7f89a4149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:02.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.950+0000 7f89a9200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a40af4d0 con 0x7f89a4166860 2024-03-08T06:03:02.951 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.950+0000 7f89a9200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a40af350 con 0x7f89a406f8f0 2024-03-08T06:03:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.950+0000 7f89a9200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a4154e60 con 0x7f89a406ac50 2024-03-08T06:03:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.950+0000 7f89a3400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89a406ac50 0x7f89a414a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.950+0000 7f899aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89a406f8f0 0x7f89a414f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.950+0000 7f89a3400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89a406ac50 0x7f89a414a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:46254/0 (socket says 172.21.15.42:46254) 2024-03-08T06:03:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.950+0000 7f89a3400640 1 -- 172.21.15.42:0/2651669170 learned_addr learned my addr 172.21.15.42:0/2651669170 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-08T06:03:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.950+0000 7f89a3e00640 1 --2- 172.21.15.42:0/2651669170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a4166860 0x7f89a4149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.950+0000 7f89a3400640 1 -- 172.21.15.42:0/2651669170 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89a406f8f0 msgr2=0x7f89a414f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.950+0000 7f89a3400640 1 --2- 172.21.15.42:0/2651669170 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89a406f8f0 0x7f89a414f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.950+0000 7f89a3400640 1 -- 172.21.15.42:0/2651669170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a4166860 msgr2=0x7f89a4149c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.950+0000 7f89a3400640 1 --2- 172.21.15.42:0/2651669170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a4166860 0x7f89a4149c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.950+0000 7f89a3400640 1 -- 172.21.15.42:0/2651669170 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a4153870 con 0x7f89a406ac50 2024-03-08T06:03:02.952 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.950+0000 7f899aa00640 1 --2- 172.21.15.42:0/2651669170 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89a406f8f0 0x7f89a414f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T06:03:02.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.951+0000 7f89a3400640 1 --2- 172.21.15.42:0/2651669170 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89a406ac50 0x7f89a414a3f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f899400c4d0 tx=0x7f899400c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:02.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.951+0000 7f899be00640 1 -- 172.21.15.42:0/2651669170 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994018070 con 0x7f89a406ac50 2024-03-08T06:03:02.953 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.951+0000 7f899be00640 1 -- 172.21.15.42:0/2651669170 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89940074e0 con 0x7f89a406ac50 2024-03-08T06:03:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.951+0000 7f899be00640 1 -- 172.21.15.42:0/2651669170 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994004a20 con 0x7f89a406ac50 2024-03-08T06:03:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.951+0000 7f89a9200640 1 -- 172.21.15.42:0/2651669170 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a4153b50 con 0x7f89a406ac50 2024-03-08T06:03:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.951+0000 7f89a9200640 1 -- 172.21.15.42:0/2651669170 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a4154110 con 0x7f89a406ac50 2024-03-08T06:03:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.951+0000 7f899be00640 1 -- 172.21.15.42:0/2651669170 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f899401b070 con 0x7f89a406ac50 2024-03-08T06:03:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.951+0000 7f899be00640 1 -- 172.21.15.42:0/2651669170 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f8994004bc0 con 0x7f89a406ac50 2024-03-08T06:03:02.954 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.952+0000 7f89a9200640 1 -- 172.21.15.42:0/2651669170 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a4067e20 con 0x7f89a406ac50 2024-03-08T06:03:02.957 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:02.956+0000 7f899be00640 1 -- 172.21.15.42:0/2651669170 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f89a4067e20 con 0x7f89a406ac50 2024-03-08T06:03:02.959 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:02.958+0000 7f4528046040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-08T06:03:03.024 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:03.023+0000 7f4528046040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-08T06:03:03.037 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.036+0000 7f89a9200640 1 -- 172.21.15.42:0/2651669170 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f", "id": 3} v 0) v1 -- 0x7f89a40b0240 con 0x7f89a406ac50 2024-03-08T06:03:03.044 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.043+0000 7f899be00640 1 -- 172.21.15.42:0/2651669170 <== mon.2 v2:172.21.15.42:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f899401d440 con 0x7f89a406ac50 2024-03-08T06:03:03.044 INFO:teuthology.orchestra.run.smithi042.stdout:3 2024-03-08T06:03:03.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.044+0000 7f89a9200640 1 -- 172.21.15.42:0/2651669170 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89a406ac50 msgr2=0x7f89a414a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:03.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.044+0000 7f89a9200640 1 --2- 172.21.15.42:0/2651669170 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89a406ac50 0x7f89a414a3f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f899400c4d0 tx=0x7f899400c990 comp rx=0 tx=0).stop 2024-03-08T06:03:03.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.044+0000 7f89a9200640 1 -- 172.21.15.42:0/2651669170 shutdown_connections 2024-03-08T06:03:03.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.044+0000 7f89a9200640 1 --2- 172.21.15.42:0/2651669170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a4166860 0x7f89a4149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.044+0000 7f89a9200640 1 --2- 172.21.15.42:0/2651669170 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89a406f8f0 0x7f89a414f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.044+0000 7f89a9200640 1 --2- 172.21.15.42:0/2651669170 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89a406ac50 0x7f89a414a3f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.044+0000 7f89a9200640 1 -- 172.21.15.42:0/2651669170 >> 172.21.15.42:0/2651669170 conn(0x7f89a406ead0 msgr2=0x7f89a40b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:03.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.045+0000 7f89a9200640 1 -- 172.21.15.42:0/2651669170 shutdown_connections 2024-03-08T06:03:03.046 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.045+0000 7f89a9200640 1 -- 172.21.15.42:0/2651669170 wait complete. 2024-03-08T06:03:03.061 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new ef9772d0-4f1b-4ea6-9c7d-18427db01ca6 4 2024-03-08T06:03:03.087 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:03.085+0000 7f4528046040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-08T06:03:03.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.247+0000 7fd9f9800640 1 Processor -- start 2024-03-08T06:03:03.248 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.247+0000 7fd9f9800640 1 -- start start 2024-03-08T06:03:03.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.249+0000 7fd9f9800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9f415be70 0x7fd9f40cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:03.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.249+0000 7fd9f9800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd9f415f860 0x7fd9f40c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:03.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.249+0000 7fd9f9800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd9f40c5b80 0x7fd9f4099db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:03.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.249+0000 7fd9f9800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f40cf980 con 0x7fd9f40c5b80 2024-03-08T06:03:03.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.249+0000 7fd9f9800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f40cc600 con 0x7fd9f415f860 2024-03-08T06:03:03.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.249+0000 7fd9f9800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40cc8a0 con 0x7fd9f415be70 2024-03-08T06:03:03.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.249+0000 7fd9f2000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd9f415f860 0x7fd9f40c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:03.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.249+0000 7fd9f2000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd9f415f860 0x7fd9f40c5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39548/0 (socket says 172.21.15.42:39548) 2024-03-08T06:03:03.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.249+0000 7fd9f2000640 1 -- 172.21.15.42:0/33592038 learned_addr learned my addr 172.21.15.42:0/33592038 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-08T06:03:03.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.249+0000 7fd9f2a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9f415be70 0x7fd9f40cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:03.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.249+0000 7fd9f2000640 1 -- 172.21.15.42:0/33592038 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9f415be70 msgr2=0x7fd9f40cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:03.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.249+0000 7fd9f2000640 1 --2- 172.21.15.42:0/33592038 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9f415be70 0x7fd9f40cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.249+0000 7fd9f2000640 1 -- 172.21.15.42:0/33592038 >> v2:172.21.15.19:3300/0 conn(0x7fd9f40c5b80 msgr2=0x7fd9f4099db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:03.251 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.249+0000 7fd9f3400640 1 --2- 172.21.15.42:0/33592038 >> v2:172.21.15.19:3300/0 conn(0x7fd9f40c5b80 0x7fd9f4099db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:03.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.249+0000 7fd9f2000640 1 --2- 172.21.15.42:0/33592038 >> v2:172.21.15.19:3300/0 conn(0x7fd9f40c5b80 0x7fd9f4099db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.249+0000 7fd9f2000640 1 -- 172.21.15.42:0/33592038 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f40ccb80 con 0x7fd9f415f860 2024-03-08T06:03:03.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.251+0000 7fd9f2000640 1 --2- 172.21.15.42:0/33592038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9f415f860 0x7fd9f40c5640 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4071fe0 tx=0x7fd9e002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=385bedf2d556de5a server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:03.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.251+0000 7fd9f1600640 1 -- 172.21.15.42:0/33592038 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0035020 con 0x7fd9f415f860 2024-03-08T06:03:03.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.251+0000 7fd9f1600640 1 -- 172.21.15.42:0/33592038 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e0031870 con 0x7fd9f415f860 2024-03-08T06:03:03.252 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.251+0000 7fd9f1600640 1 -- 172.21.15.42:0/33592038 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0031c40 con 0x7fd9f415f860 2024-03-08T06:03:03.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.252+0000 7fd9f9800640 1 -- 172.21.15.42:0/33592038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9f415f860 msgr2=0x7fd9f40c5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:03.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.252+0000 7fd9f9800640 1 --2- 172.21.15.42:0/33592038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9f415f860 0x7fd9f40c5640 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4071fe0 tx=0x7fd9e002b910 comp rx=0 tx=0).stop 2024-03-08T06:03:03.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.252+0000 7fd9f9800640 1 -- 172.21.15.42:0/33592038 shutdown_connections 2024-03-08T06:03:03.253 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.252+0000 7fd9f9800640 1 --2- 172.21.15.42:0/33592038 >> v2:172.21.15.19:3300/0 conn(0x7fd9f40c5b80 0x7fd9f4099db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.252+0000 7fd9f9800640 1 --2- 172.21.15.42:0/33592038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9f415f860 0x7fd9f40c5640 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.252+0000 7fd9f9800640 1 --2- 172.21.15.42:0/33592038 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9f415be70 0x7fd9f40cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.252+0000 7fd9f9800640 1 -- 172.21.15.42:0/33592038 >> 172.21.15.42:0/33592038 conn(0x7fd9f40b35e0 msgr2=0x7fd9f40b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:03.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.252+0000 7fd9f9800640 1 -- 172.21.15.42:0/33592038 shutdown_connections 2024-03-08T06:03:03.254 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.252+0000 7fd9f9800640 1 -- 172.21.15.42:0/33592038 wait complete. 2024-03-08T06:03:03.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.254+0000 7fd9f9800640 1 Processor -- start 2024-03-08T06:03:03.255 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.254+0000 7fd9f9800640 1 -- start start 2024-03-08T06:03:03.256 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.255+0000 7fd9f9800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9f40c5b80 0x7fd9f40cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:03.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.255+0000 7fd9f9800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9f415be70 0x7fd9f414a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:03.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.255+0000 7fd9f9800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f415f860 0x7fd9f414aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:03.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.255+0000 7fd9f9800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40cd420 con 0x7fd9f415f860 2024-03-08T06:03:03.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.255+0000 7fd9f9800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40cd140 con 0x7fd9f40c5b80 2024-03-08T06:03:03.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.255+0000 7fd9f9800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40cde80 con 0x7fd9f415be70 2024-03-08T06:03:03.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.255+0000 7fd9f2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9f40c5b80 0x7fd9f40cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:03.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.255+0000 7fd9f2000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9f415be70 0x7fd9f414a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:03.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.255+0000 7fd9f2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9f40c5b80 0x7fd9f40cb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39558/0 (socket says 172.21.15.42:39558) 2024-03-08T06:03:03.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.255+0000 7fd9f2a00640 1 -- 172.21.15.42:0/2019864024 learned_addr learned my addr 172.21.15.42:0/2019864024 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-08T06:03:03.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.255+0000 7fd9f3400640 1 --2- 172.21.15.42:0/2019864024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f415f860 0x7fd9f414aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:03.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.255+0000 7fd9f2a00640 1 -- 172.21.15.42:0/2019864024 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9f415be70 msgr2=0x7fd9f414a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:03.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.255+0000 7fd9f2a00640 1 --2- 172.21.15.42:0/2019864024 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9f415be70 0x7fd9f414a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.255+0000 7fd9f2a00640 1 -- 172.21.15.42:0/2019864024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f415f860 msgr2=0x7fd9f414aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:03.257 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.255+0000 7fd9f2a00640 1 --2- 172.21.15.42:0/2019864024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f415f860 0x7fd9f414aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.255+0000 7fd9f2a00640 1 -- 172.21.15.42:0/2019864024 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f415dfe0 con 0x7fd9f40c5b80 2024-03-08T06:03:03.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.255+0000 7fd9f3400640 1 --2- 172.21.15.42:0/2019864024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f415f860 0x7fd9f414aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:03.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.255+0000 7fd9f2000640 1 --2- 172.21.15.42:0/2019864024 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9f415be70 0x7fd9f414a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T06:03:03.258 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.256+0000 7fd9f2a00640 1 --2- 172.21.15.42:0/2019864024 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9f40c5b80 0x7fd9f40cb2f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd9e400d5f0 tx=0x7fd9e400dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:03.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.256+0000 7fd9eaa00640 1 -- 172.21.15.42:0/2019864024 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e40125f0 con 0x7fd9f40c5b80 2024-03-08T06:03:03.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.256+0000 7fd9eaa00640 1 -- 172.21.15.42:0/2019864024 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e4019070 con 0x7fd9f40c5b80 2024-03-08T06:03:03.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.256+0000 7fd9eaa00640 1 -- 172.21.15.42:0/2019864024 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e40129d0 con 0x7fd9f40c5b80 2024-03-08T06:03:03.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.256+0000 7fd9f9800640 1 -- 172.21.15.42:0/2019864024 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f414b080 con 0x7fd9f40c5b80 2024-03-08T06:03:03.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.256+0000 7fd9f9800640 1 -- 172.21.15.42:0/2019864024 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f414b640 con 0x7fd9f40c5b80 2024-03-08T06:03:03.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.257+0000 7fd9eaa00640 1 -- 172.21.15.42:0/2019864024 <== mon.1 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd9e4012b70 con 0x7fd9f40c5b80 2024-03-08T06:03:03.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.257+0000 7fd9eaa00640 1 -- 172.21.15.42:0/2019864024 <== mon.1 v2:172.21.15.42:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fd9e401e970 con 0x7fd9f40c5b80 2024-03-08T06:03:03.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.257+0000 7fd9f9800640 1 -- 172.21.15.42:0/2019864024 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f40683c0 con 0x7fd9f40c5b80 2024-03-08T06:03:03.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.260+0000 7fd9eaa00640 1 -- 172.21.15.42:0/2019864024 <== mon.1 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd9f415dfe0 con 0x7fd9f40c5b80 2024-03-08T06:03:03.340 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.339+0000 7fd9f9800640 1 -- 172.21.15.42:0/2019864024 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ef9772d0-4f1b-4ea6-9c7d-18427db01ca6", "id": 4} v 0) v1 -- 0x7fd9f40b4480 con 0x7fd9f40c5b80 2024-03-08T06:03:03.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.346+0000 7fd9eaa00640 1 -- 172.21.15.42:0/2019864024 <== mon.1 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ef9772d0-4f1b-4ea6-9c7d-18427db01ca6", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd9e401e460 con 0x7fd9f40c5b80 2024-03-08T06:03:03.348 INFO:teuthology.orchestra.run.smithi042.stdout:4 2024-03-08T06:03:03.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.347+0000 7fd9f9800640 1 -- 172.21.15.42:0/2019864024 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9f40c5b80 msgr2=0x7fd9f40cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:03.348 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.347+0000 7fd9f9800640 1 --2- 172.21.15.42:0/2019864024 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9f40c5b80 0x7fd9f40cb2f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd9e400d5f0 tx=0x7fd9e400dab0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.347+0000 7fd9f9800640 1 -- 172.21.15.42:0/2019864024 shutdown_connections 2024-03-08T06:03:03.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.347+0000 7fd9f9800640 1 --2- 172.21.15.42:0/2019864024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9f415f860 0x7fd9f414aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.347+0000 7fd9f9800640 1 --2- 172.21.15.42:0/2019864024 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9f415be70 0x7fd9f414a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.347+0000 7fd9f9800640 1 --2- 172.21.15.42:0/2019864024 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9f40c5b80 0x7fd9f40cb2f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.347+0000 7fd9f9800640 1 -- 172.21.15.42:0/2019864024 >> 172.21.15.42:0/2019864024 conn(0x7fd9f40b35e0 msgr2=0x7fd9f4071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:03.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.348+0000 7fd9f9800640 1 -- 172.21.15.42:0/2019864024 shutdown_connections 2024-03-08T06:03:03.349 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.348+0000 7fd9f9800640 1 -- 172.21.15.42:0/2019864024 wait complete. 2024-03-08T06:03:03.366 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new de314af8-6388-4ef6-8774-e1bc18372b31 5 2024-03-08T06:03:03.367 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:03.366+0000 7fe619c0e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-08T06:03:03.536 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:03.535+0000 7fe619c0e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-08T06:03:03.575 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:03.574+0000 7f4528046040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-08T06:03:03.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.600+0000 7f745cc00640 1 Processor -- start 2024-03-08T06:03:03.601 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.600+0000 7f745cc00640 1 -- start start 2024-03-08T06:03:03.603 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.602+0000 7f745cc00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74580d34e0 0x7f74580b2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.602+0000 7f745cc00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f74580b6c70 0x7f74580d2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.602+0000 7f745cc00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74581617d0 con 0x7f74581613f0 2024-03-08T06:03:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.602+0000 7f745cc00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74580d1040 con 0x7f74580b6c70 2024-03-08T06:03:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.602+0000 7f745cc00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74580d1290 con 0x7f74580d34e0 2024-03-08T06:03:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.602+0000 7f7457400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f74581613f0 0x7f74580b5550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:44712/0 (socket says 172.21.15.42:44712) 2024-03-08T06:03:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.602+0000 7f7457400640 1 -- 172.21.15.42:0/673772597 learned_addr learned my addr 172.21.15.42:0/673772597 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-03-08T06:03:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.602+0000 7f7456a00640 1 --2- 172.21.15.42:0/673772597 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74580d34e0 0x7f74580b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.602+0000 7f7457e00640 1 --2- 172.21.15.42:0/673772597 >> v2:172.21.15.19:3300/0 conn(0x7f74580b6c70 0x7f74580d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.602+0000 7f7456000640 1 -- 172.21.15.42:0/673772597 <== mon.1 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514966650 0 0) 0x7f74581617d0 con 0x7f74581613f0 2024-03-08T06:03:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.602+0000 7f7456a00640 1 -- 172.21.15.42:0/673772597 >> v2:172.21.15.19:3300/0 conn(0x7f74580b6c70 msgr2=0x7f74580d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.603+0000 7f7456a00640 1 --2- 172.21.15.42:0/673772597 >> v2:172.21.15.19:3300/0 conn(0x7f74580b6c70 0x7f74580d2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.603+0000 7f7456a00640 1 -- 172.21.15.42:0/673772597 >> v1:172.21.15.42:6789/0 conn(0x7f74581613f0 legacy=0x7f74580b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:03.604 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.603+0000 7f7456a00640 1 -- 172.21.15.42:0/673772597 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74580cebb0 con 0x7f74580d34e0 2024-03-08T06:03:03.605 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.604+0000 7f7456a00640 1 --2- 172.21.15.42:0/673772597 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74580d34e0 0x7f74580b2810 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f74440097a0 tx=0x7f744402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39d010612e875f49 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:03.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.605+0000 7f7456000640 1 -- 172.21.15.42:0/673772597 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7444035020 con 0x7f74580d34e0 2024-03-08T06:03:03.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.605+0000 7f7456000640 1 -- 172.21.15.42:0/673772597 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7444031810 con 0x7f74580d34e0 2024-03-08T06:03:03.606 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.605+0000 7f7456000640 1 -- 172.21.15.42:0/673772597 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7444031be0 con 0x7f74580d34e0 2024-03-08T06:03:03.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.605+0000 7f745cc00640 1 -- 172.21.15.42:0/673772597 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74580d34e0 msgr2=0x7f74580b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:03.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.605+0000 7f745cc00640 1 --2- 172.21.15.42:0/673772597 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74580d34e0 0x7f74580b2810 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f74440097a0 tx=0x7f744402b8b0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.606+0000 7f745cc00640 1 -- 172.21.15.42:0/673772597 shutdown_connections 2024-03-08T06:03:03.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.606+0000 7f745cc00640 1 --2- 172.21.15.42:0/673772597 >> v2:172.21.15.19:3300/0 conn(0x7f74580b6c70 0x7f74580d2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.606+0000 7f745cc00640 1 --2- 172.21.15.42:0/673772597 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74580d34e0 0x7f74580b2810 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.606+0000 7f745cc00640 1 -- 172.21.15.42:0/673772597 >> 172.21.15.42:0/673772597 conn(0x7f745806c740 msgr2=0x7f745806cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:03.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.606+0000 7f745cc00640 1 -- 172.21.15.42:0/673772597 shutdown_connections 2024-03-08T06:03:03.607 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.606+0000 7f745cc00640 1 -- 172.21.15.42:0/673772597 wait complete. 2024-03-08T06:03:03.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.608+0000 7f745cc00640 1 Processor -- start 2024-03-08T06:03:03.609 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.608+0000 7f745cc00640 1 -- start start 2024-03-08T06:03:03.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.609+0000 7f745cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74580b6c70 0x7f745814e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:03.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.609+0000 7f745cc00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74581613f0 0x7f74580b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:03.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.609+0000 7f745cc00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74580b4be0 0x7f74580d1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:03.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.609+0000 7f745cc00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74580b5de0 con 0x7f74580b4be0 2024-03-08T06:03:03.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.609+0000 7f745cc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74580b5c60 con 0x7f74580b6c70 2024-03-08T06:03:03.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.609+0000 7f745cc00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74580b2dc0 con 0x7f74581613f0 2024-03-08T06:03:03.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.609+0000 7f7456a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74581613f0 0x7f74580b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:03.611 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.609+0000 7f7457400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74580b6c70 0x7f745814e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:03.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.609+0000 7f7456a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74581613f0 0x7f74580b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.42:46302/0 (socket says 172.21.15.42:46302) 2024-03-08T06:03:03.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.609+0000 7f7456a00640 1 -- 172.21.15.42:0/1473852518 learned_addr learned my addr 172.21.15.42:0/1473852518 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-08T06:03:03.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.609+0000 7f7457e00640 1 --2- 172.21.15.42:0/1473852518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74580b4be0 0x7f74580d1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:03.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.610+0000 7f7456a00640 1 -- 172.21.15.42:0/1473852518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74580b6c70 msgr2=0x7f745814e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:03.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.610+0000 7f7456a00640 1 --2- 172.21.15.42:0/1473852518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74580b6c70 0x7f745814e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.610+0000 7f7456a00640 1 -- 172.21.15.42:0/1473852518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74580b4be0 msgr2=0x7f74580d1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:03.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.610+0000 7f7456a00640 1 --2- 172.21.15.42:0/1473852518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74580b4be0 0x7f74580d1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.610+0000 7f7456a00640 1 -- 172.21.15.42:0/1473852518 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745814eb70 con 0x7f74581613f0 2024-03-08T06:03:03.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.610+0000 7f7457400640 1 --2- 172.21.15.42:0/1473852518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74580b6c70 0x7f745814e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T06:03:03.612 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.610+0000 7f7456a00640 1 --2- 172.21.15.42:0/1473852518 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74581613f0 0x7f74580b46a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f744402bec0 tx=0x7f74440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:03.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.610+0000 7f744f400640 1 -- 172.21.15.42:0/1473852518 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7444041070 con 0x7f74581613f0 2024-03-08T06:03:03.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.610+0000 7f744f400640 1 -- 172.21.15.42:0/1473852518 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744403ad00 con 0x7f74581613f0 2024-03-08T06:03:03.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.610+0000 7f744f400640 1 -- 172.21.15.42:0/1473852518 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7444035040 con 0x7f74581613f0 2024-03-08T06:03:03.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.611+0000 7f745cc00640 1 -- 172.21.15.42:0/1473852518 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74580cb920 con 0x7f74581613f0 2024-03-08T06:03:03.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.611+0000 7f745cc00640 1 -- 172.21.15.42:0/1473852518 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74580cc1c0 con 0x7f74581613f0 2024-03-08T06:03:03.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.611+0000 7f744f400640 1 -- 172.21.15.42:0/1473852518 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f744404c060 con 0x7f74581613f0 2024-03-08T06:03:03.613 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.611+0000 7f744f400640 1 -- 172.21.15.42:0/1473852518 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f744403bbd0 con 0x7f74581613f0 2024-03-08T06:03:03.614 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.612+0000 7f745cc00640 1 -- 172.21.15.42:0/1473852518 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74580cbd10 con 0x7f74581613f0 2024-03-08T06:03:03.615 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.614+0000 7f744f400640 1 -- 172.21.15.42:0/1473852518 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f744403b650 con 0x7f74581613f0 2024-03-08T06:03:03.679 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:03.678+0000 7fe619c0e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-08T06:03:03.694 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.693+0000 7f745cc00640 1 -- 172.21.15.42:0/1473852518 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_command({"prefix": "osd new", "uuid": "de314af8-6388-4ef6-8774-e1bc18372b31", "id": 5} v 0) v1 -- 0x7f74580b6230 con 0x7f74581613f0 2024-03-08T06:03:03.703 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.702+0000 7f744f400640 1 -- 172.21.15.42:0/1473852518 <== mon.2 v2:172.21.15.42:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "de314af8-6388-4ef6-8774-e1bc18372b31", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7444053020 con 0x7f74581613f0 2024-03-08T06:03:03.703 INFO:teuthology.orchestra.run.smithi042.stdout:5 2024-03-08T06:03:03.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.703+0000 7f745cc00640 1 -- 172.21.15.42:0/1473852518 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74581613f0 msgr2=0x7f74580b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:03.704 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.703+0000 7f745cc00640 1 --2- 172.21.15.42:0/1473852518 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74581613f0 0x7f74580b46a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f744402bec0 tx=0x7f74440046c0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.703+0000 7f745cc00640 1 -- 172.21.15.42:0/1473852518 shutdown_connections 2024-03-08T06:03:03.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.703+0000 7f745cc00640 1 --2- 172.21.15.42:0/1473852518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74580b4be0 0x7f74580d1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.703+0000 7f745cc00640 1 --2- 172.21.15.42:0/1473852518 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74581613f0 0x7f74580b46a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.703+0000 7f745cc00640 1 --2- 172.21.15.42:0/1473852518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74580b6c70 0x7f745814e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.703+0000 7f745cc00640 1 -- 172.21.15.42:0/1473852518 >> 172.21.15.42:0/1473852518 conn(0x7f745806c740 msgr2=0x7f745815d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:03.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.703+0000 7f745cc00640 1 -- 172.21.15.42:0/1473852518 shutdown_connections 2024-03-08T06:03:03.705 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.703+0000 7f745cc00640 1 -- 172.21.15.42:0/1473852518 wait complete. 2024-03-08T06:03:03.720 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new 2dd4cc3d-53b5-42bc-8725-d04628f2b125 6 2024-03-08T06:03:03.735 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:03.735+0000 7fe619c0e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-08T06:03:03.752 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:03.751+0000 7f4528046040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-08T06:03:03.868 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:03.867+0000 7fe619c0e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-08T06:03:03.902 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:03.900+0000 7f4528046040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-08T06:03:03.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.909+0000 7ff597e00640 1 Processor -- start 2024-03-08T06:03:03.910 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.909+0000 7ff597e00640 1 -- start start 2024-03-08T06:03:03.912 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.910+0000 7ff597e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff59015df20 0x7ff590161bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.910+0000 7ff597e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff59015e300 0x7ff5900ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.910+0000 7ff597e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff5900d0720 0x7ff5900d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.911+0000 7ff597e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5900d1080 con 0x7ff59015df20 2024-03-08T06:03:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.911+0000 7ff597e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5901622f0 con 0x7ff59015e300 2024-03-08T06:03:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.911+0000 7ff597e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5901625d0 con 0x7ff5900d0720 2024-03-08T06:03:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.911+0000 7ff594a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff59015e300 0x7ff5900ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.911+0000 7ff595e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff5900d0720 0x7ff5900d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.911+0000 7ff594a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff59015e300 0x7ff5900ce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39578/0 (socket says 172.21.15.42:39578) 2024-03-08T06:03:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.911+0000 7ff594a00640 1 -- 172.21.15.42:0/2739406897 learned_addr learned my addr 172.21.15.42:0/2739406897 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-08T06:03:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.911+0000 7ff595400640 1 --2- 172.21.15.42:0/2739406897 >> v2:172.21.15.19:3300/0 conn(0x7ff59015df20 0x7ff590161bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.911+0000 7ff594a00640 1 -- 172.21.15.42:0/2739406897 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff5900d0720 msgr2=0x7ff5900d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.911+0000 7ff594a00640 1 --2- 172.21.15.42:0/2739406897 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff5900d0720 0x7ff5900d0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.913 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.911+0000 7ff594a00640 1 -- 172.21.15.42:0/2739406897 >> v2:172.21.15.19:3300/0 conn(0x7ff59015df20 msgr2=0x7ff590161bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:03.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.911+0000 7ff594a00640 1 --2- 172.21.15.42:0/2739406897 >> v2:172.21.15.19:3300/0 conn(0x7ff59015df20 0x7ff590161bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.911+0000 7ff594a00640 1 -- 172.21.15.42:0/2739406897 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5901628b0 con 0x7ff59015e300 2024-03-08T06:03:03.914 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.911+0000 7ff595e00640 1 --2- 172.21.15.42:0/2739406897 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff5900d0720 0x7ff5900d0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T06:03:03.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.913+0000 7ff594a00640 1 --2- 172.21.15.42:0/2739406897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff59015e300 0x7ff5900ce5e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff59006d2f0 tx=0x7ff57c02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5647a9171c3f04bf server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:03.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.913+0000 7ff58fe00640 1 -- 172.21.15.42:0/2739406897 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c035020 con 0x7ff59015e300 2024-03-08T06:03:03.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.913+0000 7ff58fe00640 1 -- 172.21.15.42:0/2739406897 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57c031870 con 0x7ff59015e300 2024-03-08T06:03:03.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.913+0000 7ff58fe00640 1 -- 172.21.15.42:0/2739406897 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c031c40 con 0x7ff59015e300 2024-03-08T06:03:03.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.913+0000 7ff597e00640 1 -- 172.21.15.42:0/2739406897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff59015e300 msgr2=0x7ff5900ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:03.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.913+0000 7ff597e00640 1 --2- 172.21.15.42:0/2739406897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff59015e300 0x7ff5900ce5e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff59006d2f0 tx=0x7ff57c02b910 comp rx=0 tx=0).stop 2024-03-08T06:03:03.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.914+0000 7ff597e00640 1 -- 172.21.15.42:0/2739406897 shutdown_connections 2024-03-08T06:03:03.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.914+0000 7ff597e00640 1 --2- 172.21.15.42:0/2739406897 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff5900d0720 0x7ff5900d0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.915 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.914+0000 7ff597e00640 1 --2- 172.21.15.42:0/2739406897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff59015e300 0x7ff5900ce5e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.914+0000 7ff597e00640 1 --2- 172.21.15.42:0/2739406897 >> v2:172.21.15.19:3300/0 conn(0x7ff59015df20 0x7ff590161bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.914+0000 7ff597e00640 1 -- 172.21.15.42:0/2739406897 >> 172.21.15.42:0/2739406897 conn(0x7ff59006c470 msgr2=0x7ff59006c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.914+0000 7ff597e00640 1 -- 172.21.15.42:0/2739406897 shutdown_connections 2024-03-08T06:03:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.914+0000 7ff597e00640 1 -- 172.21.15.42:0/2739406897 wait complete. 2024-03-08T06:03:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.915+0000 7ff597e00640 1 Processor -- start 2024-03-08T06:03:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.915+0000 7ff597e00640 1 -- start start 2024-03-08T06:03:03.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.916+0000 7ff597e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5900d0720 0x7ff59014c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:03.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.916+0000 7ff597e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff59015df20 0x7ff590160740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:03.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.916+0000 7ff597e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff59015e6f0 0x7ff59014b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:03.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.916+0000 7ff597e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5900b5910 con 0x7ff59015df20 2024-03-08T06:03:03.919 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.916+0000 7ff597e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5900b5790 con 0x7ff5900d0720 2024-03-08T06:03:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.916+0000 7ff597e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5900b5a90 con 0x7ff59015e6f0 2024-03-08T06:03:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.917+0000 7ff595400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5900d0720 0x7ff59014c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.917+0000 7ff595e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff59015e6f0 0x7ff59014b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.917+0000 7ff595400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5900d0720 0x7ff59014c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39580/0 (socket says 172.21.15.42:39580) 2024-03-08T06:03:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.917+0000 7ff595400640 1 -- 172.21.15.42:0/3788516009 learned_addr learned my addr 172.21.15.42:0/3788516009 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-08T06:03:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.917+0000 7ff594a00640 1 --2- 172.21.15.42:0/3788516009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff59015df20 0x7ff590160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.917+0000 7ff595400640 1 -- 172.21.15.42:0/3788516009 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff59015e6f0 msgr2=0x7ff59014b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.917+0000 7ff595400640 1 --2- 172.21.15.42:0/3788516009 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff59015e6f0 0x7ff59014b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.917+0000 7ff595400640 1 -- 172.21.15.42:0/3788516009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff59015df20 msgr2=0x7ff590160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.917+0000 7ff595400640 1 --2- 172.21.15.42:0/3788516009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff59015df20 0x7ff590160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.917+0000 7ff595400640 1 -- 172.21.15.42:0/3788516009 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59014cee0 con 0x7ff5900d0720 2024-03-08T06:03:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.917+0000 7ff595e00640 1 --2- 172.21.15.42:0/3788516009 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff59015e6f0 0x7ff59014b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T06:03:03.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.917+0000 7ff595400640 1 --2- 172.21.15.42:0/3788516009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5900d0720 0x7ff59014c9a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff584007ef0 tx=0x7ff58400e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:03.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.918+0000 7ff58d600640 1 -- 172.21.15.42:0/3788516009 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584014620 con 0x7ff5900d0720 2024-03-08T06:03:03.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.918+0000 7ff58d600640 1 -- 172.21.15.42:0/3788516009 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff584019070 con 0x7ff5900d0720 2024-03-08T06:03:03.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.918+0000 7ff58d600640 1 -- 172.21.15.42:0/3788516009 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584014a00 con 0x7ff5900d0720 2024-03-08T06:03:03.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.918+0000 7ff597e00640 1 -- 172.21.15.42:0/3788516009 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff590161260 con 0x7ff5900d0720 2024-03-08T06:03:03.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.918+0000 7ff597e00640 1 -- 172.21.15.42:0/3788516009 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59014a910 con 0x7ff5900d0720 2024-03-08T06:03:03.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.918+0000 7ff58d600640 1 -- 172.21.15.42:0/3788516009 <== mon.1 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ff584014ba0 con 0x7ff5900d0720 2024-03-08T06:03:03.921 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.918+0000 7ff58d600640 1 -- 172.21.15.42:0/3788516009 <== mon.1 v2:172.21.15.42:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7ff58401ea50 con 0x7ff5900d0720 2024-03-08T06:03:03.922 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.919+0000 7ff597e00640 1 -- 172.21.15.42:0/3788516009 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5900683c0 con 0x7ff5900d0720 2024-03-08T06:03:03.924 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:03.923+0000 7ff58d600640 1 -- 172.21.15.42:0/3788516009 <== mon.1 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7ff59014cee0 con 0x7ff5900d0720 2024-03-08T06:03:03.962 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:03.961+0000 7f4528046040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-08T06:03:03.985 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:03.984+0000 7fe619c0e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-08T06:03:04.003 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.002+0000 7ff597e00640 1 -- 172.21.15.42:0/3788516009 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2dd4cc3d-53b5-42bc-8725-d04628f2b125", "id": 6} v 0) v1 -- 0x7ff5900d1a90 con 0x7ff5900d0720 2024-03-08T06:03:04.010 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.009+0000 7ff58d600640 1 -- 172.21.15.42:0/3788516009 <== mon.1 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2dd4cc3d-53b5-42bc-8725-d04628f2b125", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff58401e460 con 0x7ff5900d0720 2024-03-08T06:03:04.010 INFO:teuthology.orchestra.run.smithi042.stdout:6 2024-03-08T06:03:04.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.010+0000 7ff597e00640 1 -- 172.21.15.42:0/3788516009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5900d0720 msgr2=0x7ff59014c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:04.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.010+0000 7ff597e00640 1 --2- 172.21.15.42:0/3788516009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5900d0720 0x7ff59014c9a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff584007ef0 tx=0x7ff58400e4b0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.010+0000 7ff597e00640 1 -- 172.21.15.42:0/3788516009 shutdown_connections 2024-03-08T06:03:04.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.010+0000 7ff597e00640 1 --2- 172.21.15.42:0/3788516009 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff59015e6f0 0x7ff59014b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.010+0000 7ff597e00640 1 --2- 172.21.15.42:0/3788516009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff59015df20 0x7ff590160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.010+0000 7ff597e00640 1 --2- 172.21.15.42:0/3788516009 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5900d0720 0x7ff59014c9a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.010+0000 7ff597e00640 1 -- 172.21.15.42:0/3788516009 >> 172.21.15.42:0/3788516009 conn(0x7ff59006c470 msgr2=0x7ff5900b76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:04.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.010+0000 7ff597e00640 1 -- 172.21.15.42:0/3788516009 shutdown_connections 2024-03-08T06:03:04.012 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.011+0000 7ff597e00640 1 -- 172.21.15.42:0/3788516009 wait complete. 2024-03-08T06:03:04.028 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd new c0d07107-a24b-4530-976e-bdc14ea42db0 7 2024-03-08T06:03:04.099 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:04.098+0000 7f4528046040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-08T06:03:04.171 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:04.169+0000 7fe619c0e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-08T06:03:04.219 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:04.218+0000 7f4528046040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-08T06:03:04.222 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:04.222+0000 7fe619c0e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-08T06:03:04.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.258+0000 7f91b4400640 1 Processor -- start 2024-03-08T06:03:04.259 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.258+0000 7f91b4400640 1 -- start start 2024-03-08T06:03:04.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.259+0000 7f91b4400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f91ac0b5e80 0x7f91ac0ce550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:04.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.260+0000 7f91b4400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ac15e250 con 0x7f91ac0d2b20 2024-03-08T06:03:04.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.260+0000 7f91b4400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ac0cf1f0 con 0x7f91ac15de70 2024-03-08T06:03:04.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.260+0000 7f91b4400640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ac0d1d60 con 0x7f91ac0b5e80 2024-03-08T06:03:04.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.260+0000 7f91b1a00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f91ac15de70 0x7f91ac0b5770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:44720/0 (socket says 172.21.15.42:44720) 2024-03-08T06:03:04.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.260+0000 7f91b1a00640 1 -- 172.21.15.42:0/493904263 learned_addr learned my addr 172.21.15.42:0/493904263 (peer_addr_for_me v1:172.21.15.42:0/0) 2024-03-08T06:03:04.261 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.260+0000 7f91b1000640 1 --2- 172.21.15.42:0/493904263 >> v2:172.21.15.19:3300/0 conn(0x7f91ac0b5e80 0x7f91ac0ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:04.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.260+0000 7f91abe00640 1 -- 172.21.15.42:0/493904263 <== mon.1 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520047281 0 0) 0x7f91ac0cf1f0 con 0x7f91ac15de70 2024-03-08T06:03:04.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.260+0000 7f91abe00640 1 -- 172.21.15.42:0/493904263 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9194003520 con 0x7f91ac15de70 2024-03-08T06:03:04.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.261+0000 7f91abe00640 1 -- 172.21.15.42:0/493904263 <== mon.1 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1071490216 0 0) 0x7f9194003520 con 0x7f91ac15de70 2024-03-08T06:03:04.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.261+0000 7f91abe00640 1 -- 172.21.15.42:0/493904263 >> v2:172.21.15.19:3300/0 conn(0x7f91ac0b5e80 msgr2=0x7f91ac0ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:04.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.261+0000 7f91abe00640 1 --2- 172.21.15.42:0/493904263 >> v2:172.21.15.19:3300/0 conn(0x7f91ac0b5e80 0x7f91ac0ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.261+0000 7f91abe00640 1 -- 172.21.15.42:0/493904263 >> v1:172.21.15.19:6789/0 conn(0x7f91ac0d2b20 legacy=0x7f91ac0b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:04.263 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.261+0000 7f91abe00640 1 -- 172.21.15.42:0/493904263 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac0d2040 con 0x7f91ac15de70 2024-03-08T06:03:04.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.261+0000 7f91abe00640 1 -- 172.21.15.42:0/493904263 <== mon.1 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f91a0001670 con 0x7f91ac15de70 2024-03-08T06:03:04.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.261+0000 7f91abe00640 1 -- 172.21.15.42:0/493904263 >> v1:172.21.15.42:6789/0 conn(0x7f91ac15de70 legacy=0x7f91ac0b5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:04.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.261+0000 7f91abe00640 1 --2- 172.21.15.42:0/493904263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91940039b0 0x7f9194003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:04.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.261+0000 7f91abe00640 1 --2- 172.21.15.42:0/493904263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9194004800 0x7f9194004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:04.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.261+0000 7f91abe00640 1 --2- 172.21.15.42:0/493904263 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f91940051c0 0x7f919400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:04.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.261+0000 7f91abe00640 1 -- 172.21.15.42:0/493904263 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac0d1d60 con 0x7f91940039b0 2024-03-08T06:03:04.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.261+0000 7f91abe00640 1 -- 172.21.15.42:0/493904263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919400c060 con 0x7f9194004800 2024-03-08T06:03:04.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.261+0000 7f91abe00640 1 -- 172.21.15.42:0/493904263 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919400c260 con 0x7f91940051c0 2024-03-08T06:03:04.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.261+0000 7f91b1000640 1 --2- 172.21.15.42:0/493904263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9194004800 0x7f9194004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:04.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.261+0000 7f91b2400640 1 --2- 172.21.15.42:0/493904263 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f91940051c0 0x7f919400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:04.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.261+0000 7f91b1a00640 1 --2- 172.21.15.42:0/493904263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91940039b0 0x7f9194003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:04.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.262+0000 7f91b1000640 1 -- 172.21.15.42:0/493904263 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f91940051c0 msgr2=0x7f919400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:04.264 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.262+0000 7f91b1000640 1 --2- 172.21.15.42:0/493904263 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f91940051c0 0x7f919400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.262+0000 7f91b1000640 1 -- 172.21.15.42:0/493904263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91940039b0 msgr2=0x7f9194003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:04.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.262+0000 7f91b1000640 1 --2- 172.21.15.42:0/493904263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91940039b0 0x7f9194003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.262+0000 7f91b1000640 1 -- 172.21.15.42:0/493904263 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9194003520 con 0x7f9194004800 2024-03-08T06:03:04.265 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.262+0000 7f91b2400640 1 -- 172.21.15.42:0/493904263 reap_dead start 2024-03-08T06:03:04.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.263+0000 7f91b1000640 1 --2- 172.21.15.42:0/493904263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9194004800 0x7f9194004c80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9198009ac0 tx=0x7f9194005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b5306858256e2d4 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:04.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.263+0000 7f91abe00640 1 -- 172.21.15.42:0/493904263 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9198039070 con 0x7f9194004800 2024-03-08T06:03:04.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.263+0000 7f91abe00640 1 -- 172.21.15.42:0/493904263 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919802c6b0 con 0x7f9194004800 2024-03-08T06:03:04.266 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.263+0000 7f91abe00640 1 -- 172.21.15.42:0/493904263 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9198009690 con 0x7f9194004800 2024-03-08T06:03:04.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.263+0000 7f91b4400640 1 -- 172.21.15.42:0/493904263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9194004800 msgr2=0x7f9194004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:04.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.263+0000 7f91b4400640 1 --2- 172.21.15.42:0/493904263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9194004800 0x7f9194004c80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9198009ac0 tx=0x7f9194005830 comp rx=0 tx=0).stop 2024-03-08T06:03:04.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.264+0000 7f91b4400640 1 -- 172.21.15.42:0/493904263 shutdown_connections 2024-03-08T06:03:04.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.264+0000 7f91b4400640 1 --2- 172.21.15.42:0/493904263 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9194004800 0x7f9194004c80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.264+0000 7f91b4400640 1 -- 172.21.15.42:0/493904263 >> 172.21.15.42:0/493904263 conn(0x7f91ac067240 msgr2=0x7f91ac0d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:04.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.264+0000 7f91b4400640 1 -- 172.21.15.42:0/493904263 shutdown_connections 2024-03-08T06:03:04.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.264+0000 7f91b4400640 1 -- 172.21.15.42:0/493904263 wait complete. 2024-03-08T06:03:04.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.265+0000 7f91b4400640 1 Processor -- start 2024-03-08T06:03:04.267 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.266+0000 7f91b4400640 1 -- start start 2024-03-08T06:03:04.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.266+0000 7f91b4400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9194004800 0x7f91ac0ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:04.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.266+0000 7f91b4400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f91ac1f8120 0x7f91ac155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:04.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.266+0000 7f91b4400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91ac0b4780 0x7f91ac0b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:04.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.266+0000 7f91b4400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac0b5770 con 0x7f91ac0b4780 2024-03-08T06:03:04.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.266+0000 7f91b4400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac0d2600 con 0x7f9194004800 2024-03-08T06:03:04.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.266+0000 7f91b4400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac0b58f0 con 0x7f91ac1f8120 2024-03-08T06:03:04.269 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.267+0000 7f91b1a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9194004800 0x7f91ac0ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.267+0000 7f91b1000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f91ac1f8120 0x7f91ac155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.267+0000 7f91b1a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9194004800 0x7f91ac0ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:39590/0 (socket says 172.21.15.42:39590) 2024-03-08T06:03:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.267+0000 7f91b1a00640 1 -- 172.21.15.42:0/2623284864 learned_addr learned my addr 172.21.15.42:0/2623284864 (peer_addr_for_me v2:172.21.15.42:0/0) 2024-03-08T06:03:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.267+0000 7f91b2400640 1 --2- 172.21.15.42:0/2623284864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91ac0b4780 0x7f91ac0b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.267+0000 7f91b1a00640 1 -- 172.21.15.42:0/2623284864 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f91ac1f8120 msgr2=0x7f91ac155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.267+0000 7f91b1a00640 1 --2- 172.21.15.42:0/2623284864 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f91ac1f8120 0x7f91ac155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.267+0000 7f91b1a00640 1 -- 172.21.15.42:0/2623284864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91ac0b4780 msgr2=0x7f91ac0b4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.267+0000 7f91b1a00640 1 --2- 172.21.15.42:0/2623284864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91ac0b4780 0x7f91ac0b4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.267+0000 7f91b1a00640 1 -- 172.21.15.42:0/2623284864 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac0cd080 con 0x7f9194004800 2024-03-08T06:03:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.267+0000 7f91b2400640 1 --2- 172.21.15.42:0/2623284864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91ac0b4780 0x7f91ac0b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.267+0000 7f91b1a00640 1 --2- 172.21.15.42:0/2623284864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9194004800 0x7f91ac0ccb40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f91a000e800 tx=0x7f91a000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.268+0000 7f91a9600640 1 -- 172.21.15.42:0/2623284864 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a000c8d0 con 0x7f9194004800 2024-03-08T06:03:04.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.268+0000 7f91a9600640 1 -- 172.21.15.42:0/2623284864 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a0018070 con 0x7f9194004800 2024-03-08T06:03:04.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.268+0000 7f91a9600640 1 -- 172.21.15.42:0/2623284864 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a000ccd0 con 0x7f9194004800 2024-03-08T06:03:04.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.268+0000 7f91b4400640 1 -- 172.21.15.42:0/2623284864 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ac0cd890 con 0x7f9194004800 2024-03-08T06:03:04.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.268+0000 7f91b4400640 1 -- 172.21.15.42:0/2623284864 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ac1f7920 con 0x7f9194004800 2024-03-08T06:03:04.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.268+0000 7f91a9600640 1 -- 172.21.15.42:0/2623284864 <== mon.1 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f91a001d460 con 0x7f9194004800 2024-03-08T06:03:04.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.268+0000 7f91a9600640 1 -- 172.21.15.42:0/2623284864 <== mon.1 v2:172.21.15.42:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f91a0013bc0 con 0x7f9194004800 2024-03-08T06:03:04.271 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.269+0000 7f91b4400640 1 -- 172.21.15.42:0/2623284864 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ac067cb0 con 0x7f9194004800 2024-03-08T06:03:04.272 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.271+0000 7f91a9600640 1 -- 172.21.15.42:0/2623284864 <== mon.1 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f91a0013dc0 con 0x7f9194004800 2024-03-08T06:03:04.351 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.350+0000 7f91b4400640 1 -- 172.21.15.42:0/2623284864 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c0d07107-a24b-4530-976e-bdc14ea42db0", "id": 7} v 0) v1 -- 0x7f91ac0b67d0 con 0x7f9194004800 2024-03-08T06:03:04.358 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.357+0000 7f91a9600640 1 -- 172.21.15.42:0/2623284864 <== mon.1 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c0d07107-a24b-4530-976e-bdc14ea42db0", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f91a0013560 con 0x7f9194004800 2024-03-08T06:03:04.358 INFO:teuthology.orchestra.run.smithi042.stdout:7 2024-03-08T06:03:04.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.358+0000 7f91b4400640 1 -- 172.21.15.42:0/2623284864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9194004800 msgr2=0x7f91ac0ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:04.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.358+0000 7f91b4400640 1 --2- 172.21.15.42:0/2623284864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9194004800 0x7f91ac0ccb40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f91a000e800 tx=0x7f91a000ecc0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.359 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.358+0000 7f91b4400640 1 -- 172.21.15.42:0/2623284864 shutdown_connections 2024-03-08T06:03:04.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.358+0000 7f91b4400640 1 --2- 172.21.15.42:0/2623284864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91ac0b4780 0x7f91ac0b4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.358+0000 7f91b4400640 1 --2- 172.21.15.42:0/2623284864 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f91ac1f8120 0x7f91ac155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.358+0000 7f91b4400640 1 --2- 172.21.15.42:0/2623284864 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9194004800 0x7f91ac0ccb40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.358+0000 7f91b4400640 1 -- 172.21.15.42:0/2623284864 >> 172.21.15.42:0/2623284864 conn(0x7f91ac067240 msgr2=0x7f91ac0b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:04.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.358+0000 7f91b4400640 1 -- 172.21.15.42:0/2623284864 shutdown_connections 2024-03-08T06:03:04.360 INFO:teuthology.orchestra.run.smithi042.stderr:2024-03-08T06:03:04.358+0000 7f91b4400640 1 -- 172.21.15.42:0/2623284864 wait complete. 2024-03-08T06:03:04.375 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-08T06:03:04.375 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-08T06:03:04.383 INFO:tasks.ceph.osd.0:Started 2024-03-08T06:03:04.383 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-08T06:03:04.383 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-08T06:03:04.390 INFO:tasks.ceph.osd.1:Started 2024-03-08T06:03:04.390 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-08T06:03:04.390 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-08T06:03:04.398 INFO:tasks.ceph.osd.2:Started 2024-03-08T06:03:04.398 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-08T06:03:04.398 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-08T06:03:04.406 INFO:tasks.ceph.osd.3:Started 2024-03-08T06:03:04.406 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-08T06:03:04.406 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-08T06:03:04.408 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:04.408+0000 7fe619c0e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-08T06:03:04.411 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:04.409+0000 7f4528046040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-08T06:03:04.417 INFO:tasks.ceph.osd.4:Started 2024-03-08T06:03:04.417 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-08T06:03:04.417 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-08T06:03:04.425 INFO:tasks.ceph.osd.5:Started 2024-03-08T06:03:04.425 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-08T06:03:04.425 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-08T06:03:04.430 INFO:tasks.ceph.osd.6:Started 2024-03-08T06:03:04.430 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-08T06:03:04.430 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-08T06:03:04.435 INFO:tasks.ceph.osd.7:Started 2024-03-08T06:03:04.436 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:03:04.472 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:04.471+0000 7f4528046040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-08T06:03:04.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.647+0000 7f9795800640 1 Processor -- start 2024-03-08T06:03:04.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.647+0000 7f9795800640 1 -- start start 2024-03-08T06:03:04.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.648+0000 7f9795800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f979015df20 0x7f97900ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:04.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.648+0000 7f9795800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f97900b6bd0 0x7f9790162400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:04.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.648+0000 7f9795800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979015e300 con 0x7f97900d0aa0 2024-03-08T06:03:04.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.648+0000 7f9795800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97900d3990 con 0x7f979015df20 2024-03-08T06:03:04.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.648+0000 7f9795800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9790162940 con 0x7f97900b6bd0 2024-03-08T06:03:04.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.648+0000 7f9794e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f97900d0aa0 0x7f97900b5590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46310/0 (socket says 172.21.15.19:46310) 2024-03-08T06:03:04.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.648+0000 7f9794e00640 1 -- 172.21.15.19:0/483179325 learned_addr learned my addr 172.21.15.19:0/483179325 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:04.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.648+0000 7f978fe00640 1 --2- 172.21.15.19:0/483179325 >> v2:172.21.15.19:3300/0 conn(0x7f979015df20 0x7f97900ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:04.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.648+0000 7f978f400640 1 --2- 172.21.15.19:0/483179325 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f97900b6bd0 0x7f9790162400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:04.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.649+0000 7f978fe00640 1 -- 172.21.15.19:0/483179325 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f97900b6bd0 msgr2=0x7f9790162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:04.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.649+0000 7f978fe00640 1 --2- 172.21.15.19:0/483179325 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f97900b6bd0 0x7f9790162400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.649+0000 7f978fe00640 1 -- 172.21.15.19:0/483179325 >> v1:172.21.15.19:6789/0 conn(0x7f97900d0aa0 legacy=0x7f97900b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:04.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.649+0000 7f978fe00640 1 -- 172.21.15.19:0/483179325 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97900cf030 con 0x7f979015df20 2024-03-08T06:03:04.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.650+0000 7f978fe00640 1 --2- 172.21.15.19:0/483179325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f979015df20 0x7f97900ce9e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f97800097a0 tx=0x7f978002b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155bb08c17d90407 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:04.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.650+0000 7f978ea00640 1 -- 172.21.15.19:0/483179325 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780034070 con 0x7f979015df20 2024-03-08T06:03:04.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.650+0000 7f978ea00640 1 -- 172.21.15.19:0/483179325 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9780030800 con 0x7f979015df20 2024-03-08T06:03:04.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.650+0000 7f978ea00640 1 -- 172.21.15.19:0/483179325 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780030bd0 con 0x7f979015df20 2024-03-08T06:03:04.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.650+0000 7f9795800640 1 -- 172.21.15.19:0/483179325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f979015df20 msgr2=0x7f97900ce9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:04.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.650+0000 7f9795800640 1 --2- 172.21.15.19:0/483179325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f979015df20 0x7f97900ce9e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f97800097a0 tx=0x7f978002b940 comp rx=0 tx=0).stop 2024-03-08T06:03:04.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.651+0000 7f9795800640 1 -- 172.21.15.19:0/483179325 shutdown_connections 2024-03-08T06:03:04.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.651+0000 7f9795800640 1 --2- 172.21.15.19:0/483179325 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f97900b6bd0 0x7f9790162400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.651+0000 7f9795800640 1 --2- 172.21.15.19:0/483179325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f979015df20 0x7f97900ce9e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.651+0000 7f9795800640 1 -- 172.21.15.19:0/483179325 >> 172.21.15.19:0/483179325 conn(0x7f979006c740 msgr2=0x7f979006cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:04.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.651+0000 7f9795800640 1 -- 172.21.15.19:0/483179325 shutdown_connections 2024-03-08T06:03:04.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.651+0000 7f9795800640 1 -- 172.21.15.19:0/483179325 wait complete. 2024-03-08T06:03:04.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.652+0000 7f9795800640 1 Processor -- start 2024-03-08T06:03:04.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.653+0000 7f9795800640 1 -- start start 2024-03-08T06:03:04.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.653+0000 7f9795800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f97900b6bd0 0x7f97900cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:04.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.653+0000 7f9795800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97900d0aa0 0x7f9790071310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:04.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.653+0000 7f9795800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f979015df20 0x7f97900ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:04.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.653+0000 7f9795800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97900d2180 con 0x7f97900d0aa0 2024-03-08T06:03:04.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.653+0000 7f9795800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97900d1ea0 con 0x7f979015df20 2024-03-08T06:03:04.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.653+0000 7f9795800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97900d2460 con 0x7f97900b6bd0 2024-03-08T06:03:04.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.654+0000 7f978f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97900d0aa0 0x7f9790071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:04.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.654+0000 7f978fe00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f97900b6bd0 0x7f97900cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:04.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.654+0000 7f978f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97900d0aa0 0x7f9790071310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47834/0 (socket says 172.21.15.19:47834) 2024-03-08T06:03:04.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.654+0000 7f978f400640 1 -- 172.21.15.19:0/2074746591 learned_addr learned my addr 172.21.15.19:0/2074746591 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:04.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.654+0000 7f9794e00640 1 --2- 172.21.15.19:0/2074746591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f979015df20 0x7f97900ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:04.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.654+0000 7f978f400640 1 -- 172.21.15.19:0/2074746591 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f97900b6bd0 msgr2=0x7f97900cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:04.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.654+0000 7f978f400640 1 --2- 172.21.15.19:0/2074746591 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f97900b6bd0 0x7f97900cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.654+0000 7f978f400640 1 -- 172.21.15.19:0/2074746591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f979015df20 msgr2=0x7f97900ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:04.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.654+0000 7f978f400640 1 --2- 172.21.15.19:0/2074746591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f979015df20 0x7f97900ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.654+0000 7f978f400640 1 -- 172.21.15.19:0/2074746591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9790071850 con 0x7f97900d0aa0 2024-03-08T06:03:04.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.654+0000 7f978fe00640 1 --2- 172.21.15.19:0/2074746591 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f97900b6bd0 0x7f97900cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T06:03:04.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.654+0000 7f978f400640 1 --2- 172.21.15.19:0/2074746591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97900d0aa0 0x7f9790071310 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f977c00e9b0 tx=0x7f977c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:04.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.655+0000 7f9787e00640 1 -- 172.21.15.19:0/2074746591 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c017070 con 0x7f97900d0aa0 2024-03-08T06:03:04.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.655+0000 7f9787e00640 1 -- 172.21.15.19:0/2074746591 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977c00c9a0 con 0x7f97900d0aa0 2024-03-08T06:03:04.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.655+0000 7f9787e00640 1 -- 172.21.15.19:0/2074746591 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c00cd90 con 0x7f97900d0aa0 2024-03-08T06:03:04.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.655+0000 7f9795800640 1 -- 172.21.15.19:0/2074746591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979015f560 con 0x7f97900d0aa0 2024-03-08T06:03:04.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.655+0000 7f9795800640 1 -- 172.21.15.19:0/2074746591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979015fb20 con 0x7f97900d0aa0 2024-03-08T06:03:04.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.656+0000 7f9787e00640 1 -- 172.21.15.19:0/2074746591 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f977c01a070 con 0x7f97900d0aa0 2024-03-08T06:03:04.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.656+0000 7f9787e00640 1 -- 172.21.15.19:0/2074746591 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f977c006660 con 0x7f97900d0aa0 2024-03-08T06:03:04.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.656+0000 7f9795800640 1 -- 172.21.15.19:0/2074746591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9790075100 con 0x7f97900d0aa0 2024-03-08T06:03:04.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.661+0000 7f9787e00640 1 -- 172.21.15.19:0/2074746591 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f977c005990 con 0x7f97900d0aa0 2024-03-08T06:03:04.673 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:04.672+0000 7f4528046040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-08T06:03:04.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.726+0000 7f9795800640 1 -- 172.21.15.19:0/2074746591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f979015d1f0 con 0x7f97900d0aa0 2024-03-08T06:03:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.727+0000 7f9787e00640 1 -- 172.21.15.19:0/2074746591 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f977c005b70 con 0x7f97900d0aa0 2024-03-08T06:03:04.728 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:04.728 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":10,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:03:04.353385+0000","last_up_change":"0.000000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:03:04.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.728+0000 7f9795800640 1 -- 172.21.15.19:0/2074746591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97900d0aa0 msgr2=0x7f9790071310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:04.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.728+0000 7f9795800640 1 --2- 172.21.15.19:0/2074746591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97900d0aa0 0x7f9790071310 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f977c00e9b0 tx=0x7f977c00ee70 comp rx=0 tx=0).stop 2024-03-08T06:03:04.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.728+0000 7f9795800640 1 -- 172.21.15.19:0/2074746591 shutdown_connections 2024-03-08T06:03:04.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.728+0000 7f9795800640 1 --2- 172.21.15.19:0/2074746591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f979015df20 0x7f97900ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.728+0000 7f9795800640 1 --2- 172.21.15.19:0/2074746591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97900d0aa0 0x7f9790071310 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.728+0000 7f9795800640 1 --2- 172.21.15.19:0/2074746591 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f97900b6bd0 0x7f97900cb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:04.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.728+0000 7f9795800640 1 -- 172.21.15.19:0/2074746591 >> 172.21.15.19:0/2074746591 conn(0x7f979006c740 msgr2=0x7f97900b28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:04.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.729+0000 7f9795800640 1 -- 172.21.15.19:0/2074746591 shutdown_connections 2024-03-08T06:03:04.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:04.729+0000 7f9795800640 1 -- 172.21.15.19:0/2074746591 wait complete. 2024-03-08T06:03:04.745 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-08T06:03:04.745 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-08T06:03:05.089 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-03-08T06:03:05.089+0000 7faeb4866640 -1 Falling back to public interface 2024-03-08T06:03:05.114 INFO:tasks.ceph.osd.4.smithi042.stderr:2024-03-08T06:03:05.113+0000 7ff88f328640 -1 Falling back to public interface 2024-03-08T06:03:05.115 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-03-08T06:03:05.114+0000 7f5805349640 -1 Falling back to public interface 2024-03-08T06:03:05.119 INFO:tasks.ceph.osd.7.smithi042.stderr:2024-03-08T06:03:05.118+0000 7fc5faf0d640 -1 Falling back to public interface 2024-03-08T06:03:05.139 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-03-08T06:03:05.138+0000 7f6828338640 -1 Falling back to public interface 2024-03-08T06:03:05.139 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-03-08T06:03:05.138+0000 7f466de0d640 -1 Falling back to public interface 2024-03-08T06:03:05.147 INFO:tasks.ceph.osd.5.smithi042.stderr:2024-03-08T06:03:05.146+0000 7f834f80f640 -1 Falling back to public interface 2024-03-08T06:03:05.150 INFO:tasks.ceph.osd.6.smithi042.stderr:2024-03-08T06:03:05.149+0000 7febfbbdd640 -1 Falling back to public interface 2024-03-08T06:03:05.514 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:05.513+0000 7fe619c0e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-08T06:03:05.550 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-08T06:03:05.712 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.711+0000 7f88b0c00640 1 Processor -- start 2024-03-08T06:03:05.712 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.711+0000 7f88b0c00640 1 -- start start 2024-03-08T06:03:05.714 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.712+0000 7f88b0c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f88ac0d07a0 0x7f88ac0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:05.714 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.712+0000 7f88b0c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f88ac162620 0x7f88ac0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:05.714 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.712+0000 7f88b0c00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ac0cf660 con 0x7f88ac0d10c0 2024-03-08T06:03:05.714 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.712+0000 7f88b0c00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ac0d1550 con 0x7f88ac0d07a0 2024-03-08T06:03:05.714 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.712+0000 7f88b0c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0b3630 con 0x7f88ac162620 2024-03-08T06:03:05.714 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.713+0000 7f88a9e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f88ac0d07a0 0x7f88ac0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:05.714 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.713+0000 7f88a9e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f88ac0d07a0 0x7f88ac0d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47836/0 (socket says 172.21.15.19:47836) 2024-03-08T06:03:05.714 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.713+0000 7f88a9e00640 1 -- 172.21.15.19:0/4017683680 learned_addr learned my addr 172.21.15.19:0/4017683680 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:05.714 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.713+0000 7f88aa800640 1 --2- 172.21.15.19:0/4017683680 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f88ac162620 0x7f88ac0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:05.714 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.713+0000 7f88a9e00640 1 -- 172.21.15.19:0/4017683680 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f88ac162620 msgr2=0x7f88ac0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:05.714 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.713+0000 7f88a9e00640 1 --2- 172.21.15.19:0/4017683680 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f88ac162620 0x7f88ac0b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:05.714 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.713+0000 7f88a9e00640 1 -- 172.21.15.19:0/4017683680 >> v1:172.21.15.42:6789/0 conn(0x7f88ac0d10c0 legacy=0x7f88ac161f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:05.714 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.713+0000 7f88a9e00640 1 -- 172.21.15.19:0/4017683680 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac0cf940 con 0x7f88ac0d07a0 2024-03-08T06:03:05.715 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.714+0000 7f88a9e00640 1 --2- 172.21.15.19:0/4017683680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88ac0d07a0 0x7f88ac0d0b80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f889c009870 tx=0x7f889c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ab545f45b6bd27 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:05.715 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.714+0000 7f88a8a00640 1 -- 172.21.15.19:0/4017683680 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c0317c0 con 0x7f88ac0d07a0 2024-03-08T06:03:05.715 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.714+0000 7f88a8a00640 1 -- 172.21.15.19:0/4017683680 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889c037070 con 0x7f88ac0d07a0 2024-03-08T06:03:05.715 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.714+0000 7f88a8a00640 1 -- 172.21.15.19:0/4017683680 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c031b80 con 0x7f88ac0d07a0 2024-03-08T06:03:05.716 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.715+0000 7f88b0c00640 1 -- 172.21.15.19:0/4017683680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88ac0d07a0 msgr2=0x7f88ac0d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:05.716 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.715+0000 7f88b0c00640 1 --2- 172.21.15.19:0/4017683680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88ac0d07a0 0x7f88ac0d0b80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f889c009870 tx=0x7f889c02b860 comp rx=0 tx=0).stop 2024-03-08T06:03:05.716 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.715+0000 7f88b0c00640 1 -- 172.21.15.19:0/4017683680 shutdown_connections 2024-03-08T06:03:05.716 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.715+0000 7f88b0c00640 1 --2- 172.21.15.19:0/4017683680 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f88ac162620 0x7f88ac0b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:05.716 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.715+0000 7f88b0c00640 1 --2- 172.21.15.19:0/4017683680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88ac0d07a0 0x7f88ac0d0b80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:05.716 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.715+0000 7f88b0c00640 1 -- 172.21.15.19:0/4017683680 >> 172.21.15.19:0/4017683680 conn(0x7f88ac0d3cd0 msgr2=0x7f88ac0d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:05.717 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.715+0000 7f88b0c00640 1 -- 172.21.15.19:0/4017683680 shutdown_connections 2024-03-08T06:03:05.717 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.715+0000 7f88b0c00640 1 -- 172.21.15.19:0/4017683680 wait complete. 2024-03-08T06:03:05.717 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.717+0000 7f88b0c00640 1 Processor -- start 2024-03-08T06:03:05.717 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.717+0000 7f88b0c00640 1 -- start start 2024-03-08T06:03:05.720 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.718+0000 7f88b0c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88ac0d07a0 0x7f88ac09eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:05.721 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.718+0000 7f88b0c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88ac0d10c0 0x7f88ac0a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:05.721 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.718+0000 7f88b0c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f88ac162620 0x7f88ac153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:05.721 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.718+0000 7f88b0c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0cf2f0 con 0x7f88ac0d10c0 2024-03-08T06:03:05.721 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.718+0000 7f88b0c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0b3910 con 0x7f88ac0d07a0 2024-03-08T06:03:05.721 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.718+0000 7f88b0c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0d4940 con 0x7f88ac162620 2024-03-08T06:03:05.721 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.718+0000 7f88a9400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88ac0d10c0 0x7f88ac0a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:05.721 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.718+0000 7f88a9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88ac0d07a0 0x7f88ac09eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:05.721 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.718+0000 7f88a9400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88ac0d10c0 0x7f88ac0a03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47844/0 (socket says 172.21.15.19:47844) 2024-03-08T06:03:05.721 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.718+0000 7f88a9400640 1 -- 172.21.15.19:0/2657104732 learned_addr learned my addr 172.21.15.19:0/2657104732 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:05.721 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.718+0000 7f88aa800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f88ac162620 0x7f88ac153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:05.721 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.719+0000 7f88a9400640 1 -- 172.21.15.19:0/2657104732 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f88ac162620 msgr2=0x7f88ac153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:05.721 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.719+0000 7f88a9400640 1 --2- 172.21.15.19:0/2657104732 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f88ac162620 0x7f88ac153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:05.722 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.719+0000 7f88a9400640 1 -- 172.21.15.19:0/2657104732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88ac0d07a0 msgr2=0x7f88ac09eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:05.722 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.719+0000 7f88a9400640 1 --2- 172.21.15.19:0/2657104732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88ac0d07a0 0x7f88ac09eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:05.722 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.719+0000 7f88a9400640 1 -- 172.21.15.19:0/2657104732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac0a0b10 con 0x7f88ac0d10c0 2024-03-08T06:03:05.722 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.719+0000 7f88a9e00640 1 --2- 172.21.15.19:0/2657104732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88ac0d07a0 0x7f88ac09eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T06:03:05.722 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.719+0000 7f88a9400640 1 --2- 172.21.15.19:0/2657104732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88ac0d10c0 0x7f88ac0a03c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f889800c3c0 tx=0x7f889800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:05.722 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.719+0000 7f88a2000640 1 -- 172.21.15.19:0/2657104732 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88980052d0 con 0x7f88ac0d10c0 2024-03-08T06:03:05.722 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.719+0000 7f88a2000640 1 -- 172.21.15.19:0/2657104732 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8898005490 con 0x7f88ac0d10c0 2024-03-08T06:03:05.722 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.719+0000 7f88b0c00640 1 -- 172.21.15.19:0/2657104732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ac0a0df0 con 0x7f88ac0d10c0 2024-03-08T06:03:05.722 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.719+0000 7f88a2000640 1 -- 172.21.15.19:0/2657104732 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8898007260 con 0x7f88ac0d10c0 2024-03-08T06:03:05.722 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.719+0000 7f88b0c00640 1 -- 172.21.15.19:0/2657104732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ac0a13b0 con 0x7f88ac0d10c0 2024-03-08T06:03:05.722 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.720+0000 7f88a2000640 1 -- 172.21.15.19:0/2657104732 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f8898007400 con 0x7f88ac0d10c0 2024-03-08T06:03:05.722 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.720+0000 7f88a2000640 1 -- 172.21.15.19:0/2657104732 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f8898003a00 con 0x7f88ac0d10c0 2024-03-08T06:03:05.723 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.721+0000 7f88b0c00640 1 -- 172.21.15.19:0/2657104732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ac075160 con 0x7f88ac0d10c0 2024-03-08T06:03:05.724 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.723+0000 7f88a2000640 1 -- 172.21.15.19:0/2657104732 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f88980035f0 con 0x7f88ac0d10c0 2024-03-08T06:03:05.782 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:05.781+0000 7f4528046040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-08T06:03:05.790 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.790+0000 7f88b0c00640 1 -- 172.21.15.19:0/2657104732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88ac0ce9f0 con 0x7f88ac0d10c0 2024-03-08T06:03:05.792 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.791+0000 7f88a2000640 1 -- 172.21.15.19:0/2657104732 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f8898003ce0 con 0x7f88ac0d10c0 2024-03-08T06:03:05.792 INFO:teuthology.misc.health.smithi019.stdout: 2024-03-08T06:03:05.792 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":10,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:03:04.353385+0000","last_up_change":"0.000000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:03:05.793 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.792+0000 7f88b0c00640 1 -- 172.21.15.19:0/2657104732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88ac0d10c0 msgr2=0x7f88ac0a03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:05.793 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.792+0000 7f88b0c00640 1 --2- 172.21.15.19:0/2657104732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88ac0d10c0 0x7f88ac0a03c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f889800c3c0 tx=0x7f889800c880 comp rx=0 tx=0).stop 2024-03-08T06:03:05.793 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.792+0000 7f88b0c00640 1 -- 172.21.15.19:0/2657104732 shutdown_connections 2024-03-08T06:03:05.793 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.792+0000 7f88b0c00640 1 --2- 172.21.15.19:0/2657104732 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f88ac162620 0x7f88ac153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:05.793 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.792+0000 7f88b0c00640 1 --2- 172.21.15.19:0/2657104732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88ac0d10c0 0x7f88ac0a03c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:05.793 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.792+0000 7f88b0c00640 1 --2- 172.21.15.19:0/2657104732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88ac0d07a0 0x7f88ac09eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:05.794 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.792+0000 7f88b0c00640 1 -- 172.21.15.19:0/2657104732 >> 172.21.15.19:0/2657104732 conn(0x7f88ac0d3cd0 msgr2=0x7f88ac0b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:05.794 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.793+0000 7f88b0c00640 1 -- 172.21.15.19:0/2657104732 shutdown_connections 2024-03-08T06:03:05.794 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:05.793+0000 7f88b0c00640 1 -- 172.21.15.19:0/2657104732 wait complete. 2024-03-08T06:03:05.805 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-08T06:03:05.845 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:05.845+0000 7fe619c0e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-08T06:03:05.909 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:05.908+0000 7fe619c0e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-08T06:03:06.046 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:06.045+0000 7fe619c0e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-08T06:03:06.135 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:06.134+0000 7f4528046040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-08T06:03:06.198 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:06.197+0000 7f4528046040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-08T06:03:06.336 INFO:tasks.ceph.mgr.x.smithi042.stderr:2024-03-08T06:03:06.335+0000 7f4528046040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-08T06:03:07.078 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:07.077+0000 7fe5ba000640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-08T06:03:07.078 INFO:tasks.ceph.mgr.y.smithi019.stderr:2024-03-08T06:03:07.077+0000 7fe5ba000640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-08T06:03:08.601 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-03-08T06:03:08.600+0000 7faeb4866640 -1 osd.2 0 log_to_monitors true 2024-03-08T06:03:08.653 INFO:tasks.ceph.osd.7.smithi042.stderr:2024-03-08T06:03:08.652+0000 7fc5faf0d640 -1 osd.7 0 log_to_monitors true 2024-03-08T06:03:08.655 INFO:tasks.ceph.osd.4.smithi042.stderr:2024-03-08T06:03:08.654+0000 7ff88f328640 -1 osd.4 0 log_to_monitors true 2024-03-08T06:03:08.659 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-03-08T06:03:08.659+0000 7f5805349640 -1 osd.0 0 log_to_monitors true 2024-03-08T06:03:08.683 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-03-08T06:03:08.682+0000 7f466de0d640 -1 osd.3 0 log_to_monitors true 2024-03-08T06:03:08.685 INFO:tasks.ceph.osd.5.smithi042.stderr:2024-03-08T06:03:08.684+0000 7f834f80f640 -1 osd.5 0 log_to_monitors true 2024-03-08T06:03:08.710 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-03-08T06:03:08.710+0000 7f6828338640 -1 osd.1 0 log_to_monitors true 2024-03-08T06:03:08.731 INFO:tasks.ceph.osd.6.smithi042.stderr:2024-03-08T06:03:08.730+0000 7febfbbdd640 -1 osd.6 0 log_to_monitors true 2024-03-08T06:03:11.787 INFO:tasks.ceph.osd.4.smithi042.stderr:2024-03-08T06:03:11.786+0000 7ff889800640 -1 osd.4 0 waiting for initial osdmap 2024-03-08T06:03:11.797 INFO:tasks.ceph.osd.4.smithi042.stderr:2024-03-08T06:03:11.795+0000 7ff880200640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T06:03:11.821 INFO:tasks.ceph.osd.7.smithi042.stderr:2024-03-08T06:03:11.820+0000 7fc5f5400640 -1 osd.7 0 waiting for initial osdmap 2024-03-08T06:03:11.823 INFO:tasks.ceph.osd.5.smithi042.stderr:2024-03-08T06:03:11.822+0000 7f8349600640 -1 osd.5 0 waiting for initial osdmap 2024-03-08T06:03:11.827 INFO:tasks.ceph.osd.7.smithi042.stderr:2024-03-08T06:03:11.826+0000 7fc5ebe00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T06:03:11.832 INFO:tasks.ceph.osd.5.smithi042.stderr:2024-03-08T06:03:11.831+0000 7f8340000640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T06:03:11.843 INFO:tasks.ceph.osd.6.smithi042.stderr:2024-03-08T06:03:11.842+0000 7febf6000640 -1 osd.6 0 waiting for initial osdmap 2024-03-08T06:03:11.854 INFO:tasks.ceph.osd.6.smithi042.stderr:2024-03-08T06:03:11.853+0000 7febeca00640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T06:03:12.430 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-03-08T06:03:12.429+0000 7faeb0c00640 -1 osd.2 0 waiting for initial osdmap 2024-03-08T06:03:12.441 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-03-08T06:03:12.440+0000 7faea5800640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T06:03:12.484 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-03-08T06:03:12.484+0000 7f4669a00640 -1 osd.3 0 waiting for initial osdmap 2024-03-08T06:03:12.492 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-03-08T06:03:12.492+0000 7f465e600640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T06:03:12.498 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-03-08T06:03:12.498+0000 7f5801600640 -1 osd.0 0 waiting for initial osdmap 2024-03-08T06:03:12.507 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-03-08T06:03:12.506+0000 7f57f6200640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T06:03:12.516 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-03-08T06:03:12.516+0000 7f6822800640 -1 osd.1 0 waiting for initial osdmap 2024-03-08T06:03:12.521 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-03-08T06:03:12.521+0000 7f6819200640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-08T06:03:12.612 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-08T06:03:12.795 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.793+0000 7f87b3200640 1 Processor -- start 2024-03-08T06:03:12.795 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.794+0000 7f87b3200640 1 -- start start 2024-03-08T06:03:12.797 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.796+0000 7f87b3200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f87ac0d4600 0x7f87ac0d1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:12.797 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.796+0000 7f87b3200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ac0b2fa0 con 0x7f87ac15dbf0 2024-03-08T06:03:12.797 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.796+0000 7f87b1e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f87ac15dbf0 0x7f87ac0d0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35070/0 (socket says 172.21.15.19:35070) 2024-03-08T06:03:12.797 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.796+0000 7f87b1e00640 1 -- 172.21.15.19:0/19296972 learned_addr learned my addr 172.21.15.19:0/19296972 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:12.797 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.796+0000 7f87b3200640 1 -- 172.21.15.19:0/19296972 --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ac0b3240 con 0x7f87ac15dfd0 2024-03-08T06:03:12.797 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.796+0000 7f87b3200640 1 -- 172.21.15.19:0/19296972 --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ac0b3520 con 0x7f87ac0d4600 2024-03-08T06:03:12.798 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.797+0000 7f87b1400640 1 --2- 172.21.15.19:0/19296972 >> v2:172.21.15.42:3300/0 conn(0x7f87ac0d4600 0x7f87ac0d1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:12.800 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.799+0000 7f87b0a00640 1 -- 172.21.15.19:0/19296972 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2006125419 0 0) 0x7f87ac0b2fa0 con 0x7f87ac15dbf0 2024-03-08T06:03:12.800 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.799+0000 7f87b0a00640 1 -- 172.21.15.19:0/19296972 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8794003520 con 0x7f87ac15dbf0 2024-03-08T06:03:12.800 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.799+0000 7f87b1400640 1 -- 172.21.15.19:0/19296972 >> v1:172.21.15.42:6789/0 conn(0x7f87ac15dfd0 legacy=0x7f87ac0b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:12.800 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.799+0000 7f87b1400640 1 -- 172.21.15.19:0/19296972 >> v1:172.21.15.19:6789/0 conn(0x7f87ac15dbf0 legacy=0x7f87ac0d0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:12.801 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.800+0000 7f87b1400640 1 -- 172.21.15.19:0/19296972 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac0d1310 con 0x7f87ac0d4600 2024-03-08T06:03:12.804 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.804+0000 7f87b1400640 1 --2- 172.21.15.19:0/19296972 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87ac0d4600 0x7f87ac0d1d30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f879c0097a0 tx=0x7f879c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9a25e089f104326 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:12.808 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.807+0000 7f87b0a00640 1 -- 172.21.15.19:0/19296972 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c035020 con 0x7f87ac0d4600 2024-03-08T06:03:12.808 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.807+0000 7f87b0a00640 1 -- 172.21.15.19:0/19296972 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c031830 con 0x7f87ac0d4600 2024-03-08T06:03:12.808 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.808+0000 7f87b0a00640 1 -- 172.21.15.19:0/19296972 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c031c00 con 0x7f87ac0d4600 2024-03-08T06:03:12.809 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.809+0000 7f87b3200640 1 -- 172.21.15.19:0/19296972 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87ac0d4600 msgr2=0x7f87ac0d1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:12.809 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.809+0000 7f87b3200640 1 --2- 172.21.15.19:0/19296972 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87ac0d4600 0x7f87ac0d1d30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f879c0097a0 tx=0x7f879c02b8d0 comp rx=0 tx=0).stop 2024-03-08T06:03:12.810 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.809+0000 7f87b3200640 1 -- 172.21.15.19:0/19296972 shutdown_connections 2024-03-08T06:03:12.810 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.809+0000 7f87b3200640 1 --2- 172.21.15.19:0/19296972 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87ac0d4600 0x7f87ac0d1d30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:12.811 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.809+0000 7f87b3200640 1 -- 172.21.15.19:0/19296972 >> 172.21.15.19:0/19296972 conn(0x7f87ac0d3a70 msgr2=0x7f87ac0d3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:12.811 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.810+0000 7f87b3200640 1 -- 172.21.15.19:0/19296972 shutdown_connections 2024-03-08T06:03:12.811 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.810+0000 7f87b3200640 1 -- 172.21.15.19:0/19296972 wait complete. 2024-03-08T06:03:12.813 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.812+0000 7f87b3200640 1 Processor -- start 2024-03-08T06:03:12.814 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.813+0000 7f87b3200640 1 -- start start 2024-03-08T06:03:12.816 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.814+0000 7f87b3200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87ac0d4600 0x7f87ac15b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:12.816 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.814+0000 7f87b3200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f87ac15dbf0 0x7f87ac0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:12.816 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.814+0000 7f87b3200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87ac15dfd0 0x7f87ac0cea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:12.816 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.814+0000 7f87b3200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0d2640 con 0x7f87ac15dfd0 2024-03-08T06:03:12.817 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.814+0000 7f87b3200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0d24c0 con 0x7f87ac0d4600 2024-03-08T06:03:12.817 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.814+0000 7f87b3200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0b4430 con 0x7f87ac15dbf0 2024-03-08T06:03:12.817 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.814+0000 7f87b2800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87ac15dfd0 0x7f87ac0cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:12.817 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.814+0000 7f87b2800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87ac15dfd0 0x7f87ac0cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39436/0 (socket says 172.21.15.19:39436) 2024-03-08T06:03:12.817 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.814+0000 7f87b2800640 1 -- 172.21.15.19:0/4128707710 learned_addr learned my addr 172.21.15.19:0/4128707710 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:12.817 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.814+0000 7f87b1400640 1 --2- 172.21.15.19:0/4128707710 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f87ac15dbf0 0x7f87ac0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:12.817 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.814+0000 7f87b1e00640 1 --2- 172.21.15.19:0/4128707710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87ac0d4600 0x7f87ac15b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:12.817 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.815+0000 7f87b2800640 1 -- 172.21.15.19:0/4128707710 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f87ac15dbf0 msgr2=0x7f87ac0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:12.817 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.815+0000 7f87b2800640 1 --2- 172.21.15.19:0/4128707710 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f87ac15dbf0 0x7f87ac0ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:12.817 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.815+0000 7f87b2800640 1 -- 172.21.15.19:0/4128707710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87ac0d4600 msgr2=0x7f87ac15b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:12.817 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.815+0000 7f87b2800640 1 --2- 172.21.15.19:0/4128707710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87ac0d4600 0x7f87ac15b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:12.817 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.815+0000 7f87b2800640 1 -- 172.21.15.19:0/4128707710 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac15e3f0 con 0x7f87ac15dfd0 2024-03-08T06:03:12.818 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.815+0000 7f87b2800640 1 --2- 172.21.15.19:0/4128707710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87ac15dfd0 0x7f87ac0cea40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f87a800c760 tx=0x7f87a800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:12.818 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.815+0000 7f87a6000640 1 -- 172.21.15.19:0/4128707710 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8016020 con 0x7f87ac15dfd0 2024-03-08T06:03:12.818 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.815+0000 7f87a6000640 1 -- 172.21.15.19:0/4128707710 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a8006d50 con 0x7f87ac15dfd0 2024-03-08T06:03:12.818 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.815+0000 7f87a6000640 1 -- 172.21.15.19:0/4128707710 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8003bb0 con 0x7f87ac15dfd0 2024-03-08T06:03:12.818 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.815+0000 7f87b3200640 1 -- 172.21.15.19:0/4128707710 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ac15e6b0 con 0x7f87ac15dfd0 2024-03-08T06:03:12.818 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.816+0000 7f87b3200640 1 -- 172.21.15.19:0/4128707710 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ac15ec70 con 0x7f87ac15dfd0 2024-03-08T06:03:12.818 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.817+0000 7f87b3200640 1 -- 172.21.15.19:0/4128707710 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ac04f810 con 0x7f87ac15dfd0 2024-03-08T06:03:12.819 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.819+0000 7f87a6000640 1 -- 172.21.15.19:0/4128707710 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7f87a80050d0 con 0x7f87ac15dfd0 2024-03-08T06:03:12.820 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.820+0000 7f87a6000640 1 --2- 172.21.15.19:0/4128707710 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f879006b440 0x7f879006d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:12.821 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.820+0000 7f87a6000640 1 -- 172.21.15.19:0/4128707710 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f87a8089610 con 0x7f87ac15dfd0 2024-03-08T06:03:12.821 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.820+0000 7f87b1e00640 1 --2- 172.21.15.19:0/4128707710 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f879006b440 0x7f879006d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:12.821 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.821+0000 7f87b1e00640 1 --2- 172.21.15.19:0/4128707710 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f879006b440 0x7f879006d900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f87a0005880 tx=0x7f87a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:12.826 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:12.826+0000 7f87a6000640 1 -- 172.21.15.19:0/4128707710 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f87a8020020 con 0x7f87ac15dfd0 2024-03-08T06:03:13.017 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:13.016+0000 7f87b3200640 1 -- 172.21.15.19:0/4128707710 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87ac074350 con 0x7f87ac15dfd0 2024-03-08T06:03:13.018 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:13.017+0000 7f87a6000640 1 -- 172.21.15.19:0/4128707710 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10849 (secure 0 0 0) 0x7f87a8058480 con 0x7f87ac15dfd0 2024-03-08T06:03:13.018 INFO:teuthology.misc.health.smithi019.stdout: 2024-03-08T06:03:13.018 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":13,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:03:12.793224+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:03:13.021 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:13.019+0000 7f87b3200640 1 -- 172.21.15.19:0/4128707710 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f879006b440 msgr2=0x7f879006d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:13.021 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:13.019+0000 7f87b3200640 1 --2- 172.21.15.19:0/4128707710 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f879006b440 0x7f879006d900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f87a0005880 tx=0x7f87a0009040 comp rx=0 tx=0).stop 2024-03-08T06:03:13.021 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:13.019+0000 7f87b3200640 1 -- 172.21.15.19:0/4128707710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87ac15dfd0 msgr2=0x7f87ac0cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:13.021 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:13.019+0000 7f87b3200640 1 --2- 172.21.15.19:0/4128707710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87ac15dfd0 0x7f87ac0cea40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f87a800c760 tx=0x7f87a800cb60 comp rx=0 tx=0).stop 2024-03-08T06:03:13.021 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:13.019+0000 7f87b3200640 1 -- 172.21.15.19:0/4128707710 shutdown_connections 2024-03-08T06:03:13.021 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:13.019+0000 7f87b3200640 1 --2- 172.21.15.19:0/4128707710 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f879006b440 0x7f879006d900 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.021 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:13.019+0000 7f87b3200640 1 --2- 172.21.15.19:0/4128707710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87ac15dfd0 0x7f87ac0cea40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.021 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:13.019+0000 7f87b3200640 1 --2- 172.21.15.19:0/4128707710 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f87ac15dbf0 0x7f87ac0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.021 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:13.019+0000 7f87b3200640 1 --2- 172.21.15.19:0/4128707710 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87ac0d4600 0x7f87ac15b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.021 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:13.020+0000 7f87b3200640 1 -- 172.21.15.19:0/4128707710 >> 172.21.15.19:0/4128707710 conn(0x7f87ac0d3a70 msgr2=0x7f87ac06c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:13.022 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:13.020+0000 7f87b3200640 1 -- 172.21.15.19:0/4128707710 shutdown_connections 2024-03-08T06:03:13.022 INFO:teuthology.misc.health.smithi019.stderr:2024-03-08T06:03:13.020+0000 7f87b3200640 1 -- 172.21.15.19:0/4128707710 wait complete. 2024-03-08T06:03:13.034 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-08T06:03:13.034 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-08T06:03:13.034 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-08T06:03:13.034 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-08T06:03:13.039 INFO:tasks.ceph.mds.a:Started 2024-03-08T06:03:13.040 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-08T06:03:13.040 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-08T06:03:13.044 INFO:tasks.ceph.mds.c:Started 2024-03-08T06:03:13.044 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-08T06:03:13.045 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-08T06:03:13.052 INFO:tasks.ceph.mds.b:Started 2024-03-08T06:03:13.053 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-08T06:03:13.053 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-08T06:03:13.060 INFO:tasks.ceph.mds.d:Started 2024-03-08T06:03:13.061 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-08T06:03:13.063 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:03:13.199 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-03-08T06:03:13.200 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-03-08T06:03:13.228 INFO:tasks.ceph.mds.b.smithi042.stdout:starting mds.b at 2024-03-08T06:03:13.229 INFO:tasks.ceph.mds.d.smithi042.stdout:starting mds.d at 2024-03-08T06:03:13.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.243+0000 7fb0aa200640 1 Processor -- start 2024-03-08T06:03:13.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.244+0000 7fb0aa200640 1 -- start start 2024-03-08T06:03:13.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.245+0000 7fb0aa200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb0a40b6bd0 0x7fb0a40ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:13.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.245+0000 7fb0aa200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a415e300 con 0x7fb0a40d11b0 2024-03-08T06:03:13.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.245+0000 7fb0aa200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a40cf030 con 0x7fb0a415df20 2024-03-08T06:03:13.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.245+0000 7fb0aa200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a40d1bc0 con 0x7fb0a40b6bd0 2024-03-08T06:03:13.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.245+0000 7fb0a3e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb0a40d11b0 0x7fb0a40d2980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35092/0 (socket says 172.21.15.19:35092) 2024-03-08T06:03:13.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.245+0000 7fb0a3e00640 1 -- 172.21.15.19:0/3011849575 learned_addr learned my addr 172.21.15.19:0/3011849575 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:13.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.245+0000 7fb0a9800640 1 --2- 172.21.15.19:0/3011849575 >> v2:172.21.15.19:3300/0 conn(0x7fb0a40b6bd0 0x7fb0a40ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:13.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.245+0000 7fb0a3400640 1 -- 172.21.15.19:0/3011849575 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161643221 0 0) 0x7fb0a415e300 con 0x7fb0a40d11b0 2024-03-08T06:03:13.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.245+0000 7fb0a3400640 1 -- 172.21.15.19:0/3011849575 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb08c003520 con 0x7fb0a40d11b0 2024-03-08T06:03:13.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.245+0000 7fb0a3400640 1 -- 172.21.15.19:0/3011849575 <== mon.1 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015940543 0 0) 0x7fb0a40cf030 con 0x7fb0a415df20 2024-03-08T06:03:13.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.245+0000 7fb0a9800640 1 -- 172.21.15.19:0/3011849575 >> v1:172.21.15.42:6789/0 conn(0x7fb0a415df20 legacy=0x7fb0a40d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:13.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.245+0000 7fb0a9800640 1 -- 172.21.15.19:0/3011849575 >> v1:172.21.15.19:6789/0 conn(0x7fb0a40d11b0 legacy=0x7fb0a40d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:13.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.245+0000 7fb0a9800640 1 -- 172.21.15.19:0/3011849575 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a40d1ea0 con 0x7fb0a40b6bd0 2024-03-08T06:03:13.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.246+0000 7fb0a9800640 1 --2- 172.21.15.19:0/3011849575 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0a40b6bd0 0x7fb0a40ce9e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009d90 tx=0x7fb09c02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b431a33d7f7633 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:13.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.247+0000 7fb0a3400640 1 -- 172.21.15.19:0/3011849575 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c039070 con 0x7fb0a40b6bd0 2024-03-08T06:03:13.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.247+0000 7fb0a3400640 1 -- 172.21.15.19:0/3011849575 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c02cd80 con 0x7fb0a40b6bd0 2024-03-08T06:03:13.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.247+0000 7fb0a3400640 1 -- 172.21.15.19:0/3011849575 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c034660 con 0x7fb0a40b6bd0 2024-03-08T06:03:13.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.247+0000 7fb0aa200640 1 -- 172.21.15.19:0/3011849575 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0a40b6bd0 msgr2=0x7fb0a40ce9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:13.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.247+0000 7fb0aa200640 1 --2- 172.21.15.19:0/3011849575 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0a40b6bd0 0x7fb0a40ce9e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009d90 tx=0x7fb09c02bfd0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.247+0000 7fb0aa200640 1 -- 172.21.15.19:0/3011849575 shutdown_connections 2024-03-08T06:03:13.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.247+0000 7fb0aa200640 1 --2- 172.21.15.19:0/3011849575 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0a40b6bd0 0x7fb0a40ce9e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.247+0000 7fb0aa200640 1 -- 172.21.15.19:0/3011849575 >> 172.21.15.19:0/3011849575 conn(0x7fb0a406c740 msgr2=0x7fb0a406cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:13.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.247+0000 7fb0aa200640 1 -- 172.21.15.19:0/3011849575 shutdown_connections 2024-03-08T06:03:13.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.247+0000 7fb0aa200640 1 -- 172.21.15.19:0/3011849575 wait complete. 2024-03-08T06:03:13.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.249+0000 7fb0aa200640 1 Processor -- start 2024-03-08T06:03:13.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.249+0000 7fb0aa200640 1 -- start start 2024-03-08T06:03:13.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.250+0000 7fb0aa200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0a40b6bd0 0x7fb0a4150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:13.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.250+0000 7fb0aa200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb0a40d11b0 0x7fb0a415fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:13.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.250+0000 7fb0aa200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0a415df20 0x7fb0a4160530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:13.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.250+0000 7fb0aa200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a4162400 con 0x7fb0a40b6bd0 2024-03-08T06:03:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.250+0000 7fb0aa200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40d2460 con 0x7fb0a415df20 2024-03-08T06:03:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.250+0000 7fb0aa200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a4162580 con 0x7fb0a40d11b0 2024-03-08T06:03:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.250+0000 7fb0a8e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0a40b6bd0 0x7fb0a4150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.250+0000 7fb0a8e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0a40b6bd0 0x7fb0a4150f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39458/0 (socket says 172.21.15.19:39458) 2024-03-08T06:03:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.250+0000 7fb0a8e00640 1 -- 172.21.15.19:0/2168181642 learned_addr learned my addr 172.21.15.19:0/2168181642 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.251+0000 7fb0a3e00640 1 --2- 172.21.15.19:0/2168181642 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb0a40d11b0 0x7fb0a415fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.251+0000 7fb0a9800640 1 --2- 172.21.15.19:0/2168181642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0a415df20 0x7fb0a4160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.251+0000 7fb0a8e00640 1 -- 172.21.15.19:0/2168181642 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb0a40d11b0 msgr2=0x7fb0a415fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.251+0000 7fb0a8e00640 1 --2- 172.21.15.19:0/2168181642 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb0a40d11b0 0x7fb0a415fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.251+0000 7fb0a8e00640 1 -- 172.21.15.19:0/2168181642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0a415df20 msgr2=0x7fb0a4160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.251+0000 7fb0a8e00640 1 --2- 172.21.15.19:0/2168181642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0a415df20 0x7fb0a4160530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.251+0000 7fb0a8e00640 1 -- 172.21.15.19:0/2168181642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a40c95b0 con 0x7fb0a40b6bd0 2024-03-08T06:03:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.251+0000 7fb0a8e00640 1 --2- 172.21.15.19:0/2168181642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0a40b6bd0 0x7fb0a4150f80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb09800c3c0 tx=0x7fb09800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.251+0000 7fb0a0c00640 1 -- 172.21.15.19:0/2168181642 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb098017070 con 0x7fb0a40b6bd0 2024-03-08T06:03:13.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.252+0000 7fb0a0c00640 1 -- 172.21.15.19:0/2168181642 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0980035f0 con 0x7fb0a40b6bd0 2024-03-08T06:03:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.252+0000 7fb0a0c00640 1 -- 172.21.15.19:0/2168181642 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0980039e0 con 0x7fb0a40b6bd0 2024-03-08T06:03:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.252+0000 7fb0aa200640 1 -- 172.21.15.19:0/2168181642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a40c9890 con 0x7fb0a40b6bd0 2024-03-08T06:03:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.252+0000 7fb0aa200640 1 -- 172.21.15.19:0/2168181642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a40c8af0 con 0x7fb0a40b6bd0 2024-03-08T06:03:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.253+0000 7fb0aa200640 1 -- 172.21.15.19:0/2168181642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a4075100 con 0x7fb0a40b6bd0 2024-03-08T06:03:13.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.254+0000 7fb0a0c00640 1 -- 172.21.15.19:0/2168181642 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7fb09801a070 con 0x7fb0a40b6bd0 2024-03-08T06:03:13.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.254+0000 7fb0a0c00640 1 --2- 172.21.15.19:0/2168181642 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb08406b490 0x7fb08406d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:13.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.255+0000 7fb0a0c00640 1 -- 172.21.15.19:0/2168181642 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fb098088ee0 con 0x7fb0a40b6bd0 2024-03-08T06:03:13.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.255+0000 7fb0a3e00640 1 --2- 172.21.15.19:0/2168181642 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb08406b490 0x7fb08406d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:13.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.255+0000 7fb0a3e00640 1 --2- 172.21.15.19:0/2168181642 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb08406b490 0x7fb08406d950 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40c8a80 tx=0x7fb090009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:13.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.259+0000 7fb0a0c00640 1 -- 172.21.15.19:0/2168181642 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb098057d30 con 0x7fb0a40b6bd0 2024-03-08T06:03:13.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.456+0000 7fb0aa200640 1 -- 172.21.15.19:0/2168181642 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0a4161520 con 0x7fb0a40b6bd0 2024-03-08T06:03:13.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.458+0000 7fb0a0c00640 1 -- 172.21.15.19:0/2168181642 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10849 (secure 0 0 0) 0x7fb09805bdd0 con 0x7fb0a40b6bd0 2024-03-08T06:03:13.459 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:13.459 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":13,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:03:12.793224+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:03:13.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.460+0000 7fb0aa200640 1 -- 172.21.15.19:0/2168181642 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb08406b490 msgr2=0x7fb08406d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:13.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.460+0000 7fb0aa200640 1 --2- 172.21.15.19:0/2168181642 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb08406b490 0x7fb08406d950 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40c8a80 tx=0x7fb090009040 comp rx=0 tx=0).stop 2024-03-08T06:03:13.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.460+0000 7fb0aa200640 1 -- 172.21.15.19:0/2168181642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0a40b6bd0 msgr2=0x7fb0a4150f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:13.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.460+0000 7fb0aa200640 1 --2- 172.21.15.19:0/2168181642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0a40b6bd0 0x7fb0a4150f80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb09800c3c0 tx=0x7fb09800c880 comp rx=0 tx=0).stop 2024-03-08T06:03:13.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.461+0000 7fb0aa200640 1 -- 172.21.15.19:0/2168181642 shutdown_connections 2024-03-08T06:03:13.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.461+0000 7fb0aa200640 1 --2- 172.21.15.19:0/2168181642 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb08406b490 0x7fb08406d950 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.461+0000 7fb0aa200640 1 --2- 172.21.15.19:0/2168181642 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb0a415df20 0x7fb0a4160530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.461+0000 7fb0aa200640 1 --2- 172.21.15.19:0/2168181642 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb0a40d11b0 0x7fb0a415fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.461+0000 7fb0aa200640 1 --2- 172.21.15.19:0/2168181642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0a40b6bd0 0x7fb0a4150f80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.461+0000 7fb0aa200640 1 -- 172.21.15.19:0/2168181642 >> 172.21.15.19:0/2168181642 conn(0x7fb0a406c740 msgr2=0x7fb0a40b6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:13.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.461+0000 7fb0aa200640 1 -- 172.21.15.19:0/2168181642 shutdown_connections 2024-03-08T06:03:13.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.461+0000 7fb0aa200640 1 -- 172.21.15.19:0/2168181642 wait complete. 2024-03-08T06:03:13.478 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-03-08T06:03:13.478 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T06:03:13.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.684+0000 7fa98a400640 1 Processor -- start 2024-03-08T06:03:13.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.684+0000 7fa98a400640 1 -- start start 2024-03-08T06:03:13.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.686+0000 7fa98a400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa984071ab0 0x7fa98415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:13.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.686+0000 7fa98a400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa98406d600 0x7fa984144d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:13.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.686+0000 7fa98a400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98415d0c0 con 0x7fa984071e90 2024-03-08T06:03:13.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.686+0000 7fa98a400640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98406ef40 con 0x7fa98406d600 2024-03-08T06:03:13.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.686+0000 7fa98a400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98406da80 con 0x7fa984071ab0 2024-03-08T06:03:13.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.686+0000 7fa97be00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa98406d600 0x7fa984144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:13.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.686+0000 7fa97be00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa98406d600 0x7fa984144d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39472/0 (socket says 172.21.15.19:39472) 2024-03-08T06:03:13.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.686+0000 7fa97be00640 1 -- 172.21.15.19:0/3135692085 learned_addr learned my addr 172.21.15.19:0/3135692085 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:13.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.686+0000 7fa983400640 1 --2- 172.21.15.19:0/3135692085 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa984071ab0 0x7fa98415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:13.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.687+0000 7fa97be00640 1 -- 172.21.15.19:0/3135692085 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa984071ab0 msgr2=0x7fa98415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:13.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.687+0000 7fa97be00640 1 --2- 172.21.15.19:0/3135692085 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa984071ab0 0x7fa98415cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.687+0000 7fa97be00640 1 -- 172.21.15.19:0/3135692085 >> v1:172.21.15.19:6789/0 conn(0x7fa984071e90 legacy=0x7fa98415f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:13.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.687+0000 7fa97be00640 1 -- 172.21.15.19:0/3135692085 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98406dd60 con 0x7fa98406d600 2024-03-08T06:03:13.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.688+0000 7fa97be00640 1 --2- 172.21.15.19:0/3135692085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa98406d600 0x7fa984144d60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009870 tx=0x7fa96c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a57e76318dec15 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:13.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.688+0000 7fa982a00640 1 -- 172.21.15.19:0/3135692085 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c034070 con 0x7fa98406d600 2024-03-08T06:03:13.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.688+0000 7fa982a00640 1 -- 172.21.15.19:0/3135692085 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96c030840 con 0x7fa98406d600 2024-03-08T06:03:13.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.688+0000 7fa982a00640 1 -- 172.21.15.19:0/3135692085 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c030c10 con 0x7fa98406d600 2024-03-08T06:03:13.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.689+0000 7fa98a400640 1 -- 172.21.15.19:0/3135692085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa98406d600 msgr2=0x7fa984144d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:13.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.689+0000 7fa98a400640 1 --2- 172.21.15.19:0/3135692085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa98406d600 0x7fa984144d60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009870 tx=0x7fa96c02b980 comp rx=0 tx=0).stop 2024-03-08T06:03:13.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.689+0000 7fa98a400640 1 -- 172.21.15.19:0/3135692085 shutdown_connections 2024-03-08T06:03:13.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.689+0000 7fa98a400640 1 --2- 172.21.15.19:0/3135692085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa98406d600 0x7fa984144d60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.689+0000 7fa98a400640 1 --2- 172.21.15.19:0/3135692085 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa984071ab0 0x7fa98415cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.689+0000 7fa98a400640 1 -- 172.21.15.19:0/3135692085 >> 172.21.15.19:0/3135692085 conn(0x7fa98406ae30 msgr2=0x7fa98406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:13.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.689+0000 7fa98a400640 1 -- 172.21.15.19:0/3135692085 shutdown_connections 2024-03-08T06:03:13.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.689+0000 7fa98a400640 1 -- 172.21.15.19:0/3135692085 wait complete. 2024-03-08T06:03:13.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.690+0000 7fa98a400640 1 Processor -- start 2024-03-08T06:03:13.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.691+0000 7fa98a400640 1 -- start start 2024-03-08T06:03:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.691+0000 7fa98a400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa98406d600 0x7fa98413c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.691+0000 7fa98a400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa984071ab0 0x7fa98414ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.692+0000 7fa98a400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa984071e90 0x7fa98413f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.692+0000 7fa98a400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98406e600 con 0x7fa984071ab0 2024-03-08T06:03:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.692+0000 7fa98a400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98406e320 con 0x7fa984071e90 2024-03-08T06:03:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.692+0000 7fa98a400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98415e3b0 con 0x7fa98406d600 2024-03-08T06:03:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.692+0000 7fa97be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa984071ab0 0x7fa98414ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.692+0000 7fa97be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa984071ab0 0x7fa98414ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39486/0 (socket says 172.21.15.19:39486) 2024-03-08T06:03:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.692+0000 7fa97be00640 1 -- 172.21.15.19:0/1984327622 learned_addr learned my addr 172.21.15.19:0/1984327622 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.692+0000 7fa983400640 1 --2- 172.21.15.19:0/1984327622 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa98406d600 0x7fa98413c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.692+0000 7fa983e00640 1 --2- 172.21.15.19:0/1984327622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa984071e90 0x7fa98413f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.692+0000 7fa97be00640 1 -- 172.21.15.19:0/1984327622 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa98406d600 msgr2=0x7fa98413c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.692+0000 7fa97be00640 1 --2- 172.21.15.19:0/1984327622 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa98406d600 0x7fa98413c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.692+0000 7fa97be00640 1 -- 172.21.15.19:0/1984327622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa984071e90 msgr2=0x7fa98413f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.692+0000 7fa97be00640 1 --2- 172.21.15.19:0/1984327622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa984071e90 0x7fa98413f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.692+0000 7fa97be00640 1 -- 172.21.15.19:0/1984327622 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa984141a20 con 0x7fa984071ab0 2024-03-08T06:03:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.692+0000 7fa983e00640 1 --2- 172.21.15.19:0/1984327622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa984071e90 0x7fa98413f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.693+0000 7fa97be00640 1 --2- 172.21.15.19:0/1984327622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa984071ab0 0x7fa98414ff10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa96c02b9c0 tx=0x7fa96c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.693+0000 7fa97b400640 1 -- 172.21.15.19:0/1984327622 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c048070 con 0x7fa984071ab0 2024-03-08T06:03:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.693+0000 7fa97b400640 1 -- 172.21.15.19:0/1984327622 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96c030640 con 0x7fa984071ab0 2024-03-08T06:03:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.693+0000 7fa97b400640 1 -- 172.21.15.19:0/1984327622 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c034040 con 0x7fa984071ab0 2024-03-08T06:03:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.693+0000 7fa98a400640 1 -- 172.21.15.19:0/1984327622 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa984141d00 con 0x7fa984071ab0 2024-03-08T06:03:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.693+0000 7fa98a400640 1 -- 172.21.15.19:0/1984327622 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9841422c0 con 0x7fa984071ab0 2024-03-08T06:03:13.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.694+0000 7fa98a400640 1 -- 172.21.15.19:0/1984327622 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa984067cb0 con 0x7fa984071ab0 2024-03-08T06:03:13.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.695+0000 7fa97b400640 1 -- 172.21.15.19:0/1984327622 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7fa96c037070 con 0x7fa984071ab0 2024-03-08T06:03:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.696+0000 7fa97b400640 1 --2- 172.21.15.19:0/1984327622 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa96006b470 0x7fa96006d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.696+0000 7fa97b400640 1 -- 172.21.15.19:0/1984327622 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fa96c0ab970 con 0x7fa984071ab0 2024-03-08T06:03:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.696+0000 7fa983400640 1 --2- 172.21.15.19:0/1984327622 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa96006b470 0x7fa96006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:13.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.697+0000 7fa983400640 1 --2- 172.21.15.19:0/1984327622 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa96006b470 0x7fa96006d930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa974009a10 tx=0x7fa974008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:13.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.701+0000 7fa97b400640 1 -- 172.21.15.19:0/1984327622 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa96c07ae30 con 0x7fa984071ab0 2024-03-08T06:03:13.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.936+0000 7fa98a400640 1 -- 172.21.15.19:0/1984327622 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9840b4a00 con 0x7fa984071ab0 2024-03-08T06:03:13.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.937+0000 7fa97b400640 1 -- 172.21.15.19:0/1984327622 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7fa96c030810 con 0x7fa984071ab0 2024-03-08T06:03:13.938 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:13.938 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6836/1964979810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1964979810},{"type":"v1","addr":"172.21.15.19:6836","nonce":1964979810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-03-08T06:03:13.939 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 2 2024-03-08T06:03:13.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.940+0000 7fa98a400640 1 -- 172.21.15.19:0/1984327622 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa96006b470 msgr2=0x7fa96006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:13.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.940+0000 7fa98a400640 1 --2- 172.21.15.19:0/1984327622 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa96006b470 0x7fa96006d930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa974009a10 tx=0x7fa974008040 comp rx=0 tx=0).stop 2024-03-08T06:03:13.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.940+0000 7fa98a400640 1 -- 172.21.15.19:0/1984327622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa984071ab0 msgr2=0x7fa98414ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:13.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.940+0000 7fa98a400640 1 --2- 172.21.15.19:0/1984327622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa984071ab0 0x7fa98414ff10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa96c02b9c0 tx=0x7fa96c004730 comp rx=0 tx=0).stop 2024-03-08T06:03:13.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.940+0000 7fa98a400640 1 -- 172.21.15.19:0/1984327622 shutdown_connections 2024-03-08T06:03:13.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.940+0000 7fa98a400640 1 --2- 172.21.15.19:0/1984327622 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa96006b470 0x7fa96006d930 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.940+0000 7fa98a400640 1 --2- 172.21.15.19:0/1984327622 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa984071e90 0x7fa98413f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.940+0000 7fa98a400640 1 --2- 172.21.15.19:0/1984327622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa984071ab0 0x7fa98414ff10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.940+0000 7fa98a400640 1 --2- 172.21.15.19:0/1984327622 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa98406d600 0x7fa98413c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:13.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.940+0000 7fa98a400640 1 -- 172.21.15.19:0/1984327622 >> 172.21.15.19:0/1984327622 conn(0x7fa98406ae30 msgr2=0x7fa9840b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:13.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.940+0000 7fa98a400640 1 -- 172.21.15.19:0/1984327622 shutdown_connections 2024-03-08T06:03:13.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:13.941+0000 7fa98a400640 1 -- 172.21.15.19:0/1984327622 wait complete. 2024-03-08T06:03:15.960 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T06:03:16.090 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T06:03:16.096 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T06:03:16.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.193+0000 7f3b2ae00640 1 Processor -- start 2024-03-08T06:03:16.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.194+0000 7f3b2ae00640 1 -- start start 2024-03-08T06:03:16.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.195+0000 7f3b2ae00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3b24071ab0 0x7f3b2415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:16.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.195+0000 7f3b2ae00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2415d0c0 con 0x7f3b24071e90 2024-03-08T06:03:16.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.195+0000 7f3b2ae00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2406da80 con 0x7f3b2406d600 2024-03-08T06:03:16.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.195+0000 7f3b2ae00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2406ef40 con 0x7f3b24071ab0 2024-03-08T06:03:16.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.196+0000 7f3b28e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3b24071e90 0x7f3b2415d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35118/0 (socket says 172.21.15.19:35118) 2024-03-08T06:03:16.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.196+0000 7f3b28e00640 1 -- 172.21.15.19:0/4177881173 learned_addr learned my addr 172.21.15.19:0/4177881173 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:16.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.196+0000 7f3b23e00640 1 --2- 172.21.15.19:0/4177881173 >> v2:172.21.15.42:3300/0 conn(0x7f3b24071ab0 0x7f3b2415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:16.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.196+0000 7f3b22a00640 1 -- 172.21.15.19:0/4177881173 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144492799 0 0) 0x7f3b1c001490 con 0x7f3b24071e90 2024-03-08T06:03:16.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.196+0000 7f3b22a00640 1 -- 172.21.15.19:0/4177881173 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b08003520 con 0x7f3b24071e90 2024-03-08T06:03:16.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.196+0000 7f3b23e00640 1 -- 172.21.15.19:0/4177881173 >> v1:172.21.15.42:6789/0 conn(0x7f3b2406d600 legacy=0x7f3b24144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:16.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.196+0000 7f3b23e00640 1 -- 172.21.15.19:0/4177881173 >> v1:172.21.15.19:6789/0 conn(0x7f3b24071e90 legacy=0x7f3b2415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:16.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.196+0000 7f3b23e00640 1 -- 172.21.15.19:0/4177881173 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2406dd60 con 0x7f3b24071ab0 2024-03-08T06:03:16.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.198+0000 7f3b23e00640 1 --2- 172.21.15.19:0/4177881173 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b24071ab0 0x7f3b2415cb80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3b140097a0 tx=0x7f3b1402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fbcdfb7f3148774 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:16.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.198+0000 7f3b22a00640 1 -- 172.21.15.19:0/4177881173 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14034070 con 0x7f3b24071ab0 2024-03-08T06:03:16.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.198+0000 7f3b22a00640 1 -- 172.21.15.19:0/4177881173 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b14030610 con 0x7f3b24071ab0 2024-03-08T06:03:16.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.198+0000 7f3b22a00640 1 -- 172.21.15.19:0/4177881173 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b140309e0 con 0x7f3b24071ab0 2024-03-08T06:03:16.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.199+0000 7f3b2ae00640 1 -- 172.21.15.19:0/4177881173 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b24071ab0 msgr2=0x7f3b2415cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:16.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.199+0000 7f3b2ae00640 1 --2- 172.21.15.19:0/4177881173 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b24071ab0 0x7f3b2415cb80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3b140097a0 tx=0x7f3b1402b960 comp rx=0 tx=0).stop 2024-03-08T06:03:16.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.199+0000 7f3b2ae00640 1 -- 172.21.15.19:0/4177881173 shutdown_connections 2024-03-08T06:03:16.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.199+0000 7f3b2ae00640 1 --2- 172.21.15.19:0/4177881173 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b24071ab0 0x7f3b2415cb80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:16.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.199+0000 7f3b2ae00640 1 -- 172.21.15.19:0/4177881173 >> 172.21.15.19:0/4177881173 conn(0x7f3b2406ae30 msgr2=0x7f3b2406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:16.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.199+0000 7f3b2ae00640 1 -- 172.21.15.19:0/4177881173 shutdown_connections 2024-03-08T06:03:16.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.199+0000 7f3b2ae00640 1 -- 172.21.15.19:0/4177881173 wait complete. 2024-03-08T06:03:16.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.201+0000 7f3b2ae00640 1 Processor -- start 2024-03-08T06:03:16.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.201+0000 7f3b2ae00640 1 -- start start 2024-03-08T06:03:16.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.202+0000 7f3b2ae00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b2406d600 0x7f3b240afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:16.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.202+0000 7f3b2ae00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b24071ab0 0x7f3b2415ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:16.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.203+0000 7f3b2ae00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3b24071e90 0x7f3b2415b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:16.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.203+0000 7f3b2ae00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2406e600 con 0x7f3b2406d600 2024-03-08T06:03:16.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.203+0000 7f3b2ae00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2406e100 con 0x7f3b24071ab0 2024-03-08T06:03:16.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.203+0000 7f3b2ae00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b24145470 con 0x7f3b24071e90 2024-03-08T06:03:16.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.203+0000 7f3b23e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b2406d600 0x7f3b240afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:16.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.203+0000 7f3b23e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b2406d600 0x7f3b240afe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39498/0 (socket says 172.21.15.19:39498) 2024-03-08T06:03:16.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.203+0000 7f3b23e00640 1 -- 172.21.15.19:0/1658685826 learned_addr learned my addr 172.21.15.19:0/1658685826 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:16.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.203+0000 7f3b23400640 1 --2- 172.21.15.19:0/1658685826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b24071ab0 0x7f3b2415ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:16.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.203+0000 7f3b28e00640 1 --2- 172.21.15.19:0/1658685826 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3b24071e90 0x7f3b2415b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:16.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.203+0000 7f3b23e00640 1 -- 172.21.15.19:0/1658685826 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3b24071e90 msgr2=0x7f3b2415b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:16.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.203+0000 7f3b23e00640 1 --2- 172.21.15.19:0/1658685826 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3b24071e90 0x7f3b2415b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:16.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.203+0000 7f3b23e00640 1 -- 172.21.15.19:0/1658685826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b24071ab0 msgr2=0x7f3b2415ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:16.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.203+0000 7f3b23e00640 1 --2- 172.21.15.19:0/1658685826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b24071ab0 0x7f3b2415ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:16.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.203+0000 7f3b23e00640 1 -- 172.21.15.19:0/1658685826 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b241f4cd0 con 0x7f3b2406d600 2024-03-08T06:03:16.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.203+0000 7f3b28e00640 1 --2- 172.21.15.19:0/1658685826 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3b24071e90 0x7f3b2415b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:16.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.204+0000 7f3b23e00640 1 --2- 172.21.15.19:0/1658685826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b2406d600 0x7f3b240afe30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3b14000c00 tx=0x7f3b140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:16.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.204+0000 7f3b1be00640 1 -- 172.21.15.19:0/1658685826 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14034040 con 0x7f3b2406d600 2024-03-08T06:03:16.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.204+0000 7f3b1be00640 1 -- 172.21.15.19:0/1658685826 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b14030410 con 0x7f3b2406d600 2024-03-08T06:03:16.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.204+0000 7f3b2ae00640 1 -- 172.21.15.19:0/1658685826 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b241f76e0 con 0x7f3b2406d600 2024-03-08T06:03:16.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.204+0000 7f3b1be00640 1 -- 172.21.15.19:0/1658685826 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b14039c70 con 0x7f3b2406d600 2024-03-08T06:03:16.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.204+0000 7f3b2ae00640 1 -- 172.21.15.19:0/1658685826 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b241f7ca0 con 0x7f3b2406d600 2024-03-08T06:03:16.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.205+0000 7f3b2ae00640 1 -- 172.21.15.19:0/1658685826 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b24067cb0 con 0x7f3b2406d600 2024-03-08T06:03:16.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.206+0000 7f3b1be00640 1 -- 172.21.15.19:0/1658685826 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7f3b14037070 con 0x7f3b2406d600 2024-03-08T06:03:16.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.207+0000 7f3b1be00640 1 --2- 172.21.15.19:0/1658685826 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3b0406b440 0x7f3b0406d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:16.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.208+0000 7f3b1be00640 1 -- 172.21.15.19:0/1658685826 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3b140abd20 con 0x7f3b2406d600 2024-03-08T06:03:16.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.208+0000 7f3b23400640 1 --2- 172.21.15.19:0/1658685826 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3b0406b440 0x7f3b0406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:16.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.209+0000 7f3b23400640 1 --2- 172.21.15.19:0/1658685826 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3b0406b440 0x7f3b0406d900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3b240b0790 tx=0x7f3b10009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:16.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.213+0000 7f3b1be00640 1 -- 172.21.15.19:0/1658685826 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3b1407b0e0 con 0x7f3b2406d600 2024-03-08T06:03:16.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.449+0000 7f3b2ae00640 1 -- 172.21.15.19:0/1658685826 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b241447b0 con 0x7f3b2406d600 2024-03-08T06:03:16.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.451+0000 7f3b1be00640 1 -- 172.21.15.19:0/1658685826 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7f3b1407a9e0 con 0x7f3b2406d600 2024-03-08T06:03:16.452 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:16.452 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1494509643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6835","nonce":1494509643},{"type":"v1","addr":"172.21.15.19:6837","nonce":1494509643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/2031610239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2031610239},{"type":"v1","addr":"172.21.15.42:6834","nonce":2031610239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6836/1964979810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1964979810},{"type":"v1","addr":"172.21.15.19:6836","nonce":1964979810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1462224228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1462224228},{"type":"v1","addr":"172.21.15.42:6835","nonce":1462224228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-08T06:03:16.452 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 3 2024-03-08T06:03:16.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.453+0000 7f3b2ae00640 1 -- 172.21.15.19:0/1658685826 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3b0406b440 msgr2=0x7f3b0406d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:16.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.453+0000 7f3b2ae00640 1 --2- 172.21.15.19:0/1658685826 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3b0406b440 0x7f3b0406d900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3b240b0790 tx=0x7f3b10009040 comp rx=0 tx=0).stop 2024-03-08T06:03:16.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.453+0000 7f3b2ae00640 1 -- 172.21.15.19:0/1658685826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b2406d600 msgr2=0x7f3b240afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:16.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.453+0000 7f3b2ae00640 1 --2- 172.21.15.19:0/1658685826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b2406d600 0x7f3b240afe30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3b14000c00 tx=0x7f3b140046c0 comp rx=0 tx=0).stop 2024-03-08T06:03:16.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.453+0000 7f3b2ae00640 1 -- 172.21.15.19:0/1658685826 shutdown_connections 2024-03-08T06:03:16.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.453+0000 7f3b2ae00640 1 --2- 172.21.15.19:0/1658685826 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3b0406b440 0x7f3b0406d900 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:16.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.453+0000 7f3b2ae00640 1 --2- 172.21.15.19:0/1658685826 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3b24071e90 0x7f3b2415b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:16.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.453+0000 7f3b2ae00640 1 --2- 172.21.15.19:0/1658685826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b24071ab0 0x7f3b2415ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:16.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.453+0000 7f3b2ae00640 1 --2- 172.21.15.19:0/1658685826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b2406d600 0x7f3b240afe30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:16.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.453+0000 7f3b2ae00640 1 -- 172.21.15.19:0/1658685826 >> 172.21.15.19:0/1658685826 conn(0x7f3b2406ae30 msgr2=0x7f3b2415c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:16.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.454+0000 7f3b2ae00640 1 -- 172.21.15.19:0/1658685826 shutdown_connections 2024-03-08T06:03:16.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.454+0000 7f3b2ae00640 1 -- 172.21.15.19:0/1658685826 wait complete. 2024-03-08T06:03:16.475 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:03:16.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.742+0000 7fbc45000640 1 Processor -- start 2024-03-08T06:03:16.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.742+0000 7fbc45000640 1 -- start start 2024-03-08T06:03:16.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.744+0000 7fbc45000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc4006d600 0x7fbc40144d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:16.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.744+0000 7fbc45000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbc40071e90 0x7fbc401452a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:16.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.744+0000 7fbc45000640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc4006da80 con 0x7fbc40071ab0 2024-03-08T06:03:16.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.744+0000 7fbc45000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4006ef40 con 0x7fbc40071e90 2024-03-08T06:03:16.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.744+0000 7fbc45000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc401457e0 con 0x7fbc4006d600 2024-03-08T06:03:16.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.744+0000 7fbc3de00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbc40071ab0 0x7fbc4015cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35128/0 (socket says 172.21.15.19:35128) 2024-03-08T06:03:16.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.744+0000 7fbc3de00640 1 -- 172.21.15.19:0/2167933340 learned_addr learned my addr 172.21.15.19:0/2167933340 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:16.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.744+0000 7fbc3e800640 1 --2- 172.21.15.19:0/2167933340 >> v2:172.21.15.42:3300/0 conn(0x7fbc40071e90 0x7fbc401452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:16.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.745+0000 7fbc3d400640 1 --2- 172.21.15.19:0/2167933340 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc4006d600 0x7fbc40144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:16.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.745+0000 7fbc3ca00640 1 -- 172.21.15.19:0/2167933340 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571447561 0 0) 0x7fbc4006da80 con 0x7fbc40071ab0 2024-03-08T06:03:16.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.745+0000 7fbc3ca00640 1 -- 172.21.15.19:0/2167933340 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc20003520 con 0x7fbc40071ab0 2024-03-08T06:03:16.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.745+0000 7fbc3ca00640 1 -- 172.21.15.19:0/2167933340 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4152188514 0 0) 0x7fbc20003520 con 0x7fbc40071ab0 2024-03-08T06:03:16.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.745+0000 7fbc3ca00640 1 -- 172.21.15.19:0/2167933340 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc4006d600 msgr2=0x7fbc40144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:16.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.745+0000 7fbc3ca00640 1 --2- 172.21.15.19:0/2167933340 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc4006d600 0x7fbc40144d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:16.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.745+0000 7fbc3ca00640 1 -- 172.21.15.19:0/2167933340 >> v2:172.21.15.42:3300/0 conn(0x7fbc40071e90 msgr2=0x7fbc401452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:16.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.745+0000 7fbc3ca00640 1 --2- 172.21.15.19:0/2167933340 >> v2:172.21.15.42:3300/0 conn(0x7fbc40071e90 0x7fbc401452a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:16.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.745+0000 7fbc3ca00640 1 -- 172.21.15.19:0/2167933340 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4006dd60 con 0x7fbc40071ab0 2024-03-08T06:03:16.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.745+0000 7fbc3ca00640 1 -- 172.21.15.19:0/2167933340 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7fbc30001670 con 0x7fbc40071ab0 2024-03-08T06:03:16.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.745+0000 7fbc3ca00640 1 -- 172.21.15.19:0/2167933340 >> v1:172.21.15.19:6789/0 conn(0x7fbc40071ab0 legacy=0x7fbc4015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:16.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.745+0000 7fbc3ca00640 1 --2- 172.21.15.19:0/2167933340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc200039b0 0x7fbc20003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:16.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.745+0000 7fbc3ca00640 1 --2- 172.21.15.19:0/2167933340 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc4006d600 0x7fbc20004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:16.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.745+0000 7fbc3ca00640 1 --2- 172.21.15.19:0/2167933340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc20004d40 0x7fbc200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:16.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.746+0000 7fbc3ca00640 1 -- 172.21.15.19:0/2167933340 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc401457e0 con 0x7fbc200039b0 2024-03-08T06:03:16.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.746+0000 7fbc3ca00640 1 -- 172.21.15.19:0/2167933340 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2000b9c0 con 0x7fbc20004d40 2024-03-08T06:03:16.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.746+0000 7fbc3ca00640 1 -- 172.21.15.19:0/2167933340 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2000bb40 con 0x7fbc4006d600 2024-03-08T06:03:16.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.746+0000 7fbc3de00640 1 --2- 172.21.15.19:0/2167933340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc200039b0 0x7fbc20003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:16.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.746+0000 7fbc3de00640 1 -- 172.21.15.19:0/2167933340 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc4006d600 msgr2=0x7fbc20004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:16.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.746+0000 7fbc3de00640 1 --2- 172.21.15.19:0/2167933340 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc4006d600 0x7fbc20004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:16.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.746+0000 7fbc3de00640 1 -- 172.21.15.19:0/2167933340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc20004d40 msgr2=0x7fbc200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:16.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.746+0000 7fbc3de00640 1 --2- 172.21.15.19:0/2167933340 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc20004d40 0x7fbc200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:16.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.746+0000 7fbc3de00640 1 -- 172.21.15.19:0/2167933340 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc20003520 con 0x7fbc200039b0 2024-03-08T06:03:16.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.747+0000 7fbc3de00640 1 --2- 172.21.15.19:0/2167933340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc200039b0 0x7fbc20003dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000c270 tx=0x7fbc20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4d36bbdb555c3c server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:16.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.748+0000 7fbc3ca00640 1 -- 172.21.15.19:0/2167933340 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc30007d30 con 0x7fbc200039b0 2024-03-08T06:03:16.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.748+0000 7fbc3ca00640 1 -- 172.21.15.19:0/2167933340 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc30030070 con 0x7fbc200039b0 2024-03-08T06:03:16.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.748+0000 7fbc3ca00640 1 -- 172.21.15.19:0/2167933340 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3002cd60 con 0x7fbc200039b0 2024-03-08T06:03:16.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.748+0000 7fbc45000640 1 -- 172.21.15.19:0/2167933340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc200039b0 msgr2=0x7fbc20003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:16.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.748+0000 7fbc45000640 1 --2- 172.21.15.19:0/2167933340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc200039b0 0x7fbc20003dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000c270 tx=0x7fbc20005830 comp rx=0 tx=0).stop 2024-03-08T06:03:16.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.748+0000 7fbc3e800640 1 -- 172.21.15.19:0/2167933340 reap_dead start 2024-03-08T06:03:16.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.749+0000 7fbc45000640 1 -- 172.21.15.19:0/2167933340 shutdown_connections 2024-03-08T06:03:16.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.749+0000 7fbc45000640 1 -- 172.21.15.19:0/2167933340 >> 172.21.15.19:0/2167933340 conn(0x7fbc4006ae30 msgr2=0x7fbc4006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:16.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.749+0000 7fbc45000640 1 -- 172.21.15.19:0/2167933340 shutdown_connections 2024-03-08T06:03:16.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.749+0000 7fbc45000640 1 -- 172.21.15.19:0/2167933340 wait complete. 2024-03-08T06:03:16.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.751+0000 7fbc45000640 1 Processor -- start 2024-03-08T06:03:16.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.751+0000 7fbc45000640 1 -- start start 2024-03-08T06:03:16.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.752+0000 7fbc45000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc200039b0 0x7fbc40141c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:16.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.752+0000 7fbc45000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4013b260 0x7fbc40142740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:16.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.752+0000 7fbc45000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc40142c80 0x7fbc4014fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:16.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.752+0000 7fbc45000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4006e600 con 0x7fbc4013b260 2024-03-08T06:03:16.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.752+0000 7fbc45000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4006e320 con 0x7fbc40142c80 2024-03-08T06:03:16.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.752+0000 7fbc45000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc40144d60 con 0x7fbc200039b0 2024-03-08T06:03:16.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.752+0000 7fbc3d400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4013b260 0x7fbc40142740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:16.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.752+0000 7fbc3d400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4013b260 0x7fbc40142740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39514/0 (socket says 172.21.15.19:39514) 2024-03-08T06:03:16.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.752+0000 7fbc3d400640 1 -- 172.21.15.19:0/3390484259 learned_addr learned my addr 172.21.15.19:0/3390484259 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:16.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.752+0000 7fbc3de00640 1 --2- 172.21.15.19:0/3390484259 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc200039b0 0x7fbc40141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:16.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.752+0000 7fbc3d400640 1 -- 172.21.15.19:0/3390484259 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc200039b0 msgr2=0x7fbc40141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:16.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.752+0000 7fbc3d400640 1 --2- 172.21.15.19:0/3390484259 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc200039b0 0x7fbc40141c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:16.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.752+0000 7fbc3d400640 1 -- 172.21.15.19:0/3390484259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc40142c80 msgr2=0x7fbc4014fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:16.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.752+0000 7fbc3e800640 1 --2- 172.21.15.19:0/3390484259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc40142c80 0x7fbc4014fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:16.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.753+0000 7fbc3d400640 1 --2- 172.21.15.19:0/3390484259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc40142c80 0x7fbc4014fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:16.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.753+0000 7fbc3d400640 1 -- 172.21.15.19:0/3390484259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc40140bb0 con 0x7fbc4013b260 2024-03-08T06:03:16.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.753+0000 7fbc3d400640 1 --2- 172.21.15.19:0/3390484259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4013b260 0x7fbc40142740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc2800ef10 tx=0x7fbc2800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:16.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.753+0000 7fbc36000640 1 -- 172.21.15.19:0/3390484259 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28018020 con 0x7fbc4013b260 2024-03-08T06:03:16.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.753+0000 7fbc36000640 1 -- 172.21.15.19:0/3390484259 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc28014400 con 0x7fbc4013b260 2024-03-08T06:03:16.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.753+0000 7fbc45000640 1 -- 172.21.15.19:0/3390484259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc40140e90 con 0x7fbc4013b260 2024-03-08T06:03:16.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.753+0000 7fbc36000640 1 -- 172.21.15.19:0/3390484259 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc280147d0 con 0x7fbc4013b260 2024-03-08T06:03:16.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.753+0000 7fbc45000640 1 -- 172.21.15.19:0/3390484259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc40141450 con 0x7fbc4013b260 2024-03-08T06:03:16.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.755+0000 7fbc45000640 1 -- 172.21.15.19:0/3390484259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc40067cb0 con 0x7fbc4013b260 2024-03-08T06:03:16.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.756+0000 7fbc36000640 1 -- 172.21.15.19:0/3390484259 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7fbc28005d10 con 0x7fbc4013b260 2024-03-08T06:03:16.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.757+0000 7fbc36000640 1 --2- 172.21.15.19:0/3390484259 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fbc1c06b440 0x7fbc1c06d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:16.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.757+0000 7fbc36000640 1 -- 172.21.15.19:0/3390484259 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbc2808a830 con 0x7fbc4013b260 2024-03-08T06:03:16.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.758+0000 7fbc3de00640 1 --2- 172.21.15.19:0/3390484259 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fbc1c06b440 0x7fbc1c06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:16.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.758+0000 7fbc3de00640 1 --2- 172.21.15.19:0/3390484259 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fbc1c06b440 0x7fbc1c06d900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbc30034000 tx=0x7fbc30007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:16.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.762+0000 7fbc36000640 1 -- 172.21.15.19:0/3390484259 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbc28022030 con 0x7fbc4013b260 2024-03-08T06:03:16.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.988+0000 7fbc45000640 1 -- 172.21.15.19:0/3390484259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc40144570 con 0x7fbc4013b260 2024-03-08T06:03:16.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.989+0000 7fbc36000640 1 -- 172.21.15.19:0/3390484259 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12824 (secure 0 0 0) 0x7fbc28059a40 con 0x7fbc4013b260 2024-03-08T06:03:16.991 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:16.991 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":17,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:03:16.823007+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:03:16.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.992+0000 7fbc45000640 1 -- 172.21.15.19:0/3390484259 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fbc1c06b440 msgr2=0x7fbc1c06d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:16.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.992+0000 7fbc45000640 1 --2- 172.21.15.19:0/3390484259 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fbc1c06b440 0x7fbc1c06d900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbc30034000 tx=0x7fbc30007000 comp rx=0 tx=0).stop 2024-03-08T06:03:16.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.992+0000 7fbc45000640 1 -- 172.21.15.19:0/3390484259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4013b260 msgr2=0x7fbc40142740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.992+0000 7fbc45000640 1 --2- 172.21.15.19:0/3390484259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4013b260 0x7fbc40142740 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc2800ef10 tx=0x7fbc2800b480 comp rx=0 tx=0).stop 2024-03-08T06:03:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.992+0000 7fbc45000640 1 -- 172.21.15.19:0/3390484259 shutdown_connections 2024-03-08T06:03:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.992+0000 7fbc45000640 1 --2- 172.21.15.19:0/3390484259 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fbc1c06b440 0x7fbc1c06d900 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.992+0000 7fbc45000640 1 --2- 172.21.15.19:0/3390484259 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc40142c80 0x7fbc4014fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.992+0000 7fbc45000640 1 --2- 172.21.15.19:0/3390484259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4013b260 0x7fbc40142740 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.992+0000 7fbc45000640 1 --2- 172.21.15.19:0/3390484259 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbc200039b0 0x7fbc40141c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.992+0000 7fbc45000640 1 -- 172.21.15.19:0/3390484259 >> 172.21.15.19:0/3390484259 conn(0x7fbc4006ae30 msgr2=0x7fbc40143370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.992+0000 7fbc45000640 1 -- 172.21.15.19:0/3390484259 shutdown_connections 2024-03-08T06:03:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:16.992+0000 7fbc45000640 1 -- 172.21.15.19:0/3390484259 wait complete. 2024-03-08T06:03:17.012 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T06:03:14.149736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T06:03:17.012 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T06:03:17.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.218+0000 7fb294a00640 1 Processor -- start 2024-03-08T06:03:17.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.218+0000 7fb294a00640 1 -- start start 2024-03-08T06:03:17.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.219+0000 7fb294a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb29006ce80 0x7fb2900cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:17.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.220+0000 7fb294a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29006c380 con 0x7fb290161850 2024-03-08T06:03:17.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.220+0000 7fb294a00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29006c0a0 con 0x7fb2900b4380 2024-03-08T06:03:17.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.220+0000 7fb294a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2900d1000 con 0x7fb29006ce80 2024-03-08T06:03:17.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.220+0000 7fb28de00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb290161850 0x7fb29006c770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35130/0 (socket says 172.21.15.19:35130) 2024-03-08T06:03:17.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.220+0000 7fb28de00640 1 -- 172.21.15.19:0/2104438917 learned_addr learned my addr 172.21.15.19:0/2104438917 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:17.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.220+0000 7fb28e800640 1 --2- 172.21.15.19:0/2104438917 >> v2:172.21.15.19:3300/0 conn(0x7fb29006ce80 0x7fb2900cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:17.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.220+0000 7fb28ca00640 1 -- 172.21.15.19:0/2104438917 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713533564 0 0) 0x7fb29006c380 con 0x7fb290161850 2024-03-08T06:03:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.220+0000 7fb28ca00640 1 -- 172.21.15.19:0/2104438917 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb270003520 con 0x7fb290161850 2024-03-08T06:03:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.220+0000 7fb28e800640 1 -- 172.21.15.19:0/2104438917 >> v1:172.21.15.42:6789/0 conn(0x7fb2900b4380 legacy=0x7fb2900cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.220+0000 7fb28e800640 1 -- 172.21.15.19:0/2104438917 >> v1:172.21.15.19:6789/0 conn(0x7fb290161850 legacy=0x7fb29006c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.220+0000 7fb28e800640 1 -- 172.21.15.19:0/2104438917 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2900d12e0 con 0x7fb29006ce80 2024-03-08T06:03:17.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.221+0000 7fb28e800640 1 --2- 172.21.15.19:0/2104438917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb29006ce80 0x7fb2900cc940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb288009d90 tx=0x7fb28802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd44793bbfd78ead server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.222+0000 7fb28ca00640 1 -- 172.21.15.19:0/2104438917 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288039070 con 0x7fb29006ce80 2024-03-08T06:03:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.222+0000 7fb28ca00640 1 -- 172.21.15.19:0/2104438917 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28802cbd0 con 0x7fb29006ce80 2024-03-08T06:03:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.222+0000 7fb28ca00640 1 -- 172.21.15.19:0/2104438917 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288034440 con 0x7fb29006ce80 2024-03-08T06:03:17.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.222+0000 7fb294a00640 1 -- 172.21.15.19:0/2104438917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb29006ce80 msgr2=0x7fb2900cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:17.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.222+0000 7fb294a00640 1 --2- 172.21.15.19:0/2104438917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb29006ce80 0x7fb2900cc940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb288009d90 tx=0x7fb28802be20 comp rx=0 tx=0).stop 2024-03-08T06:03:17.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.223+0000 7fb294a00640 1 -- 172.21.15.19:0/2104438917 shutdown_connections 2024-03-08T06:03:17.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.223+0000 7fb294a00640 1 --2- 172.21.15.19:0/2104438917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb29006ce80 0x7fb2900cc940 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:17.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.223+0000 7fb294a00640 1 -- 172.21.15.19:0/2104438917 >> 172.21.15.19:0/2104438917 conn(0x7fb2900b36d0 msgr2=0x7fb2900b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:17.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.223+0000 7fb294a00640 1 -- 172.21.15.19:0/2104438917 shutdown_connections 2024-03-08T06:03:17.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.223+0000 7fb294a00640 1 -- 172.21.15.19:0/2104438917 wait complete. 2024-03-08T06:03:17.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.225+0000 7fb294a00640 1 Processor -- start 2024-03-08T06:03:17.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.225+0000 7fb294a00640 1 -- start start 2024-03-08T06:03:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.226+0000 7fb294a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb29006ce80 0x7fb2901f4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.226+0000 7fb294a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2900b4380 0x7fb290157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.226+0000 7fb294a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb290161850 0x7fb290158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.226+0000 7fb294a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2900b2df0 con 0x7fb2900b4380 2024-03-08T06:03:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.226+0000 7fb294a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2900b2c70 con 0x7fb290161850 2024-03-08T06:03:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.226+0000 7fb294a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2900b2f70 con 0x7fb29006ce80 2024-03-08T06:03:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.226+0000 7fb28d400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2900b4380 0x7fb290157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.226+0000 7fb28d400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2900b4380 0x7fb290157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39530/0 (socket says 172.21.15.19:39530) 2024-03-08T06:03:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.226+0000 7fb28d400640 1 -- 172.21.15.19:0/2689310239 learned_addr learned my addr 172.21.15.19:0/2689310239 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.226+0000 7fb28de00640 1 --2- 172.21.15.19:0/2689310239 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb29006ce80 0x7fb2901f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.226+0000 7fb28e800640 1 --2- 172.21.15.19:0/2689310239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb290161850 0x7fb290158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.226+0000 7fb28d400640 1 -- 172.21.15.19:0/2689310239 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb29006ce80 msgr2=0x7fb2901f4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.226+0000 7fb28d400640 1 --2- 172.21.15.19:0/2689310239 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb29006ce80 0x7fb2901f4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.226+0000 7fb28d400640 1 -- 172.21.15.19:0/2689310239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb290161850 msgr2=0x7fb290158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.226+0000 7fb28d400640 1 --2- 172.21.15.19:0/2689310239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb290161850 0x7fb290158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.226+0000 7fb28d400640 1 -- 172.21.15.19:0/2689310239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2901f4590 con 0x7fb2900b4380 2024-03-08T06:03:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.227+0000 7fb28de00640 1 --2- 172.21.15.19:0/2689310239 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb29006ce80 0x7fb2901f4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.227+0000 7fb28e800640 1 --2- 172.21.15.19:0/2689310239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb290161850 0x7fb290158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.227+0000 7fb28d400640 1 --2- 172.21.15.19:0/2689310239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2900b4380 0x7fb290157b10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb27800c400 tx=0x7fb27800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.229+0000 7fb286000640 1 -- 172.21.15.19:0/2689310239 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb278011790 con 0x7fb2900b4380 2024-03-08T06:03:17.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.229+0000 7fb286000640 1 -- 172.21.15.19:0/2689310239 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb278017070 con 0x7fb2900b4380 2024-03-08T06:03:17.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.229+0000 7fb286000640 1 -- 172.21.15.19:0/2689310239 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb278011bb0 con 0x7fb2900b4380 2024-03-08T06:03:17.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.229+0000 7fb294a00640 1 -- 172.21.15.19:0/2689310239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29015a0d0 con 0x7fb2900b4380 2024-03-08T06:03:17.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.229+0000 7fb294a00640 1 -- 172.21.15.19:0/2689310239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29015a690 con 0x7fb2900b4380 2024-03-08T06:03:17.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.230+0000 7fb294a00640 1 -- 172.21.15.19:0/2689310239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb290067cb0 con 0x7fb2900b4380 2024-03-08T06:03:17.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.231+0000 7fb286000640 1 -- 172.21.15.19:0/2689310239 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7fb27801c460 con 0x7fb2900b4380 2024-03-08T06:03:17.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.232+0000 7fb286000640 1 --2- 172.21.15.19:0/2689310239 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb26c06b440 0x7fb26c06d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:17.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.232+0000 7fb286000640 1 -- 172.21.15.19:0/2689310239 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb278089bf0 con 0x7fb2900b4380 2024-03-08T06:03:17.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.232+0000 7fb28de00640 1 --2- 172.21.15.19:0/2689310239 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb26c06b440 0x7fb26c06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:17.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.233+0000 7fb28de00640 1 --2- 172.21.15.19:0/2689310239 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb26c06b440 0x7fb26c06d900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb280005880 tx=0x7fb280009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:17.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.236+0000 7fb286000640 1 -- 172.21.15.19:0/2689310239 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb2901f4590 con 0x7fb2900b4380 2024-03-08T06:03:17.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.438+0000 7fb294a00640 1 -- 172.21.15.19:0/2689310239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb29006c550 con 0x7fb2900b4380 2024-03-08T06:03:17.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.439+0000 7fb286000640 1 -- 172.21.15.19:0/2689310239 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb278058e90 con 0x7fb2900b4380 2024-03-08T06:03:17.440 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-08T06:03:17.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.442+0000 7fb294a00640 1 -- 172.21.15.19:0/2689310239 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb26c06b440 msgr2=0x7fb26c06d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:17.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.442+0000 7fb294a00640 1 --2- 172.21.15.19:0/2689310239 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb26c06b440 0x7fb26c06d900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb280005880 tx=0x7fb280009040 comp rx=0 tx=0).stop 2024-03-08T06:03:17.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.442+0000 7fb294a00640 1 -- 172.21.15.19:0/2689310239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2900b4380 msgr2=0x7fb290157b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:17.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.442+0000 7fb294a00640 1 --2- 172.21.15.19:0/2689310239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2900b4380 0x7fb290157b10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb27800c400 tx=0x7fb27800c8c0 comp rx=0 tx=0).stop 2024-03-08T06:03:17.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.442+0000 7fb294a00640 1 -- 172.21.15.19:0/2689310239 shutdown_connections 2024-03-08T06:03:17.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.442+0000 7fb294a00640 1 --2- 172.21.15.19:0/2689310239 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb26c06b440 0x7fb26c06d900 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:17.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.442+0000 7fb294a00640 1 --2- 172.21.15.19:0/2689310239 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb290161850 0x7fb290158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:17.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.442+0000 7fb294a00640 1 --2- 172.21.15.19:0/2689310239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2900b4380 0x7fb290157b10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:17.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.442+0000 7fb294a00640 1 --2- 172.21.15.19:0/2689310239 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb29006ce80 0x7fb2901f4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:17.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.442+0000 7fb294a00640 1 -- 172.21.15.19:0/2689310239 >> 172.21.15.19:0/2689310239 conn(0x7fb2900b36d0 msgr2=0x7fb2900c5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:17.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.442+0000 7fb294a00640 1 -- 172.21.15.19:0/2689310239 shutdown_connections 2024-03-08T06:03:17.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.442+0000 7fb294a00640 1 -- 172.21.15.19:0/2689310239 wait complete. 2024-03-08T06:03:17.461 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-08T06:03:17.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.660+0000 7f5b66600640 1 Processor -- start 2024-03-08T06:03:17.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.660+0000 7f5b66600640 1 -- start start 2024-03-08T06:03:17.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.661+0000 7f5b66600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5b601614f0 0x7f5b600ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:17.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.662+0000 7f5b66600640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b60162a00 con 0x7f5b600d1130 2024-03-08T06:03:17.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.662+0000 7f5b66600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b600d2b90 con 0x7f5b600d3630 2024-03-08T06:03:17.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.662+0000 7f5b66600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b600b6d50 con 0x7f5b601614f0 2024-03-08T06:03:17.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.662+0000 7f5b5fe00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5b600d1130 0x7f5b601622f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35142/0 (socket says 172.21.15.19:35142) 2024-03-08T06:03:17.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.662+0000 7f5b5fe00640 1 -- 172.21.15.19:0/2609361847 learned_addr learned my addr 172.21.15.19:0/2609361847 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.662+0000 7f5b5f400640 1 --2- 172.21.15.19:0/2609361847 >> v2:172.21.15.42:3300/0 conn(0x7f5b601614f0 0x7f5b600ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.662+0000 7f5b5e000640 1 -- 172.21.15.19:0/2609361847 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989840740 0 0) 0x7f5b60162a00 con 0x7f5b600d1130 2024-03-08T06:03:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.663+0000 7f5b5e000640 1 -- 172.21.15.19:0/2609361847 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b44003520 con 0x7f5b600d1130 2024-03-08T06:03:17.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.663+0000 7f5b5e000640 1 -- 172.21.15.19:0/2609361847 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1872939352 0 0) 0x7f5b44003520 con 0x7f5b600d1130 2024-03-08T06:03:17.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.663+0000 7f5b5e000640 1 -- 172.21.15.19:0/2609361847 >> v2:172.21.15.42:3300/0 conn(0x7f5b601614f0 msgr2=0x7f5b600ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:17.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.663+0000 7f5b5e000640 1 --2- 172.21.15.19:0/2609361847 >> v2:172.21.15.42:3300/0 conn(0x7f5b601614f0 0x7f5b600ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:17.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.663+0000 7f5b5e000640 1 -- 172.21.15.19:0/2609361847 >> v1:172.21.15.42:6789/0 conn(0x7f5b600d3630 legacy=0x7f5b60161be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:17.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.663+0000 7f5b5e000640 1 -- 172.21.15.19:0/2609361847 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b600b9820 con 0x7f5b600d1130 2024-03-08T06:03:17.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.663+0000 7f5b5e000640 1 -- 172.21.15.19:0/2609361847 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f5b580019f0 con 0x7f5b600d1130 2024-03-08T06:03:17.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.663+0000 7f5b5e000640 1 -- 172.21.15.19:0/2609361847 >> v1:172.21.15.19:6789/0 conn(0x7f5b600d1130 legacy=0x7f5b601622f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:17.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.663+0000 7f5b5e000640 1 --2- 172.21.15.19:0/2609361847 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b44003a00 0x7f5b44003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:17.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.663+0000 7f5b5e000640 1 --2- 172.21.15.19:0/2609361847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b44004800 0x7f5b44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.663+0000 7f5b5e000640 1 --2- 172.21.15.19:0/2609361847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b440051c0 0x7f5b4400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.663+0000 7f5b5e000640 1 -- 172.21.15.19:0/2609361847 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4400c090 con 0x7f5b440051c0 2024-03-08T06:03:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.663+0000 7f5b5e000640 1 -- 172.21.15.19:0/2609361847 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4400c240 con 0x7f5b44004800 2024-03-08T06:03:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.663+0000 7f5b5e000640 1 -- 172.21.15.19:0/2609361847 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4400c440 con 0x7f5b44003a00 2024-03-08T06:03:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.663+0000 7f5b5fe00640 1 --2- 172.21.15.19:0/2609361847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b440051c0 0x7f5b4400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.664+0000 7f5b5f400640 1 --2- 172.21.15.19:0/2609361847 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b44003a00 0x7f5b44003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.664+0000 7f5b5ea00640 1 --2- 172.21.15.19:0/2609361847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b44004800 0x7f5b44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.664+0000 7f5b5fe00640 1 -- 172.21.15.19:0/2609361847 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b44003a00 msgr2=0x7f5b44003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.664+0000 7f5b5fe00640 1 --2- 172.21.15.19:0/2609361847 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b44003a00 0x7f5b44003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.664+0000 7f5b5fe00640 1 -- 172.21.15.19:0/2609361847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b44004800 msgr2=0x7f5b44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.664+0000 7f5b5fe00640 1 --2- 172.21.15.19:0/2609361847 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b44004800 0x7f5b44004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.664+0000 7f5b5fe00640 1 -- 172.21.15.19:0/2609361847 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b44003520 con 0x7f5b440051c0 2024-03-08T06:03:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.665+0000 7f5b5fe00640 1 -- 172.21.15.19:0/2609361847 reap_dead start 2024-03-08T06:03:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.665+0000 7f5b5fe00640 1 --2- 172.21.15.19:0/2609361847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b440051c0 0x7f5b4400b9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800a7b0 tx=0x7f5b44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbc2eb0e44b78e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.665+0000 7f5b5e000640 1 -- 172.21.15.19:0/2609361847 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5800a3d0 con 0x7f5b440051c0 2024-03-08T06:03:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.665+0000 7f5b5e000640 1 -- 172.21.15.19:0/2609361847 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b58034650 con 0x7f5b440051c0 2024-03-08T06:03:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.665+0000 7f5b5e000640 1 -- 172.21.15.19:0/2609361847 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58034a40 con 0x7f5b440051c0 2024-03-08T06:03:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.666+0000 7f5b66600640 1 -- 172.21.15.19:0/2609361847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b440051c0 msgr2=0x7f5b4400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.666+0000 7f5b66600640 1 --2- 172.21.15.19:0/2609361847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b440051c0 0x7f5b4400b9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800a7b0 tx=0x7f5b44005830 comp rx=0 tx=0).stop 2024-03-08T06:03:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.666+0000 7f5b66600640 1 -- 172.21.15.19:0/2609361847 shutdown_connections 2024-03-08T06:03:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.666+0000 7f5b66600640 1 --2- 172.21.15.19:0/2609361847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b440051c0 0x7f5b4400b9c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:17.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.666+0000 7f5b66600640 1 -- 172.21.15.19:0/2609361847 >> 172.21.15.19:0/2609361847 conn(0x7f5b6006c8f0 msgr2=0x7f5b6006cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:17.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.666+0000 7f5b66600640 1 -- 172.21.15.19:0/2609361847 shutdown_connections 2024-03-08T06:03:17.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.666+0000 7f5b66600640 1 -- 172.21.15.19:0/2609361847 wait complete. 2024-03-08T06:03:17.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.669+0000 7f5b66600640 1 Processor -- start 2024-03-08T06:03:17.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.669+0000 7f5b66600640 1 -- start start 2024-03-08T06:03:17.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.670+0000 7f5b66600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b440051c0 0x7f5b600cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:17.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.670+0000 7f5b66600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b6015e140 0x7f5b6015fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:17.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.670+0000 7f5b66600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b60150fa0 0x7f5b600b7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:17.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.670+0000 7f5b66600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b600b95d0 con 0x7f5b60150fa0 2024-03-08T06:03:17.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.670+0000 7f5b66600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b600d3370 con 0x7f5b440051c0 2024-03-08T06:03:17.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.670+0000 7f5b66600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b600d2ee0 con 0x7f5b6015e140 2024-03-08T06:03:17.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.671+0000 7f5b5fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b60150fa0 0x7f5b600b7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.671+0000 7f5b5fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b60150fa0 0x7f5b600b7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39548/0 (socket says 172.21.15.19:39548) 2024-03-08T06:03:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.671+0000 7f5b5fe00640 1 -- 172.21.15.19:0/1748488613 learned_addr learned my addr 172.21.15.19:0/1748488613 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.671+0000 7f5b5ea00640 1 --2- 172.21.15.19:0/1748488613 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b6015e140 0x7f5b6015fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.671+0000 7f5b5f400640 1 --2- 172.21.15.19:0/1748488613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b440051c0 0x7f5b600cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.671+0000 7f5b5fe00640 1 -- 172.21.15.19:0/1748488613 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b6015e140 msgr2=0x7f5b6015fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.671+0000 7f5b5fe00640 1 --2- 172.21.15.19:0/1748488613 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b6015e140 0x7f5b6015fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.671+0000 7f5b5fe00640 1 -- 172.21.15.19:0/1748488613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b440051c0 msgr2=0x7f5b600cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.671+0000 7f5b5fe00640 1 --2- 172.21.15.19:0/1748488613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b440051c0 0x7f5b600cb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.671+0000 7f5b5fe00640 1 -- 172.21.15.19:0/1748488613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6015d0a0 con 0x7f5b60150fa0 2024-03-08T06:03:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.671+0000 7f5b5fe00640 1 --2- 172.21.15.19:0/1748488613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b60150fa0 0x7f5b600b7200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800a8d0 tx=0x7f5b58001cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.672+0000 7f5b57400640 1 -- 172.21.15.19:0/1748488613 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58039040 con 0x7f5b60150fa0 2024-03-08T06:03:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.672+0000 7f5b57400640 1 -- 172.21.15.19:0/1748488613 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b58043070 con 0x7f5b60150fa0 2024-03-08T06:03:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.672+0000 7f5b57400640 1 -- 172.21.15.19:0/1748488613 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58001930 con 0x7f5b60150fa0 2024-03-08T06:03:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.672+0000 7f5b66600640 1 -- 172.21.15.19:0/1748488613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6015d380 con 0x7f5b60150fa0 2024-03-08T06:03:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.672+0000 7f5b66600640 1 -- 172.21.15.19:0/1748488613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6015d940 con 0x7f5b60150fa0 2024-03-08T06:03:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.673+0000 7f5b66600640 1 -- 172.21.15.19:0/1748488613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b60067cb0 con 0x7f5b60150fa0 2024-03-08T06:03:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.674+0000 7f5b57400640 1 -- 172.21.15.19:0/1748488613 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7f5b58034650 con 0x7f5b60150fa0 2024-03-08T06:03:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.675+0000 7f5b57400640 1 --2- 172.21.15.19:0/1748488613 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5b4006b440 0x7f5b4006d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.675+0000 7f5b57400640 1 -- 172.21.15.19:0/1748488613 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5b580abdb0 con 0x7f5b60150fa0 2024-03-08T06:03:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.675+0000 7f5b5f400640 1 --2- 172.21.15.19:0/1748488613 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5b4006b440 0x7f5b4006d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.676+0000 7f5b5f400640 1 --2- 172.21.15.19:0/1748488613 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5b4006b440 0x7f5b4006d900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5b50009950 tx=0x7f5b50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.679+0000 7f5b57400640 1 -- 172.21.15.19:0/1748488613 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5b58004e20 con 0x7f5b60150fa0 2024-03-08T06:03:17.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.888+0000 7f5b66600640 1 -- 172.21.15.19:0/1748488613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5b600b4000 con 0x7f5b60150fa0 2024-03-08T06:03:17.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.889+0000 7f5b57400640 1 -- 172.21.15.19:0/1748488613 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5b5807b050 con 0x7f5b60150fa0 2024-03-08T06:03:17.890 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:17.890 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-03-08T06:03:17.890 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:03:17.890 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2024-03-08T06:03:17.891 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2024-03-08T06:03:17.891 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:03:17.891 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-03-08T06:03:17.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.892+0000 7f5b66600640 1 -- 172.21.15.19:0/1748488613 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5b4006b440 msgr2=0x7f5b4006d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:17.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.892+0000 7f5b66600640 1 --2- 172.21.15.19:0/1748488613 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5b4006b440 0x7f5b4006d900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5b50009950 tx=0x7f5b50008040 comp rx=0 tx=0).stop 2024-03-08T06:03:17.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.892+0000 7f5b66600640 1 -- 172.21.15.19:0/1748488613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b60150fa0 msgr2=0x7f5b600b7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:17.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.892+0000 7f5b66600640 1 --2- 172.21.15.19:0/1748488613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b60150fa0 0x7f5b600b7200 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800a8d0 tx=0x7f5b58001cf0 comp rx=0 tx=0).stop 2024-03-08T06:03:17.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.892+0000 7f5b66600640 1 -- 172.21.15.19:0/1748488613 shutdown_connections 2024-03-08T06:03:17.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.892+0000 7f5b66600640 1 --2- 172.21.15.19:0/1748488613 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5b4006b440 0x7f5b4006d900 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:17.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.892+0000 7f5b66600640 1 --2- 172.21.15.19:0/1748488613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b60150fa0 0x7f5b600b7200 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:17.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.892+0000 7f5b66600640 1 --2- 172.21.15.19:0/1748488613 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b6015e140 0x7f5b6015fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:17.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.892+0000 7f5b66600640 1 --2- 172.21.15.19:0/1748488613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b440051c0 0x7f5b600cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:17.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.892+0000 7f5b66600640 1 -- 172.21.15.19:0/1748488613 >> 172.21.15.19:0/1748488613 conn(0x7f5b6006c8f0 msgr2=0x7f5b600b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:17.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.892+0000 7f5b66600640 1 -- 172.21.15.19:0/1748488613 shutdown_connections 2024-03-08T06:03:17.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:17.892+0000 7f5b66600640 1 -- 172.21.15.19:0/1748488613 wait complete. 2024-03-08T06:03:17.913 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-08T06:03:17.913 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-08T06:03:18.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.117+0000 7f545b600640 1 Processor -- start 2024-03-08T06:03:18.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.117+0000 7f545b600640 1 -- start start 2024-03-08T06:03:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.119+0000 7f545b600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f54541455b0 0x7f545415c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.119+0000 7f545b600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5454071950 0x7f5454071d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.119+0000 7f545b600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54540cd5a0 con 0x7f54541604f0 2024-03-08T06:03:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.119+0000 7f545b600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54540ccda0 con 0x7f54541455b0 2024-03-08T06:03:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.119+0000 7f545b600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54540cdc20 con 0x7f5454071950 2024-03-08T06:03:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.120+0000 7f5458c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f54541455b0 0x7f545415c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.120+0000 7f5459600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5454071950 0x7f5454071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.120+0000 7f5458c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f54541455b0 0x7f545415c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.19:39954/0 (socket says 172.21.15.19:39954) 2024-03-08T06:03:18.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.120+0000 7f5458c00640 1 -- 172.21.15.19:0/2177544506 learned_addr learned my addr 172.21.15.19:0/2177544506 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:18.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.121+0000 7f5458c00640 1 -- 172.21.15.19:0/2177544506 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5454071950 msgr2=0x7f5454071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:18.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.121+0000 7f5458c00640 1 --2- 172.21.15.19:0/2177544506 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5454071950 0x7f5454071d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:18.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.121+0000 7f5458c00640 1 -- 172.21.15.19:0/2177544506 >> v1:172.21.15.42:6789/0 conn(0x7f54541604f0 legacy=0x7f54540cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:18.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.121+0000 7f5458c00640 1 -- 172.21.15.19:0/2177544506 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54540ccfe0 con 0x7f54541455b0 2024-03-08T06:03:18.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.121+0000 7f5459600640 1 --2- 172.21.15.19:0/2177544506 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5454071950 0x7f5454071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T06:03:18.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.122+0000 7f5458c00640 1 --2- 172.21.15.19:0/2177544506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54541455b0 0x7f545415c1d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5448009870 tx=0x7f544802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b5c8b84c426c7c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:18.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.123+0000 7f5453400640 1 -- 172.21.15.19:0/2177544506 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5448034070 con 0x7f54541455b0 2024-03-08T06:03:18.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.123+0000 7f5453400640 1 -- 172.21.15.19:0/2177544506 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5448030840 con 0x7f54541455b0 2024-03-08T06:03:18.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.123+0000 7f5453400640 1 -- 172.21.15.19:0/2177544506 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5448030c10 con 0x7f54541455b0 2024-03-08T06:03:18.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.123+0000 7f545b600640 1 -- 172.21.15.19:0/2177544506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54541455b0 msgr2=0x7f545415c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:18.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.123+0000 7f545b600640 1 --2- 172.21.15.19:0/2177544506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54541455b0 0x7f545415c1d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5448009870 tx=0x7f544802b980 comp rx=0 tx=0).stop 2024-03-08T06:03:18.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.124+0000 7f545b600640 1 -- 172.21.15.19:0/2177544506 shutdown_connections 2024-03-08T06:03:18.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.124+0000 7f545b600640 1 --2- 172.21.15.19:0/2177544506 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5454071950 0x7f5454071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:18.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.124+0000 7f545b600640 1 --2- 172.21.15.19:0/2177544506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54541455b0 0x7f545415c1d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:18.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.124+0000 7f545b600640 1 -- 172.21.15.19:0/2177544506 >> 172.21.15.19:0/2177544506 conn(0x7f545406ae30 msgr2=0x7f545406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:18.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.124+0000 7f545b600640 1 -- 172.21.15.19:0/2177544506 shutdown_connections 2024-03-08T06:03:18.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.124+0000 7f545b600640 1 -- 172.21.15.19:0/2177544506 wait complete. 2024-03-08T06:03:18.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.125+0000 7f545b600640 1 Processor -- start 2024-03-08T06:03:18.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.126+0000 7f545b600640 1 -- start start 2024-03-08T06:03:18.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.126+0000 7f545b600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5454071950 0x7f545415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:18.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.127+0000 7f545b600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54541455b0 0x7f54540b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:18.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.127+0000 7f545b600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54541604f0 0x7f54540b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:18.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.127+0000 7f545b600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54540cd8b0 con 0x7f5454071950 2024-03-08T06:03:18.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.127+0000 7f545b600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54540722d0 con 0x7f54541604f0 2024-03-08T06:03:18.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.127+0000 7f545b600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545415c710 con 0x7f54541455b0 2024-03-08T06:03:18.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.127+0000 7f5458c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5454071950 0x7f545415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:18.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.127+0000 7f5458c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5454071950 0x7f545415b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39564/0 (socket says 172.21.15.19:39564) 2024-03-08T06:03:18.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.127+0000 7f5458c00640 1 -- 172.21.15.19:0/3208557996 learned_addr learned my addr 172.21.15.19:0/3208557996 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:18.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.127+0000 7f5459600640 1 --2- 172.21.15.19:0/3208557996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54541604f0 0x7f54540b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:18.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.127+0000 7f5453e00640 1 --2- 172.21.15.19:0/3208557996 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54541455b0 0x7f54540b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:18.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.128+0000 7f5458c00640 1 -- 172.21.15.19:0/3208557996 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54541455b0 msgr2=0x7f54540b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:18.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.128+0000 7f5458c00640 1 --2- 172.21.15.19:0/3208557996 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54541455b0 0x7f54540b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:18.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.128+0000 7f5458c00640 1 -- 172.21.15.19:0/3208557996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54541604f0 msgr2=0x7f54540b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:18.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.128+0000 7f5458c00640 1 --2- 172.21.15.19:0/3208557996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54541604f0 0x7f54540b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:18.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.128+0000 7f5458c00640 1 -- 172.21.15.19:0/3208557996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54541f85f0 con 0x7f5454071950 2024-03-08T06:03:18.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.128+0000 7f5458c00640 1 --2- 172.21.15.19:0/3208557996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5454071950 0x7f545415b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5448000c00 tx=0x7f5448004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:18.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.128+0000 7f5450c00640 1 -- 172.21.15.19:0/3208557996 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5448048070 con 0x7f5454071950 2024-03-08T06:03:18.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.128+0000 7f5450c00640 1 -- 172.21.15.19:0/3208557996 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5448030640 con 0x7f5454071950 2024-03-08T06:03:18.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.128+0000 7f5450c00640 1 -- 172.21.15.19:0/3208557996 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5448034040 con 0x7f5454071950 2024-03-08T06:03:18.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.128+0000 7f545b600640 1 -- 172.21.15.19:0/3208557996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54541f7830 con 0x7f5454071950 2024-03-08T06:03:18.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.129+0000 7f545b600640 1 -- 172.21.15.19:0/3208557996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54541f7df0 con 0x7f5454071950 2024-03-08T06:03:18.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.130+0000 7f545b600640 1 -- 172.21.15.19:0/3208557996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5454067cb0 con 0x7f5454071950 2024-03-08T06:03:18.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.130+0000 7f5450c00640 1 -- 172.21.15.19:0/3208557996 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 89724+0+0 (secure 0 0 0) 0x7f5448037070 con 0x7f5454071950 2024-03-08T06:03:18.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.131+0000 7f5450c00640 1 --2- 172.21.15.19:0/3208557996 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f543406b440 0x7f543406d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:18.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.131+0000 7f5450c00640 1 -- 172.21.15.19:0/3208557996 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f54480ab980 con 0x7f5454071950 2024-03-08T06:03:18.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.132+0000 7f5453e00640 1 --2- 172.21.15.19:0/3208557996 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f543406b440 0x7f543406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:18.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.132+0000 7f5453e00640 1 --2- 172.21.15.19:0/3208557996 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f543406b440 0x7f543406d900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5440007fd0 tx=0x7f5440009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:18.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.136+0000 7f5450c00640 1 -- 172.21.15.19:0/3208557996 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f544807ad40 con 0x7f5454071950 2024-03-08T06:03:18.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.337+0000 7f545b600640 1 -- 172.21.15.19:0/3208557996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f54540729c0 con 0x7f5454071950 2024-03-08T06:03:18.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.853+0000 7f5450c00640 1 -- 172.21.15.19:0/3208557996 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f544807a640 con 0x7f5454071950 2024-03-08T06:03:18.854 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2024-03-08T06:03:18.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.857+0000 7f545b600640 1 -- 172.21.15.19:0/3208557996 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f543406b440 msgr2=0x7f543406d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:18.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.857+0000 7f545b600640 1 --2- 172.21.15.19:0/3208557996 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f543406b440 0x7f543406d900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5440007fd0 tx=0x7f5440009040 comp rx=0 tx=0).stop 2024-03-08T06:03:18.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.857+0000 7f545b600640 1 -- 172.21.15.19:0/3208557996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5454071950 msgr2=0x7f545415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:18.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.857+0000 7f545b600640 1 --2- 172.21.15.19:0/3208557996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5454071950 0x7f545415b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5448000c00 tx=0x7f5448004730 comp rx=0 tx=0).stop 2024-03-08T06:03:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.858+0000 7f545b600640 1 -- 172.21.15.19:0/3208557996 shutdown_connections 2024-03-08T06:03:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.858+0000 7f545b600640 1 --2- 172.21.15.19:0/3208557996 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f543406b440 0x7f543406d900 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.858+0000 7f545b600640 1 --2- 172.21.15.19:0/3208557996 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54541604f0 0x7f54540b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.858+0000 7f545b600640 1 --2- 172.21.15.19:0/3208557996 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54541455b0 0x7f54540b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.858+0000 7f545b600640 1 --2- 172.21.15.19:0/3208557996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5454071950 0x7f545415b0a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.858+0000 7f545b600640 1 -- 172.21.15.19:0/3208557996 >> 172.21.15.19:0/3208557996 conn(0x7f545406ae30 msgr2=0x7f54540b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.858+0000 7f545b600640 1 -- 172.21.15.19:0/3208557996 shutdown_connections 2024-03-08T06:03:18.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:18.859+0000 7f545b600640 1 -- 172.21.15.19:0/3208557996 wait complete. 2024-03-08T06:03:18.889 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-08T06:03:19.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.090+0000 7f95ee600640 1 Processor -- start 2024-03-08T06:03:19.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.091+0000 7f95ee600640 1 -- start start 2024-03-08T06:03:19.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.092+0000 7f95ee600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f95e815ed20 0x7f95e8168e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:19.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.092+0000 7f95ee600640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e815f390 con 0x7f95e81584a0 2024-03-08T06:03:19.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.093+0000 7f95ee600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e806d820 con 0x7f95e8072060 2024-03-08T06:03:19.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.093+0000 7f95ee600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e806db00 con 0x7f95e815ed20 2024-03-08T06:03:19.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.093+0000 7f95e7400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f95e81584a0 0x7f95e8071950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35146/0 (socket says 172.21.15.19:35146) 2024-03-08T06:03:19.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.093+0000 7f95e7400640 1 -- 172.21.15.19:0/2648177425 learned_addr learned my addr 172.21.15.19:0/2648177425 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:19.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.093+0000 7f95e7e00640 1 --2- 172.21.15.19:0/2648177425 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f95e815ed20 0x7f95e8168e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:19.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.093+0000 7f95e6000640 1 -- 172.21.15.19:0/2648177425 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1634582354 0 0) 0x7f95e815f390 con 0x7f95e81584a0 2024-03-08T06:03:19.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.094+0000 7f95e6000640 1 -- 172.21.15.19:0/2648177425 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95cc003520 con 0x7f95e81584a0 2024-03-08T06:03:19.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.094+0000 7f95e6000640 1 -- 172.21.15.19:0/2648177425 <== mon.1 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235708813 0 0) 0x7f95e806d820 con 0x7f95e8072060 2024-03-08T06:03:19.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.094+0000 7f95e6000640 1 -- 172.21.15.19:0/2648177425 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95e815f390 con 0x7f95e8072060 2024-03-08T06:03:19.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.094+0000 7f95e6000640 1 -- 172.21.15.19:0/2648177425 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1303033596 0 0) 0x7f95cc003520 con 0x7f95e81584a0 2024-03-08T06:03:19.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.094+0000 7f95e6000640 1 -- 172.21.15.19:0/2648177425 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f95e815ed20 msgr2=0x7f95e8168e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.094+0000 7f95e6000640 1 --2- 172.21.15.19:0/2648177425 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f95e815ed20 0x7f95e8168e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.094+0000 7f95e6000640 1 -- 172.21.15.19:0/2648177425 >> v1:172.21.15.42:6789/0 conn(0x7f95e8072060 legacy=0x7f95e815e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.094+0000 7f95e6000640 1 -- 172.21.15.19:0/2648177425 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e806dde0 con 0x7f95e81584a0 2024-03-08T06:03:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.094+0000 7f95e6000640 1 -- 172.21.15.19:0/2648177425 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f95d80019f0 con 0x7f95e81584a0 2024-03-08T06:03:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.094+0000 7f95e6000640 1 -- 172.21.15.19:0/2648177425 >> v1:172.21.15.19:6789/0 conn(0x7f95e81584a0 legacy=0x7f95e8071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.094+0000 7f95e6000640 1 --2- 172.21.15.19:0/2648177425 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f95e815ed20 0x7f95cc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.094+0000 7f95e6000640 1 --2- 172.21.15.19:0/2648177425 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95cc0040d0 0x7f95cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.094+0000 7f95e6000640 1 --2- 172.21.15.19:0/2648177425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95cc004d40 0x7f95cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.094+0000 7f95e6000640 1 -- 172.21.15.19:0/2648177425 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e806db00 con 0x7f95cc0040d0 2024-03-08T06:03:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.094+0000 7f95e6000640 1 -- 172.21.15.19:0/2648177425 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc00bb50 con 0x7f95cc004d40 2024-03-08T06:03:19.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.094+0000 7f95e6000640 1 -- 172.21.15.19:0/2648177425 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc00bd20 con 0x7f95e815ed20 2024-03-08T06:03:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.094+0000 7f95e6a00640 1 --2- 172.21.15.19:0/2648177425 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95cc0040d0 0x7f95cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.095+0000 7f95e7e00640 1 --2- 172.21.15.19:0/2648177425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95cc004d40 0x7f95cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.095+0000 7f95e7400640 1 --2- 172.21.15.19:0/2648177425 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f95e815ed20 0x7f95cc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.095+0000 7f95e6a00640 1 -- 172.21.15.19:0/2648177425 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f95e815ed20 msgr2=0x7f95cc003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.095+0000 7f95e6a00640 1 --2- 172.21.15.19:0/2648177425 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f95e815ed20 0x7f95cc003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.095+0000 7f95e6a00640 1 -- 172.21.15.19:0/2648177425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95cc004d40 msgr2=0x7f95cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.095+0000 7f95e6a00640 1 --2- 172.21.15.19:0/2648177425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95cc004d40 0x7f95cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.095+0000 7f95e6a00640 1 -- 172.21.15.19:0/2648177425 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc003520 con 0x7f95cc0040d0 2024-03-08T06:03:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.096+0000 7f95e6a00640 1 --2- 172.21.15.19:0/2648177425 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95cc0040d0 0x7f95cc004800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f95e806f900 tx=0x7f95cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eceeb741a4cb429a server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.096+0000 7f95e6000640 1 -- 172.21.15.19:0/2648177425 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d4037070 con 0x7f95cc0040d0 2024-03-08T06:03:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.096+0000 7f95e6000640 1 -- 172.21.15.19:0/2648177425 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d40052d0 con 0x7f95cc0040d0 2024-03-08T06:03:19.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.096+0000 7f95e6000640 1 -- 172.21.15.19:0/2648177425 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d40014f0 con 0x7f95cc0040d0 2024-03-08T06:03:19.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.097+0000 7f95ee600640 1 -- 172.21.15.19:0/2648177425 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95cc0040d0 msgr2=0x7f95cc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:19.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.097+0000 7f95ee600640 1 --2- 172.21.15.19:0/2648177425 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95cc0040d0 0x7f95cc004800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f95e806f900 tx=0x7f95cc005830 comp rx=0 tx=0).stop 2024-03-08T06:03:19.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.097+0000 7f95e7e00640 1 -- 172.21.15.19:0/2648177425 reap_dead start 2024-03-08T06:03:19.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.097+0000 7f95ee600640 1 -- 172.21.15.19:0/2648177425 shutdown_connections 2024-03-08T06:03:19.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.097+0000 7f95ee600640 1 -- 172.21.15.19:0/2648177425 >> 172.21.15.19:0/2648177425 conn(0x7f95e806ae30 msgr2=0x7f95e806b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:19.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.097+0000 7f95ee600640 1 -- 172.21.15.19:0/2648177425 shutdown_connections 2024-03-08T06:03:19.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.097+0000 7f95ee600640 1 -- 172.21.15.19:0/2648177425 wait complete. 2024-03-08T06:03:19.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.099+0000 7f95ee600640 1 Processor -- start 2024-03-08T06:03:19.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.099+0000 7f95ee600640 1 -- start start 2024-03-08T06:03:19.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.100+0000 7f95ee600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95cc0040d0 0x7f95e80cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:19.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.100+0000 7f95ee600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f95e80af820 0x7f95e813b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:19.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.100+0000 7f95ee600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95e8160930 0x7f95e8160de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:19.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.100+0000 7f95ee600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e806e5e0 con 0x7f95cc0040d0 2024-03-08T06:03:19.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.100+0000 7f95ee600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e8158880 con 0x7f95e8160930 2024-03-08T06:03:19.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.100+0000 7f95ee600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e80cdec0 con 0x7f95e80af820 2024-03-08T06:03:19.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.100+0000 7f95e7400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95cc0040d0 0x7f95e80cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:19.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.100+0000 7f95e7400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95cc0040d0 0x7f95e80cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39590/0 (socket says 172.21.15.19:39590) 2024-03-08T06:03:19.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.100+0000 7f95e7400640 1 -- 172.21.15.19:0/2914249751 learned_addr learned my addr 172.21.15.19:0/2914249751 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:19.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.101+0000 7f95e7e00640 1 --2- 172.21.15.19:0/2914249751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95e8160930 0x7f95e8160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:19.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.101+0000 7f95e7400640 1 -- 172.21.15.19:0/2914249751 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f95e80af820 msgr2=0x7f95e813b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:19.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.101+0000 7f95e7400640 1 --2- 172.21.15.19:0/2914249751 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f95e80af820 0x7f95e813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:19.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.101+0000 7f95e7400640 1 -- 172.21.15.19:0/2914249751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95e8160930 msgr2=0x7f95e8160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:19.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.101+0000 7f95e7400640 1 --2- 172.21.15.19:0/2914249751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95e8160930 0x7f95e8160de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:19.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.101+0000 7f95e7400640 1 -- 172.21.15.19:0/2914249751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e80ce1a0 con 0x7f95cc0040d0 2024-03-08T06:03:19.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.101+0000 7f95e7400640 1 --2- 172.21.15.19:0/2914249751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95cc0040d0 0x7f95e80cd690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f95d80012e0 tx=0x7f95d800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:19.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.101+0000 7f95df400640 1 -- 172.21.15.19:0/2914249751 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d800ee50 con 0x7f95cc0040d0 2024-03-08T06:03:19.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.101+0000 7f95df400640 1 -- 172.21.15.19:0/2914249751 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d8018070 con 0x7f95cc0040d0 2024-03-08T06:03:19.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.101+0000 7f95ee600640 1 -- 172.21.15.19:0/2914249751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e80ce480 con 0x7f95cc0040d0 2024-03-08T06:03:19.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.101+0000 7f95df400640 1 -- 172.21.15.19:0/2914249751 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8013660 con 0x7f95cc0040d0 2024-03-08T06:03:19.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.102+0000 7f95ee600640 1 -- 172.21.15.19:0/2914249751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e80cea40 con 0x7f95cc0040d0 2024-03-08T06:03:19.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.103+0000 7f95ee600640 1 -- 172.21.15.19:0/2914249751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e8067cb0 con 0x7f95cc0040d0 2024-03-08T06:03:19.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.104+0000 7f95df400640 1 -- 172.21.15.19:0/2914249751 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f95d8013800 con 0x7f95cc0040d0 2024-03-08T06:03:19.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.104+0000 7f95df400640 1 --2- 172.21.15.19:0/2914249751 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f95c806b670 0x7f95c806db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:19.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.105+0000 7f95df400640 1 -- 172.21.15.19:0/2914249751 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f95d808a6c0 con 0x7f95cc0040d0 2024-03-08T06:03:19.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.105+0000 7f95e6a00640 1 --2- 172.21.15.19:0/2914249751 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f95c806b670 0x7f95c806db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:19.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.105+0000 7f95e6a00640 1 --2- 172.21.15.19:0/2914249751 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f95c806b670 0x7f95c806db30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f95d4034000 tx=0x7f95d4009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:19.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.109+0000 7f95df400640 1 -- 172.21.15.19:0/2914249751 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f95d8059710 con 0x7f95cc0040d0 2024-03-08T06:03:19.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:19.310+0000 7f95ee600640 1 -- 172.21.15.19:0/2914249751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f95e806f280 con 0x7f95cc0040d0 2024-03-08T06:03:20.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.031+0000 7f95df400640 1 -- 172.21.15.19:0/2914249751 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f95d8059010 con 0x7f95cc0040d0 2024-03-08T06:03:20.032 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2024-03-08T06:03:20.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.035+0000 7f95ee600640 1 -- 172.21.15.19:0/2914249751 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f95c806b670 msgr2=0x7f95c806db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:20.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.035+0000 7f95ee600640 1 --2- 172.21.15.19:0/2914249751 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f95c806b670 0x7f95c806db30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f95d4034000 tx=0x7f95d4009030 comp rx=0 tx=0).stop 2024-03-08T06:03:20.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.035+0000 7f95ee600640 1 -- 172.21.15.19:0/2914249751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95cc0040d0 msgr2=0x7f95e80cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:20.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.035+0000 7f95ee600640 1 --2- 172.21.15.19:0/2914249751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95cc0040d0 0x7f95e80cd690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f95d80012e0 tx=0x7f95d800e530 comp rx=0 tx=0).stop 2024-03-08T06:03:20.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.036+0000 7f95ee600640 1 -- 172.21.15.19:0/2914249751 shutdown_connections 2024-03-08T06:03:20.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.036+0000 7f95ee600640 1 --2- 172.21.15.19:0/2914249751 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f95c806b670 0x7f95c806db30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:20.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.036+0000 7f95ee600640 1 --2- 172.21.15.19:0/2914249751 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f95e8160930 0x7f95e8160de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:20.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.036+0000 7f95ee600640 1 --2- 172.21.15.19:0/2914249751 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f95e80af820 0x7f95e813b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:20.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.036+0000 7f95ee600640 1 --2- 172.21.15.19:0/2914249751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95cc0040d0 0x7f95e80cd690 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:20.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.036+0000 7f95ee600640 1 -- 172.21.15.19:0/2914249751 >> 172.21.15.19:0/2914249751 conn(0x7f95e806ae30 msgr2=0x7f95e80ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:20.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.040+0000 7f95ee600640 1 -- 172.21.15.19:0/2914249751 shutdown_connections 2024-03-08T06:03:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.044+0000 7f95ee600640 1 -- 172.21.15.19:0/2914249751 wait complete. 2024-03-08T06:03:20.085 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-08T06:03:20.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.271+0000 7f40c2c00640 1 Processor -- start 2024-03-08T06:03:20.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.272+0000 7f40c2c00640 1 -- start start 2024-03-08T06:03:20.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.273+0000 7f40c2c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f40bc15bcc0 0x7f40bc0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:20.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.273+0000 7f40c2c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f40bc15c0a0 0x7f40bc0d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:20.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.273+0000 7f40c2c00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40bc0cf9d0 con 0x7f40bc0cc6c0 2024-03-08T06:03:20.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.273+0000 7f40c2c00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40bc0ccc50 con 0x7f40bc15bcc0 2024-03-08T06:03:20.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.273+0000 7f40c2c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc0ccf30 con 0x7f40bc15c0a0 2024-03-08T06:03:20.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.274+0000 7f40bb400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f40bc15c0a0 0x7f40bc0d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:20.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.274+0000 7f40c0c00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f40bc0cc6c0 0x7f40bc099e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.19:57670/0 (socket says 172.21.15.19:57670) 2024-03-08T06:03:20.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.274+0000 7f40c0c00640 1 -- 172.21.15.19:0/634029380 learned_addr learned my addr 172.21.15.19:0/634029380 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:20.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.275+0000 7f40bbe00640 1 --2- 172.21.15.19:0/634029380 >> v2:172.21.15.42:3300/0 conn(0x7f40bc15bcc0 0x7f40bc0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:20.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.275+0000 7f40baa00640 1 -- 172.21.15.19:0/634029380 <== mon.1 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766196966 0 0) 0x7f40bc0cf9d0 con 0x7f40bc0cc6c0 2024-03-08T06:03:20.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.275+0000 7f40baa00640 1 -- 172.21.15.19:0/634029380 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40a0003520 con 0x7f40bc0cc6c0 2024-03-08T06:03:20.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.275+0000 7f40bb400640 1 -- 172.21.15.19:0/634029380 >> v2:172.21.15.42:3300/0 conn(0x7f40bc15bcc0 msgr2=0x7f40bc0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:20.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.275+0000 7f40bb400640 1 --2- 172.21.15.19:0/634029380 >> v2:172.21.15.42:3300/0 conn(0x7f40bc15bcc0 0x7f40bc0cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:20.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.275+0000 7f40bb400640 1 -- 172.21.15.19:0/634029380 >> v1:172.21.15.42:6789/0 conn(0x7f40bc0cc6c0 legacy=0x7f40bc099e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:20.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.275+0000 7f40bb400640 1 -- 172.21.15.19:0/634029380 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc0cd210 con 0x7f40bc15c0a0 2024-03-08T06:03:20.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.277+0000 7f40bb400640 1 --2- 172.21.15.19:0/634029380 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f40bc15c0a0 0x7f40bc0d0630 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f40a80097a0 tx=0x7f40a802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d314c6f8a5d61656 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:20.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.277+0000 7f40baa00640 1 -- 172.21.15.19:0/634029380 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8035020 con 0x7f40bc15c0a0 2024-03-08T06:03:20.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.277+0000 7f40baa00640 1 -- 172.21.15.19:0/634029380 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a8031830 con 0x7f40bc15c0a0 2024-03-08T06:03:20.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.277+0000 7f40baa00640 1 -- 172.21.15.19:0/634029380 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8031c00 con 0x7f40bc15c0a0 2024-03-08T06:03:20.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.278+0000 7f40c2c00640 1 -- 172.21.15.19:0/634029380 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f40bc15c0a0 msgr2=0x7f40bc0d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:20.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.278+0000 7f40c2c00640 1 --2- 172.21.15.19:0/634029380 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f40bc15c0a0 0x7f40bc0d0630 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f40a80097a0 tx=0x7f40a802b8d0 comp rx=0 tx=0).stop 2024-03-08T06:03:20.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.278+0000 7f40c2c00640 1 -- 172.21.15.19:0/634029380 shutdown_connections 2024-03-08T06:03:20.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.278+0000 7f40c2c00640 1 --2- 172.21.15.19:0/634029380 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f40bc15c0a0 0x7f40bc0d0630 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:20.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.278+0000 7f40c2c00640 1 --2- 172.21.15.19:0/634029380 >> v2:172.21.15.42:3300/0 conn(0x7f40bc15bcc0 0x7f40bc0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:20.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.278+0000 7f40c2c00640 1 -- 172.21.15.19:0/634029380 >> 172.21.15.19:0/634029380 conn(0x7f40bc0b3630 msgr2=0x7f40bc0b3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:20.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.278+0000 7f40c2c00640 1 -- 172.21.15.19:0/634029380 shutdown_connections 2024-03-08T06:03:20.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.278+0000 7f40c2c00640 1 -- 172.21.15.19:0/634029380 wait complete. 2024-03-08T06:03:20.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.280+0000 7f40c2c00640 1 Processor -- start 2024-03-08T06:03:20.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.280+0000 7f40c2c00640 1 -- start start 2024-03-08T06:03:20.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.281+0000 7f40c2c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f40bc0cc6c0 0x7f40bc0b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:20.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.281+0000 7f40c2c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40bc15bcc0 0x7f40bc0c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:20.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.281+0000 7f40c2c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40bc15c0a0 0x7f40bc0709b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:20.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.281+0000 7f40c2c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc0d0b70 con 0x7f40bc15bcc0 2024-03-08T06:03:20.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.281+0000 7f40c2c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc0cd7d0 con 0x7f40bc15c0a0 2024-03-08T06:03:20.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.281+0000 7f40c2c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc09a530 con 0x7f40bc0cc6c0 2024-03-08T06:03:20.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.281+0000 7f40bb400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40bc15bcc0 0x7f40bc0c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:20.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.281+0000 7f40bb400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40bc15bcc0 0x7f40bc0c9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39606/0 (socket says 172.21.15.19:39606) 2024-03-08T06:03:20.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.281+0000 7f40bb400640 1 -- 172.21.15.19:0/858916022 learned_addr learned my addr 172.21.15.19:0/858916022 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:20.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.282+0000 7f40c0c00640 1 --2- 172.21.15.19:0/858916022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40bc15c0a0 0x7f40bc0709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:20.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.282+0000 7f40bbe00640 1 --2- 172.21.15.19:0/858916022 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f40bc0cc6c0 0x7f40bc0b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:20.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.282+0000 7f40bb400640 1 -- 172.21.15.19:0/858916022 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f40bc0cc6c0 msgr2=0x7f40bc0b6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:20.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.282+0000 7f40bb400640 1 --2- 172.21.15.19:0/858916022 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f40bc0cc6c0 0x7f40bc0b6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:20.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.282+0000 7f40bb400640 1 -- 172.21.15.19:0/858916022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40bc15c0a0 msgr2=0x7f40bc0709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:20.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.282+0000 7f40bb400640 1 --2- 172.21.15.19:0/858916022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40bc15c0a0 0x7f40bc0709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:20.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.282+0000 7f40bb400640 1 -- 172.21.15.19:0/858916022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc1f7e90 con 0x7f40bc15bcc0 2024-03-08T06:03:20.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.282+0000 7f40bb400640 1 --2- 172.21.15.19:0/858916022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40bc15bcc0 0x7f40bc0c9900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f40a8034040 tx=0x7f40a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:20.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.282+0000 7f40b3e00640 1 -- 172.21.15.19:0/858916022 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8040070 con 0x7f40bc15bcc0 2024-03-08T06:03:20.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.282+0000 7f40b3e00640 1 -- 172.21.15.19:0/858916022 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a803a910 con 0x7f40bc15bcc0 2024-03-08T06:03:20.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.282+0000 7f40b3e00640 1 -- 172.21.15.19:0/858916022 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8035040 con 0x7f40bc15bcc0 2024-03-08T06:03:20.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.282+0000 7f40c2c00640 1 -- 172.21.15.19:0/858916022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40bc0c8e20 con 0x7f40bc15bcc0 2024-03-08T06:03:20.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.283+0000 7f40c2c00640 1 -- 172.21.15.19:0/858916022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40bc0c93e0 con 0x7f40bc15bcc0 2024-03-08T06:03:20.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.284+0000 7f40c2c00640 1 -- 172.21.15.19:0/858916022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40bc0683c0 con 0x7f40bc15bcc0 2024-03-08T06:03:20.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.285+0000 7f40b3e00640 1 -- 172.21.15.19:0/858916022 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f40a8038020 con 0x7f40bc15bcc0 2024-03-08T06:03:20.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.285+0000 7f40b3e00640 1 --2- 172.21.15.19:0/858916022 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f409c06b4d0 0x7f409c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:20.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.286+0000 7f40b3e00640 1 -- 172.21.15.19:0/858916022 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f40a80ab9d0 con 0x7f40bc15bcc0 2024-03-08T06:03:20.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.286+0000 7f40bbe00640 1 --2- 172.21.15.19:0/858916022 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f409c06b4d0 0x7f409c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:20.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.286+0000 7f40bbe00640 1 --2- 172.21.15.19:0/858916022 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f409c06b4d0 0x7f409c06d990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0074a0 tx=0x7f40ac00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:20.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.291+0000 7f40b3e00640 1 -- 172.21.15.19:0/858916022 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f40a807a8b0 con 0x7f40bc15bcc0 2024-03-08T06:03:20.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:20.529+0000 7f40c2c00640 1 -- 172.21.15.19:0/858916022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f40bc071790 con 0x7f40bc15bcc0 2024-03-08T06:03:21.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.071+0000 7f40b3e00640 1 -- 172.21.15.19:0/858916022 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f40a807a1b0 con 0x7f40bc15bcc0 2024-03-08T06:03:21.076 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 2 and data pool 3 2024-03-08T06:03:21.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.078+0000 7f40c2c00640 1 -- 172.21.15.19:0/858916022 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f409c06b4d0 msgr2=0x7f409c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:21.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.078+0000 7f40c2c00640 1 --2- 172.21.15.19:0/858916022 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f409c06b4d0 0x7f409c06d990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0074a0 tx=0x7f40ac00b040 comp rx=0 tx=0).stop 2024-03-08T06:03:21.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.078+0000 7f40c2c00640 1 -- 172.21.15.19:0/858916022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40bc15bcc0 msgr2=0x7f40bc0c9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:21.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.078+0000 7f40c2c00640 1 --2- 172.21.15.19:0/858916022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40bc15bcc0 0x7f40bc0c9900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f40a8034040 tx=0x7f40a80046c0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.078+0000 7f40c2c00640 1 -- 172.21.15.19:0/858916022 shutdown_connections 2024-03-08T06:03:21.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.078+0000 7f40c2c00640 1 --2- 172.21.15.19:0/858916022 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f409c06b4d0 0x7f409c06d990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.078+0000 7f40c2c00640 1 --2- 172.21.15.19:0/858916022 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f40bc15c0a0 0x7f40bc0709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.078+0000 7f40c2c00640 1 --2- 172.21.15.19:0/858916022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40bc15bcc0 0x7f40bc0c9900 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.078+0000 7f40c2c00640 1 --2- 172.21.15.19:0/858916022 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f40bc0cc6c0 0x7f40bc0b6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.078+0000 7f40c2c00640 1 -- 172.21.15.19:0/858916022 >> 172.21.15.19:0/858916022 conn(0x7f40bc0b3630 msgr2=0x7f40bc0744a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:21.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.079+0000 7f40c2c00640 1 -- 172.21.15.19:0/858916022 shutdown_connections 2024-03-08T06:03:21.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.079+0000 7f40c2c00640 1 -- 172.21.15.19:0/858916022 wait complete. 2024-03-08T06:03:21.118 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:03:21.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.296+0000 7f2808a00640 1 Processor -- start 2024-03-08T06:03:21.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.296+0000 7f2808a00640 1 -- start start 2024-03-08T06:03:21.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.297+0000 7f2808a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f280406d600 0x7f2804144d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:21.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.297+0000 7f2808a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2804071e90 0x7f28041452a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:21.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.298+0000 7f2808a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280406da80 con 0x7f2804071ab0 2024-03-08T06:03:21.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.298+0000 7f2808a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280406ef40 con 0x7f280406d600 2024-03-08T06:03:21.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.298+0000 7f2808a00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28041457e0 con 0x7f2804071e90 2024-03-08T06:03:21.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.298+0000 7f2801400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f280406d600 0x7f2804144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:21.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.298+0000 7f2801400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f280406d600 0x7f2804144d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39610/0 (socket says 172.21.15.19:39610) 2024-03-08T06:03:21.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.298+0000 7f2801400640 1 -- 172.21.15.19:0/512854366 learned_addr learned my addr 172.21.15.19:0/512854366 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:21.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.298+0000 7f2801e00640 1 --1- 172.21.15.19:0/512854366 >> v1:172.21.15.19:6789/0 conn(0x7f2804071ab0 0x7f280415cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35150/0 (socket says 172.21.15.19:35150) 2024-03-08T06:03:21.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.298+0000 7f2802800640 1 --2- 172.21.15.19:0/512854366 >> v2:172.21.15.42:3300/0 conn(0x7f2804071e90 0x7f28041452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:21.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.299+0000 7f2801400640 1 -- 172.21.15.19:0/512854366 >> v2:172.21.15.42:3300/0 conn(0x7f2804071e90 msgr2=0x7f28041452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:21.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.299+0000 7f2801400640 1 --2- 172.21.15.19:0/512854366 >> v2:172.21.15.42:3300/0 conn(0x7f2804071e90 0x7f28041452a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.299+0000 7f2801400640 1 -- 172.21.15.19:0/512854366 >> v1:172.21.15.19:6789/0 conn(0x7f2804071ab0 legacy=0x7f280415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:21.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.299+0000 7f2801400640 1 -- 172.21.15.19:0/512854366 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280406dd60 con 0x7f280406d600 2024-03-08T06:03:21.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.299+0000 7f2800a00640 1 -- 172.21.15.19:0/512854366 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048203061 0 0) 0x7f280406da80 con 0x7f2804071ab0 2024-03-08T06:03:21.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.300+0000 7f2801400640 1 --2- 172.21.15.19:0/512854366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280406d600 0x7f2804144d60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f28040cf2e0 tx=0x7f27f002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef5a22dc5012bf4 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:21.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.300+0000 7f2800a00640 1 -- 172.21.15.19:0/512854366 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0034070 con 0x7f280406d600 2024-03-08T06:03:21.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.300+0000 7f2800a00640 1 -- 172.21.15.19:0/512854366 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f0030860 con 0x7f280406d600 2024-03-08T06:03:21.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.300+0000 7f2800a00640 1 -- 172.21.15.19:0/512854366 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0030c30 con 0x7f280406d600 2024-03-08T06:03:21.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.301+0000 7f2808a00640 1 -- 172.21.15.19:0/512854366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280406d600 msgr2=0x7f2804144d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:21.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.301+0000 7f2808a00640 1 --2- 172.21.15.19:0/512854366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280406d600 0x7f2804144d60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f28040cf2e0 tx=0x7f27f002b9a0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.301+0000 7f2808a00640 1 -- 172.21.15.19:0/512854366 shutdown_connections 2024-03-08T06:03:21.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.301+0000 7f2808a00640 1 --2- 172.21.15.19:0/512854366 >> v2:172.21.15.42:3300/0 conn(0x7f2804071e90 0x7f28041452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.301+0000 7f2808a00640 1 --2- 172.21.15.19:0/512854366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280406d600 0x7f2804144d60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.301+0000 7f2808a00640 1 -- 172.21.15.19:0/512854366 >> 172.21.15.19:0/512854366 conn(0x7f280406ae30 msgr2=0x7f280406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:21.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.301+0000 7f2808a00640 1 -- 172.21.15.19:0/512854366 shutdown_connections 2024-03-08T06:03:21.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.301+0000 7f2808a00640 1 -- 172.21.15.19:0/512854366 wait complete. 2024-03-08T06:03:21.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.303+0000 7f2808a00640 1 Processor -- start 2024-03-08T06:03:21.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.303+0000 7f2808a00640 1 -- start start 2024-03-08T06:03:21.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.304+0000 7f2808a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280406d600 0x7f280413d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:21.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.304+0000 7f2808a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2804071ab0 0x7f280415e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:21.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.304+0000 7f2808a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2804071e90 0x7f28040b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:21.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.304+0000 7f2808a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280406e600 con 0x7f280406d600 2024-03-08T06:03:21.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.304+0000 7f2808a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280406e100 con 0x7f2804071ab0 2024-03-08T06:03:21.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.304+0000 7f2808a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280415d3a0 con 0x7f2804071e90 2024-03-08T06:03:21.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.304+0000 7f2801e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280406d600 0x7f280413d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:21.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.304+0000 7f2801e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280406d600 0x7f280413d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39618/0 (socket says 172.21.15.19:39618) 2024-03-08T06:03:21.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.304+0000 7f2801e00640 1 -- 172.21.15.19:0/2372439745 learned_addr learned my addr 172.21.15.19:0/2372439745 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:21.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.304+0000 7f2801400640 1 --2- 172.21.15.19:0/2372439745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2804071ab0 0x7f280415e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:21.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.304+0000 7f2801e00640 1 -- 172.21.15.19:0/2372439745 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2804071e90 msgr2=0x7f28040b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:21.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.304+0000 7f2801e00640 1 --2- 172.21.15.19:0/2372439745 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2804071e90 0x7f28040b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.304+0000 7f2801e00640 1 -- 172.21.15.19:0/2372439745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2804071ab0 msgr2=0x7f280415e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:21.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.304+0000 7f2801e00640 1 --2- 172.21.15.19:0/2372439745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2804071ab0 0x7f280415e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.304+0000 7f2801e00640 1 -- 172.21.15.19:0/2372439745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28040b4510 con 0x7f280406d600 2024-03-08T06:03:21.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.305+0000 7f2801e00640 1 --2- 172.21.15.19:0/2372439745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280406d600 0x7f280413d430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00c890 tx=0x7f27fc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:21.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.305+0000 7f27fa000640 1 -- 172.21.15.19:0/2372439745 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc018070 con 0x7f280406d600 2024-03-08T06:03:21.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.305+0000 7f27fa000640 1 -- 172.21.15.19:0/2372439745 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc00a640 con 0x7f280406d600 2024-03-08T06:03:21.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.305+0000 7f2808a00640 1 -- 172.21.15.19:0/2372439745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28040b47f0 con 0x7f280406d600 2024-03-08T06:03:21.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.305+0000 7f27fa000640 1 -- 172.21.15.19:0/2372439745 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00aa30 con 0x7f280406d600 2024-03-08T06:03:21.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.305+0000 7f2808a00640 1 -- 172.21.15.19:0/2372439745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28040b2e80 con 0x7f280406d600 2024-03-08T06:03:21.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.306+0000 7f2808a00640 1 -- 172.21.15.19:0/2372439745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2804067cb0 con 0x7f280406d600 2024-03-08T06:03:21.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.307+0000 7f27fa000640 1 -- 172.21.15.19:0/2372439745 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f27fc01b070 con 0x7f280406d600 2024-03-08T06:03:21.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.309+0000 7f27fa000640 1 --2- 172.21.15.19:0/2372439745 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f27e406b4d0 0x7f27e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:21.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.309+0000 7f27fa000640 1 -- 172.21.15.19:0/2372439745 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27fc089900 con 0x7f280406d600 2024-03-08T06:03:21.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.309+0000 7f2801400640 1 --2- 172.21.15.19:0/2372439745 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f27e406b4d0 0x7f27e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:21.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.310+0000 7f2801400640 1 --2- 172.21.15.19:0/2372439745 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f27e406b4d0 0x7f27e406d990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f27f0036000 tx=0x7f27f003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:21.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.313+0000 7f27fa000640 1 -- 172.21.15.19:0/2372439745 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f27fc058770 con 0x7f280406d600 2024-03-08T06:03:21.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.507+0000 7f2808a00640 1 -- 172.21.15.19:0/2372439745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f280415ed30 con 0x7f280406d600 2024-03-08T06:03:21.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.509+0000 7f27fa000640 1 -- 172.21.15.19:0/2372439745 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16558 (secure 0 0 0) 0x7f27fc058070 con 0x7f280406d600 2024-03-08T06:03:21.510 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:21.510 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:03:20.531569+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:03:18.392703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T06:03:19.537912+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:03:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.511+0000 7f2808a00640 1 -- 172.21.15.19:0/2372439745 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f27e406b4d0 msgr2=0x7f27e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.511+0000 7f2808a00640 1 --2- 172.21.15.19:0/2372439745 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f27e406b4d0 0x7f27e406d990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f27f0036000 tx=0x7f27f003b040 comp rx=0 tx=0).stop 2024-03-08T06:03:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.511+0000 7f2808a00640 1 -- 172.21.15.19:0/2372439745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280406d600 msgr2=0x7f280413d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.511+0000 7f2808a00640 1 --2- 172.21.15.19:0/2372439745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280406d600 0x7f280413d430 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00c890 tx=0x7f27fc00cd50 comp rx=0 tx=0).stop 2024-03-08T06:03:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.511+0000 7f2808a00640 1 -- 172.21.15.19:0/2372439745 shutdown_connections 2024-03-08T06:03:21.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.512+0000 7f2808a00640 1 --2- 172.21.15.19:0/2372439745 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f27e406b4d0 0x7f27e406d990 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.512+0000 7f2808a00640 1 --2- 172.21.15.19:0/2372439745 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2804071e90 0x7f28040b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.512+0000 7f2808a00640 1 --2- 172.21.15.19:0/2372439745 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2804071ab0 0x7f280415e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.512+0000 7f2808a00640 1 --2- 172.21.15.19:0/2372439745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f280406d600 0x7f280413d430 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.512+0000 7f2808a00640 1 -- 172.21.15.19:0/2372439745 >> 172.21.15.19:0/2372439745 conn(0x7f280406ae30 msgr2=0x7f28040b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:21.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.512+0000 7f2808a00640 1 -- 172.21.15.19:0/2372439745 shutdown_connections 2024-03-08T06:03:21.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.512+0000 7f2808a00640 1 -- 172.21.15.19:0/2372439745 wait complete. 2024-03-08T06:03:21.530 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:03:21.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.744+0000 7efc49400640 1 Processor -- start 2024-03-08T06:03:21.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.744+0000 7efc49400640 1 -- start start 2024-03-08T06:03:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.746+0000 7efc49400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efc4406bd60 0x7efc4406c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.746+0000 7efc49400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efc440d04f0 0x7efc440d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.746+0000 7efc49400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc4406ca50 con 0x7efc44099c60 2024-03-08T06:03:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.746+0000 7efc49400640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4406cd30 con 0x7efc4406bd60 2024-03-08T06:03:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.746+0000 7efc49400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc440cfcf0 con 0x7efc440d04f0 2024-03-08T06:03:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.746+0000 7efc43e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7efc44099c60 0x7efc4409a040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35162/0 (socket says 172.21.15.19:35162) 2024-03-08T06:03:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.746+0000 7efc43e00640 1 -- 172.21.15.19:0/887445732 learned_addr learned my addr 172.21.15.19:0/887445732 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.746+0000 7efc3be00640 1 --2- 172.21.15.19:0/887445732 >> v2:172.21.15.42:3300/0 conn(0x7efc4406bd60 0x7efc4406c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:21.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.746+0000 7efc48a00640 1 --2- 172.21.15.19:0/887445732 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efc440d04f0 0x7efc440d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:21.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.746+0000 7efc43400640 1 -- 172.21.15.19:0/887445732 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469299671 0 0) 0x7efc4406ca50 con 0x7efc44099c60 2024-03-08T06:03:21.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.747+0000 7efc43400640 1 -- 172.21.15.19:0/887445732 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc28003520 con 0x7efc44099c60 2024-03-08T06:03:21.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.747+0000 7efc43400640 1 -- 172.21.15.19:0/887445732 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 764711452 0 0) 0x7efc28003520 con 0x7efc44099c60 2024-03-08T06:03:21.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.747+0000 7efc43400640 1 -- 172.21.15.19:0/887445732 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efc440d04f0 msgr2=0x7efc440d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:21.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.747+0000 7efc43400640 1 --2- 172.21.15.19:0/887445732 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efc440d04f0 0x7efc440d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.747+0000 7efc43400640 1 -- 172.21.15.19:0/887445732 >> v2:172.21.15.42:3300/0 conn(0x7efc4406bd60 msgr2=0x7efc4406c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:21.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.747+0000 7efc43400640 1 --2- 172.21.15.19:0/887445732 >> v2:172.21.15.42:3300/0 conn(0x7efc4406bd60 0x7efc4406c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.747+0000 7efc43400640 1 -- 172.21.15.19:0/887445732 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc440cffd0 con 0x7efc44099c60 2024-03-08T06:03:21.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.747+0000 7efc43400640 1 -- 172.21.15.19:0/887445732 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7efc34001670 con 0x7efc44099c60 2024-03-08T06:03:21.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.747+0000 7efc43400640 1 -- 172.21.15.19:0/887445732 >> v1:172.21.15.19:6789/0 conn(0x7efc44099c60 legacy=0x7efc4409a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:21.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.747+0000 7efc43400640 1 --2- 172.21.15.19:0/887445732 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efc440d04f0 0x7efc280039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.747+0000 7efc43400640 1 --2- 172.21.15.19:0/887445732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc28003f80 0x7efc28004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.747+0000 7efc43400640 1 --2- 172.21.15.19:0/887445732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc28004d40 0x7efc280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.747+0000 7efc43400640 1 -- 172.21.15.19:0/887445732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4406cd30 con 0x7efc28003f80 2024-03-08T06:03:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.747+0000 7efc43400640 1 -- 172.21.15.19:0/887445732 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc440cfcf0 con 0x7efc28004d40 2024-03-08T06:03:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.747+0000 7efc43400640 1 -- 172.21.15.19:0/887445732 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2800b9c0 con 0x7efc440d04f0 2024-03-08T06:03:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.747+0000 7efc3be00640 1 --2- 172.21.15.19:0/887445732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc28003f80 0x7efc28004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.748+0000 7efc3be00640 1 -- 172.21.15.19:0/887445732 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efc440d04f0 msgr2=0x7efc280039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.748+0000 7efc3be00640 1 --2- 172.21.15.19:0/887445732 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efc440d04f0 0x7efc280039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.748+0000 7efc3be00640 1 -- 172.21.15.19:0/887445732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc28004d40 msgr2=0x7efc280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.748+0000 7efc48a00640 1 --2- 172.21.15.19:0/887445732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc28004d40 0x7efc280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.748+0000 7efc3be00640 1 --2- 172.21.15.19:0/887445732 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc28004d40 0x7efc280051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.748+0000 7efc3be00640 1 -- 172.21.15.19:0/887445732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc28003520 con 0x7efc28003f80 2024-03-08T06:03:21.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.749+0000 7efc3be00640 1 --2- 172.21.15.19:0/887445732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc28003f80 0x7efc28004800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc2c009af0 tx=0x7efc28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b22f5babbdc23bb server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:21.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.749+0000 7efc43400640 1 -- 172.21.15.19:0/887445732 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c039070 con 0x7efc28003f80 2024-03-08T06:03:21.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.749+0000 7efc43400640 1 -- 172.21.15.19:0/887445732 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2c02c710 con 0x7efc28003f80 2024-03-08T06:03:21.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.749+0000 7efc43400640 1 -- 172.21.15.19:0/887445732 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c009690 con 0x7efc28003f80 2024-03-08T06:03:21.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.750+0000 7efc49400640 1 -- 172.21.15.19:0/887445732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc28003f80 msgr2=0x7efc28004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:21.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.750+0000 7efc49400640 1 --2- 172.21.15.19:0/887445732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc28003f80 0x7efc28004800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc2c009af0 tx=0x7efc28005830 comp rx=0 tx=0).stop 2024-03-08T06:03:21.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.750+0000 7efc48a00640 1 -- 172.21.15.19:0/887445732 reap_dead start 2024-03-08T06:03:21.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.750+0000 7efc49400640 1 -- 172.21.15.19:0/887445732 shutdown_connections 2024-03-08T06:03:21.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.750+0000 7efc49400640 1 -- 172.21.15.19:0/887445732 >> 172.21.15.19:0/887445732 conn(0x7efc440d19c0 msgr2=0x7efc440d1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:21.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.750+0000 7efc49400640 1 -- 172.21.15.19:0/887445732 shutdown_connections 2024-03-08T06:03:21.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.750+0000 7efc49400640 1 -- 172.21.15.19:0/887445732 wait complete. 2024-03-08T06:03:21.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.752+0000 7efc49400640 1 Processor -- start 2024-03-08T06:03:21.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.752+0000 7efc49400640 1 -- start start 2024-03-08T06:03:21.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.753+0000 7efc49400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc28003f80 0x7efc4415c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:21.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.753+0000 7efc49400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efc44150c90 0x7efc441f7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:21.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.753+0000 7efc49400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc44151110 0x7efc441f7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:21.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.753+0000 7efc49400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4406d010 con 0x7efc44151110 2024-03-08T06:03:21.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.753+0000 7efc49400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4415f730 con 0x7efc28003f80 2024-03-08T06:03:21.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.753+0000 7efc49400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc4415e0b0 con 0x7efc44150c90 2024-03-08T06:03:21.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.753+0000 7efc48a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc44151110 0x7efc441f7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:21.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.753+0000 7efc48a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc44151110 0x7efc441f7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39636/0 (socket says 172.21.15.19:39636) 2024-03-08T06:03:21.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.753+0000 7efc48a00640 1 -- 172.21.15.19:0/935439417 learned_addr learned my addr 172.21.15.19:0/935439417 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:21.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.753+0000 7efc48a00640 1 -- 172.21.15.19:0/935439417 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efc44150c90 msgr2=0x7efc441f7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:21.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.753+0000 7efc48a00640 1 --2- 172.21.15.19:0/935439417 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efc44150c90 0x7efc441f7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.753+0000 7efc43e00640 1 --2- 172.21.15.19:0/935439417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc28003f80 0x7efc4415c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:21.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.753+0000 7efc48a00640 1 -- 172.21.15.19:0/935439417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc28003f80 msgr2=0x7efc4415c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:21.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.753+0000 7efc48a00640 1 --2- 172.21.15.19:0/935439417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc28003f80 0x7efc4415c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.753+0000 7efc48a00640 1 -- 172.21.15.19:0/935439417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc441f42b0 con 0x7efc44151110 2024-03-08T06:03:21.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.754+0000 7efc48a00640 1 --2- 172.21.15.19:0/935439417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc44151110 0x7efc441f7a50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc4406df40 tx=0x7efc3c00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:21.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.754+0000 7efc40c00640 1 -- 172.21.15.19:0/935439417 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c00fe30 con 0x7efc44151110 2024-03-08T06:03:21.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.754+0000 7efc40c00640 1 -- 172.21.15.19:0/935439417 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c003990 con 0x7efc44151110 2024-03-08T06:03:21.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.754+0000 7efc40c00640 1 -- 172.21.15.19:0/935439417 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c003d80 con 0x7efc44151110 2024-03-08T06:03:21.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.754+0000 7efc49400640 1 -- 172.21.15.19:0/935439417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc441f8080 con 0x7efc44151110 2024-03-08T06:03:21.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.754+0000 7efc49400640 1 -- 172.21.15.19:0/935439417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc4415bb40 con 0x7efc44151110 2024-03-08T06:03:21.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.755+0000 7efc49400640 1 -- 172.21.15.19:0/935439417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc44075100 con 0x7efc44151110 2024-03-08T06:03:21.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.756+0000 7efc40c00640 1 -- 172.21.15.19:0/935439417 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efc3c005d10 con 0x7efc44151110 2024-03-08T06:03:21.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.757+0000 7efc40c00640 1 --2- 172.21.15.19:0/935439417 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efc2006b4d0 0x7efc2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:21.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.757+0000 7efc40c00640 1 -- 172.21.15.19:0/935439417 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc3c08a4d0 con 0x7efc44151110 2024-03-08T06:03:21.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.757+0000 7efc43e00640 1 --2- 172.21.15.19:0/935439417 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efc2006b4d0 0x7efc2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:21.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.758+0000 7efc43e00640 1 --2- 172.21.15.19:0/935439417 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efc2006b4d0 0x7efc2006d990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efc44158c60 tx=0x7efc34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:21.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.762+0000 7efc40c00640 1 -- 172.21.15.19:0/935439417 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efc3c012070 con 0x7efc44151110 2024-03-08T06:03:21.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.963+0000 7efc49400640 1 -- 172.21.15.19:0/935439417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc440d2760 con 0x7efc44151110 2024-03-08T06:03:21.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.965+0000 7efc40c00640 1 -- 172.21.15.19:0/935439417 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16558 (secure 0 0 0) 0x7efc3c0592b0 con 0x7efc44151110 2024-03-08T06:03:21.966 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:21.966 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:03:20.531569+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:03:18.392703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T06:03:19.537912+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:03:21.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.967+0000 7efc49400640 1 -- 172.21.15.19:0/935439417 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efc2006b4d0 msgr2=0x7efc2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:21.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.967+0000 7efc49400640 1 --2- 172.21.15.19:0/935439417 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efc2006b4d0 0x7efc2006d990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efc44158c60 tx=0x7efc34009040 comp rx=0 tx=0).stop 2024-03-08T06:03:21.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.967+0000 7efc49400640 1 -- 172.21.15.19:0/935439417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc44151110 msgr2=0x7efc441f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:21.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.967+0000 7efc49400640 1 --2- 172.21.15.19:0/935439417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc44151110 0x7efc441f7a50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efc4406df40 tx=0x7efc3c00f4a0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.967+0000 7efc49400640 1 -- 172.21.15.19:0/935439417 shutdown_connections 2024-03-08T06:03:21.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.967+0000 7efc49400640 1 --2- 172.21.15.19:0/935439417 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efc2006b4d0 0x7efc2006d990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.967+0000 7efc49400640 1 --2- 172.21.15.19:0/935439417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc44151110 0x7efc441f7a50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.967+0000 7efc49400640 1 --2- 172.21.15.19:0/935439417 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efc44150c90 0x7efc441f7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.967+0000 7efc49400640 1 --2- 172.21.15.19:0/935439417 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efc28003f80 0x7efc4415c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:21.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.967+0000 7efc49400640 1 -- 172.21.15.19:0/935439417 >> 172.21.15.19:0/935439417 conn(0x7efc440d19c0 msgr2=0x7efc440cbff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:21.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.968+0000 7efc49400640 1 -- 172.21.15.19:0/935439417 shutdown_connections 2024-03-08T06:03:21.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:21.968+0000 7efc49400640 1 -- 172.21.15.19:0/935439417 wait complete. 2024-03-08T06:03:21.986 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-08T06:03:22.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.221+0000 7fd9cfe00640 1 Processor -- start 2024-03-08T06:03:22.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.221+0000 7fd9cfe00640 1 -- start start 2024-03-08T06:03:22.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.222+0000 7fd9cfe00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9d015adf0 0x7fd9d00cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:22.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.222+0000 7fd9cfe00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d00cb350 con 0x7fd9d015aa10 2024-03-08T06:03:22.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.222+0000 7fd9cfe00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d00ce780 con 0x7fd9d00cd650 2024-03-08T06:03:22.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.222+0000 7fd9cfe00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00cdc80 con 0x7fd9d015adf0 2024-03-08T06:03:22.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.223+0000 7fd9cea00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd9d015aa10 0x7fd9d006ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35356/0 (socket says 172.21.15.19:35356) 2024-03-08T06:03:22.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.223+0000 7fd9cea00640 1 -- 172.21.15.19:0/1874813796 learned_addr learned my addr 172.21.15.19:0/1874813796 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.223+0000 7fd9cd600640 1 -- 172.21.15.19:0/1874813796 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223370449 0 0) 0x7fd9d00cb350 con 0x7fd9d015aa10 2024-03-08T06:03:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.223+0000 7fd9cd600640 1 -- 172.21.15.19:0/1874813796 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9b0003520 con 0x7fd9d015aa10 2024-03-08T06:03:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.223+0000 7fd9ce000640 1 --2- 172.21.15.19:0/1874813796 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9d015adf0 0x7fd9d00cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.223+0000 7fd9cd600640 1 -- 172.21.15.19:0/1874813796 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1985341951 0 0) 0x7fd9b0003520 con 0x7fd9d015aa10 2024-03-08T06:03:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.223+0000 7fd9cd600640 1 -- 172.21.15.19:0/1874813796 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9d015adf0 msgr2=0x7fd9d00cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.223+0000 7fd9cd600640 1 --2- 172.21.15.19:0/1874813796 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9d015adf0 0x7fd9d00cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.223+0000 7fd9cd600640 1 -- 172.21.15.19:0/1874813796 >> v1:172.21.15.42:6789/0 conn(0x7fd9d00cd650 legacy=0x7fd9d00d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.224+0000 7fd9cd600640 1 -- 172.21.15.19:0/1874813796 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d00cdf60 con 0x7fd9d015aa10 2024-03-08T06:03:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.224+0000 7fd9cd600640 1 -- 172.21.15.19:0/1874813796 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7fd9c0001690 con 0x7fd9d015aa10 2024-03-08T06:03:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.224+0000 7fd9cd600640 1 -- 172.21.15.19:0/1874813796 >> v1:172.21.15.19:6789/0 conn(0x7fd9d015aa10 legacy=0x7fd9d006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.224+0000 7fd9cd600640 1 --2- 172.21.15.19:0/1874813796 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9d015adf0 0x7fd9b0003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.224+0000 7fd9cd600640 1 --2- 172.21.15.19:0/1874813796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9b00040d0 0x7fd9b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.224+0000 7fd9cd600640 1 --2- 172.21.15.19:0/1874813796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b0004db0 0x7fd9b0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.224+0000 7fd9cd600640 1 -- 172.21.15.19:0/1874813796 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00cdc80 con 0x7fd9b0004db0 2024-03-08T06:03:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.224+0000 7fd9cd600640 1 -- 172.21.15.19:0/1874813796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b000de30 con 0x7fd9b00040d0 2024-03-08T06:03:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.224+0000 7fd9cd600640 1 -- 172.21.15.19:0/1874813796 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b000e030 con 0x7fd9d015adf0 2024-03-08T06:03:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.224+0000 7fd9cf400640 1 --2- 172.21.15.19:0/1874813796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b0004db0 0x7fd9b0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.224+0000 7fd9cea00640 1 --2- 172.21.15.19:0/1874813796 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9d015adf0 0x7fd9b0003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.224+0000 7fd9ce000640 1 --2- 172.21.15.19:0/1874813796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9b00040d0 0x7fd9b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.224+0000 7fd9cf400640 1 -- 172.21.15.19:0/1874813796 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9d015adf0 msgr2=0x7fd9b0003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.224+0000 7fd9cf400640 1 --2- 172.21.15.19:0/1874813796 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9d015adf0 0x7fd9b0003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.224+0000 7fd9cf400640 1 -- 172.21.15.19:0/1874813796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9b00040d0 msgr2=0x7fd9b0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.224+0000 7fd9cf400640 1 --2- 172.21.15.19:0/1874813796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9b00040d0 0x7fd9b0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.225+0000 7fd9cf400640 1 -- 172.21.15.19:0/1874813796 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b0003520 con 0x7fd9b0004db0 2024-03-08T06:03:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.226+0000 7fd9cf400640 1 --2- 172.21.15.19:0/1874813796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b0004db0 0x7fd9b0005230 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8001750 tx=0x7fd9b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2427fe48eaeb02f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.226+0000 7fd9cd600640 1 -- 172.21.15.19:0/1874813796 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8001370 con 0x7fd9b0004db0 2024-03-08T06:03:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.226+0000 7fd9cd600640 1 -- 172.21.15.19:0/1874813796 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c80052d0 con 0x7fd9b0004db0 2024-03-08T06:03:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.226+0000 7fd9cd600640 1 -- 172.21.15.19:0/1874813796 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8003830 con 0x7fd9b0004db0 2024-03-08T06:03:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.226+0000 7fd9cfe00640 1 -- 172.21.15.19:0/1874813796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b0004db0 msgr2=0x7fd9b0005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.226+0000 7fd9cfe00640 1 --2- 172.21.15.19:0/1874813796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9b0004db0 0x7fd9b0005230 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8001750 tx=0x7fd9b0005830 comp rx=0 tx=0).stop 2024-03-08T06:03:22.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.226+0000 7fd9cf400640 1 -- 172.21.15.19:0/1874813796 reap_dead start 2024-03-08T06:03:22.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.226+0000 7fd9cfe00640 1 -- 172.21.15.19:0/1874813796 shutdown_connections 2024-03-08T06:03:22.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.227+0000 7fd9cfe00640 1 -- 172.21.15.19:0/1874813796 >> 172.21.15.19:0/1874813796 conn(0x7fd9d0099a70 msgr2=0x7fd9d0099e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:22.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.227+0000 7fd9cfe00640 1 -- 172.21.15.19:0/1874813796 shutdown_connections 2024-03-08T06:03:22.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.227+0000 7fd9cfe00640 1 -- 172.21.15.19:0/1874813796 wait complete. 2024-03-08T06:03:22.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.228+0000 7fd9cfe00640 1 Processor -- start 2024-03-08T06:03:22.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.229+0000 7fd9cfe00640 1 -- start start 2024-03-08T06:03:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.229+0000 7fd9cfe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9b0004db0 0x7fd9d01f3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.229+0000 7fd9cfe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9d0147990 0x7fd9d0149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.230+0000 7fd9cfe00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9d0147e10 0x7fd9d0149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.230+0000 7fd9cfe00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d006f1a0 con 0x7fd9d0147990 2024-03-08T06:03:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.230+0000 7fd9cfe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00cb8d0 con 0x7fd9b0004db0 2024-03-08T06:03:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.230+0000 7fd9cfe00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00d0c00 con 0x7fd9d0147e10 2024-03-08T06:03:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.230+0000 7fd9ce000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9d0147990 0x7fd9d0149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.230+0000 7fd9ce000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9d0147990 0x7fd9d0149a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33344/0 (socket says 172.21.15.19:33344) 2024-03-08T06:03:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.230+0000 7fd9ce000640 1 -- 172.21.15.19:0/103494677 learned_addr learned my addr 172.21.15.19:0/103494677 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.230+0000 7fd9cea00640 1 --2- 172.21.15.19:0/103494677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9b0004db0 0x7fd9d01f3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.230+0000 7fd9cf400640 1 --2- 172.21.15.19:0/103494677 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9d0147e10 0x7fd9d0149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.230+0000 7fd9ce000640 1 -- 172.21.15.19:0/103494677 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9d0147e10 msgr2=0x7fd9d0149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.230+0000 7fd9ce000640 1 --2- 172.21.15.19:0/103494677 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9d0147e10 0x7fd9d0149f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:22.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.230+0000 7fd9ce000640 1 -- 172.21.15.19:0/103494677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9b0004db0 msgr2=0x7fd9d01f3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:22.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.230+0000 7fd9ce000640 1 --2- 172.21.15.19:0/103494677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9b0004db0 0x7fd9d01f3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:22.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.230+0000 7fd9ce000640 1 -- 172.21.15.19:0/103494677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d00c8ec0 con 0x7fd9d0147990 2024-03-08T06:03:22.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.231+0000 7fd9ce000640 1 --2- 172.21.15.19:0/103494677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9d0147990 0x7fd9d0149a20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009c80 tx=0x7fd9b8007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:22.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.231+0000 7fd9c6a00640 1 -- 172.21.15.19:0/103494677 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8014610 con 0x7fd9d0147990 2024-03-08T06:03:22.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.231+0000 7fd9c6a00640 1 -- 172.21.15.19:0/103494677 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b8019070 con 0x7fd9d0147990 2024-03-08T06:03:22.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.231+0000 7fd9c6a00640 1 -- 172.21.15.19:0/103494677 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80149d0 con 0x7fd9d0147990 2024-03-08T06:03:22.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.231+0000 7fd9cfe00640 1 -- 172.21.15.19:0/103494677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d00c9160 con 0x7fd9d0147990 2024-03-08T06:03:22.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.231+0000 7fd9cfe00640 1 -- 172.21.15.19:0/103494677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d00c9720 con 0x7fd9d0147990 2024-03-08T06:03:22.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.232+0000 7fd9cfe00640 1 -- 172.21.15.19:0/103494677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d0075090 con 0x7fd9d0147990 2024-03-08T06:03:22.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.233+0000 7fd9c6a00640 1 -- 172.21.15.19:0/103494677 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd9b8014b70 con 0x7fd9d0147990 2024-03-08T06:03:22.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.234+0000 7fd9c6a00640 1 --2- 172.21.15.19:0/103494677 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd9ac06b4d0 0x7fd9ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:22.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.235+0000 7fd9c6a00640 1 -- 172.21.15.19:0/103494677 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9b808ac40 con 0x7fd9d0147990 2024-03-08T06:03:22.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.235+0000 7fd9cea00640 1 --2- 172.21.15.19:0/103494677 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd9ac06b4d0 0x7fd9ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:22.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.235+0000 7fd9cea00640 1 --2- 172.21.15.19:0/103494677 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd9ac06b4d0 0x7fd9ac06d990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0001050 tx=0x7fd9c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:22.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.239+0000 7fd9c6a00640 1 -- 172.21.15.19:0/103494677 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd9b8059a20 con 0x7fd9d0147990 2024-03-08T06:03:22.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:22.479+0000 7fd9cfe00640 1 -- 172.21.15.19:0/103494677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd9d015e570 con 0x7fd9d0147990 2024-03-08T06:03:23.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.091+0000 7fd9c6a00640 1 -- 172.21.15.19:0/103494677 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd9b8059320 con 0x7fd9d0147990 2024-03-08T06:03:23.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.094+0000 7fd9cfe00640 1 -- 172.21.15.19:0/103494677 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd9ac06b4d0 msgr2=0x7fd9ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:23.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.094+0000 7fd9cfe00640 1 --2- 172.21.15.19:0/103494677 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd9ac06b4d0 0x7fd9ac06d990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0001050 tx=0x7fd9c0009040 comp rx=0 tx=0).stop 2024-03-08T06:03:23.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.094+0000 7fd9cfe00640 1 -- 172.21.15.19:0/103494677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9d0147990 msgr2=0x7fd9d0149a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:23.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.094+0000 7fd9cfe00640 1 --2- 172.21.15.19:0/103494677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9d0147990 0x7fd9d0149a20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009c80 tx=0x7fd9b8007700 comp rx=0 tx=0).stop 2024-03-08T06:03:23.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.095+0000 7fd9cfe00640 1 -- 172.21.15.19:0/103494677 shutdown_connections 2024-03-08T06:03:23.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.095+0000 7fd9cfe00640 1 --2- 172.21.15.19:0/103494677 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd9ac06b4d0 0x7fd9ac06d990 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:23.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.095+0000 7fd9cfe00640 1 --2- 172.21.15.19:0/103494677 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd9d0147e10 0x7fd9d0149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:23.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.095+0000 7fd9cfe00640 1 --2- 172.21.15.19:0/103494677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9d0147990 0x7fd9d0149a20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:23.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.095+0000 7fd9cfe00640 1 --2- 172.21.15.19:0/103494677 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd9b0004db0 0x7fd9d01f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:23.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.095+0000 7fd9cfe00640 1 -- 172.21.15.19:0/103494677 >> 172.21.15.19:0/103494677 conn(0x7fd9d0099a70 msgr2=0x7fd9d00ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:23.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.095+0000 7fd9cfe00640 1 -- 172.21.15.19:0/103494677 shutdown_connections 2024-03-08T06:03:23.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.095+0000 7fd9cfe00640 1 -- 172.21.15.19:0/103494677 wait complete. 2024-03-08T06:03:23.120 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-08T06:03:23.120 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-08T06:03:23.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.346+0000 7f8df1c00640 1 Processor -- start 2024-03-08T06:03:23.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.346+0000 7f8df1c00640 1 -- start start 2024-03-08T06:03:23.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.348+0000 7f8df1c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8dec145500 0x7f8dec06ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:23.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.348+0000 7f8df1c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8dec15bfb0 0x7f8dec0716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:23.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.348+0000 7f8df1c00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dec15c460 con 0x7f8dec071c20 2024-03-08T06:03:23.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.348+0000 7f8df1c00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dec072050 con 0x7f8dec145500 2024-03-08T06:03:23.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.348+0000 7f8df1c00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dec15c740 con 0x7f8dec15bfb0 2024-03-08T06:03:23.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.349+0000 7f8debe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8dec145500 0x7f8dec06ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:23.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.349+0000 7f8debe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8dec145500 0x7f8dec06ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33360/0 (socket says 172.21.15.19:33360) 2024-03-08T06:03:23.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.349+0000 7f8debe00640 1 -- 172.21.15.19:0/805747223 learned_addr learned my addr 172.21.15.19:0/805747223 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:23.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.349+0000 7f8df1200640 1 --1- 172.21.15.19:0/805747223 >> v1:172.21.15.19:6789/0 conn(0x7f8dec071c20 0x7f8dec06d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35368/0 (socket says 172.21.15.19:35368) 2024-03-08T06:03:23.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.349+0000 7f8de3e00640 1 --2- 172.21.15.19:0/805747223 >> v2:172.21.15.42:3300/0 conn(0x7f8dec15bfb0 0x7f8dec0716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:23.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.349+0000 7f8debe00640 1 -- 172.21.15.19:0/805747223 >> v2:172.21.15.42:3300/0 conn(0x7f8dec15bfb0 msgr2=0x7f8dec0716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:23.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.349+0000 7f8debe00640 1 --2- 172.21.15.19:0/805747223 >> v2:172.21.15.42:3300/0 conn(0x7f8dec15bfb0 0x7f8dec0716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:23.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.349+0000 7f8debe00640 1 -- 172.21.15.19:0/805747223 >> v1:172.21.15.19:6789/0 conn(0x7f8dec071c20 legacy=0x7f8dec06d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:23.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.349+0000 7f8debe00640 1 -- 172.21.15.19:0/805747223 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dec15ca20 con 0x7f8dec145500 2024-03-08T06:03:23.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.349+0000 7f8deb400640 1 -- 172.21.15.19:0/805747223 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929143161 0 0) 0x7f8dec15c460 con 0x7f8dec071c20 2024-03-08T06:03:23.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.349+0000 7f8de3e00640 1 --2- 172.21.15.19:0/805747223 >> v2:172.21.15.42:3300/0 conn(0x7f8dec15bfb0 0x7f8dec0716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:23.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.350+0000 7f8debe00640 1 --2- 172.21.15.19:0/805747223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8dec145500 0x7f8dec06ecb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8dec06ebc0 tx=0x7f8ddc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6ff14f56d81f56 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:23.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.351+0000 7f8deb400640 1 -- 172.21.15.19:0/805747223 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc035020 con 0x7f8dec145500 2024-03-08T06:03:23.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.351+0000 7f8deb400640 1 -- 172.21.15.19:0/805747223 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ddc031870 con 0x7f8dec145500 2024-03-08T06:03:23.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.351+0000 7f8deb400640 1 -- 172.21.15.19:0/805747223 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc031c40 con 0x7f8dec145500 2024-03-08T06:03:23.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.351+0000 7f8df1c00640 1 -- 172.21.15.19:0/805747223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8dec145500 msgr2=0x7f8dec06ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:23.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.351+0000 7f8df1c00640 1 --2- 172.21.15.19:0/805747223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8dec145500 0x7f8dec06ecb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8dec06ebc0 tx=0x7f8ddc02b910 comp rx=0 tx=0).stop 2024-03-08T06:03:23.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.351+0000 7f8df1c00640 1 -- 172.21.15.19:0/805747223 shutdown_connections 2024-03-08T06:03:23.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.351+0000 7f8df1c00640 1 --2- 172.21.15.19:0/805747223 >> v2:172.21.15.42:3300/0 conn(0x7f8dec15bfb0 0x7f8dec0716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:23.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.351+0000 7f8df1c00640 1 --2- 172.21.15.19:0/805747223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8dec145500 0x7f8dec06ecb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:23.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.351+0000 7f8df1c00640 1 -- 172.21.15.19:0/805747223 >> 172.21.15.19:0/805747223 conn(0x7f8dec0b1850 msgr2=0x7f8dec0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:23.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.351+0000 7f8df1c00640 1 -- 172.21.15.19:0/805747223 shutdown_connections 2024-03-08T06:03:23.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.352+0000 7f8df1c00640 1 -- 172.21.15.19:0/805747223 wait complete. 2024-03-08T06:03:23.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.353+0000 7f8df1c00640 1 Processor -- start 2024-03-08T06:03:23.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.353+0000 7f8df1c00640 1 -- start start 2024-03-08T06:03:23.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.354+0000 7f8df1c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8dec071c20 0x7f8dec13c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:23.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.354+0000 7f8df1c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dec145500 0x7f8dec0b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:23.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.354+0000 7f8df1c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8dec15bfb0 0x7f8dec0b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:23.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.354+0000 7f8df1c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec06f370 con 0x7f8dec071c20 2024-03-08T06:03:23.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.354+0000 7f8df1c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec06f1f0 con 0x7f8dec145500 2024-03-08T06:03:23.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.354+0000 7f8df1c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec0cd510 con 0x7f8dec15bfb0 2024-03-08T06:03:23.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.355+0000 7f8debe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8dec071c20 0x7f8dec13c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:23.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.355+0000 7f8debe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8dec071c20 0x7f8dec13c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33368/0 (socket says 172.21.15.19:33368) 2024-03-08T06:03:23.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.355+0000 7f8debe00640 1 -- 172.21.15.19:0/1044997902 learned_addr learned my addr 172.21.15.19:0/1044997902 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:23.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.355+0000 7f8de3e00640 1 --2- 172.21.15.19:0/1044997902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dec145500 0x7f8dec0b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:23.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.355+0000 7f8df1200640 1 --2- 172.21.15.19:0/1044997902 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8dec15bfb0 0x7f8dec0b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:23.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.355+0000 7f8debe00640 1 -- 172.21.15.19:0/1044997902 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8dec15bfb0 msgr2=0x7f8dec0b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:23.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.355+0000 7f8debe00640 1 --2- 172.21.15.19:0/1044997902 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8dec15bfb0 0x7f8dec0b4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:23.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.355+0000 7f8debe00640 1 -- 172.21.15.19:0/1044997902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dec145500 msgr2=0x7f8dec0b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:23.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.355+0000 7f8debe00640 1 --2- 172.21.15.19:0/1044997902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dec145500 0x7f8dec0b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:23.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.355+0000 7f8debe00640 1 -- 172.21.15.19:0/1044997902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dec1e22c0 con 0x7f8dec071c20 2024-03-08T06:03:23.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.355+0000 7f8de3e00640 1 --2- 172.21.15.19:0/1044997902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dec145500 0x7f8dec0b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:23.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.355+0000 7f8debe00640 1 --2- 172.21.15.19:0/1044997902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8dec071c20 0x7f8dec13c6c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc02b950 tx=0x7f8ddc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:23.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.356+0000 7f8de8c00640 1 -- 172.21.15.19:0/1044997902 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc040070 con 0x7f8dec071c20 2024-03-08T06:03:23.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.356+0000 7f8de8c00640 1 -- 172.21.15.19:0/1044997902 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ddc03a420 con 0x7f8dec071c20 2024-03-08T06:03:23.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.356+0000 7f8de8c00640 1 -- 172.21.15.19:0/1044997902 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc035040 con 0x7f8dec071c20 2024-03-08T06:03:23.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.356+0000 7f8df1c00640 1 -- 172.21.15.19:0/1044997902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dec1e25a0 con 0x7f8dec071c20 2024-03-08T06:03:23.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.356+0000 7f8df1c00640 1 -- 172.21.15.19:0/1044997902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dec1e2b60 con 0x7f8dec071c20 2024-03-08T06:03:23.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.357+0000 7f8df1c00640 1 -- 172.21.15.19:0/1044997902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dec075090 con 0x7f8dec071c20 2024-03-08T06:03:23.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.358+0000 7f8de8c00640 1 -- 172.21.15.19:0/1044997902 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8ddc04b060 con 0x7f8dec071c20 2024-03-08T06:03:23.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.359+0000 7f8de8c00640 1 --2- 172.21.15.19:0/1044997902 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f8dc806b4d0 0x7f8dc806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:23.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.359+0000 7f8de8c00640 1 -- 172.21.15.19:0/1044997902 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ddc0ac1f0 con 0x7f8dec071c20 2024-03-08T06:03:23.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.359+0000 7f8de3e00640 1 --2- 172.21.15.19:0/1044997902 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f8dc806b4d0 0x7f8dc806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:23.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.360+0000 7f8de3e00640 1 --2- 172.21.15.19:0/1044997902 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f8dc806b4d0 0x7f8dc806d990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4006fd0 tx=0x7f8dd4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:23.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.363+0000 7f8de8c00640 1 -- 172.21.15.19:0/1044997902 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8ddc07b060 con 0x7f8dec071c20 2024-03-08T06:03:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:23.602+0000 7f8df1c00640 1 -- 172.21.15.19:0/1044997902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8dec06bb60 con 0x7f8dec071c20 2024-03-08T06:03:24.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.103+0000 7f8de8c00640 1 -- 172.21.15.19:0/1044997902 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8ddc07a960 con 0x7f8dec071c20 2024-03-08T06:03:24.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.107+0000 7f8df1c00640 1 -- 172.21.15.19:0/1044997902 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f8dc806b4d0 msgr2=0x7f8dc806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:24.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.107+0000 7f8df1c00640 1 --2- 172.21.15.19:0/1044997902 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f8dc806b4d0 0x7f8dc806d990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4006fd0 tx=0x7f8dd4008040 comp rx=0 tx=0).stop 2024-03-08T06:03:24.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.107+0000 7f8df1c00640 1 -- 172.21.15.19:0/1044997902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8dec071c20 msgr2=0x7f8dec13c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:24.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.107+0000 7f8df1c00640 1 --2- 172.21.15.19:0/1044997902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8dec071c20 0x7f8dec13c6c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc02b950 tx=0x7f8ddc0046c0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.107+0000 7f8df1c00640 1 -- 172.21.15.19:0/1044997902 shutdown_connections 2024-03-08T06:03:24.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.107+0000 7f8df1c00640 1 --2- 172.21.15.19:0/1044997902 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f8dc806b4d0 0x7f8dc806d990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.107+0000 7f8df1c00640 1 --2- 172.21.15.19:0/1044997902 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8dec15bfb0 0x7f8dec0b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.107+0000 7f8df1c00640 1 --2- 172.21.15.19:0/1044997902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dec145500 0x7f8dec0b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.107+0000 7f8df1c00640 1 --2- 172.21.15.19:0/1044997902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8dec071c20 0x7f8dec13c6c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.107+0000 7f8df1c00640 1 -- 172.21.15.19:0/1044997902 >> 172.21.15.19:0/1044997902 conn(0x7f8dec0b1850 msgr2=0x7f8dec0ae170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:24.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.108+0000 7f8df1c00640 1 -- 172.21.15.19:0/1044997902 shutdown_connections 2024-03-08T06:03:24.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.108+0000 7f8df1c00640 1 -- 172.21.15.19:0/1044997902 wait complete. 2024-03-08T06:03:24.129 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-08T06:03:24.129 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T06:03:24.232 INFO:tasks.ceph.mds.d.smithi042.stderr:2024-03-08T06:03:24.231+0000 7f538b200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-08T06:03:24.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.351+0000 7f9d27a00640 1 Processor -- start 2024-03-08T06:03:24.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.352+0000 7f9d27a00640 1 -- start start 2024-03-08T06:03:24.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.353+0000 7f9d27a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9d201614f0 0x7f9d200ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:24.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.353+0000 7f9d27a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9d200d1130 0x7f9d200cee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:24.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.353+0000 7f9d27a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d200d2b90 con 0x7f9d200d3630 2024-03-08T06:03:24.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.353+0000 7f9d27a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d200b6d50 con 0x7f9d200d1130 2024-03-08T06:03:24.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.353+0000 7f9d27a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200d3370 con 0x7f9d201614f0 2024-03-08T06:03:24.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.353+0000 7f9d25a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9d200d1130 0x7f9d200cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:24.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.354+0000 7f9d1fe00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9d200d3630 0x7f9d20161be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35380/0 (socket says 172.21.15.19:35380) 2024-03-08T06:03:24.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.354+0000 7f9d25a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9d200d1130 0x7f9d200cee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33372/0 (socket says 172.21.15.19:33372) 2024-03-08T06:03:24.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.354+0000 7f9d1fe00640 1 -- 172.21.15.19:0/3502299627 learned_addr learned my addr 172.21.15.19:0/3502299627 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:24.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.354+0000 7f9d25000640 1 --2- 172.21.15.19:0/3502299627 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9d201614f0 0x7f9d200ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:24.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.354+0000 7f9d25a00640 1 -- 172.21.15.19:0/3502299627 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9d201614f0 msgr2=0x7f9d200ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:24.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.354+0000 7f9d25a00640 1 --2- 172.21.15.19:0/3502299627 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9d201614f0 0x7f9d200ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.354+0000 7f9d25a00640 1 -- 172.21.15.19:0/3502299627 >> v1:172.21.15.19:6789/0 conn(0x7f9d200d3630 legacy=0x7f9d20161be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:24.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.354+0000 7f9d1f400640 1 -- 172.21.15.19:0/3502299627 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804132195 0 0) 0x7f9d200d2b90 con 0x7f9d200d3630 2024-03-08T06:03:24.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.354+0000 7f9d25a00640 1 -- 172.21.15.19:0/3502299627 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d200b9820 con 0x7f9d200d1130 2024-03-08T06:03:24.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.355+0000 7f9d25a00640 1 --2- 172.21.15.19:0/3502299627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d200d1130 0x7f9d200cee50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9d180097a0 tx=0x7f9d1802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac96346fc042f4f3 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:24.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.355+0000 7f9d1f400640 1 -- 172.21.15.19:0/3502299627 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d180315a0 con 0x7f9d200d1130 2024-03-08T06:03:24.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.355+0000 7f9d1f400640 1 -- 172.21.15.19:0/3502299627 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d18037070 con 0x7f9d200d1130 2024-03-08T06:03:24.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.356+0000 7f9d1f400640 1 -- 172.21.15.19:0/3502299627 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18031960 con 0x7f9d200d1130 2024-03-08T06:03:24.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.356+0000 7f9d27a00640 1 -- 172.21.15.19:0/3502299627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d200d1130 msgr2=0x7f9d200cee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:24.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.356+0000 7f9d27a00640 1 --2- 172.21.15.19:0/3502299627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d200d1130 0x7f9d200cee50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9d180097a0 tx=0x7f9d1802b840 comp rx=0 tx=0).stop 2024-03-08T06:03:24.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.356+0000 7f9d27a00640 1 -- 172.21.15.19:0/3502299627 shutdown_connections 2024-03-08T06:03:24.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.356+0000 7f9d27a00640 1 --2- 172.21.15.19:0/3502299627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d200d1130 0x7f9d200cee50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.356+0000 7f9d27a00640 1 --2- 172.21.15.19:0/3502299627 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9d201614f0 0x7f9d200ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.356+0000 7f9d27a00640 1 -- 172.21.15.19:0/3502299627 >> 172.21.15.19:0/3502299627 conn(0x7f9d2006c8f0 msgr2=0x7f9d2006cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:24.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.356+0000 7f9d27a00640 1 -- 172.21.15.19:0/3502299627 shutdown_connections 2024-03-08T06:03:24.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.356+0000 7f9d27a00640 1 -- 172.21.15.19:0/3502299627 wait complete. 2024-03-08T06:03:24.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.358+0000 7f9d27a00640 1 Processor -- start 2024-03-08T06:03:24.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.358+0000 7f9d27a00640 1 -- start start 2024-03-08T06:03:24.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.359+0000 7f9d27a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9d200d1130 0x7f9d201514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:24.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.359+0000 7f9d27a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d200d3630 0x7f9d200caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:24.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.359+0000 7f9d27a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d201614f0 0x7f9d200b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:24.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.359+0000 7f9d27a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200d2ee0 con 0x7f9d200d3630 2024-03-08T06:03:24.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.359+0000 7f9d27a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200b95d0 con 0x7f9d201614f0 2024-03-08T06:03:24.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.359+0000 7f9d27a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d201618d0 con 0x7f9d200d1130 2024-03-08T06:03:24.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.359+0000 7f9d1fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d200d3630 0x7f9d200caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:24.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.359+0000 7f9d1fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d200d3630 0x7f9d200caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33384/0 (socket says 172.21.15.19:33384) 2024-03-08T06:03:24.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.359+0000 7f9d1fe00640 1 -- 172.21.15.19:0/2882320155 learned_addr learned my addr 172.21.15.19:0/2882320155 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:24.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.360+0000 7f9d25000640 1 --2- 172.21.15.19:0/2882320155 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9d200d1130 0x7f9d201514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:24.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.360+0000 7f9d1fe00640 1 -- 172.21.15.19:0/2882320155 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9d200d1130 msgr2=0x7f9d201514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:24.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.360+0000 7f9d1fe00640 1 --2- 172.21.15.19:0/2882320155 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9d200d1130 0x7f9d201514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.360+0000 7f9d25a00640 1 --2- 172.21.15.19:0/2882320155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d201614f0 0x7f9d200b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:24.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.360+0000 7f9d1fe00640 1 -- 172.21.15.19:0/2882320155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d201614f0 msgr2=0x7f9d200b7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:24.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.360+0000 7f9d1fe00640 1 --2- 172.21.15.19:0/2882320155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d201614f0 0x7f9d200b7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.360+0000 7f9d1fe00640 1 -- 172.21.15.19:0/2882320155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d200cc4e0 con 0x7f9d200d3630 2024-03-08T06:03:24.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.360+0000 7f9d1fe00640 1 --2- 172.21.15.19:0/2882320155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d200d3630 0x7f9d200caca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9d0800c460 tx=0x7f9d0800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:24.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.360+0000 7f9d1cc00640 1 -- 172.21.15.19:0/2882320155 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d08018070 con 0x7f9d200d3630 2024-03-08T06:03:24.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.360+0000 7f9d1cc00640 1 -- 172.21.15.19:0/2882320155 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d08007500 con 0x7f9d200d3630 2024-03-08T06:03:24.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.360+0000 7f9d1cc00640 1 -- 172.21.15.19:0/2882320155 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d08004a20 con 0x7f9d200d3630 2024-03-08T06:03:24.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.360+0000 7f9d27a00640 1 -- 172.21.15.19:0/2882320155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d200cb6f0 con 0x7f9d200d3630 2024-03-08T06:03:24.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.361+0000 7f9d27a00640 1 -- 172.21.15.19:0/2882320155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d200cbcb0 con 0x7f9d200d3630 2024-03-08T06:03:24.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.362+0000 7f9d27a00640 1 -- 172.21.15.19:0/2882320155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d20067cb0 con 0x7f9d200d3630 2024-03-08T06:03:24.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.363+0000 7f9d1cc00640 1 -- 172.21.15.19:0/2882320155 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9d0801b070 con 0x7f9d200d3630 2024-03-08T06:03:24.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.364+0000 7f9d1cc00640 1 --2- 172.21.15.19:0/2882320155 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9cfc06b4d0 0x7f9cfc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:24.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.364+0000 7f9d1cc00640 1 -- 172.21.15.19:0/2882320155 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d080894c0 con 0x7f9d200d3630 2024-03-08T06:03:24.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.364+0000 7f9d25000640 1 --2- 172.21.15.19:0/2882320155 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9cfc06b4d0 0x7f9cfc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:24.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.365+0000 7f9d25000640 1 --2- 172.21.15.19:0/2882320155 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9cfc06b4d0 0x7f9cfc06d990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9d2015c150 tx=0x7f9d100039b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:24.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.369+0000 7f9d1cc00640 1 -- 172.21.15.19:0/2882320155 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9d08058330 con 0x7f9d200d3630 2024-03-08T06:03:24.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.607+0000 7f9d27a00640 1 -- 172.21.15.19:0/2882320155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d200b64e0 con 0x7f9d200d3630 2024-03-08T06:03:24.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.608+0000 7f9d1cc00640 1 -- 172.21.15.19:0/2882320155 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7f9d08057c30 con 0x7f9d200d3630 2024-03-08T06:03:24.609 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:24.609 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1494509643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6835","nonce":1494509643},{"type":"v1","addr":"172.21.15.19:6837","nonce":1494509643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/2031610239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2031610239},{"type":"v1","addr":"172.21.15.42:6834","nonce":2031610239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6836/1964979810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1964979810},{"type":"v1","addr":"172.21.15.19:6836","nonce":1964979810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T06:03:20.532032+0000","modified":"2024-03-08T06:03:23.604391+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1462224228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1462224228},{"type":"v1","addr":"172.21.15.42:6835","nonce":1462224228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T06:03:24.610 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2024-03-08T06:03:24.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.611+0000 7f9d27a00640 1 -- 172.21.15.19:0/2882320155 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9cfc06b4d0 msgr2=0x7f9cfc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:24.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.611+0000 7f9d27a00640 1 --2- 172.21.15.19:0/2882320155 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9cfc06b4d0 0x7f9cfc06d990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9d2015c150 tx=0x7f9d100039b0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.611+0000 7f9d27a00640 1 -- 172.21.15.19:0/2882320155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d200d3630 msgr2=0x7f9d200caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:24.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.611+0000 7f9d27a00640 1 --2- 172.21.15.19:0/2882320155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d200d3630 0x7f9d200caca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9d0800c460 tx=0x7f9d0800c920 comp rx=0 tx=0).stop 2024-03-08T06:03:24.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.611+0000 7f9d27a00640 1 -- 172.21.15.19:0/2882320155 shutdown_connections 2024-03-08T06:03:24.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.611+0000 7f9d27a00640 1 --2- 172.21.15.19:0/2882320155 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9cfc06b4d0 0x7f9cfc06d990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.611+0000 7f9d27a00640 1 --2- 172.21.15.19:0/2882320155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d201614f0 0x7f9d200b7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.611+0000 7f9d27a00640 1 --2- 172.21.15.19:0/2882320155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d200d3630 0x7f9d200caca0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.611+0000 7f9d27a00640 1 --2- 172.21.15.19:0/2882320155 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9d200d1130 0x7f9d201514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.611+0000 7f9d27a00640 1 -- 172.21.15.19:0/2882320155 >> 172.21.15.19:0/2882320155 conn(0x7f9d2006c8f0 msgr2=0x7f9d200b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:24.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.611+0000 7f9d27a00640 1 -- 172.21.15.19:0/2882320155 shutdown_connections 2024-03-08T06:03:24.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.611+0000 7f9d27a00640 1 -- 172.21.15.19:0/2882320155 wait complete. 2024-03-08T06:03:24.632 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:03:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.848+0000 7fde73200640 1 Processor -- start 2024-03-08T06:03:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.848+0000 7fde73200640 1 -- start start 2024-03-08T06:03:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.850+0000 7fde73200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fde6c145520 0x7fde6c15d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.850+0000 7fde73200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde6c071df0 0x7fde6c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.850+0000 7fde73200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde6c15ceb0 con 0x7fde6c15bea0 2024-03-08T06:03:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.850+0000 7fde73200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde6c15c330 con 0x7fde6c145520 2024-03-08T06:03:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.850+0000 7fde73200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde6c15c610 con 0x7fde6c071df0 2024-03-08T06:03:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.850+0000 7fde71400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fde6c15bea0 0x7fde6c0716e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35382/0 (socket says 172.21.15.19:35382) 2024-03-08T06:03:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.850+0000 7fde71400640 1 -- 172.21.15.19:0/3189204326 learned_addr learned my addr 172.21.15.19:0/3189204326 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.850+0000 7fde71e00640 1 --2- 172.21.15.19:0/3189204326 >> v2:172.21.15.42:3300/0 conn(0x7fde6c145520 0x7fde6c15d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.850+0000 7fde72800640 1 --2- 172.21.15.19:0/3189204326 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde6c071df0 0x7fde6c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.850+0000 7fde70a00640 1 -- 172.21.15.19:0/3189204326 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2376100502 0 0) 0x7fde6c15ceb0 con 0x7fde6c15bea0 2024-03-08T06:03:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.850+0000 7fde70a00640 1 -- 172.21.15.19:0/3189204326 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde54003520 con 0x7fde6c15bea0 2024-03-08T06:03:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.851+0000 7fde70a00640 1 -- 172.21.15.19:0/3189204326 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 939355287 0 0) 0x7fde54003520 con 0x7fde6c15bea0 2024-03-08T06:03:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.851+0000 7fde70a00640 1 -- 172.21.15.19:0/3189204326 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde6c071df0 msgr2=0x7fde6c06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.851+0000 7fde70a00640 1 --2- 172.21.15.19:0/3189204326 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde6c071df0 0x7fde6c06d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.851+0000 7fde70a00640 1 -- 172.21.15.19:0/3189204326 >> v2:172.21.15.42:3300/0 conn(0x7fde6c145520 msgr2=0x7fde6c15d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.851+0000 7fde70a00640 1 --2- 172.21.15.19:0/3189204326 >> v2:172.21.15.42:3300/0 conn(0x7fde6c145520 0x7fde6c15d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.851+0000 7fde70a00640 1 -- 172.21.15.19:0/3189204326 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6c15c8f0 con 0x7fde6c15bea0 2024-03-08T06:03:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.851+0000 7fde70a00640 1 -- 172.21.15.19:0/3189204326 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7fde5c001670 con 0x7fde6c15bea0 2024-03-08T06:03:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.851+0000 7fde70a00640 1 -- 172.21.15.19:0/3189204326 >> v1:172.21.15.19:6789/0 conn(0x7fde6c15bea0 legacy=0x7fde6c0716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.851+0000 7fde70a00640 1 --2- 172.21.15.19:0/3189204326 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde6c071df0 0x7fde540039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.851+0000 7fde70a00640 1 --2- 172.21.15.19:0/3189204326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde54003f80 0x7fde54004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.851+0000 7fde70a00640 1 --2- 172.21.15.19:0/3189204326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54004d40 0x7fde540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.851+0000 7fde70a00640 1 -- 172.21.15.19:0/3189204326 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6c15c330 con 0x7fde54004d40 2024-03-08T06:03:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.851+0000 7fde70a00640 1 -- 172.21.15.19:0/3189204326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6c15c610 con 0x7fde54003f80 2024-03-08T06:03:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.851+0000 7fde70a00640 1 -- 172.21.15.19:0/3189204326 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5400fdd0 con 0x7fde6c071df0 2024-03-08T06:03:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.851+0000 7fde72800640 1 --2- 172.21.15.19:0/3189204326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54004d40 0x7fde540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.852+0000 7fde71400640 1 --2- 172.21.15.19:0/3189204326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde54003f80 0x7fde54004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.852+0000 7fde71e00640 1 --2- 172.21.15.19:0/3189204326 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde6c071df0 0x7fde540039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.852+0000 7fde72800640 1 -- 172.21.15.19:0/3189204326 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde6c071df0 msgr2=0x7fde540039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.852+0000 7fde72800640 1 --2- 172.21.15.19:0/3189204326 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde6c071df0 0x7fde540039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.852+0000 7fde72800640 1 -- 172.21.15.19:0/3189204326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde54003f80 msgr2=0x7fde54004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.852+0000 7fde72800640 1 --2- 172.21.15.19:0/3189204326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde54003f80 0x7fde54004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.852+0000 7fde72800640 1 -- 172.21.15.19:0/3189204326 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde54003520 con 0x7fde54004d40 2024-03-08T06:03:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.852+0000 7fde71e00640 1 --2- 172.21.15.19:0/3189204326 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde6c071df0 0x7fde540039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.853+0000 7fde72800640 1 --2- 172.21.15.19:0/3189204326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54004d40 0x7fde540051c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fde68009fc0 tx=0x7fde54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8012c0af9e07d025 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.853+0000 7fde70a00640 1 -- 172.21.15.19:0/3189204326 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde68039070 con 0x7fde54004d40 2024-03-08T06:03:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.853+0000 7fde70a00640 1 -- 172.21.15.19:0/3189204326 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6802cbd0 con 0x7fde54004d40 2024-03-08T06:03:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.853+0000 7fde70a00640 1 -- 172.21.15.19:0/3189204326 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde68009c10 con 0x7fde54004d40 2024-03-08T06:03:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.854+0000 7fde73200640 1 -- 172.21.15.19:0/3189204326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54004d40 msgr2=0x7fde540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.854+0000 7fde73200640 1 --2- 172.21.15.19:0/3189204326 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54004d40 0x7fde540051c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fde68009fc0 tx=0x7fde54005830 comp rx=0 tx=0).stop 2024-03-08T06:03:24.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.854+0000 7fde72800640 1 -- 172.21.15.19:0/3189204326 reap_dead start 2024-03-08T06:03:24.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.854+0000 7fde73200640 1 -- 172.21.15.19:0/3189204326 shutdown_connections 2024-03-08T06:03:24.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.854+0000 7fde73200640 1 -- 172.21.15.19:0/3189204326 >> 172.21.15.19:0/3189204326 conn(0x7fde6c0b1850 msgr2=0x7fde6c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:24.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.854+0000 7fde73200640 1 -- 172.21.15.19:0/3189204326 shutdown_connections 2024-03-08T06:03:24.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.854+0000 7fde73200640 1 -- 172.21.15.19:0/3189204326 wait complete. 2024-03-08T06:03:24.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.856+0000 7fde73200640 1 Processor -- start 2024-03-08T06:03:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.856+0000 7fde73200640 1 -- start start 2024-03-08T06:03:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.857+0000 7fde73200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54004d40 0x7fde6c15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.857+0000 7fde73200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde6c1580e0 0x7fde6c159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.857+0000 7fde73200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde6c159550 0x7fde6c15e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.857+0000 7fde73200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6c0af1c0 con 0x7fde54004d40 2024-03-08T06:03:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.857+0000 7fde73200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6c0af040 con 0x7fde6c1580e0 2024-03-08T06:03:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.857+0000 7fde73200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde6c06e410 con 0x7fde6c159550 2024-03-08T06:03:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.857+0000 7fde71e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54004d40 0x7fde6c15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.857+0000 7fde71e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54004d40 0x7fde6c15b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33400/0 (socket says 172.21.15.19:33400) 2024-03-08T06:03:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.857+0000 7fde71e00640 1 -- 172.21.15.19:0/1582632236 learned_addr learned my addr 172.21.15.19:0/1582632236 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:24.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.857+0000 7fde71400640 1 --2- 172.21.15.19:0/1582632236 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde6c1580e0 0x7fde6c159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.857+0000 7fde72800640 1 --2- 172.21.15.19:0/1582632236 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde6c159550 0x7fde6c15e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.858+0000 7fde71e00640 1 -- 172.21.15.19:0/1582632236 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde6c159550 msgr2=0x7fde6c15e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.858+0000 7fde71e00640 1 --2- 172.21.15.19:0/1582632236 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde6c159550 0x7fde6c15e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.858+0000 7fde71e00640 1 -- 172.21.15.19:0/1582632236 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde6c1580e0 msgr2=0x7fde6c159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.858+0000 7fde71e00640 1 --2- 172.21.15.19:0/1582632236 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde6c1580e0 0x7fde6c159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.858+0000 7fde71e00640 1 -- 172.21.15.19:0/1582632236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6c15d610 con 0x7fde54004d40 2024-03-08T06:03:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.858+0000 7fde71400640 1 --2- 172.21.15.19:0/1582632236 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde6c1580e0 0x7fde6c159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.858+0000 7fde71e00640 1 --2- 172.21.15.19:0/1582632236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54004d40 0x7fde6c15b070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fde600109d0 tx=0x7fde60010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.858+0000 7fde66000640 1 -- 172.21.15.19:0/1582632236 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6000f040 con 0x7fde54004d40 2024-03-08T06:03:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.858+0000 7fde66000640 1 -- 172.21.15.19:0/1582632236 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6000ec20 con 0x7fde54004d40 2024-03-08T06:03:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.858+0000 7fde66000640 1 -- 172.21.15.19:0/1582632236 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6001c400 con 0x7fde54004d40 2024-03-08T06:03:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.858+0000 7fde73200640 1 -- 172.21.15.19:0/1582632236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde6c13a060 con 0x7fde54004d40 2024-03-08T06:03:24.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.858+0000 7fde73200640 1 -- 172.21.15.19:0/1582632236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde6c15dbb0 con 0x7fde54004d40 2024-03-08T06:03:24.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.859+0000 7fde73200640 1 -- 172.21.15.19:0/1582632236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde6c0ce7f0 con 0x7fde54004d40 2024-03-08T06:03:24.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.860+0000 7fde66000640 1 -- 172.21.15.19:0/1582632236 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fde6001c5a0 con 0x7fde54004d40 2024-03-08T06:03:24.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.861+0000 7fde66000640 1 --2- 172.21.15.19:0/1582632236 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fde5006b4d0 0x7fde5006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:24.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.861+0000 7fde66000640 1 -- 172.21.15.19:0/1582632236 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde6008aa20 con 0x7fde54004d40 2024-03-08T06:03:24.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.862+0000 7fde71400640 1 --2- 172.21.15.19:0/1582632236 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fde5006b4d0 0x7fde5006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:24.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.862+0000 7fde71400640 1 --2- 172.21.15.19:0/1582632236 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fde5006b4d0 0x7fde5006d990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fde5c000c00 tx=0x7fde5c000f50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:24.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:24.866+0000 7fde66000640 1 -- 172.21.15.19:0/1582632236 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fde6c0ce7f0 con 0x7fde54004d40 2024-03-08T06:03:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.064+0000 7fde73200640 1 -- 172.21.15.19:0/1582632236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde6c075100 con 0x7fde54004d40 2024-03-08T06:03:25.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.066+0000 7fde66000640 1 -- 172.21.15.19:0/1582632236 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7fde60018030 con 0x7fde54004d40 2024-03-08T06:03:25.067 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:25.067 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:03:22.069498+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:03:18.392703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T06:03:19.537912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:03:25.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.068+0000 7fde73200640 1 -- 172.21.15.19:0/1582632236 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fde5006b4d0 msgr2=0x7fde5006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.068+0000 7fde73200640 1 --2- 172.21.15.19:0/1582632236 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fde5006b4d0 0x7fde5006d990 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fde5c000c00 tx=0x7fde5c000f50 comp rx=0 tx=0).stop 2024-03-08T06:03:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.068+0000 7fde73200640 1 -- 172.21.15.19:0/1582632236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54004d40 msgr2=0x7fde6c15b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.068+0000 7fde73200640 1 --2- 172.21.15.19:0/1582632236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54004d40 0x7fde6c15b070 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fde600109d0 tx=0x7fde60010e90 comp rx=0 tx=0).stop 2024-03-08T06:03:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.068+0000 7fde73200640 1 -- 172.21.15.19:0/1582632236 shutdown_connections 2024-03-08T06:03:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.068+0000 7fde73200640 1 --2- 172.21.15.19:0/1582632236 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fde5006b4d0 0x7fde5006d990 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.069+0000 7fde73200640 1 --2- 172.21.15.19:0/1582632236 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde6c159550 0x7fde6c15e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.069+0000 7fde73200640 1 --2- 172.21.15.19:0/1582632236 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde6c1580e0 0x7fde6c159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.069+0000 7fde73200640 1 --2- 172.21.15.19:0/1582632236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54004d40 0x7fde6c15b070 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.069+0000 7fde73200640 1 -- 172.21.15.19:0/1582632236 >> 172.21.15.19:0/1582632236 conn(0x7fde6c0b1850 msgr2=0x7fde6c0b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.069+0000 7fde73200640 1 -- 172.21.15.19:0/1582632236 shutdown_connections 2024-03-08T06:03:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.069+0000 7fde73200640 1 -- 172.21.15.19:0/1582632236 wait complete. 2024-03-08T06:03:25.089 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-08T06:03:25.089 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T06:03:25.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.303+0000 7f6f03200640 1 Processor -- start 2024-03-08T06:03:25.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.304+0000 7f6f03200640 1 -- start start 2024-03-08T06:03:25.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.305+0000 7f6f03200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6f0415fa00 0x7f6f040b2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:25.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.305+0000 7f6f03200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6f041624d0 0x7f6f040b4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:25.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.305+0000 7f6f03200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f04162960 con 0x7f6f040b4b90 2024-03-08T06:03:25.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.305+0000 7f6f03200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f04162c40 con 0x7f6f0415fa00 2024-03-08T06:03:25.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.305+0000 7f6f03200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f04162f20 con 0x7f6f041624d0 2024-03-08T06:03:25.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.306+0000 7f6ef9400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6f041624d0 0x7f6f040b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:25.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.306+0000 7f6f01e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6f0415fa00 0x7f6f040b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:25.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.306+0000 7f6ef9400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6f041624d0 0x7f6f040b4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.19:49574/0 (socket says 172.21.15.19:49574) 2024-03-08T06:03:25.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.306+0000 7f6ef9400640 1 -- 172.21.15.19:0/3077218889 learned_addr learned my addr 172.21.15.19:0/3077218889 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:25.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.307+0000 7f6ef9400640 1 -- 172.21.15.19:0/3077218889 >> v2:172.21.15.42:3300/0 conn(0x7f6f0415fa00 msgr2=0x7f6f040b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:25.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.307+0000 7f6ef9400640 1 --2- 172.21.15.19:0/3077218889 >> v2:172.21.15.42:3300/0 conn(0x7f6f0415fa00 0x7f6f040b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:25.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.307+0000 7f6ef9400640 1 -- 172.21.15.19:0/3077218889 >> v1:172.21.15.42:6789/0 conn(0x7f6f040b4b90 legacy=0x7f6f040716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:25.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.307+0000 7f6ef9400640 1 -- 172.21.15.19:0/3077218889 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f04163200 con 0x7f6f041624d0 2024-03-08T06:03:25.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.307+0000 7f6f01e00640 1 --2- 172.21.15.19:0/3077218889 >> v2:172.21.15.42:3300/0 conn(0x7f6f0415fa00 0x7f6f040b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T06:03:25.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.308+0000 7f6ef9400640 1 --2- 172.21.15.19:0/3077218889 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6f041624d0 0x7f6f040b4650 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009870 tx=0x7f6eec02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=633f7018a6b49ea1 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:25.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.309+0000 7f6f01400640 1 -- 172.21.15.19:0/3077218889 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec035020 con 0x7f6f041624d0 2024-03-08T06:03:25.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.309+0000 7f6f01400640 1 -- 172.21.15.19:0/3077218889 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec031640 con 0x7f6f041624d0 2024-03-08T06:03:25.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.309+0000 7f6f01400640 1 -- 172.21.15.19:0/3077218889 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec02d040 con 0x7f6f041624d0 2024-03-08T06:03:25.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.310+0000 7f6f03200640 1 -- 172.21.15.19:0/3077218889 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6f041624d0 msgr2=0x7f6f040b4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:25.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.310+0000 7f6f03200640 1 --2- 172.21.15.19:0/3077218889 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6f041624d0 0x7f6f040b4650 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009870 tx=0x7f6eec02b8f0 comp rx=0 tx=0).stop 2024-03-08T06:03:25.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.310+0000 7f6f03200640 1 -- 172.21.15.19:0/3077218889 shutdown_connections 2024-03-08T06:03:25.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.310+0000 7f6f03200640 1 --2- 172.21.15.19:0/3077218889 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6f041624d0 0x7f6f040b4650 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:25.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.310+0000 7f6f03200640 1 --2- 172.21.15.19:0/3077218889 >> v2:172.21.15.42:3300/0 conn(0x7f6f0415fa00 0x7f6f040b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:25.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.310+0000 7f6f03200640 1 -- 172.21.15.19:0/3077218889 >> 172.21.15.19:0/3077218889 conn(0x7f6f040b1850 msgr2=0x7f6f040b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:25.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.310+0000 7f6f03200640 1 -- 172.21.15.19:0/3077218889 shutdown_connections 2024-03-08T06:03:25.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.310+0000 7f6f03200640 1 -- 172.21.15.19:0/3077218889 wait complete. 2024-03-08T06:03:25.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.312+0000 7f6f03200640 1 Processor -- start 2024-03-08T06:03:25.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.312+0000 7f6f03200640 1 -- start start 2024-03-08T06:03:25.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.313+0000 7f6f03200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f040b4b90 0x7f6f0415cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:25.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.313+0000 7f6f03200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6f0415fa00 0x7f6f041612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:25.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.313+0000 7f6f03200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f0415b5e0 0x7f6f0415ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:25.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.313+0000 7f6f03200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f040b3030 con 0x7f6f0415b5e0 2024-03-08T06:03:25.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.313+0000 7f6f03200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f040b2eb0 con 0x7f6f040b4b90 2024-03-08T06:03:25.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.313+0000 7f6f03200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f04071df0 con 0x7f6f0415fa00 2024-03-08T06:03:25.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.313+0000 7f6f02800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f0415b5e0 0x7f6f0415ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.314+0000 7f6f02800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f0415b5e0 0x7f6f0415ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33402/0 (socket says 172.21.15.19:33402) 2024-03-08T06:03:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.314+0000 7f6f02800640 1 -- 172.21.15.19:0/1762378035 learned_addr learned my addr 172.21.15.19:0/1762378035 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.314+0000 7f6f01e00640 1 --2- 172.21.15.19:0/1762378035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f040b4b90 0x7f6f0415cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.314+0000 7f6ef9400640 1 --2- 172.21.15.19:0/1762378035 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6f0415fa00 0x7f6f041612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.314+0000 7f6f02800640 1 -- 172.21.15.19:0/1762378035 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6f0415fa00 msgr2=0x7f6f041612b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.314+0000 7f6f02800640 1 --2- 172.21.15.19:0/1762378035 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6f0415fa00 0x7f6f041612b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.314+0000 7f6f02800640 1 -- 172.21.15.19:0/1762378035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f040b4b90 msgr2=0x7f6f0415cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.314+0000 7f6f02800640 1 --2- 172.21.15.19:0/1762378035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f040b4b90 0x7f6f0415cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.314+0000 7f6f02800640 1 -- 172.21.15.19:0/1762378035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f040a84d0 con 0x7f6f0415b5e0 2024-03-08T06:03:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.314+0000 7f6f02800640 1 --2- 172.21.15.19:0/1762378035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f0415b5e0 0x7f6f0415ba50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00c760 tx=0x7f6efc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:25.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.315+0000 7f6efaa00640 1 -- 172.21.15.19:0/1762378035 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc003b70 con 0x7f6f0415b5e0 2024-03-08T06:03:25.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.315+0000 7f6efaa00640 1 -- 172.21.15.19:0/1762378035 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6efc003d10 con 0x7f6f0415b5e0 2024-03-08T06:03:25.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.315+0000 7f6efaa00640 1 -- 172.21.15.19:0/1762378035 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc00aa90 con 0x7f6f0415b5e0 2024-03-08T06:03:25.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.315+0000 7f6f03200640 1 -- 172.21.15.19:0/1762378035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f040af310 con 0x7f6f0415b5e0 2024-03-08T06:03:25.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.315+0000 7f6f03200640 1 -- 172.21.15.19:0/1762378035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f0415c3f0 con 0x7f6f0415b5e0 2024-03-08T06:03:25.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.316+0000 7f6f03200640 1 -- 172.21.15.19:0/1762378035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f04075100 con 0x7f6f0415b5e0 2024-03-08T06:03:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.317+0000 7f6efaa00640 1 -- 172.21.15.19:0/1762378035 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6efc00ac30 con 0x7f6f0415b5e0 2024-03-08T06:03:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.318+0000 7f6efaa00640 1 --2- 172.21.15.19:0/1762378035 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6ee006b4d0 0x7f6ee006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.319+0000 7f6efaa00640 1 -- 172.21.15.19:0/1762378035 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6efc08a100 con 0x7f6f0415b5e0 2024-03-08T06:03:25.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.319+0000 7f6f01e00640 1 --2- 172.21.15.19:0/1762378035 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6ee006b4d0 0x7f6ee006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:25.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.319+0000 7f6f01e00640 1 --2- 172.21.15.19:0/1762378035 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6ee006b4d0 0x7f6ee006d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009560 tx=0x7f6ef4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:25.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.323+0000 7f6efaa00640 1 -- 172.21.15.19:0/1762378035 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6efc058ee0 con 0x7f6f0415b5e0 2024-03-08T06:03:25.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.518+0000 7f6f03200640 1 -- 172.21.15.19:0/1762378035 --> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f040cdb70 con 0x7f6ee006b4d0 2024-03-08T06:03:25.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.541+0000 7f6efaa00640 1 -- 172.21.15.19:0/1762378035 <== mgr.4107 v2:172.21.15.19:6832/3589745192 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251902 (secure 0 0 0) 0x7f6f040cdb70 con 0x7f6ee006b4d0 2024-03-08T06:03:25.546 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:25.548 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-08T06:03:25.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.547+0000 7f6f03200640 1 -- 172.21.15.19:0/1762378035 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6ee006b4d0 msgr2=0x7f6ee006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:25.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.547+0000 7f6f03200640 1 --2- 172.21.15.19:0/1762378035 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6ee006b4d0 0x7f6ee006d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009560 tx=0x7f6ef4009190 comp rx=0 tx=0).stop 2024-03-08T06:03:25.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.547+0000 7f6f03200640 1 -- 172.21.15.19:0/1762378035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f0415b5e0 msgr2=0x7f6f0415ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:25.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.547+0000 7f6f03200640 1 --2- 172.21.15.19:0/1762378035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f0415b5e0 0x7f6f0415ba50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00c760 tx=0x7f6efc00cc20 comp rx=0 tx=0).stop 2024-03-08T06:03:25.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.547+0000 7f6f03200640 1 -- 172.21.15.19:0/1762378035 shutdown_connections 2024-03-08T06:03:25.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.547+0000 7f6f03200640 1 --2- 172.21.15.19:0/1762378035 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6ee006b4d0 0x7f6ee006d990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:25.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.547+0000 7f6f03200640 1 --2- 172.21.15.19:0/1762378035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f0415b5e0 0x7f6f0415ba50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:25.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.547+0000 7f6f03200640 1 --2- 172.21.15.19:0/1762378035 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6f0415fa00 0x7f6f041612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:25.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.547+0000 7f6f03200640 1 --2- 172.21.15.19:0/1762378035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6f040b4b90 0x7f6f0415cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:25.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.547+0000 7f6f03200640 1 -- 172.21.15.19:0/1762378035 >> 172.21.15.19:0/1762378035 conn(0x7f6f040b1850 msgr2=0x7f6f0406d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:25.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.547+0000 7f6f03200640 1 -- 172.21.15.19:0/1762378035 shutdown_connections 2024-03-08T06:03:25.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.547+0000 7f6f03200640 1 -- 172.21.15.19:0/1762378035 wait complete. 2024-03-08T06:03:25.569 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-03-08T06:03:24.076306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235824,"kb_used_data":2860,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738896,"statfs":{"total":773094113280,"available":772852629504,"internally_reserved":0,"allocated":2928640,"data_stored":1758896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":20,"num_read_kb":18,"num_write":81,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.218667"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090939+0000","last_change":"2024-03-08T06:03:21.089349+0000","last_active":"2024-03-08T06:03:22.090939+0000","last_peered":"2024-03-08T06:03:22.090939+0000","last_clean":"2024-03-08T06:03:22.090939+0000","last_became_active":"2024-03-08T06:03:21.085662+0000","last_became_peered":"2024-03-08T06:03:21.085662+0000","last_unstale":"2024-03-08T06:03:22.090939+0000","last_undegraded":"2024-03-08T06:03:22.090939+0000","last_fullsized":"2024-03-08T06:03:22.090939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:18:48.558283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087395+0000","last_change":"2024-03-08T06:03:21.089313+0000","last_active":"2024-03-08T06:03:22.087395+0000","last_peered":"2024-03-08T06:03:22.087395+0000","last_clean":"2024-03-08T06:03:22.087395+0000","last_became_active":"2024-03-08T06:03:21.088958+0000","last_became_peered":"2024-03-08T06:03:21.088958+0000","last_unstale":"2024-03-08T06:03:22.087395+0000","last_undegraded":"2024-03-08T06:03:22.087395+0000","last_fullsized":"2024-03-08T06:03:22.087395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:23:37.355382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.105633+0000","last_change":"2024-03-08T06:03:21.098797+0000","last_active":"2024-03-08T06:03:21.105633+0000","last_peered":"2024-03-08T06:03:21.105633+0000","last_clean":"2024-03-08T06:03:21.105633+0000","last_became_active":"2024-03-08T06:03:21.098387+0000","last_became_peered":"2024-03-08T06:03:21.098387+0000","last_unstale":"2024-03-08T06:03:21.105633+0000","last_undegraded":"2024-03-08T06:03:21.105633+0000","last_fullsized":"2024-03-08T06:03:21.105633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:23.037684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.110356+0000","last_change":"2024-03-08T06:03:21.099948+0000","last_active":"2024-03-08T06:03:21.110356+0000","last_peered":"2024-03-08T06:03:21.110356+0000","last_clean":"2024-03-08T06:03:21.110356+0000","last_became_active":"2024-03-08T06:03:21.097388+0000","last_became_peered":"2024-03-08T06:03:21.097388+0000","last_unstale":"2024-03-08T06:03:21.110356+0000","last_undegraded":"2024-03-08T06:03:21.110356+0000","last_fullsized":"2024-03-08T06:03:21.110356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:42.646547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088264+0000","last_change":"2024-03-08T06:03:21.080856+0000","last_active":"2024-03-08T06:03:22.088264+0000","last_peered":"2024-03-08T06:03:22.088264+0000","last_clean":"2024-03-08T06:03:22.088264+0000","last_became_active":"2024-03-08T06:03:21.080513+0000","last_became_peered":"2024-03-08T06:03:21.080513+0000","last_unstale":"2024-03-08T06:03:22.088264+0000","last_undegraded":"2024-03-08T06:03:22.088264+0000","last_fullsized":"2024-03-08T06:03:22.088264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:49:03.245653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.114126+0000","last_change":"2024-03-08T06:03:21.106729+0000","last_active":"2024-03-08T06:03:21.114126+0000","last_peered":"2024-03-08T06:03:21.114126+0000","last_clean":"2024-03-08T06:03:21.114126+0000","last_became_active":"2024-03-08T06:03:21.106444+0000","last_became_peered":"2024-03-08T06:03:21.106444+0000","last_unstale":"2024-03-08T06:03:21.114126+0000","last_undegraded":"2024-03-08T06:03:21.114126+0000","last_fullsized":"2024-03-08T06:03:21.114126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:48:27.568109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087914+0000","last_change":"2024-03-08T06:03:21.091772+0000","last_active":"2024-03-08T06:03:22.087914+0000","last_peered":"2024-03-08T06:03:22.087914+0000","last_clean":"2024-03-08T06:03:22.087914+0000","last_became_active":"2024-03-08T06:03:21.091340+0000","last_became_peered":"2024-03-08T06:03:21.091340+0000","last_unstale":"2024-03-08T06:03:22.087914+0000","last_undegraded":"2024-03-08T06:03:22.087914+0000","last_fullsized":"2024-03-08T06:03:22.087914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:48:37.493932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.095793+0000","last_change":"2024-03-08T06:03:21.091248+0000","last_active":"2024-03-08T06:03:21.095793+0000","last_peered":"2024-03-08T06:03:21.095793+0000","last_clean":"2024-03-08T06:03:21.095793+0000","last_became_active":"2024-03-08T06:03:21.090881+0000","last_became_peered":"2024-03-08T06:03:21.090881+0000","last_unstale":"2024-03-08T06:03:21.095793+0000","last_undegraded":"2024-03-08T06:03:21.095793+0000","last_fullsized":"2024-03-08T06:03:21.095793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:27.959321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090833+0000","last_change":"2024-03-08T06:03:21.116525+0000","last_active":"2024-03-08T06:03:22.090833+0000","last_peered":"2024-03-08T06:03:22.090833+0000","last_clean":"2024-03-08T06:03:22.090833+0000","last_became_active":"2024-03-08T06:03:21.116143+0000","last_became_peered":"2024-03-08T06:03:21.116143+0000","last_unstale":"2024-03-08T06:03:22.090833+0000","last_undegraded":"2024-03-08T06:03:22.090833+0000","last_fullsized":"2024-03-08T06:03:22.090833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:19:57.197522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.116588+0000","last_change":"2024-03-08T06:03:21.108467+0000","last_active":"2024-03-08T06:03:21.116588+0000","last_peered":"2024-03-08T06:03:21.116588+0000","last_clean":"2024-03-08T06:03:21.116588+0000","last_became_active":"2024-03-08T06:03:21.108167+0000","last_became_peered":"2024-03-08T06:03:21.108167+0000","last_unstale":"2024-03-08T06:03:21.116588+0000","last_undegraded":"2024-03-08T06:03:21.116588+0000","last_fullsized":"2024-03-08T06:03:21.116588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:10:52.112651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.106269+0000","last_change":"2024-03-08T06:03:21.097402+0000","last_active":"2024-03-08T06:03:21.106269+0000","last_peered":"2024-03-08T06:03:21.106269+0000","last_clean":"2024-03-08T06:03:21.106269+0000","last_became_active":"2024-03-08T06:03:21.097092+0000","last_became_peered":"2024-03-08T06:03:21.097092+0000","last_unstale":"2024-03-08T06:03:21.106269+0000","last_undegraded":"2024-03-08T06:03:21.106269+0000","last_fullsized":"2024-03-08T06:03:21.106269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:48:27.568109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.089691+0000","last_change":"2024-03-08T06:03:21.094282+0000","last_active":"2024-03-08T06:03:22.089691+0000","last_peered":"2024-03-08T06:03:22.089691+0000","last_clean":"2024-03-08T06:03:22.089691+0000","last_became_active":"2024-03-08T06:03:21.093991+0000","last_became_peered":"2024-03-08T06:03:21.093991+0000","last_unstale":"2024-03-08T06:03:22.089691+0000","last_undegraded":"2024-03-08T06:03:22.089691+0000","last_fullsized":"2024-03-08T06:03:22.089691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:42.646547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.095738+0000","last_change":"2024-03-08T06:03:21.089482+0000","last_active":"2024-03-08T06:03:21.095738+0000","last_peered":"2024-03-08T06:03:21.095738+0000","last_clean":"2024-03-08T06:03:21.095738+0000","last_became_active":"2024-03-08T06:03:21.088934+0000","last_became_peered":"2024-03-08T06:03:21.088934+0000","last_unstale":"2024-03-08T06:03:21.095738+0000","last_undegraded":"2024-03-08T06:03:21.095738+0000","last_fullsized":"2024-03-08T06:03:21.095738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:23.037684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.108422+0000","last_change":"2024-03-08T06:03:21.100913+0000","last_active":"2024-03-08T06:03:21.108422+0000","last_peered":"2024-03-08T06:03:21.108422+0000","last_clean":"2024-03-08T06:03:21.108422+0000","last_became_active":"2024-03-08T06:03:21.097463+0000","last_became_peered":"2024-03-08T06:03:21.097463+0000","last_unstale":"2024-03-08T06:03:21.108422+0000","last_undegraded":"2024-03-08T06:03:21.108422+0000","last_fullsized":"2024-03-08T06:03:21.108422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:42.646547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087416+0000","last_change":"2024-03-08T06:03:21.073630+0000","last_active":"2024-03-08T06:03:22.087416+0000","last_peered":"2024-03-08T06:03:22.087416+0000","last_clean":"2024-03-08T06:03:22.087416+0000","last_became_active":"2024-03-08T06:03:21.073333+0000","last_became_peered":"2024-03-08T06:03:21.073333+0000","last_unstale":"2024-03-08T06:03:22.087416+0000","last_undegraded":"2024-03-08T06:03:22.087416+0000","last_fullsized":"2024-03-08T06:03:22.087416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:27:57.207381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.113826+0000","last_change":"2024-03-08T06:03:21.096870+0000","last_active":"2024-03-08T06:03:21.113826+0000","last_peered":"2024-03-08T06:03:21.113826+0000","last_clean":"2024-03-08T06:03:21.113826+0000","last_became_active":"2024-03-08T06:03:21.096623+0000","last_became_peered":"2024-03-08T06:03:21.096623+0000","last_unstale":"2024-03-08T06:03:21.113826+0000","last_undegraded":"2024-03-08T06:03:21.113826+0000","last_fullsized":"2024-03-08T06:03:21.113826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:54:48.839891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.114474+0000","last_change":"2024-03-08T06:03:21.113130+0000","last_active":"2024-03-08T06:03:21.114474+0000","last_peered":"2024-03-08T06:03:21.114474+0000","last_clean":"2024-03-08T06:03:21.114474+0000","last_became_active":"2024-03-08T06:03:21.110951+0000","last_became_peered":"2024-03-08T06:03:21.110951+0000","last_unstale":"2024-03-08T06:03:21.114474+0000","last_undegraded":"2024-03-08T06:03:21.114474+0000","last_fullsized":"2024-03-08T06:03:21.114474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:10:52.112651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.097880+0000","last_change":"2024-03-08T06:03:21.093041+0000","last_active":"2024-03-08T06:03:21.097880+0000","last_peered":"2024-03-08T06:03:21.097880+0000","last_clean":"2024-03-08T06:03:21.097880+0000","last_became_active":"2024-03-08T06:03:21.092766+0000","last_became_peered":"2024-03-08T06:03:21.092766+0000","last_unstale":"2024-03-08T06:03:21.097880+0000","last_undegraded":"2024-03-08T06:03:21.097880+0000","last_fullsized":"2024-03-08T06:03:21.097880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:23.037684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090177+0000","last_change":"2024-03-08T06:03:21.083536+0000","last_active":"2024-03-08T06:03:22.090177+0000","last_peered":"2024-03-08T06:03:22.090177+0000","last_clean":"2024-03-08T06:03:22.090177+0000","last_became_active":"2024-03-08T06:03:21.083203+0000","last_became_peered":"2024-03-08T06:03:21.083203+0000","last_unstale":"2024-03-08T06:03:22.090177+0000","last_undegraded":"2024-03-08T06:03:22.090177+0000","last_fullsized":"2024-03-08T06:03:22.090177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:17:34.427952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.109774+0000","last_change":"2024-03-08T06:03:21.099174+0000","last_active":"2024-03-08T06:03:21.109774+0000","last_peered":"2024-03-08T06:03:21.109774+0000","last_clean":"2024-03-08T06:03:21.109774+0000","last_became_active":"2024-03-08T06:03:21.098562+0000","last_became_peered":"2024-03-08T06:03:21.098562+0000","last_unstale":"2024-03-08T06:03:21.109774+0000","last_undegraded":"2024-03-08T06:03:21.109774+0000","last_fullsized":"2024-03-08T06:03:21.109774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:33:15.887777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.099679+0000","last_change":"2024-03-08T06:03:21.090407+0000","last_active":"2024-03-08T06:03:21.099679+0000","last_peered":"2024-03-08T06:03:21.099679+0000","last_clean":"2024-03-08T06:03:21.099679+0000","last_became_active":"2024-03-08T06:03:21.090050+0000","last_became_peered":"2024-03-08T06:03:21.090050+0000","last_unstale":"2024-03-08T06:03:21.099679+0000","last_undegraded":"2024-03-08T06:03:21.099679+0000","last_fullsized":"2024-03-08T06:03:21.099679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:44:32.153058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.113845+0000","last_change":"2024-03-08T06:03:21.103042+0000","last_active":"2024-03-08T06:03:21.113845+0000","last_peered":"2024-03-08T06:03:21.113845+0000","last_clean":"2024-03-08T06:03:21.113845+0000","last_became_active":"2024-03-08T06:03:21.102711+0000","last_became_peered":"2024-03-08T06:03:21.102711+0000","last_unstale":"2024-03-08T06:03:21.113845+0000","last_undegraded":"2024-03-08T06:03:21.113845+0000","last_fullsized":"2024-03-08T06:03:21.113845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:32:38.303917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.103055+0000","last_change":"2024-03-08T06:03:21.094816+0000","last_active":"2024-03-08T06:03:21.103055+0000","last_peered":"2024-03-08T06:03:21.103055+0000","last_clean":"2024-03-08T06:03:21.103055+0000","last_became_active":"2024-03-08T06:03:21.092861+0000","last_became_peered":"2024-03-08T06:03:21.092861+0000","last_unstale":"2024-03-08T06:03:21.103055+0000","last_undegraded":"2024-03-08T06:03:21.103055+0000","last_fullsized":"2024-03-08T06:03:21.103055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:32:38.303917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.113800+0000","last_change":"2024-03-08T06:03:21.096814+0000","last_active":"2024-03-08T06:03:21.113800+0000","last_peered":"2024-03-08T06:03:21.113800+0000","last_clean":"2024-03-08T06:03:21.113800+0000","last_became_active":"2024-03-08T06:03:21.096448+0000","last_became_peered":"2024-03-08T06:03:21.096448+0000","last_unstale":"2024-03-08T06:03:21.113800+0000","last_undegraded":"2024-03-08T06:03:21.113800+0000","last_fullsized":"2024-03-08T06:03:21.113800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:54:21.540639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.105122+0000","last_change":"2024-03-08T06:03:21.101873+0000","last_active":"2024-03-08T06:03:21.105122+0000","last_peered":"2024-03-08T06:03:21.105122+0000","last_clean":"2024-03-08T06:03:21.105122+0000","last_became_active":"2024-03-08T06:03:21.101436+0000","last_became_peered":"2024-03-08T06:03:21.101436+0000","last_unstale":"2024-03-08T06:03:21.105122+0000","last_undegraded":"2024-03-08T06:03:21.105122+0000","last_fullsized":"2024-03-08T06:03:21.105122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:33:15.887777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.102703+0000","last_change":"2024-03-08T06:03:21.093616+0000","last_active":"2024-03-08T06:03:21.102703+0000","last_peered":"2024-03-08T06:03:21.102703+0000","last_clean":"2024-03-08T06:03:21.102703+0000","last_became_active":"2024-03-08T06:03:21.093287+0000","last_became_peered":"2024-03-08T06:03:21.093287+0000","last_unstale":"2024-03-08T06:03:21.102703+0000","last_undegraded":"2024-03-08T06:03:21.102703+0000","last_fullsized":"2024-03-08T06:03:21.102703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:21:05.940407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087812+0000","last_change":"2024-03-08T06:03:21.081645+0000","last_active":"2024-03-08T06:03:22.087812+0000","last_peered":"2024-03-08T06:03:22.087812+0000","last_clean":"2024-03-08T06:03:22.087812+0000","last_became_active":"2024-03-08T06:03:21.079927+0000","last_became_peered":"2024-03-08T06:03:21.079927+0000","last_unstale":"2024-03-08T06:03:22.087812+0000","last_undegraded":"2024-03-08T06:03:22.087812+0000","last_fullsized":"2024-03-08T06:03:22.087812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:29:07.055814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.105154+0000","last_change":"2024-03-08T06:03:21.101884+0000","last_active":"2024-03-08T06:03:21.105154+0000","last_peered":"2024-03-08T06:03:21.105154+0000","last_clean":"2024-03-08T06:03:21.105154+0000","last_became_active":"2024-03-08T06:03:21.101536+0000","last_became_peered":"2024-03-08T06:03:21.101536+0000","last_unstale":"2024-03-08T06:03:21.105154+0000","last_undegraded":"2024-03-08T06:03:21.105154+0000","last_fullsized":"2024-03-08T06:03:21.105154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:10:52.112651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.100914+0000","last_change":"2024-03-08T06:03:21.096440+0000","last_active":"2024-03-08T06:03:21.100914+0000","last_peered":"2024-03-08T06:03:21.100914+0000","last_clean":"2024-03-08T06:03:21.100914+0000","last_became_active":"2024-03-08T06:03:21.095943+0000","last_became_peered":"2024-03-08T06:03:21.095943+0000","last_unstale":"2024-03-08T06:03:21.100914+0000","last_undegraded":"2024-03-08T06:03:21.100914+0000","last_fullsized":"2024-03-08T06:03:21.100914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:54:48.839891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.110706+0000","last_change":"2024-03-08T06:03:21.100381+0000","last_active":"2024-03-08T06:03:21.110706+0000","last_peered":"2024-03-08T06:03:21.110706+0000","last_clean":"2024-03-08T06:03:21.110706+0000","last_became_active":"2024-03-08T06:03:21.095958+0000","last_became_peered":"2024-03-08T06:03:21.095958+0000","last_unstale":"2024-03-08T06:03:21.110706+0000","last_undegraded":"2024-03-08T06:03:21.110706+0000","last_fullsized":"2024-03-08T06:03:21.110706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:21:05.940407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.108060+0000","last_change":"2024-03-08T06:03:21.105006+0000","last_active":"2024-03-08T06:03:21.108060+0000","last_peered":"2024-03-08T06:03:21.108060+0000","last_clean":"2024-03-08T06:03:21.108060+0000","last_became_active":"2024-03-08T06:03:21.104720+0000","last_became_peered":"2024-03-08T06:03:21.104720+0000","last_unstale":"2024-03-08T06:03:21.108060+0000","last_undegraded":"2024-03-08T06:03:21.108060+0000","last_fullsized":"2024-03-08T06:03:21.108060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:31.826322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.111595+0000","last_change":"2024-03-08T06:03:21.096533+0000","last_active":"2024-03-08T06:03:21.111595+0000","last_peered":"2024-03-08T06:03:21.111595+0000","last_clean":"2024-03-08T06:03:21.111595+0000","last_became_active":"2024-03-08T06:03:21.096204+0000","last_became_peered":"2024-03-08T06:03:21.096204+0000","last_unstale":"2024-03-08T06:03:21.111595+0000","last_undegraded":"2024-03-08T06:03:21.111595+0000","last_fullsized":"2024-03-08T06:03:21.111595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:32:38.303917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087486+0000","last_change":"2024-03-08T06:03:21.076936+0000","last_active":"2024-03-08T06:03:22.087486+0000","last_peered":"2024-03-08T06:03:22.087486+0000","last_clean":"2024-03-08T06:03:22.087486+0000","last_became_active":"2024-03-08T06:03:21.076550+0000","last_became_peered":"2024-03-08T06:03:21.076550+0000","last_unstale":"2024-03-08T06:03:22.087486+0000","last_undegraded":"2024-03-08T06:03:22.087486+0000","last_fullsized":"2024-03-08T06:03:22.087486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:23.037684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.107853+0000","last_change":"2024-03-08T06:03:20.068219+0000","last_active":"2024-03-08T06:03:21.107853+0000","last_peered":"2024-03-08T06:03:21.107853+0000","last_clean":"2024-03-08T06:03:21.107853+0000","last_became_active":"2024-03-08T06:03:20.067429+0000","last_became_peered":"2024-03-08T06:03:20.067429+0000","last_unstale":"2024-03-08T06:03:21.107853+0000","last_undegraded":"2024-03-08T06:03:21.107853+0000","last_fullsized":"2024-03-08T06:03:21.107853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:54:20.527395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.108434+0000","last_change":"2024-03-08T06:03:21.101698+0000","last_active":"2024-03-08T06:03:21.108434+0000","last_peered":"2024-03-08T06:03:21.108434+0000","last_clean":"2024-03-08T06:03:21.108434+0000","last_became_active":"2024-03-08T06:03:21.101361+0000","last_became_peered":"2024-03-08T06:03:21.101361+0000","last_unstale":"2024-03-08T06:03:21.108434+0000","last_undegraded":"2024-03-08T06:03:21.108434+0000","last_fullsized":"2024-03-08T06:03:21.108434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:27.959321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.112947+0000","last_change":"2024-03-08T06:03:20.055111+0000","last_active":"2024-03-08T06:03:21.112947+0000","last_peered":"2024-03-08T06:03:21.112947+0000","last_clean":"2024-03-08T06:03:21.112947+0000","last_became_active":"2024-03-08T06:03:20.054685+0000","last_became_peered":"2024-03-08T06:03:20.054685+0000","last_unstale":"2024-03-08T06:03:21.112947+0000","last_undegraded":"2024-03-08T06:03:21.112947+0000","last_fullsized":"2024-03-08T06:03:21.112947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:54:47.826647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.068644+0000","last_change":"2024-03-08T06:03:20.069995+0000","last_active":"2024-03-08T06:03:21.068644+0000","last_peered":"2024-03-08T06:03:21.068644+0000","last_clean":"2024-03-08T06:03:21.068644+0000","last_became_active":"2024-03-08T06:03:20.069729+0000","last_became_peered":"2024-03-08T06:03:20.069729+0000","last_unstale":"2024-03-08T06:03:21.068644+0000","last_undegraded":"2024-03-08T06:03:21.068644+0000","last_fullsized":"2024-03-08T06:03:21.068644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:44:31.139813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.105383+0000","last_change":"2024-03-08T06:03:21.096605+0000","last_active":"2024-03-08T06:03:21.105383+0000","last_peered":"2024-03-08T06:03:21.105383+0000","last_clean":"2024-03-08T06:03:21.105383+0000","last_became_active":"2024-03-08T06:03:21.096303+0000","last_became_peered":"2024-03-08T06:03:21.096303+0000","last_unstale":"2024-03-08T06:03:21.105383+0000","last_undegraded":"2024-03-08T06:03:21.105383+0000","last_fullsized":"2024-03-08T06:03:21.105383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:48:27.568109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.113990+0000","last_change":"2024-03-08T06:03:20.061872+0000","last_active":"2024-03-08T06:03:21.113990+0000","last_peered":"2024-03-08T06:03:21.113990+0000","last_clean":"2024-03-08T06:03:21.113990+0000","last_became_active":"2024-03-08T06:03:20.061611+0000","last_became_peered":"2024-03-08T06:03:20.061611+0000","last_unstale":"2024-03-08T06:03:21.113990+0000","last_undegraded":"2024-03-08T06:03:21.113990+0000","last_fullsized":"2024-03-08T06:03:21.113990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:23:36.342138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088422+0000","last_change":"2024-03-08T06:03:21.079662+0000","last_active":"2024-03-08T06:03:22.088422+0000","last_peered":"2024-03-08T06:03:22.088422+0000","last_clean":"2024-03-08T06:03:22.088422+0000","last_became_active":"2024-03-08T06:03:21.079269+0000","last_became_peered":"2024-03-08T06:03:21.079269+0000","last_unstale":"2024-03-08T06:03:22.088422+0000","last_undegraded":"2024-03-08T06:03:22.088422+0000","last_fullsized":"2024-03-08T06:03:22.088422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:57:16.249537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.089673+0000","last_change":"2024-03-08T06:03:20.070774+0000","last_active":"2024-03-08T06:03:21.089673+0000","last_peered":"2024-03-08T06:03:21.089673+0000","last_clean":"2024-03-08T06:03:21.089673+0000","last_became_active":"2024-03-08T06:03:20.070284+0000","last_became_peered":"2024-03-08T06:03:20.070284+0000","last_unstale":"2024-03-08T06:03:21.089673+0000","last_undegraded":"2024-03-08T06:03:21.089673+0000","last_fullsized":"2024-03-08T06:03:21.089673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:41.633303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.114363+0000","last_change":"2024-03-08T06:03:21.112968+0000","last_active":"2024-03-08T06:03:21.114363+0000","last_peered":"2024-03-08T06:03:21.114363+0000","last_clean":"2024-03-08T06:03:21.114363+0000","last_became_active":"2024-03-08T06:03:21.110774+0000","last_became_peered":"2024-03-08T06:03:21.110774+0000","last_unstale":"2024-03-08T06:03:21.114363+0000","last_undegraded":"2024-03-08T06:03:21.114363+0000","last_fullsized":"2024-03-08T06:03:21.114363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:33:15.887777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.115755+0000","last_change":"2024-03-08T06:03:20.060802+0000","last_active":"2024-03-08T06:03:21.115755+0000","last_peered":"2024-03-08T06:03:21.115755+0000","last_clean":"2024-03-08T06:03:21.115755+0000","last_became_active":"2024-03-08T06:03:20.060402+0000","last_became_peered":"2024-03-08T06:03:20.060402+0000","last_unstale":"2024-03-08T06:03:21.115755+0000","last_undegraded":"2024-03-08T06:03:21.115755+0000","last_fullsized":"2024-03-08T06:03:21.115755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:27:56.194137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.110959+0000","last_change":"2024-03-08T06:03:21.105833+0000","last_active":"2024-03-08T06:03:21.110959+0000","last_peered":"2024-03-08T06:03:21.110959+0000","last_clean":"2024-03-08T06:03:21.110959+0000","last_became_active":"2024-03-08T06:03:21.105465+0000","last_became_peered":"2024-03-08T06:03:21.105465+0000","last_unstale":"2024-03-08T06:03:21.110959+0000","last_undegraded":"2024-03-08T06:03:21.110959+0000","last_fullsized":"2024-03-08T06:03:21.110959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:32:38.303917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087739+0000","last_change":"2024-03-08T06:03:20.072273+0000","last_active":"2024-03-08T06:03:22.087739+0000","last_peered":"2024-03-08T06:03:22.087739+0000","last_clean":"2024-03-08T06:03:22.087739+0000","last_became_active":"2024-03-08T06:03:20.071389+0000","last_became_peered":"2024-03-08T06:03:20.071389+0000","last_unstale":"2024-03-08T06:03:22.087739+0000","last_undegraded":"2024-03-08T06:03:22.087739+0000","last_fullsized":"2024-03-08T06:03:22.087739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:30.813078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090022+0000","last_change":"2024-03-08T06:03:21.089054+0000","last_active":"2024-03-08T06:03:22.090022+0000","last_peered":"2024-03-08T06:03:22.090022+0000","last_clean":"2024-03-08T06:03:22.090022+0000","last_became_active":"2024-03-08T06:03:21.080309+0000","last_became_peered":"2024-03-08T06:03:21.080309+0000","last_unstale":"2024-03-08T06:03:22.090022+0000","last_undegraded":"2024-03-08T06:03:22.090022+0000","last_fullsized":"2024-03-08T06:03:22.090022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:27.959321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.118723+0000","last_change":"2024-03-08T06:03:20.068126+0000","last_active":"2024-03-08T06:03:21.118723+0000","last_peered":"2024-03-08T06:03:21.118723+0000","last_clean":"2024-03-08T06:03:21.118723+0000","last_became_active":"2024-03-08T06:03:20.067828+0000","last_became_peered":"2024-03-08T06:03:20.067828+0000","last_unstale":"2024-03-08T06:03:21.118723+0000","last_undegraded":"2024-03-08T06:03:21.118723+0000","last_fullsized":"2024-03-08T06:03:21.118723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:26.946077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.089371+0000","last_change":"2024-03-08T06:03:21.082117+0000","last_active":"2024-03-08T06:03:22.089371+0000","last_peered":"2024-03-08T06:03:22.089371+0000","last_clean":"2024-03-08T06:03:22.089371+0000","last_became_active":"2024-03-08T06:03:21.081852+0000","last_became_peered":"2024-03-08T06:03:21.081852+0000","last_unstale":"2024-03-08T06:03:22.089371+0000","last_undegraded":"2024-03-08T06:03:22.089371+0000","last_fullsized":"2024-03-08T06:03:22.089371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:52:15.212911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.112304+0000","last_change":"2024-03-08T06:03:20.055291+0000","last_active":"2024-03-08T06:03:21.112304+0000","last_peered":"2024-03-08T06:03:21.112304+0000","last_clean":"2024-03-08T06:03:21.112304+0000","last_became_active":"2024-03-08T06:03:20.054907+0000","last_became_peered":"2024-03-08T06:03:20.054907+0000","last_unstale":"2024-03-08T06:03:21.112304+0000","last_undegraded":"2024-03-08T06:03:21.112304+0000","last_fullsized":"2024-03-08T06:03:21.112304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:04:32.971131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.101063+0000","last_change":"2024-03-08T06:03:21.092104+0000","last_active":"2024-03-08T06:03:21.101063+0000","last_peered":"2024-03-08T06:03:21.101063+0000","last_clean":"2024-03-08T06:03:21.101063+0000","last_became_active":"2024-03-08T06:03:21.091723+0000","last_became_peered":"2024-03-08T06:03:21.091723+0000","last_unstale":"2024-03-08T06:03:21.101063+0000","last_undegraded":"2024-03-08T06:03:21.101063+0000","last_fullsized":"2024-03-08T06:03:21.101063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:54:21.540639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.113646+0000","last_change":"2024-03-08T06:03:20.068308+0000","last_active":"2024-03-08T06:03:21.113646+0000","last_peered":"2024-03-08T06:03:21.113646+0000","last_clean":"2024-03-08T06:03:21.113646+0000","last_became_active":"2024-03-08T06:03:20.068036+0000","last_became_peered":"2024-03-08T06:03:20.068036+0000","last_unstale":"2024-03-08T06:03:21.113646+0000","last_undegraded":"2024-03-08T06:03:21.113646+0000","last_fullsized":"2024-03-08T06:03:21.113646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:28:12.116799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088404+0000","last_change":"2024-03-08T06:03:21.102514+0000","last_active":"2024-03-08T06:03:22.088404+0000","last_peered":"2024-03-08T06:03:22.088404+0000","last_clean":"2024-03-08T06:03:22.088404+0000","last_became_active":"2024-03-08T06:03:21.101780+0000","last_became_peered":"2024-03-08T06:03:21.101780+0000","last_unstale":"2024-03-08T06:03:22.088404+0000","last_undegraded":"2024-03-08T06:03:22.088404+0000","last_fullsized":"2024-03-08T06:03:22.088404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:00:39.301215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.083016+0000","last_change":"2024-03-08T06:03:20.049517+0000","last_active":"2024-03-08T06:03:21.083016+0000","last_peered":"2024-03-08T06:03:21.083016+0000","last_clean":"2024-03-08T06:03:21.083016+0000","last_became_active":"2024-03-08T06:03:20.047972+0000","last_became_peered":"2024-03-08T06:03:20.047972+0000","last_unstale":"2024-03-08T06:03:21.083016+0000","last_undegraded":"2024-03-08T06:03:21.083016+0000","last_fullsized":"2024-03-08T06:03:21.083016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:54:20.527395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.089855+0000","last_change":"2024-03-08T06:03:21.085035+0000","last_active":"2024-03-08T06:03:21.089855+0000","last_peered":"2024-03-08T06:03:21.089855+0000","last_clean":"2024-03-08T06:03:21.089855+0000","last_became_active":"2024-03-08T06:03:21.084676+0000","last_became_peered":"2024-03-08T06:03:21.084676+0000","last_unstale":"2024-03-08T06:03:21.089855+0000","last_undegraded":"2024-03-08T06:03:21.089855+0000","last_fullsized":"2024-03-08T06:03:21.089855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:49.593181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.111368+0000","last_change":"2024-03-08T06:03:20.065172+0000","last_active":"2024-03-08T06:03:21.111368+0000","last_peered":"2024-03-08T06:03:21.111368+0000","last_clean":"2024-03-08T06:03:21.111368+0000","last_became_active":"2024-03-08T06:03:20.064854+0000","last_became_peered":"2024-03-08T06:03:20.064854+0000","last_unstale":"2024-03-08T06:03:21.111368+0000","last_undegraded":"2024-03-08T06:03:21.111368+0000","last_fullsized":"2024-03-08T06:03:21.111368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:54:20.527395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087834+0000","last_change":"2024-03-08T06:03:21.101352+0000","last_active":"2024-03-08T06:03:22.087834+0000","last_peered":"2024-03-08T06:03:22.087834+0000","last_clean":"2024-03-08T06:03:22.087834+0000","last_became_active":"2024-03-08T06:03:21.101040+0000","last_became_peered":"2024-03-08T06:03:21.101040+0000","last_unstale":"2024-03-08T06:03:22.087834+0000","last_undegraded":"2024-03-08T06:03:22.087834+0000","last_fullsized":"2024-03-08T06:03:22.087834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:57:49.623008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087854+0000","last_change":"2024-03-08T06:03:20.057635+0000","last_active":"2024-03-08T06:03:22.087854+0000","last_peered":"2024-03-08T06:03:22.087854+0000","last_clean":"2024-03-08T06:03:22.087854+0000","last_became_active":"2024-03-08T06:03:20.057209+0000","last_became_peered":"2024-03-08T06:03:20.057209+0000","last_unstale":"2024-03-08T06:03:22.087854+0000","last_undegraded":"2024-03-08T06:03:22.087854+0000","last_fullsized":"2024-03-08T06:03:22.087854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:46:53.297684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090632+0000","last_change":"2024-03-08T06:03:21.100194+0000","last_active":"2024-03-08T06:03:22.090632+0000","last_peered":"2024-03-08T06:03:22.090632+0000","last_clean":"2024-03-08T06:03:22.090632+0000","last_became_active":"2024-03-08T06:03:21.099871+0000","last_became_peered":"2024-03-08T06:03:21.099871+0000","last_unstale":"2024-03-08T06:03:22.090632+0000","last_undegraded":"2024-03-08T06:03:22.090632+0000","last_fullsized":"2024-03-08T06:03:22.090632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:05:42.148812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.110677+0000","last_change":"2024-03-08T06:03:20.063658+0000","last_active":"2024-03-08T06:03:21.110677+0000","last_peered":"2024-03-08T06:03:21.110677+0000","last_clean":"2024-03-08T06:03:21.110677+0000","last_became_active":"2024-03-08T06:03:20.063364+0000","last_became_peered":"2024-03-08T06:03:20.063364+0000","last_unstale":"2024-03-08T06:03:21.110677+0000","last_undegraded":"2024-03-08T06:03:21.110677+0000","last_fullsized":"2024-03-08T06:03:21.110677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:48.579937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090948+0000","last_change":"2024-03-08T06:03:21.100719+0000","last_active":"2024-03-08T06:03:22.090948+0000","last_peered":"2024-03-08T06:03:22.090948+0000","last_clean":"2024-03-08T06:03:22.090948+0000","last_became_active":"2024-03-08T06:03:21.100356+0000","last_became_peered":"2024-03-08T06:03:21.100356+0000","last_unstale":"2024-03-08T06:03:22.090948+0000","last_undegraded":"2024-03-08T06:03:22.090948+0000","last_fullsized":"2024-03-08T06:03:22.090948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:17:15.821002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088072+0000","last_change":"2024-03-08T06:03:20.053836+0000","last_active":"2024-03-08T06:03:22.088072+0000","last_peered":"2024-03-08T06:03:22.088072+0000","last_clean":"2024-03-08T06:03:22.088072+0000","last_became_active":"2024-03-08T06:03:20.053485+0000","last_became_peered":"2024-03-08T06:03:20.053485+0000","last_unstale":"2024-03-08T06:03:22.088072+0000","last_undegraded":"2024-03-08T06:03:22.088072+0000","last_fullsized":"2024-03-08T06:03:22.088072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:41.633303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.113414+0000","last_change":"2024-03-08T06:03:21.097727+0000","last_active":"2024-03-08T06:03:21.113414+0000","last_peered":"2024-03-08T06:03:21.113414+0000","last_clean":"2024-03-08T06:03:21.113414+0000","last_became_active":"2024-03-08T06:03:21.096995+0000","last_became_peered":"2024-03-08T06:03:21.096995+0000","last_unstale":"2024-03-08T06:03:21.113414+0000","last_undegraded":"2024-03-08T06:03:21.113414+0000","last_fullsized":"2024-03-08T06:03:21.113414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:49.593181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.079280+0000","last_change":"2024-03-08T06:03:20.067426+0000","last_active":"2024-03-08T06:03:21.079280+0000","last_peered":"2024-03-08T06:03:21.079280+0000","last_clean":"2024-03-08T06:03:21.079280+0000","last_became_active":"2024-03-08T06:03:20.067090+0000","last_became_peered":"2024-03-08T06:03:20.067090+0000","last_unstale":"2024-03-08T06:03:21.079280+0000","last_undegraded":"2024-03-08T06:03:21.079280+0000","last_fullsized":"2024-03-08T06:03:21.079280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:54:47.826647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.089774+0000","last_change":"2024-03-08T06:03:21.107588+0000","last_active":"2024-03-08T06:03:22.089774+0000","last_peered":"2024-03-08T06:03:22.089774+0000","last_clean":"2024-03-08T06:03:22.089774+0000","last_became_active":"2024-03-08T06:03:21.107204+0000","last_became_peered":"2024-03-08T06:03:21.107204+0000","last_unstale":"2024-03-08T06:03:22.089774+0000","last_undegraded":"2024-03-08T06:03:22.089774+0000","last_fullsized":"2024-03-08T06:03:22.089774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:36:22.740638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088160+0000","last_change":"2024-03-08T06:03:16.679654+0000","last_active":"2024-03-08T06:03:22.088160+0000","last_peered":"2024-03-08T06:03:22.088160+0000","last_clean":"2024-03-08T06:03:22.088160+0000","last_became_active":"2024-03-08T06:03:16.676829+0000","last_became_peered":"2024-03-08T06:03:16.676829+0000","last_unstale":"2024-03-08T06:03:22.088160+0000","last_undegraded":"2024-03-08T06:03:22.088160+0000","last_fullsized":"2024-03-08T06:03:22.088160+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:14.800941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:14.800941+0000","last_clean_scrub_stamp":"2024-03-08T06:03:14.800941+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:20:09.927678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.113735+0000","last_change":"2024-03-08T06:03:20.066015+0000","last_active":"2024-03-08T06:03:21.113735+0000","last_peered":"2024-03-08T06:03:21.113735+0000","last_clean":"2024-03-08T06:03:21.113735+0000","last_became_active":"2024-03-08T06:03:20.065647+0000","last_became_peered":"2024-03-08T06:03:20.065647+0000","last_unstale":"2024-03-08T06:03:21.113735+0000","last_undegraded":"2024-03-08T06:03:21.113735+0000","last_fullsized":"2024-03-08T06:03:21.113735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:24:29.819056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.098948+0000","last_change":"2024-03-08T06:03:21.092065+0000","last_active":"2024-03-08T06:03:21.098948+0000","last_peered":"2024-03-08T06:03:21.098948+0000","last_clean":"2024-03-08T06:03:21.098948+0000","last_became_active":"2024-03-08T06:03:21.091753+0000","last_became_peered":"2024-03-08T06:03:21.091753+0000","last_unstale":"2024-03-08T06:03:21.098948+0000","last_undegraded":"2024-03-08T06:03:21.098948+0000","last_fullsized":"2024-03-08T06:03:21.098948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:21:05.940407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088016+0000","last_change":"2024-03-08T06:03:20.074566+0000","last_active":"2024-03-08T06:03:22.088016+0000","last_peered":"2024-03-08T06:03:22.088016+0000","last_clean":"2024-03-08T06:03:22.088016+0000","last_became_active":"2024-03-08T06:03:20.074234+0000","last_became_peered":"2024-03-08T06:03:20.074234+0000","last_unstale":"2024-03-08T06:03:22.088016+0000","last_undegraded":"2024-03-08T06:03:22.088016+0000","last_fullsized":"2024-03-08T06:03:22.088016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:22.024440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.108243+0000","last_change":"2024-03-08T06:03:21.100866+0000","last_active":"2024-03-08T06:03:21.108243+0000","last_peered":"2024-03-08T06:03:21.108243+0000","last_clean":"2024-03-08T06:03:21.108243+0000","last_became_active":"2024-03-08T06:03:21.100541+0000","last_became_peered":"2024-03-08T06:03:21.100541+0000","last_unstale":"2024-03-08T06:03:21.108243+0000","last_undegraded":"2024-03-08T06:03:21.108243+0000","last_fullsized":"2024-03-08T06:03:21.108243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:31.826322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.071756+0000","last_change":"2024-03-08T06:03:20.062458+0000","last_active":"2024-03-08T06:03:21.071756+0000","last_peered":"2024-03-08T06:03:21.071756+0000","last_clean":"2024-03-08T06:03:21.071756+0000","last_became_active":"2024-03-08T06:03:20.062017+0000","last_became_peered":"2024-03-08T06:03:20.062017+0000","last_unstale":"2024-03-08T06:03:21.071756+0000","last_undegraded":"2024-03-08T06:03:21.071756+0000","last_fullsized":"2024-03-08T06:03:21.071756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:44:31.139813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087236+0000","last_change":"2024-03-08T06:03:21.083073+0000","last_active":"2024-03-08T06:03:22.087236+0000","last_peered":"2024-03-08T06:03:22.087236+0000","last_clean":"2024-03-08T06:03:22.087236+0000","last_became_active":"2024-03-08T06:03:21.082544+0000","last_became_peered":"2024-03-08T06:03:21.082544+0000","last_unstale":"2024-03-08T06:03:22.087236+0000","last_undegraded":"2024-03-08T06:03:22.087236+0000","last_fullsized":"2024-03-08T06:03:22.087236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:17:51.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.113807+0000","last_change":"2024-03-08T06:03:20.065501+0000","last_active":"2024-03-08T06:03:21.113807+0000","last_peered":"2024-03-08T06:03:21.113807+0000","last_clean":"2024-03-08T06:03:21.113807+0000","last_became_active":"2024-03-08T06:03:20.065200+0000","last_became_peered":"2024-03-08T06:03:20.065200+0000","last_unstale":"2024-03-08T06:03:21.113807+0000","last_undegraded":"2024-03-08T06:03:21.113807+0000","last_fullsized":"2024-03-08T06:03:21.113807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:17:50.510674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087483+0000","last_change":"2024-03-08T06:03:21.091986+0000","last_active":"2024-03-08T06:03:22.087483+0000","last_peered":"2024-03-08T06:03:22.087483+0000","last_clean":"2024-03-08T06:03:22.087483+0000","last_became_active":"2024-03-08T06:03:21.091675+0000","last_became_peered":"2024-03-08T06:03:21.091675+0000","last_unstale":"2024-03-08T06:03:22.087483+0000","last_undegraded":"2024-03-08T06:03:22.087483+0000","last_fullsized":"2024-03-08T06:03:22.087483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:31.826322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.086969+0000","last_change":"2024-03-08T06:03:20.065327+0000","last_active":"2024-03-08T06:03:22.086969+0000","last_peered":"2024-03-08T06:03:22.086969+0000","last_clean":"2024-03-08T06:03:22.086969+0000","last_became_active":"2024-03-08T06:03:20.064891+0000","last_became_peered":"2024-03-08T06:03:20.064891+0000","last_unstale":"2024-03-08T06:03:22.086969+0000","last_undegraded":"2024-03-08T06:03:22.086969+0000","last_fullsized":"2024-03-08T06:03:22.086969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:26.946077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.109783+0000","last_change":"2024-03-08T06:03:21.097867+0000","last_active":"2024-03-08T06:03:21.109783+0000","last_peered":"2024-03-08T06:03:21.109783+0000","last_clean":"2024-03-08T06:03:21.109783+0000","last_became_active":"2024-03-08T06:03:21.097495+0000","last_became_peered":"2024-03-08T06:03:21.097495+0000","last_unstale":"2024-03-08T06:03:21.109783+0000","last_undegraded":"2024-03-08T06:03:21.109783+0000","last_fullsized":"2024-03-08T06:03:21.109783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:23.037684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090113+0000","last_change":"2024-03-08T06:03:20.069667+0000","last_active":"2024-03-08T06:03:22.090113+0000","last_peered":"2024-03-08T06:03:22.090113+0000","last_clean":"2024-03-08T06:03:22.090113+0000","last_became_active":"2024-03-08T06:03:20.069428+0000","last_became_peered":"2024-03-08T06:03:20.069428+0000","last_unstale":"2024-03-08T06:03:22.090113+0000","last_undegraded":"2024-03-08T06:03:22.090113+0000","last_fullsized":"2024-03-08T06:03:22.090113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:21:04.927163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.086921+0000","last_change":"2024-03-08T06:03:21.084065+0000","last_active":"2024-03-08T06:03:22.086921+0000","last_peered":"2024-03-08T06:03:22.086921+0000","last_clean":"2024-03-08T06:03:22.086921+0000","last_became_active":"2024-03-08T06:03:21.083747+0000","last_became_peered":"2024-03-08T06:03:21.083747+0000","last_unstale":"2024-03-08T06:03:22.086921+0000","last_undegraded":"2024-03-08T06:03:22.086921+0000","last_fullsized":"2024-03-08T06:03:22.086921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:24:30.832300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087595+0000","last_change":"2024-03-08T06:03:20.059341+0000","last_active":"2024-03-08T06:03:22.087595+0000","last_peered":"2024-03-08T06:03:22.087595+0000","last_clean":"2024-03-08T06:03:22.087595+0000","last_became_active":"2024-03-08T06:03:20.059016+0000","last_became_peered":"2024-03-08T06:03:20.059016+0000","last_unstale":"2024-03-08T06:03:22.087595+0000","last_undegraded":"2024-03-08T06:03:22.087595+0000","last_fullsized":"2024-03-08T06:03:22.087595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:22.024440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.095573+0000","last_change":"2024-03-08T06:03:21.088353+0000","last_active":"2024-03-08T06:03:21.095573+0000","last_peered":"2024-03-08T06:03:21.095573+0000","last_clean":"2024-03-08T06:03:21.095573+0000","last_became_active":"2024-03-08T06:03:21.088046+0000","last_became_peered":"2024-03-08T06:03:21.088046+0000","last_unstale":"2024-03-08T06:03:21.095573+0000","last_undegraded":"2024-03-08T06:03:21.095573+0000","last_fullsized":"2024-03-08T06:03:21.095573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:49.593181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.116966+0000","last_change":"2024-03-08T06:03:20.071250+0000","last_active":"2024-03-08T06:03:21.116966+0000","last_peered":"2024-03-08T06:03:21.116966+0000","last_clean":"2024-03-08T06:03:21.116966+0000","last_became_active":"2024-03-08T06:03:20.070870+0000","last_became_peered":"2024-03-08T06:03:20.070870+0000","last_unstale":"2024-03-08T06:03:21.116966+0000","last_undegraded":"2024-03-08T06:03:21.116966+0000","last_fullsized":"2024-03-08T06:03:21.116966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:30.813078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.101011+0000","last_change":"2024-03-08T06:03:21.097827+0000","last_active":"2024-03-08T06:03:21.101011+0000","last_peered":"2024-03-08T06:03:21.101011+0000","last_clean":"2024-03-08T06:03:21.101011+0000","last_became_active":"2024-03-08T06:03:21.097542+0000","last_became_peered":"2024-03-08T06:03:21.097542+0000","last_unstale":"2024-03-08T06:03:21.101011+0000","last_undegraded":"2024-03-08T06:03:21.101011+0000","last_fullsized":"2024-03-08T06:03:21.101011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:49.593181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087648+0000","last_change":"2024-03-08T06:03:20.064310+0000","last_active":"2024-03-08T06:03:22.087648+0000","last_peered":"2024-03-08T06:03:22.087648+0000","last_clean":"2024-03-08T06:03:22.087648+0000","last_became_active":"2024-03-08T06:03:20.063983+0000","last_became_peered":"2024-03-08T06:03:20.063983+0000","last_unstale":"2024-03-08T06:03:22.087648+0000","last_undegraded":"2024-03-08T06:03:22.087648+0000","last_fullsized":"2024-03-08T06:03:22.087648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:48.579937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087328+0000","last_change":"2024-03-08T06:03:21.085108+0000","last_active":"2024-03-08T06:03:22.087328+0000","last_peered":"2024-03-08T06:03:22.087328+0000","last_clean":"2024-03-08T06:03:22.087328+0000","last_became_active":"2024-03-08T06:03:21.084673+0000","last_became_peered":"2024-03-08T06:03:21.084673+0000","last_unstale":"2024-03-08T06:03:22.087328+0000","last_undegraded":"2024-03-08T06:03:22.087328+0000","last_fullsized":"2024-03-08T06:03:22.087328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:49.593181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088223+0000","last_change":"2024-03-08T06:03:20.054745+0000","last_active":"2024-03-08T06:03:22.088223+0000","last_peered":"2024-03-08T06:03:22.088223+0000","last_clean":"2024-03-08T06:03:22.088223+0000","last_became_active":"2024-03-08T06:03:20.054461+0000","last_became_peered":"2024-03-08T06:03:20.054461+0000","last_unstale":"2024-03-08T06:03:22.088223+0000","last_undegraded":"2024-03-08T06:03:22.088223+0000","last_fullsized":"2024-03-08T06:03:22.088223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:54:47.826647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.085518+0000","last_change":"2024-03-08T06:03:21.079197+0000","last_active":"2024-03-08T06:03:21.085518+0000","last_peered":"2024-03-08T06:03:21.085518+0000","last_clean":"2024-03-08T06:03:21.085518+0000","last_became_active":"2024-03-08T06:03:21.078822+0000","last_became_peered":"2024-03-08T06:03:21.078822+0000","last_unstale":"2024-03-08T06:03:21.085518+0000","last_undegraded":"2024-03-08T06:03:21.085518+0000","last_fullsized":"2024-03-08T06:03:21.085518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:54:48.839891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087455+0000","last_change":"2024-03-08T06:03:20.071672+0000","last_active":"2024-03-08T06:03:22.087455+0000","last_peered":"2024-03-08T06:03:22.087455+0000","last_clean":"2024-03-08T06:03:22.087455+0000","last_became_active":"2024-03-08T06:03:20.070816+0000","last_became_peered":"2024-03-08T06:03:20.070816+0000","last_unstale":"2024-03-08T06:03:22.087455+0000","last_undegraded":"2024-03-08T06:03:22.087455+0000","last_fullsized":"2024-03-08T06:03:22.087455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:48.579937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.095761+0000","last_change":"2024-03-08T06:03:21.089795+0000","last_active":"2024-03-08T06:03:21.095761+0000","last_peered":"2024-03-08T06:03:21.095761+0000","last_clean":"2024-03-08T06:03:21.095761+0000","last_became_active":"2024-03-08T06:03:21.089491+0000","last_became_peered":"2024-03-08T06:03:21.089491+0000","last_unstale":"2024-03-08T06:03:21.095761+0000","last_undegraded":"2024-03-08T06:03:21.095761+0000","last_fullsized":"2024-03-08T06:03:21.095761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:31.826322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088562+0000","last_change":"2024-03-08T06:03:20.063251+0000","last_active":"2024-03-08T06:03:22.088562+0000","last_peered":"2024-03-08T06:03:22.088562+0000","last_clean":"2024-03-08T06:03:22.088562+0000","last_became_active":"2024-03-08T06:03:20.061931+0000","last_became_peered":"2024-03-08T06:03:20.061931+0000","last_unstale":"2024-03-08T06:03:22.088562+0000","last_undegraded":"2024-03-08T06:03:22.088562+0000","last_fullsized":"2024-03-08T06:03:22.088562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:41.633303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.091912+0000","last_change":"2024-03-08T06:03:21.087608+0000","last_active":"2024-03-08T06:03:21.091912+0000","last_peered":"2024-03-08T06:03:21.091912+0000","last_clean":"2024-03-08T06:03:21.091912+0000","last_became_active":"2024-03-08T06:03:21.086636+0000","last_became_peered":"2024-03-08T06:03:21.086636+0000","last_unstale":"2024-03-08T06:03:21.091912+0000","last_undegraded":"2024-03-08T06:03:21.091912+0000","last_fullsized":"2024-03-08T06:03:21.091912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:23.037684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.110323+0000","last_change":"2024-03-08T06:03:21.099738+0000","last_active":"2024-03-08T06:03:21.110323+0000","last_peered":"2024-03-08T06:03:21.110323+0000","last_clean":"2024-03-08T06:03:21.110323+0000","last_became_active":"2024-03-08T06:03:21.098798+0000","last_became_peered":"2024-03-08T06:03:21.098798+0000","last_unstale":"2024-03-08T06:03:21.110323+0000","last_undegraded":"2024-03-08T06:03:21.110323+0000","last_fullsized":"2024-03-08T06:03:21.110323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:31.826322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088884+0000","last_change":"2024-03-08T06:03:20.068500+0000","last_active":"2024-03-08T06:03:22.088884+0000","last_peered":"2024-03-08T06:03:22.088884+0000","last_clean":"2024-03-08T06:03:22.088884+0000","last_became_active":"2024-03-08T06:03:20.068165+0000","last_became_peered":"2024-03-08T06:03:20.068165+0000","last_unstale":"2024-03-08T06:03:22.088884+0000","last_undegraded":"2024-03-08T06:03:22.088884+0000","last_fullsized":"2024-03-08T06:03:22.088884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:30.813078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.110379+0000","last_change":"2024-03-08T06:03:21.100116+0000","last_active":"2024-03-08T06:03:21.110379+0000","last_peered":"2024-03-08T06:03:21.110379+0000","last_clean":"2024-03-08T06:03:21.110379+0000","last_became_active":"2024-03-08T06:03:21.099049+0000","last_became_peered":"2024-03-08T06:03:21.099049+0000","last_unstale":"2024-03-08T06:03:21.110379+0000","last_undegraded":"2024-03-08T06:03:21.110379+0000","last_fullsized":"2024-03-08T06:03:21.110379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:27.959321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.089860+0000","last_change":"2024-03-08T06:03:20.073962+0000","last_active":"2024-03-08T06:03:22.089860+0000","last_peered":"2024-03-08T06:03:22.089860+0000","last_clean":"2024-03-08T06:03:22.089860+0000","last_became_active":"2024-03-08T06:03:20.073658+0000","last_became_peered":"2024-03-08T06:03:20.073658+0000","last_unstale":"2024-03-08T06:03:22.089860+0000","last_undegraded":"2024-03-08T06:03:22.089860+0000","last_fullsized":"2024-03-08T06:03:22.089860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:26.946077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.110935+0000","last_change":"2024-03-08T06:03:21.105031+0000","last_active":"2024-03-08T06:03:21.110935+0000","last_peered":"2024-03-08T06:03:21.110935+0000","last_clean":"2024-03-08T06:03:21.110935+0000","last_became_active":"2024-03-08T06:03:21.104736+0000","last_became_peered":"2024-03-08T06:03:21.104736+0000","last_unstale":"2024-03-08T06:03:21.110935+0000","last_undegraded":"2024-03-08T06:03:21.110935+0000","last_fullsized":"2024-03-08T06:03:21.110935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:21:05.940407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.108518+0000","last_change":"2024-03-08T06:03:20.061969+0000","last_active":"2024-03-08T06:03:21.108518+0000","last_peered":"2024-03-08T06:03:21.108518+0000","last_clean":"2024-03-08T06:03:21.108518+0000","last_became_active":"2024-03-08T06:03:20.061568+0000","last_became_peered":"2024-03-08T06:03:20.061568+0000","last_unstale":"2024-03-08T06:03:21.108518+0000","last_undegraded":"2024-03-08T06:03:21.108518+0000","last_fullsized":"2024-03-08T06:03:21.108518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:14:52.512990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.095766+0000","last_change":"2024-03-08T06:03:21.091233+0000","last_active":"2024-03-08T06:03:21.095766+0000","last_peered":"2024-03-08T06:03:21.095766+0000","last_clean":"2024-03-08T06:03:21.095766+0000","last_became_active":"2024-03-08T06:03:21.090260+0000","last_became_peered":"2024-03-08T06:03:21.090260+0000","last_unstale":"2024-03-08T06:03:21.095766+0000","last_undegraded":"2024-03-08T06:03:21.095766+0000","last_fullsized":"2024-03-08T06:03:21.095766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:42.646547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.109066+0000","last_change":"2024-03-08T06:03:20.066538+0000","last_active":"2024-03-08T06:03:21.109066+0000","last_peered":"2024-03-08T06:03:21.109066+0000","last_clean":"2024-03-08T06:03:21.109066+0000","last_became_active":"2024-03-08T06:03:20.065542+0000","last_became_peered":"2024-03-08T06:03:20.065542+0000","last_unstale":"2024-03-08T06:03:21.109066+0000","last_undegraded":"2024-03-08T06:03:21.109066+0000","last_fullsized":"2024-03-08T06:03:21.109066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:14:52.512990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":69395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":69305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":660311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T06:03:25.574 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T06:03:25.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.836+0000 7f7fea600640 1 Processor -- start 2024-03-08T06:03:25.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.837+0000 7f7fea600640 1 -- start start 2024-03-08T06:03:25.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.838+0000 7f7fea600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7fe40d11b0 0x7f7fe40ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:25.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.838+0000 7f7fea600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7fe40b6bd0 0x7f7fe4162400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:25.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.838+0000 7f7fea600640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe415e300 con 0x7f7fe415df20 2024-03-08T06:03:25.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.838+0000 7f7fea600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe40d3990 con 0x7f7fe40b6bd0 2024-03-08T06:03:25.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.838+0000 7f7fea600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe4162940 con 0x7f7fe40d11b0 2024-03-08T06:03:25.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.838+0000 7f7fe9200640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7fe415df20 0x7f7fe40d0aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35396/0 (socket says 172.21.15.19:35396) 2024-03-08T06:03:25.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.838+0000 7f7fe9200640 1 -- 172.21.15.19:0/1183639021 learned_addr learned my addr 172.21.15.19:0/1183639021 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:25.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.838+0000 7f7fe9c00640 1 --2- 172.21.15.19:0/1183639021 >> v2:172.21.15.42:3300/0 conn(0x7f7fe40b6bd0 0x7f7fe4162400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:25.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.839+0000 7f7fe3400640 1 -- 172.21.15.19:0/1183639021 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883453489 0 0) 0x7f7fe415e300 con 0x7f7fe415df20 2024-03-08T06:03:25.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.839+0000 7f7fe3e00640 1 --2- 172.21.15.19:0/1183639021 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7fe40d11b0 0x7f7fe40ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:25.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.839+0000 7f7fe3400640 1 -- 172.21.15.19:0/1183639021 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fcc003520 con 0x7f7fe415df20 2024-03-08T06:03:25.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.839+0000 7f7fe3400640 1 -- 172.21.15.19:0/1183639021 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1492485678 0 0) 0x7f7fcc003520 con 0x7f7fe415df20 2024-03-08T06:03:25.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.839+0000 7f7fe3400640 1 -- 172.21.15.19:0/1183639021 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7fe40d11b0 msgr2=0x7f7fe40ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:25.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.839+0000 7f7fe3400640 1 --2- 172.21.15.19:0/1183639021 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7fe40d11b0 0x7f7fe40ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:25.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.839+0000 7f7fe3400640 1 -- 172.21.15.19:0/1183639021 >> v2:172.21.15.42:3300/0 conn(0x7f7fe40b6bd0 msgr2=0x7f7fe4162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:25.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.839+0000 7f7fe3400640 1 --2- 172.21.15.19:0/1183639021 >> v2:172.21.15.42:3300/0 conn(0x7f7fe40b6bd0 0x7f7fe4162400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:25.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.839+0000 7f7fe3400640 1 -- 172.21.15.19:0/1183639021 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe40cf030 con 0x7f7fe415df20 2024-03-08T06:03:25.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.839+0000 7f7fe3400640 1 -- 172.21.15.19:0/1183639021 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f7fd8001670 con 0x7f7fe415df20 2024-03-08T06:03:25.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.839+0000 7f7fe3400640 1 -- 172.21.15.19:0/1183639021 >> v1:172.21.15.19:6789/0 conn(0x7f7fe415df20 legacy=0x7f7fe40d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:25.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.839+0000 7f7fe3400640 1 --2- 172.21.15.19:0/1183639021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fcc0039b0 0x7f7fcc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:25.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.839+0000 7f7fe3400640 1 --2- 172.21.15.19:0/1183639021 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7fcc004800 0x7f7fcc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:25.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.839+0000 7f7fe3400640 1 --2- 172.21.15.19:0/1183639021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fcc0051c0 0x7f7fcc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:25.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.839+0000 7f7fe3400640 1 -- 172.21.15.19:0/1183639021 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe40d3990 con 0x7f7fcc0039b0 2024-03-08T06:03:25.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.839+0000 7f7fe3400640 1 -- 172.21.15.19:0/1183639021 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe4162940 con 0x7f7fcc0051c0 2024-03-08T06:03:25.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.839+0000 7f7fe3400640 1 -- 172.21.15.19:0/1183639021 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc00bf30 con 0x7f7fcc004800 2024-03-08T06:03:25.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.839+0000 7f7fe3e00640 1 --2- 172.21.15.19:0/1183639021 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7fe40d11b0 0x7f7fe40ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:03:25.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.839+0000 7f7fe9200640 1 --2- 172.21.15.19:0/1183639021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fcc0039b0 0x7f7fcc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:25.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.840+0000 7f7fe9200640 1 -- 172.21.15.19:0/1183639021 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7fcc004800 msgr2=0x7f7fcc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:25.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.840+0000 7f7fe9200640 1 --2- 172.21.15.19:0/1183639021 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7fcc004800 0x7f7fcc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:25.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.840+0000 7f7fe9200640 1 -- 172.21.15.19:0/1183639021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fcc0051c0 msgr2=0x7f7fcc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:25.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.840+0000 7f7fe9c00640 1 --2- 172.21.15.19:0/1183639021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fcc0051c0 0x7f7fcc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:25.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.840+0000 7f7fe9200640 1 --2- 172.21.15.19:0/1183639021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fcc0051c0 0x7f7fcc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:25.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.840+0000 7f7fe9200640 1 -- 172.21.15.19:0/1183639021 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc003520 con 0x7f7fcc0039b0 2024-03-08T06:03:25.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.840+0000 7f7fe9c00640 1 --2- 172.21.15.19:0/1183639021 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fcc0051c0 0x7f7fcc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:25.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.841+0000 7f7fe9200640 1 --2- 172.21.15.19:0/1183639021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fcc0039b0 0x7f7fcc003dd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800c210 tx=0x7f7fcc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2bcbcc7ff2c5277 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:25.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.841+0000 7f7fe3400640 1 -- 172.21.15.19:0/1183639021 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8007d50 con 0x7f7fcc0039b0 2024-03-08T06:03:25.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.841+0000 7f7fe3400640 1 -- 172.21.15.19:0/1183639021 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd8030070 con 0x7f7fcc0039b0 2024-03-08T06:03:25.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.841+0000 7f7fe3400640 1 -- 172.21.15.19:0/1183639021 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd802cd80 con 0x7f7fcc0039b0 2024-03-08T06:03:25.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.842+0000 7f7fea600640 1 -- 172.21.15.19:0/1183639021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fcc0039b0 msgr2=0x7f7fcc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:25.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.842+0000 7f7fea600640 1 --2- 172.21.15.19:0/1183639021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fcc0039b0 0x7f7fcc003dd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800c210 tx=0x7f7fcc005830 comp rx=0 tx=0).stop 2024-03-08T06:03:25.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.842+0000 7f7fe9c00640 1 -- 172.21.15.19:0/1183639021 reap_dead start 2024-03-08T06:03:25.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.842+0000 7f7fea600640 1 -- 172.21.15.19:0/1183639021 shutdown_connections 2024-03-08T06:03:25.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.842+0000 7f7fea600640 1 -- 172.21.15.19:0/1183639021 >> 172.21.15.19:0/1183639021 conn(0x7f7fe406c740 msgr2=0x7f7fe406cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:25.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.842+0000 7f7fea600640 1 -- 172.21.15.19:0/1183639021 shutdown_connections 2024-03-08T06:03:25.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.842+0000 7f7fea600640 1 -- 172.21.15.19:0/1183639021 wait complete. 2024-03-08T06:03:25.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.844+0000 7f7fea600640 1 Processor -- start 2024-03-08T06:03:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.844+0000 7f7fea600640 1 -- start start 2024-03-08T06:03:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.845+0000 7f7fea600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fcc0039b0 0x7f7fe41522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.845+0000 7f7fea600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fe41610c0 0x7f7fe41f3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.845+0000 7f7fea600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7fe41f75e0 0x7f7fe41f7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.845+0000 7f7fea600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe40d2180 con 0x7f7fe41610c0 2024-03-08T06:03:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.845+0000 7f7fea600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe40d1ea0 con 0x7f7fcc0039b0 2024-03-08T06:03:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.845+0000 7f7fea600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe40d2460 con 0x7f7fe41f75e0 2024-03-08T06:03:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.845+0000 7f7fe3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fe41610c0 0x7f7fe41f3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.845+0000 7f7fe3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fe41610c0 0x7f7fe41f3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33416/0 (socket says 172.21.15.19:33416) 2024-03-08T06:03:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.845+0000 7f7fe3e00640 1 -- 172.21.15.19:0/2975210742 learned_addr learned my addr 172.21.15.19:0/2975210742 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.845+0000 7f7fe9200640 1 --2- 172.21.15.19:0/2975210742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fcc0039b0 0x7f7fe41522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:25.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.845+0000 7f7fe9c00640 1 --2- 172.21.15.19:0/2975210742 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7fe41f75e0 0x7f7fe41f7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:25.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.846+0000 7f7fe3e00640 1 -- 172.21.15.19:0/2975210742 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7fe41f75e0 msgr2=0x7f7fe41f7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:25.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.846+0000 7f7fe3e00640 1 --2- 172.21.15.19:0/2975210742 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7fe41f75e0 0x7f7fe41f7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:25.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.846+0000 7f7fe3e00640 1 -- 172.21.15.19:0/2975210742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fcc0039b0 msgr2=0x7f7fe41522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:25.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.846+0000 7f7fe3e00640 1 --2- 172.21.15.19:0/2975210742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fcc0039b0 0x7f7fe41522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:25.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.846+0000 7f7fe3e00640 1 -- 172.21.15.19:0/2975210742 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe4161540 con 0x7f7fe41610c0 2024-03-08T06:03:25.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.846+0000 7f7fe3e00640 1 --2- 172.21.15.19:0/2975210742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fe41610c0 0x7f7fe41f3970 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000e570 tx=0x7f7fd000ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:25.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.846+0000 7f7fe0c00640 1 -- 172.21.15.19:0/2975210742 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd000f040 con 0x7f7fe41610c0 2024-03-08T06:03:25.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.846+0000 7f7fe0c00640 1 -- 172.21.15.19:0/2975210742 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd0004250 con 0x7f7fe41610c0 2024-03-08T06:03:25.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.846+0000 7f7fe0c00640 1 -- 172.21.15.19:0/2975210742 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd0003610 con 0x7f7fe41610c0 2024-03-08T06:03:25.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.846+0000 7f7fea600640 1 -- 172.21.15.19:0/2975210742 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe41f40e0 con 0x7f7fe41610c0 2024-03-08T06:03:25.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.846+0000 7f7fea600640 1 -- 172.21.15.19:0/2975210742 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe41f46a0 con 0x7f7fe41610c0 2024-03-08T06:03:25.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.848+0000 7f7fea600640 1 -- 172.21.15.19:0/2975210742 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe41f48e0 con 0x7f7fe41610c0 2024-03-08T06:03:25.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.848+0000 7f7fe0c00640 1 -- 172.21.15.19:0/2975210742 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7fd00037b0 con 0x7f7fe41610c0 2024-03-08T06:03:25.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.849+0000 7f7fe0c00640 1 --2- 172.21.15.19:0/2975210742 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7fc406b500 0x7f7fc406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:25.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.849+0000 7f7fe0c00640 1 -- 172.21.15.19:0/2975210742 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fd0089e70 con 0x7f7fe41610c0 2024-03-08T06:03:25.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.850+0000 7f7fe9200640 1 --2- 172.21.15.19:0/2975210742 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7fc406b500 0x7f7fc406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:25.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.850+0000 7f7fe9200640 1 --2- 172.21.15.19:0/2975210742 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7fc406b500 0x7f7fc406d9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8034000 tx=0x7f7fd8007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:25.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:25.854+0000 7f7fe0c00640 1 -- 172.21.15.19:0/2975210742 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7fd0017020 con 0x7f7fe41610c0 2024-03-08T06:03:26.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.053+0000 7f7fea600640 1 -- 172.21.15.19:0/2975210742 --> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7fe4160d10 con 0x7f7fc406b500 2024-03-08T06:03:26.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.064+0000 7f7fe0c00640 1 -- 172.21.15.19:0/2975210742 <== mgr.4107 v2:172.21.15.19:6832/3589745192 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251902 (secure 0 0 0) 0x7f7fe4160d10 con 0x7f7fc406b500 2024-03-08T06:03:26.068 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:26.069 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-08T06:03:26.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.069+0000 7f7fea600640 1 -- 172.21.15.19:0/2975210742 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7fc406b500 msgr2=0x7f7fc406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:26.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.069+0000 7f7fea600640 1 --2- 172.21.15.19:0/2975210742 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7fc406b500 0x7f7fc406d9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7fd8034000 tx=0x7f7fd8007000 comp rx=0 tx=0).stop 2024-03-08T06:03:26.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.069+0000 7f7fea600640 1 -- 172.21.15.19:0/2975210742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fe41610c0 msgr2=0x7f7fe41f3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:26.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.069+0000 7f7fea600640 1 --2- 172.21.15.19:0/2975210742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fe41610c0 0x7f7fe41f3970 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000e570 tx=0x7f7fd000ea30 comp rx=0 tx=0).stop 2024-03-08T06:03:26.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.069+0000 7f7fea600640 1 -- 172.21.15.19:0/2975210742 shutdown_connections 2024-03-08T06:03:26.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.069+0000 7f7fea600640 1 --2- 172.21.15.19:0/2975210742 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7fc406b500 0x7f7fc406d9c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:26.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.069+0000 7f7fea600640 1 --2- 172.21.15.19:0/2975210742 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7fe41f75e0 0x7f7fe41f7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:26.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.069+0000 7f7fea600640 1 --2- 172.21.15.19:0/2975210742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fe41610c0 0x7f7fe41f3970 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:26.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.069+0000 7f7fea600640 1 --2- 172.21.15.19:0/2975210742 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7fcc0039b0 0x7f7fe41522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:26.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.069+0000 7f7fea600640 1 -- 172.21.15.19:0/2975210742 >> 172.21.15.19:0/2975210742 conn(0x7f7fe406c740 msgr2=0x7f7fe40ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:26.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.070+0000 7f7fea600640 1 -- 172.21.15.19:0/2975210742 shutdown_connections 2024-03-08T06:03:26.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.070+0000 7f7fea600640 1 -- 172.21.15.19:0/2975210742 wait complete. 2024-03-08T06:03:26.089 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-03-08T06:03:24.076306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235824,"kb_used_data":2860,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738896,"statfs":{"total":773094113280,"available":772852629504,"internally_reserved":0,"allocated":2928640,"data_stored":1758896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":20,"num_read_kb":18,"num_write":81,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.218667"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090939+0000","last_change":"2024-03-08T06:03:21.089349+0000","last_active":"2024-03-08T06:03:22.090939+0000","last_peered":"2024-03-08T06:03:22.090939+0000","last_clean":"2024-03-08T06:03:22.090939+0000","last_became_active":"2024-03-08T06:03:21.085662+0000","last_became_peered":"2024-03-08T06:03:21.085662+0000","last_unstale":"2024-03-08T06:03:22.090939+0000","last_undegraded":"2024-03-08T06:03:22.090939+0000","last_fullsized":"2024-03-08T06:03:22.090939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:18:48.558283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087395+0000","last_change":"2024-03-08T06:03:21.089313+0000","last_active":"2024-03-08T06:03:22.087395+0000","last_peered":"2024-03-08T06:03:22.087395+0000","last_clean":"2024-03-08T06:03:22.087395+0000","last_became_active":"2024-03-08T06:03:21.088958+0000","last_became_peered":"2024-03-08T06:03:21.088958+0000","last_unstale":"2024-03-08T06:03:22.087395+0000","last_undegraded":"2024-03-08T06:03:22.087395+0000","last_fullsized":"2024-03-08T06:03:22.087395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:23:37.355382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.105633+0000","last_change":"2024-03-08T06:03:21.098797+0000","last_active":"2024-03-08T06:03:21.105633+0000","last_peered":"2024-03-08T06:03:21.105633+0000","last_clean":"2024-03-08T06:03:21.105633+0000","last_became_active":"2024-03-08T06:03:21.098387+0000","last_became_peered":"2024-03-08T06:03:21.098387+0000","last_unstale":"2024-03-08T06:03:21.105633+0000","last_undegraded":"2024-03-08T06:03:21.105633+0000","last_fullsized":"2024-03-08T06:03:21.105633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:23.037684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.110356+0000","last_change":"2024-03-08T06:03:21.099948+0000","last_active":"2024-03-08T06:03:21.110356+0000","last_peered":"2024-03-08T06:03:21.110356+0000","last_clean":"2024-03-08T06:03:21.110356+0000","last_became_active":"2024-03-08T06:03:21.097388+0000","last_became_peered":"2024-03-08T06:03:21.097388+0000","last_unstale":"2024-03-08T06:03:21.110356+0000","last_undegraded":"2024-03-08T06:03:21.110356+0000","last_fullsized":"2024-03-08T06:03:21.110356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:42.646547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088264+0000","last_change":"2024-03-08T06:03:21.080856+0000","last_active":"2024-03-08T06:03:22.088264+0000","last_peered":"2024-03-08T06:03:22.088264+0000","last_clean":"2024-03-08T06:03:22.088264+0000","last_became_active":"2024-03-08T06:03:21.080513+0000","last_became_peered":"2024-03-08T06:03:21.080513+0000","last_unstale":"2024-03-08T06:03:22.088264+0000","last_undegraded":"2024-03-08T06:03:22.088264+0000","last_fullsized":"2024-03-08T06:03:22.088264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:49:03.245653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.114126+0000","last_change":"2024-03-08T06:03:21.106729+0000","last_active":"2024-03-08T06:03:21.114126+0000","last_peered":"2024-03-08T06:03:21.114126+0000","last_clean":"2024-03-08T06:03:21.114126+0000","last_became_active":"2024-03-08T06:03:21.106444+0000","last_became_peered":"2024-03-08T06:03:21.106444+0000","last_unstale":"2024-03-08T06:03:21.114126+0000","last_undegraded":"2024-03-08T06:03:21.114126+0000","last_fullsized":"2024-03-08T06:03:21.114126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:48:27.568109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087914+0000","last_change":"2024-03-08T06:03:21.091772+0000","last_active":"2024-03-08T06:03:22.087914+0000","last_peered":"2024-03-08T06:03:22.087914+0000","last_clean":"2024-03-08T06:03:22.087914+0000","last_became_active":"2024-03-08T06:03:21.091340+0000","last_became_peered":"2024-03-08T06:03:21.091340+0000","last_unstale":"2024-03-08T06:03:22.087914+0000","last_undegraded":"2024-03-08T06:03:22.087914+0000","last_fullsized":"2024-03-08T06:03:22.087914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:48:37.493932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.095793+0000","last_change":"2024-03-08T06:03:21.091248+0000","last_active":"2024-03-08T06:03:21.095793+0000","last_peered":"2024-03-08T06:03:21.095793+0000","last_clean":"2024-03-08T06:03:21.095793+0000","last_became_active":"2024-03-08T06:03:21.090881+0000","last_became_peered":"2024-03-08T06:03:21.090881+0000","last_unstale":"2024-03-08T06:03:21.095793+0000","last_undegraded":"2024-03-08T06:03:21.095793+0000","last_fullsized":"2024-03-08T06:03:21.095793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:27.959321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090833+0000","last_change":"2024-03-08T06:03:21.116525+0000","last_active":"2024-03-08T06:03:22.090833+0000","last_peered":"2024-03-08T06:03:22.090833+0000","last_clean":"2024-03-08T06:03:22.090833+0000","last_became_active":"2024-03-08T06:03:21.116143+0000","last_became_peered":"2024-03-08T06:03:21.116143+0000","last_unstale":"2024-03-08T06:03:22.090833+0000","last_undegraded":"2024-03-08T06:03:22.090833+0000","last_fullsized":"2024-03-08T06:03:22.090833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:19:57.197522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.116588+0000","last_change":"2024-03-08T06:03:21.108467+0000","last_active":"2024-03-08T06:03:21.116588+0000","last_peered":"2024-03-08T06:03:21.116588+0000","last_clean":"2024-03-08T06:03:21.116588+0000","last_became_active":"2024-03-08T06:03:21.108167+0000","last_became_peered":"2024-03-08T06:03:21.108167+0000","last_unstale":"2024-03-08T06:03:21.116588+0000","last_undegraded":"2024-03-08T06:03:21.116588+0000","last_fullsized":"2024-03-08T06:03:21.116588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:10:52.112651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.106269+0000","last_change":"2024-03-08T06:03:21.097402+0000","last_active":"2024-03-08T06:03:21.106269+0000","last_peered":"2024-03-08T06:03:21.106269+0000","last_clean":"2024-03-08T06:03:21.106269+0000","last_became_active":"2024-03-08T06:03:21.097092+0000","last_became_peered":"2024-03-08T06:03:21.097092+0000","last_unstale":"2024-03-08T06:03:21.106269+0000","last_undegraded":"2024-03-08T06:03:21.106269+0000","last_fullsized":"2024-03-08T06:03:21.106269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:48:27.568109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.089691+0000","last_change":"2024-03-08T06:03:21.094282+0000","last_active":"2024-03-08T06:03:22.089691+0000","last_peered":"2024-03-08T06:03:22.089691+0000","last_clean":"2024-03-08T06:03:22.089691+0000","last_became_active":"2024-03-08T06:03:21.093991+0000","last_became_peered":"2024-03-08T06:03:21.093991+0000","last_unstale":"2024-03-08T06:03:22.089691+0000","last_undegraded":"2024-03-08T06:03:22.089691+0000","last_fullsized":"2024-03-08T06:03:22.089691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:42.646547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.095738+0000","last_change":"2024-03-08T06:03:21.089482+0000","last_active":"2024-03-08T06:03:21.095738+0000","last_peered":"2024-03-08T06:03:21.095738+0000","last_clean":"2024-03-08T06:03:21.095738+0000","last_became_active":"2024-03-08T06:03:21.088934+0000","last_became_peered":"2024-03-08T06:03:21.088934+0000","last_unstale":"2024-03-08T06:03:21.095738+0000","last_undegraded":"2024-03-08T06:03:21.095738+0000","last_fullsized":"2024-03-08T06:03:21.095738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:23.037684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.108422+0000","last_change":"2024-03-08T06:03:21.100913+0000","last_active":"2024-03-08T06:03:21.108422+0000","last_peered":"2024-03-08T06:03:21.108422+0000","last_clean":"2024-03-08T06:03:21.108422+0000","last_became_active":"2024-03-08T06:03:21.097463+0000","last_became_peered":"2024-03-08T06:03:21.097463+0000","last_unstale":"2024-03-08T06:03:21.108422+0000","last_undegraded":"2024-03-08T06:03:21.108422+0000","last_fullsized":"2024-03-08T06:03:21.108422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:42.646547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087416+0000","last_change":"2024-03-08T06:03:21.073630+0000","last_active":"2024-03-08T06:03:22.087416+0000","last_peered":"2024-03-08T06:03:22.087416+0000","last_clean":"2024-03-08T06:03:22.087416+0000","last_became_active":"2024-03-08T06:03:21.073333+0000","last_became_peered":"2024-03-08T06:03:21.073333+0000","last_unstale":"2024-03-08T06:03:22.087416+0000","last_undegraded":"2024-03-08T06:03:22.087416+0000","last_fullsized":"2024-03-08T06:03:22.087416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:27:57.207381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.113826+0000","last_change":"2024-03-08T06:03:21.096870+0000","last_active":"2024-03-08T06:03:21.113826+0000","last_peered":"2024-03-08T06:03:21.113826+0000","last_clean":"2024-03-08T06:03:21.113826+0000","last_became_active":"2024-03-08T06:03:21.096623+0000","last_became_peered":"2024-03-08T06:03:21.096623+0000","last_unstale":"2024-03-08T06:03:21.113826+0000","last_undegraded":"2024-03-08T06:03:21.113826+0000","last_fullsized":"2024-03-08T06:03:21.113826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:54:48.839891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.114474+0000","last_change":"2024-03-08T06:03:21.113130+0000","last_active":"2024-03-08T06:03:21.114474+0000","last_peered":"2024-03-08T06:03:21.114474+0000","last_clean":"2024-03-08T06:03:21.114474+0000","last_became_active":"2024-03-08T06:03:21.110951+0000","last_became_peered":"2024-03-08T06:03:21.110951+0000","last_unstale":"2024-03-08T06:03:21.114474+0000","last_undegraded":"2024-03-08T06:03:21.114474+0000","last_fullsized":"2024-03-08T06:03:21.114474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:10:52.112651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.097880+0000","last_change":"2024-03-08T06:03:21.093041+0000","last_active":"2024-03-08T06:03:21.097880+0000","last_peered":"2024-03-08T06:03:21.097880+0000","last_clean":"2024-03-08T06:03:21.097880+0000","last_became_active":"2024-03-08T06:03:21.092766+0000","last_became_peered":"2024-03-08T06:03:21.092766+0000","last_unstale":"2024-03-08T06:03:21.097880+0000","last_undegraded":"2024-03-08T06:03:21.097880+0000","last_fullsized":"2024-03-08T06:03:21.097880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:23.037684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090177+0000","last_change":"2024-03-08T06:03:21.083536+0000","last_active":"2024-03-08T06:03:22.090177+0000","last_peered":"2024-03-08T06:03:22.090177+0000","last_clean":"2024-03-08T06:03:22.090177+0000","last_became_active":"2024-03-08T06:03:21.083203+0000","last_became_peered":"2024-03-08T06:03:21.083203+0000","last_unstale":"2024-03-08T06:03:22.090177+0000","last_undegraded":"2024-03-08T06:03:22.090177+0000","last_fullsized":"2024-03-08T06:03:22.090177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:17:34.427952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.109774+0000","last_change":"2024-03-08T06:03:21.099174+0000","last_active":"2024-03-08T06:03:21.109774+0000","last_peered":"2024-03-08T06:03:21.109774+0000","last_clean":"2024-03-08T06:03:21.109774+0000","last_became_active":"2024-03-08T06:03:21.098562+0000","last_became_peered":"2024-03-08T06:03:21.098562+0000","last_unstale":"2024-03-08T06:03:21.109774+0000","last_undegraded":"2024-03-08T06:03:21.109774+0000","last_fullsized":"2024-03-08T06:03:21.109774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:33:15.887777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.099679+0000","last_change":"2024-03-08T06:03:21.090407+0000","last_active":"2024-03-08T06:03:21.099679+0000","last_peered":"2024-03-08T06:03:21.099679+0000","last_clean":"2024-03-08T06:03:21.099679+0000","last_became_active":"2024-03-08T06:03:21.090050+0000","last_became_peered":"2024-03-08T06:03:21.090050+0000","last_unstale":"2024-03-08T06:03:21.099679+0000","last_undegraded":"2024-03-08T06:03:21.099679+0000","last_fullsized":"2024-03-08T06:03:21.099679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:44:32.153058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.113845+0000","last_change":"2024-03-08T06:03:21.103042+0000","last_active":"2024-03-08T06:03:21.113845+0000","last_peered":"2024-03-08T06:03:21.113845+0000","last_clean":"2024-03-08T06:03:21.113845+0000","last_became_active":"2024-03-08T06:03:21.102711+0000","last_became_peered":"2024-03-08T06:03:21.102711+0000","last_unstale":"2024-03-08T06:03:21.113845+0000","last_undegraded":"2024-03-08T06:03:21.113845+0000","last_fullsized":"2024-03-08T06:03:21.113845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:32:38.303917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.103055+0000","last_change":"2024-03-08T06:03:21.094816+0000","last_active":"2024-03-08T06:03:21.103055+0000","last_peered":"2024-03-08T06:03:21.103055+0000","last_clean":"2024-03-08T06:03:21.103055+0000","last_became_active":"2024-03-08T06:03:21.092861+0000","last_became_peered":"2024-03-08T06:03:21.092861+0000","last_unstale":"2024-03-08T06:03:21.103055+0000","last_undegraded":"2024-03-08T06:03:21.103055+0000","last_fullsized":"2024-03-08T06:03:21.103055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:32:38.303917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.113800+0000","last_change":"2024-03-08T06:03:21.096814+0000","last_active":"2024-03-08T06:03:21.113800+0000","last_peered":"2024-03-08T06:03:21.113800+0000","last_clean":"2024-03-08T06:03:21.113800+0000","last_became_active":"2024-03-08T06:03:21.096448+0000","last_became_peered":"2024-03-08T06:03:21.096448+0000","last_unstale":"2024-03-08T06:03:21.113800+0000","last_undegraded":"2024-03-08T06:03:21.113800+0000","last_fullsized":"2024-03-08T06:03:21.113800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:54:21.540639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.105122+0000","last_change":"2024-03-08T06:03:21.101873+0000","last_active":"2024-03-08T06:03:21.105122+0000","last_peered":"2024-03-08T06:03:21.105122+0000","last_clean":"2024-03-08T06:03:21.105122+0000","last_became_active":"2024-03-08T06:03:21.101436+0000","last_became_peered":"2024-03-08T06:03:21.101436+0000","last_unstale":"2024-03-08T06:03:21.105122+0000","last_undegraded":"2024-03-08T06:03:21.105122+0000","last_fullsized":"2024-03-08T06:03:21.105122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:33:15.887777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.102703+0000","last_change":"2024-03-08T06:03:21.093616+0000","last_active":"2024-03-08T06:03:21.102703+0000","last_peered":"2024-03-08T06:03:21.102703+0000","last_clean":"2024-03-08T06:03:21.102703+0000","last_became_active":"2024-03-08T06:03:21.093287+0000","last_became_peered":"2024-03-08T06:03:21.093287+0000","last_unstale":"2024-03-08T06:03:21.102703+0000","last_undegraded":"2024-03-08T06:03:21.102703+0000","last_fullsized":"2024-03-08T06:03:21.102703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:21:05.940407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087812+0000","last_change":"2024-03-08T06:03:21.081645+0000","last_active":"2024-03-08T06:03:22.087812+0000","last_peered":"2024-03-08T06:03:22.087812+0000","last_clean":"2024-03-08T06:03:22.087812+0000","last_became_active":"2024-03-08T06:03:21.079927+0000","last_became_peered":"2024-03-08T06:03:21.079927+0000","last_unstale":"2024-03-08T06:03:22.087812+0000","last_undegraded":"2024-03-08T06:03:22.087812+0000","last_fullsized":"2024-03-08T06:03:22.087812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:29:07.055814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.105154+0000","last_change":"2024-03-08T06:03:21.101884+0000","last_active":"2024-03-08T06:03:21.105154+0000","last_peered":"2024-03-08T06:03:21.105154+0000","last_clean":"2024-03-08T06:03:21.105154+0000","last_became_active":"2024-03-08T06:03:21.101536+0000","last_became_peered":"2024-03-08T06:03:21.101536+0000","last_unstale":"2024-03-08T06:03:21.105154+0000","last_undegraded":"2024-03-08T06:03:21.105154+0000","last_fullsized":"2024-03-08T06:03:21.105154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:10:52.112651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.100914+0000","last_change":"2024-03-08T06:03:21.096440+0000","last_active":"2024-03-08T06:03:21.100914+0000","last_peered":"2024-03-08T06:03:21.100914+0000","last_clean":"2024-03-08T06:03:21.100914+0000","last_became_active":"2024-03-08T06:03:21.095943+0000","last_became_peered":"2024-03-08T06:03:21.095943+0000","last_unstale":"2024-03-08T06:03:21.100914+0000","last_undegraded":"2024-03-08T06:03:21.100914+0000","last_fullsized":"2024-03-08T06:03:21.100914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:54:48.839891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.110706+0000","last_change":"2024-03-08T06:03:21.100381+0000","last_active":"2024-03-08T06:03:21.110706+0000","last_peered":"2024-03-08T06:03:21.110706+0000","last_clean":"2024-03-08T06:03:21.110706+0000","last_became_active":"2024-03-08T06:03:21.095958+0000","last_became_peered":"2024-03-08T06:03:21.095958+0000","last_unstale":"2024-03-08T06:03:21.110706+0000","last_undegraded":"2024-03-08T06:03:21.110706+0000","last_fullsized":"2024-03-08T06:03:21.110706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:21:05.940407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.108060+0000","last_change":"2024-03-08T06:03:21.105006+0000","last_active":"2024-03-08T06:03:21.108060+0000","last_peered":"2024-03-08T06:03:21.108060+0000","last_clean":"2024-03-08T06:03:21.108060+0000","last_became_active":"2024-03-08T06:03:21.104720+0000","last_became_peered":"2024-03-08T06:03:21.104720+0000","last_unstale":"2024-03-08T06:03:21.108060+0000","last_undegraded":"2024-03-08T06:03:21.108060+0000","last_fullsized":"2024-03-08T06:03:21.108060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:31.826322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.111595+0000","last_change":"2024-03-08T06:03:21.096533+0000","last_active":"2024-03-08T06:03:21.111595+0000","last_peered":"2024-03-08T06:03:21.111595+0000","last_clean":"2024-03-08T06:03:21.111595+0000","last_became_active":"2024-03-08T06:03:21.096204+0000","last_became_peered":"2024-03-08T06:03:21.096204+0000","last_unstale":"2024-03-08T06:03:21.111595+0000","last_undegraded":"2024-03-08T06:03:21.111595+0000","last_fullsized":"2024-03-08T06:03:21.111595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:32:38.303917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087486+0000","last_change":"2024-03-08T06:03:21.076936+0000","last_active":"2024-03-08T06:03:22.087486+0000","last_peered":"2024-03-08T06:03:22.087486+0000","last_clean":"2024-03-08T06:03:22.087486+0000","last_became_active":"2024-03-08T06:03:21.076550+0000","last_became_peered":"2024-03-08T06:03:21.076550+0000","last_unstale":"2024-03-08T06:03:22.087486+0000","last_undegraded":"2024-03-08T06:03:22.087486+0000","last_fullsized":"2024-03-08T06:03:22.087486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:23.037684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.107853+0000","last_change":"2024-03-08T06:03:20.068219+0000","last_active":"2024-03-08T06:03:21.107853+0000","last_peered":"2024-03-08T06:03:21.107853+0000","last_clean":"2024-03-08T06:03:21.107853+0000","last_became_active":"2024-03-08T06:03:20.067429+0000","last_became_peered":"2024-03-08T06:03:20.067429+0000","last_unstale":"2024-03-08T06:03:21.107853+0000","last_undegraded":"2024-03-08T06:03:21.107853+0000","last_fullsized":"2024-03-08T06:03:21.107853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:54:20.527395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.108434+0000","last_change":"2024-03-08T06:03:21.101698+0000","last_active":"2024-03-08T06:03:21.108434+0000","last_peered":"2024-03-08T06:03:21.108434+0000","last_clean":"2024-03-08T06:03:21.108434+0000","last_became_active":"2024-03-08T06:03:21.101361+0000","last_became_peered":"2024-03-08T06:03:21.101361+0000","last_unstale":"2024-03-08T06:03:21.108434+0000","last_undegraded":"2024-03-08T06:03:21.108434+0000","last_fullsized":"2024-03-08T06:03:21.108434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:27.959321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.112947+0000","last_change":"2024-03-08T06:03:20.055111+0000","last_active":"2024-03-08T06:03:21.112947+0000","last_peered":"2024-03-08T06:03:21.112947+0000","last_clean":"2024-03-08T06:03:21.112947+0000","last_became_active":"2024-03-08T06:03:20.054685+0000","last_became_peered":"2024-03-08T06:03:20.054685+0000","last_unstale":"2024-03-08T06:03:21.112947+0000","last_undegraded":"2024-03-08T06:03:21.112947+0000","last_fullsized":"2024-03-08T06:03:21.112947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:54:47.826647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.068644+0000","last_change":"2024-03-08T06:03:20.069995+0000","last_active":"2024-03-08T06:03:21.068644+0000","last_peered":"2024-03-08T06:03:21.068644+0000","last_clean":"2024-03-08T06:03:21.068644+0000","last_became_active":"2024-03-08T06:03:20.069729+0000","last_became_peered":"2024-03-08T06:03:20.069729+0000","last_unstale":"2024-03-08T06:03:21.068644+0000","last_undegraded":"2024-03-08T06:03:21.068644+0000","last_fullsized":"2024-03-08T06:03:21.068644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:44:31.139813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.105383+0000","last_change":"2024-03-08T06:03:21.096605+0000","last_active":"2024-03-08T06:03:21.105383+0000","last_peered":"2024-03-08T06:03:21.105383+0000","last_clean":"2024-03-08T06:03:21.105383+0000","last_became_active":"2024-03-08T06:03:21.096303+0000","last_became_peered":"2024-03-08T06:03:21.096303+0000","last_unstale":"2024-03-08T06:03:21.105383+0000","last_undegraded":"2024-03-08T06:03:21.105383+0000","last_fullsized":"2024-03-08T06:03:21.105383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:48:27.568109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.113990+0000","last_change":"2024-03-08T06:03:20.061872+0000","last_active":"2024-03-08T06:03:21.113990+0000","last_peered":"2024-03-08T06:03:21.113990+0000","last_clean":"2024-03-08T06:03:21.113990+0000","last_became_active":"2024-03-08T06:03:20.061611+0000","last_became_peered":"2024-03-08T06:03:20.061611+0000","last_unstale":"2024-03-08T06:03:21.113990+0000","last_undegraded":"2024-03-08T06:03:21.113990+0000","last_fullsized":"2024-03-08T06:03:21.113990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:23:36.342138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088422+0000","last_change":"2024-03-08T06:03:21.079662+0000","last_active":"2024-03-08T06:03:22.088422+0000","last_peered":"2024-03-08T06:03:22.088422+0000","last_clean":"2024-03-08T06:03:22.088422+0000","last_became_active":"2024-03-08T06:03:21.079269+0000","last_became_peered":"2024-03-08T06:03:21.079269+0000","last_unstale":"2024-03-08T06:03:22.088422+0000","last_undegraded":"2024-03-08T06:03:22.088422+0000","last_fullsized":"2024-03-08T06:03:22.088422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:57:16.249537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.089673+0000","last_change":"2024-03-08T06:03:20.070774+0000","last_active":"2024-03-08T06:03:21.089673+0000","last_peered":"2024-03-08T06:03:21.089673+0000","last_clean":"2024-03-08T06:03:21.089673+0000","last_became_active":"2024-03-08T06:03:20.070284+0000","last_became_peered":"2024-03-08T06:03:20.070284+0000","last_unstale":"2024-03-08T06:03:21.089673+0000","last_undegraded":"2024-03-08T06:03:21.089673+0000","last_fullsized":"2024-03-08T06:03:21.089673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:41.633303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.114363+0000","last_change":"2024-03-08T06:03:21.112968+0000","last_active":"2024-03-08T06:03:21.114363+0000","last_peered":"2024-03-08T06:03:21.114363+0000","last_clean":"2024-03-08T06:03:21.114363+0000","last_became_active":"2024-03-08T06:03:21.110774+0000","last_became_peered":"2024-03-08T06:03:21.110774+0000","last_unstale":"2024-03-08T06:03:21.114363+0000","last_undegraded":"2024-03-08T06:03:21.114363+0000","last_fullsized":"2024-03-08T06:03:21.114363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:33:15.887777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.115755+0000","last_change":"2024-03-08T06:03:20.060802+0000","last_active":"2024-03-08T06:03:21.115755+0000","last_peered":"2024-03-08T06:03:21.115755+0000","last_clean":"2024-03-08T06:03:21.115755+0000","last_became_active":"2024-03-08T06:03:20.060402+0000","last_became_peered":"2024-03-08T06:03:20.060402+0000","last_unstale":"2024-03-08T06:03:21.115755+0000","last_undegraded":"2024-03-08T06:03:21.115755+0000","last_fullsized":"2024-03-08T06:03:21.115755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:27:56.194137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.110959+0000","last_change":"2024-03-08T06:03:21.105833+0000","last_active":"2024-03-08T06:03:21.110959+0000","last_peered":"2024-03-08T06:03:21.110959+0000","last_clean":"2024-03-08T06:03:21.110959+0000","last_became_active":"2024-03-08T06:03:21.105465+0000","last_became_peered":"2024-03-08T06:03:21.105465+0000","last_unstale":"2024-03-08T06:03:21.110959+0000","last_undegraded":"2024-03-08T06:03:21.110959+0000","last_fullsized":"2024-03-08T06:03:21.110959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:32:38.303917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087739+0000","last_change":"2024-03-08T06:03:20.072273+0000","last_active":"2024-03-08T06:03:22.087739+0000","last_peered":"2024-03-08T06:03:22.087739+0000","last_clean":"2024-03-08T06:03:22.087739+0000","last_became_active":"2024-03-08T06:03:20.071389+0000","last_became_peered":"2024-03-08T06:03:20.071389+0000","last_unstale":"2024-03-08T06:03:22.087739+0000","last_undegraded":"2024-03-08T06:03:22.087739+0000","last_fullsized":"2024-03-08T06:03:22.087739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:30.813078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090022+0000","last_change":"2024-03-08T06:03:21.089054+0000","last_active":"2024-03-08T06:03:22.090022+0000","last_peered":"2024-03-08T06:03:22.090022+0000","last_clean":"2024-03-08T06:03:22.090022+0000","last_became_active":"2024-03-08T06:03:21.080309+0000","last_became_peered":"2024-03-08T06:03:21.080309+0000","last_unstale":"2024-03-08T06:03:22.090022+0000","last_undegraded":"2024-03-08T06:03:22.090022+0000","last_fullsized":"2024-03-08T06:03:22.090022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:27.959321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.118723+0000","last_change":"2024-03-08T06:03:20.068126+0000","last_active":"2024-03-08T06:03:21.118723+0000","last_peered":"2024-03-08T06:03:21.118723+0000","last_clean":"2024-03-08T06:03:21.118723+0000","last_became_active":"2024-03-08T06:03:20.067828+0000","last_became_peered":"2024-03-08T06:03:20.067828+0000","last_unstale":"2024-03-08T06:03:21.118723+0000","last_undegraded":"2024-03-08T06:03:21.118723+0000","last_fullsized":"2024-03-08T06:03:21.118723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:26.946077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.089371+0000","last_change":"2024-03-08T06:03:21.082117+0000","last_active":"2024-03-08T06:03:22.089371+0000","last_peered":"2024-03-08T06:03:22.089371+0000","last_clean":"2024-03-08T06:03:22.089371+0000","last_became_active":"2024-03-08T06:03:21.081852+0000","last_became_peered":"2024-03-08T06:03:21.081852+0000","last_unstale":"2024-03-08T06:03:22.089371+0000","last_undegraded":"2024-03-08T06:03:22.089371+0000","last_fullsized":"2024-03-08T06:03:22.089371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:52:15.212911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.112304+0000","last_change":"2024-03-08T06:03:20.055291+0000","last_active":"2024-03-08T06:03:21.112304+0000","last_peered":"2024-03-08T06:03:21.112304+0000","last_clean":"2024-03-08T06:03:21.112304+0000","last_became_active":"2024-03-08T06:03:20.054907+0000","last_became_peered":"2024-03-08T06:03:20.054907+0000","last_unstale":"2024-03-08T06:03:21.112304+0000","last_undegraded":"2024-03-08T06:03:21.112304+0000","last_fullsized":"2024-03-08T06:03:21.112304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:04:32.971131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.101063+0000","last_change":"2024-03-08T06:03:21.092104+0000","last_active":"2024-03-08T06:03:21.101063+0000","last_peered":"2024-03-08T06:03:21.101063+0000","last_clean":"2024-03-08T06:03:21.101063+0000","last_became_active":"2024-03-08T06:03:21.091723+0000","last_became_peered":"2024-03-08T06:03:21.091723+0000","last_unstale":"2024-03-08T06:03:21.101063+0000","last_undegraded":"2024-03-08T06:03:21.101063+0000","last_fullsized":"2024-03-08T06:03:21.101063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:54:21.540639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.113646+0000","last_change":"2024-03-08T06:03:20.068308+0000","last_active":"2024-03-08T06:03:21.113646+0000","last_peered":"2024-03-08T06:03:21.113646+0000","last_clean":"2024-03-08T06:03:21.113646+0000","last_became_active":"2024-03-08T06:03:20.068036+0000","last_became_peered":"2024-03-08T06:03:20.068036+0000","last_unstale":"2024-03-08T06:03:21.113646+0000","last_undegraded":"2024-03-08T06:03:21.113646+0000","last_fullsized":"2024-03-08T06:03:21.113646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:28:12.116799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088404+0000","last_change":"2024-03-08T06:03:21.102514+0000","last_active":"2024-03-08T06:03:22.088404+0000","last_peered":"2024-03-08T06:03:22.088404+0000","last_clean":"2024-03-08T06:03:22.088404+0000","last_became_active":"2024-03-08T06:03:21.101780+0000","last_became_peered":"2024-03-08T06:03:21.101780+0000","last_unstale":"2024-03-08T06:03:22.088404+0000","last_undegraded":"2024-03-08T06:03:22.088404+0000","last_fullsized":"2024-03-08T06:03:22.088404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:00:39.301215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.083016+0000","last_change":"2024-03-08T06:03:20.049517+0000","last_active":"2024-03-08T06:03:21.083016+0000","last_peered":"2024-03-08T06:03:21.083016+0000","last_clean":"2024-03-08T06:03:21.083016+0000","last_became_active":"2024-03-08T06:03:20.047972+0000","last_became_peered":"2024-03-08T06:03:20.047972+0000","last_unstale":"2024-03-08T06:03:21.083016+0000","last_undegraded":"2024-03-08T06:03:21.083016+0000","last_fullsized":"2024-03-08T06:03:21.083016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:54:20.527395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.089855+0000","last_change":"2024-03-08T06:03:21.085035+0000","last_active":"2024-03-08T06:03:21.089855+0000","last_peered":"2024-03-08T06:03:21.089855+0000","last_clean":"2024-03-08T06:03:21.089855+0000","last_became_active":"2024-03-08T06:03:21.084676+0000","last_became_peered":"2024-03-08T06:03:21.084676+0000","last_unstale":"2024-03-08T06:03:21.089855+0000","last_undegraded":"2024-03-08T06:03:21.089855+0000","last_fullsized":"2024-03-08T06:03:21.089855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:49.593181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.111368+0000","last_change":"2024-03-08T06:03:20.065172+0000","last_active":"2024-03-08T06:03:21.111368+0000","last_peered":"2024-03-08T06:03:21.111368+0000","last_clean":"2024-03-08T06:03:21.111368+0000","last_became_active":"2024-03-08T06:03:20.064854+0000","last_became_peered":"2024-03-08T06:03:20.064854+0000","last_unstale":"2024-03-08T06:03:21.111368+0000","last_undegraded":"2024-03-08T06:03:21.111368+0000","last_fullsized":"2024-03-08T06:03:21.111368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:54:20.527395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087834+0000","last_change":"2024-03-08T06:03:21.101352+0000","last_active":"2024-03-08T06:03:22.087834+0000","last_peered":"2024-03-08T06:03:22.087834+0000","last_clean":"2024-03-08T06:03:22.087834+0000","last_became_active":"2024-03-08T06:03:21.101040+0000","last_became_peered":"2024-03-08T06:03:21.101040+0000","last_unstale":"2024-03-08T06:03:22.087834+0000","last_undegraded":"2024-03-08T06:03:22.087834+0000","last_fullsized":"2024-03-08T06:03:22.087834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:57:49.623008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087854+0000","last_change":"2024-03-08T06:03:20.057635+0000","last_active":"2024-03-08T06:03:22.087854+0000","last_peered":"2024-03-08T06:03:22.087854+0000","last_clean":"2024-03-08T06:03:22.087854+0000","last_became_active":"2024-03-08T06:03:20.057209+0000","last_became_peered":"2024-03-08T06:03:20.057209+0000","last_unstale":"2024-03-08T06:03:22.087854+0000","last_undegraded":"2024-03-08T06:03:22.087854+0000","last_fullsized":"2024-03-08T06:03:22.087854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:46:53.297684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090632+0000","last_change":"2024-03-08T06:03:21.100194+0000","last_active":"2024-03-08T06:03:22.090632+0000","last_peered":"2024-03-08T06:03:22.090632+0000","last_clean":"2024-03-08T06:03:22.090632+0000","last_became_active":"2024-03-08T06:03:21.099871+0000","last_became_peered":"2024-03-08T06:03:21.099871+0000","last_unstale":"2024-03-08T06:03:22.090632+0000","last_undegraded":"2024-03-08T06:03:22.090632+0000","last_fullsized":"2024-03-08T06:03:22.090632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:05:42.148812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.110677+0000","last_change":"2024-03-08T06:03:20.063658+0000","last_active":"2024-03-08T06:03:21.110677+0000","last_peered":"2024-03-08T06:03:21.110677+0000","last_clean":"2024-03-08T06:03:21.110677+0000","last_became_active":"2024-03-08T06:03:20.063364+0000","last_became_peered":"2024-03-08T06:03:20.063364+0000","last_unstale":"2024-03-08T06:03:21.110677+0000","last_undegraded":"2024-03-08T06:03:21.110677+0000","last_fullsized":"2024-03-08T06:03:21.110677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:48.579937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090948+0000","last_change":"2024-03-08T06:03:21.100719+0000","last_active":"2024-03-08T06:03:22.090948+0000","last_peered":"2024-03-08T06:03:22.090948+0000","last_clean":"2024-03-08T06:03:22.090948+0000","last_became_active":"2024-03-08T06:03:21.100356+0000","last_became_peered":"2024-03-08T06:03:21.100356+0000","last_unstale":"2024-03-08T06:03:22.090948+0000","last_undegraded":"2024-03-08T06:03:22.090948+0000","last_fullsized":"2024-03-08T06:03:22.090948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:17:15.821002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088072+0000","last_change":"2024-03-08T06:03:20.053836+0000","last_active":"2024-03-08T06:03:22.088072+0000","last_peered":"2024-03-08T06:03:22.088072+0000","last_clean":"2024-03-08T06:03:22.088072+0000","last_became_active":"2024-03-08T06:03:20.053485+0000","last_became_peered":"2024-03-08T06:03:20.053485+0000","last_unstale":"2024-03-08T06:03:22.088072+0000","last_undegraded":"2024-03-08T06:03:22.088072+0000","last_fullsized":"2024-03-08T06:03:22.088072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:41.633303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.113414+0000","last_change":"2024-03-08T06:03:21.097727+0000","last_active":"2024-03-08T06:03:21.113414+0000","last_peered":"2024-03-08T06:03:21.113414+0000","last_clean":"2024-03-08T06:03:21.113414+0000","last_became_active":"2024-03-08T06:03:21.096995+0000","last_became_peered":"2024-03-08T06:03:21.096995+0000","last_unstale":"2024-03-08T06:03:21.113414+0000","last_undegraded":"2024-03-08T06:03:21.113414+0000","last_fullsized":"2024-03-08T06:03:21.113414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:49.593181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.079280+0000","last_change":"2024-03-08T06:03:20.067426+0000","last_active":"2024-03-08T06:03:21.079280+0000","last_peered":"2024-03-08T06:03:21.079280+0000","last_clean":"2024-03-08T06:03:21.079280+0000","last_became_active":"2024-03-08T06:03:20.067090+0000","last_became_peered":"2024-03-08T06:03:20.067090+0000","last_unstale":"2024-03-08T06:03:21.079280+0000","last_undegraded":"2024-03-08T06:03:21.079280+0000","last_fullsized":"2024-03-08T06:03:21.079280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:54:47.826647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.089774+0000","last_change":"2024-03-08T06:03:21.107588+0000","last_active":"2024-03-08T06:03:22.089774+0000","last_peered":"2024-03-08T06:03:22.089774+0000","last_clean":"2024-03-08T06:03:22.089774+0000","last_became_active":"2024-03-08T06:03:21.107204+0000","last_became_peered":"2024-03-08T06:03:21.107204+0000","last_unstale":"2024-03-08T06:03:22.089774+0000","last_undegraded":"2024-03-08T06:03:22.089774+0000","last_fullsized":"2024-03-08T06:03:22.089774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:36:22.740638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088160+0000","last_change":"2024-03-08T06:03:16.679654+0000","last_active":"2024-03-08T06:03:22.088160+0000","last_peered":"2024-03-08T06:03:22.088160+0000","last_clean":"2024-03-08T06:03:22.088160+0000","last_became_active":"2024-03-08T06:03:16.676829+0000","last_became_peered":"2024-03-08T06:03:16.676829+0000","last_unstale":"2024-03-08T06:03:22.088160+0000","last_undegraded":"2024-03-08T06:03:22.088160+0000","last_fullsized":"2024-03-08T06:03:22.088160+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:14.800941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:14.800941+0000","last_clean_scrub_stamp":"2024-03-08T06:03:14.800941+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:20:09.927678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.113735+0000","last_change":"2024-03-08T06:03:20.066015+0000","last_active":"2024-03-08T06:03:21.113735+0000","last_peered":"2024-03-08T06:03:21.113735+0000","last_clean":"2024-03-08T06:03:21.113735+0000","last_became_active":"2024-03-08T06:03:20.065647+0000","last_became_peered":"2024-03-08T06:03:20.065647+0000","last_unstale":"2024-03-08T06:03:21.113735+0000","last_undegraded":"2024-03-08T06:03:21.113735+0000","last_fullsized":"2024-03-08T06:03:21.113735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:24:29.819056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.098948+0000","last_change":"2024-03-08T06:03:21.092065+0000","last_active":"2024-03-08T06:03:21.098948+0000","last_peered":"2024-03-08T06:03:21.098948+0000","last_clean":"2024-03-08T06:03:21.098948+0000","last_became_active":"2024-03-08T06:03:21.091753+0000","last_became_peered":"2024-03-08T06:03:21.091753+0000","last_unstale":"2024-03-08T06:03:21.098948+0000","last_undegraded":"2024-03-08T06:03:21.098948+0000","last_fullsized":"2024-03-08T06:03:21.098948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:21:05.940407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088016+0000","last_change":"2024-03-08T06:03:20.074566+0000","last_active":"2024-03-08T06:03:22.088016+0000","last_peered":"2024-03-08T06:03:22.088016+0000","last_clean":"2024-03-08T06:03:22.088016+0000","last_became_active":"2024-03-08T06:03:20.074234+0000","last_became_peered":"2024-03-08T06:03:20.074234+0000","last_unstale":"2024-03-08T06:03:22.088016+0000","last_undegraded":"2024-03-08T06:03:22.088016+0000","last_fullsized":"2024-03-08T06:03:22.088016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:22.024440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.108243+0000","last_change":"2024-03-08T06:03:21.100866+0000","last_active":"2024-03-08T06:03:21.108243+0000","last_peered":"2024-03-08T06:03:21.108243+0000","last_clean":"2024-03-08T06:03:21.108243+0000","last_became_active":"2024-03-08T06:03:21.100541+0000","last_became_peered":"2024-03-08T06:03:21.100541+0000","last_unstale":"2024-03-08T06:03:21.108243+0000","last_undegraded":"2024-03-08T06:03:21.108243+0000","last_fullsized":"2024-03-08T06:03:21.108243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:31.826322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.071756+0000","last_change":"2024-03-08T06:03:20.062458+0000","last_active":"2024-03-08T06:03:21.071756+0000","last_peered":"2024-03-08T06:03:21.071756+0000","last_clean":"2024-03-08T06:03:21.071756+0000","last_became_active":"2024-03-08T06:03:20.062017+0000","last_became_peered":"2024-03-08T06:03:20.062017+0000","last_unstale":"2024-03-08T06:03:21.071756+0000","last_undegraded":"2024-03-08T06:03:21.071756+0000","last_fullsized":"2024-03-08T06:03:21.071756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:44:31.139813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087236+0000","last_change":"2024-03-08T06:03:21.083073+0000","last_active":"2024-03-08T06:03:22.087236+0000","last_peered":"2024-03-08T06:03:22.087236+0000","last_clean":"2024-03-08T06:03:22.087236+0000","last_became_active":"2024-03-08T06:03:21.082544+0000","last_became_peered":"2024-03-08T06:03:21.082544+0000","last_unstale":"2024-03-08T06:03:22.087236+0000","last_undegraded":"2024-03-08T06:03:22.087236+0000","last_fullsized":"2024-03-08T06:03:22.087236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:17:51.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.113807+0000","last_change":"2024-03-08T06:03:20.065501+0000","last_active":"2024-03-08T06:03:21.113807+0000","last_peered":"2024-03-08T06:03:21.113807+0000","last_clean":"2024-03-08T06:03:21.113807+0000","last_became_active":"2024-03-08T06:03:20.065200+0000","last_became_peered":"2024-03-08T06:03:20.065200+0000","last_unstale":"2024-03-08T06:03:21.113807+0000","last_undegraded":"2024-03-08T06:03:21.113807+0000","last_fullsized":"2024-03-08T06:03:21.113807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:17:50.510674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087483+0000","last_change":"2024-03-08T06:03:21.091986+0000","last_active":"2024-03-08T06:03:22.087483+0000","last_peered":"2024-03-08T06:03:22.087483+0000","last_clean":"2024-03-08T06:03:22.087483+0000","last_became_active":"2024-03-08T06:03:21.091675+0000","last_became_peered":"2024-03-08T06:03:21.091675+0000","last_unstale":"2024-03-08T06:03:22.087483+0000","last_undegraded":"2024-03-08T06:03:22.087483+0000","last_fullsized":"2024-03-08T06:03:22.087483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:31.826322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.086969+0000","last_change":"2024-03-08T06:03:20.065327+0000","last_active":"2024-03-08T06:03:22.086969+0000","last_peered":"2024-03-08T06:03:22.086969+0000","last_clean":"2024-03-08T06:03:22.086969+0000","last_became_active":"2024-03-08T06:03:20.064891+0000","last_became_peered":"2024-03-08T06:03:20.064891+0000","last_unstale":"2024-03-08T06:03:22.086969+0000","last_undegraded":"2024-03-08T06:03:22.086969+0000","last_fullsized":"2024-03-08T06:03:22.086969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:26.946077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.109783+0000","last_change":"2024-03-08T06:03:21.097867+0000","last_active":"2024-03-08T06:03:21.109783+0000","last_peered":"2024-03-08T06:03:21.109783+0000","last_clean":"2024-03-08T06:03:21.109783+0000","last_became_active":"2024-03-08T06:03:21.097495+0000","last_became_peered":"2024-03-08T06:03:21.097495+0000","last_unstale":"2024-03-08T06:03:21.109783+0000","last_undegraded":"2024-03-08T06:03:21.109783+0000","last_fullsized":"2024-03-08T06:03:21.109783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:23.037684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090113+0000","last_change":"2024-03-08T06:03:20.069667+0000","last_active":"2024-03-08T06:03:22.090113+0000","last_peered":"2024-03-08T06:03:22.090113+0000","last_clean":"2024-03-08T06:03:22.090113+0000","last_became_active":"2024-03-08T06:03:20.069428+0000","last_became_peered":"2024-03-08T06:03:20.069428+0000","last_unstale":"2024-03-08T06:03:22.090113+0000","last_undegraded":"2024-03-08T06:03:22.090113+0000","last_fullsized":"2024-03-08T06:03:22.090113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:21:04.927163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.086921+0000","last_change":"2024-03-08T06:03:21.084065+0000","last_active":"2024-03-08T06:03:22.086921+0000","last_peered":"2024-03-08T06:03:22.086921+0000","last_clean":"2024-03-08T06:03:22.086921+0000","last_became_active":"2024-03-08T06:03:21.083747+0000","last_became_peered":"2024-03-08T06:03:21.083747+0000","last_unstale":"2024-03-08T06:03:22.086921+0000","last_undegraded":"2024-03-08T06:03:22.086921+0000","last_fullsized":"2024-03-08T06:03:22.086921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:24:30.832300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087595+0000","last_change":"2024-03-08T06:03:20.059341+0000","last_active":"2024-03-08T06:03:22.087595+0000","last_peered":"2024-03-08T06:03:22.087595+0000","last_clean":"2024-03-08T06:03:22.087595+0000","last_became_active":"2024-03-08T06:03:20.059016+0000","last_became_peered":"2024-03-08T06:03:20.059016+0000","last_unstale":"2024-03-08T06:03:22.087595+0000","last_undegraded":"2024-03-08T06:03:22.087595+0000","last_fullsized":"2024-03-08T06:03:22.087595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:22.024440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.095573+0000","last_change":"2024-03-08T06:03:21.088353+0000","last_active":"2024-03-08T06:03:21.095573+0000","last_peered":"2024-03-08T06:03:21.095573+0000","last_clean":"2024-03-08T06:03:21.095573+0000","last_became_active":"2024-03-08T06:03:21.088046+0000","last_became_peered":"2024-03-08T06:03:21.088046+0000","last_unstale":"2024-03-08T06:03:21.095573+0000","last_undegraded":"2024-03-08T06:03:21.095573+0000","last_fullsized":"2024-03-08T06:03:21.095573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:49.593181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.116966+0000","last_change":"2024-03-08T06:03:20.071250+0000","last_active":"2024-03-08T06:03:21.116966+0000","last_peered":"2024-03-08T06:03:21.116966+0000","last_clean":"2024-03-08T06:03:21.116966+0000","last_became_active":"2024-03-08T06:03:20.070870+0000","last_became_peered":"2024-03-08T06:03:20.070870+0000","last_unstale":"2024-03-08T06:03:21.116966+0000","last_undegraded":"2024-03-08T06:03:21.116966+0000","last_fullsized":"2024-03-08T06:03:21.116966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:30.813078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.101011+0000","last_change":"2024-03-08T06:03:21.097827+0000","last_active":"2024-03-08T06:03:21.101011+0000","last_peered":"2024-03-08T06:03:21.101011+0000","last_clean":"2024-03-08T06:03:21.101011+0000","last_became_active":"2024-03-08T06:03:21.097542+0000","last_became_peered":"2024-03-08T06:03:21.097542+0000","last_unstale":"2024-03-08T06:03:21.101011+0000","last_undegraded":"2024-03-08T06:03:21.101011+0000","last_fullsized":"2024-03-08T06:03:21.101011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:49.593181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087648+0000","last_change":"2024-03-08T06:03:20.064310+0000","last_active":"2024-03-08T06:03:22.087648+0000","last_peered":"2024-03-08T06:03:22.087648+0000","last_clean":"2024-03-08T06:03:22.087648+0000","last_became_active":"2024-03-08T06:03:20.063983+0000","last_became_peered":"2024-03-08T06:03:20.063983+0000","last_unstale":"2024-03-08T06:03:22.087648+0000","last_undegraded":"2024-03-08T06:03:22.087648+0000","last_fullsized":"2024-03-08T06:03:22.087648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:48.579937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087328+0000","last_change":"2024-03-08T06:03:21.085108+0000","last_active":"2024-03-08T06:03:22.087328+0000","last_peered":"2024-03-08T06:03:22.087328+0000","last_clean":"2024-03-08T06:03:22.087328+0000","last_became_active":"2024-03-08T06:03:21.084673+0000","last_became_peered":"2024-03-08T06:03:21.084673+0000","last_unstale":"2024-03-08T06:03:22.087328+0000","last_undegraded":"2024-03-08T06:03:22.087328+0000","last_fullsized":"2024-03-08T06:03:22.087328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:49.593181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088223+0000","last_change":"2024-03-08T06:03:20.054745+0000","last_active":"2024-03-08T06:03:22.088223+0000","last_peered":"2024-03-08T06:03:22.088223+0000","last_clean":"2024-03-08T06:03:22.088223+0000","last_became_active":"2024-03-08T06:03:20.054461+0000","last_became_peered":"2024-03-08T06:03:20.054461+0000","last_unstale":"2024-03-08T06:03:22.088223+0000","last_undegraded":"2024-03-08T06:03:22.088223+0000","last_fullsized":"2024-03-08T06:03:22.088223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:54:47.826647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.085518+0000","last_change":"2024-03-08T06:03:21.079197+0000","last_active":"2024-03-08T06:03:21.085518+0000","last_peered":"2024-03-08T06:03:21.085518+0000","last_clean":"2024-03-08T06:03:21.085518+0000","last_became_active":"2024-03-08T06:03:21.078822+0000","last_became_peered":"2024-03-08T06:03:21.078822+0000","last_unstale":"2024-03-08T06:03:21.085518+0000","last_undegraded":"2024-03-08T06:03:21.085518+0000","last_fullsized":"2024-03-08T06:03:21.085518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:54:48.839891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087455+0000","last_change":"2024-03-08T06:03:20.071672+0000","last_active":"2024-03-08T06:03:22.087455+0000","last_peered":"2024-03-08T06:03:22.087455+0000","last_clean":"2024-03-08T06:03:22.087455+0000","last_became_active":"2024-03-08T06:03:20.070816+0000","last_became_peered":"2024-03-08T06:03:20.070816+0000","last_unstale":"2024-03-08T06:03:22.087455+0000","last_undegraded":"2024-03-08T06:03:22.087455+0000","last_fullsized":"2024-03-08T06:03:22.087455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:48.579937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.095761+0000","last_change":"2024-03-08T06:03:21.089795+0000","last_active":"2024-03-08T06:03:21.095761+0000","last_peered":"2024-03-08T06:03:21.095761+0000","last_clean":"2024-03-08T06:03:21.095761+0000","last_became_active":"2024-03-08T06:03:21.089491+0000","last_became_peered":"2024-03-08T06:03:21.089491+0000","last_unstale":"2024-03-08T06:03:21.095761+0000","last_undegraded":"2024-03-08T06:03:21.095761+0000","last_fullsized":"2024-03-08T06:03:21.095761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:31.826322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088562+0000","last_change":"2024-03-08T06:03:20.063251+0000","last_active":"2024-03-08T06:03:22.088562+0000","last_peered":"2024-03-08T06:03:22.088562+0000","last_clean":"2024-03-08T06:03:22.088562+0000","last_became_active":"2024-03-08T06:03:20.061931+0000","last_became_peered":"2024-03-08T06:03:20.061931+0000","last_unstale":"2024-03-08T06:03:22.088562+0000","last_undegraded":"2024-03-08T06:03:22.088562+0000","last_fullsized":"2024-03-08T06:03:22.088562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:41.633303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.091912+0000","last_change":"2024-03-08T06:03:21.087608+0000","last_active":"2024-03-08T06:03:21.091912+0000","last_peered":"2024-03-08T06:03:21.091912+0000","last_clean":"2024-03-08T06:03:21.091912+0000","last_became_active":"2024-03-08T06:03:21.086636+0000","last_became_peered":"2024-03-08T06:03:21.086636+0000","last_unstale":"2024-03-08T06:03:21.091912+0000","last_undegraded":"2024-03-08T06:03:21.091912+0000","last_fullsized":"2024-03-08T06:03:21.091912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:23.037684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.110323+0000","last_change":"2024-03-08T06:03:21.099738+0000","last_active":"2024-03-08T06:03:21.110323+0000","last_peered":"2024-03-08T06:03:21.110323+0000","last_clean":"2024-03-08T06:03:21.110323+0000","last_became_active":"2024-03-08T06:03:21.098798+0000","last_became_peered":"2024-03-08T06:03:21.098798+0000","last_unstale":"2024-03-08T06:03:21.110323+0000","last_undegraded":"2024-03-08T06:03:21.110323+0000","last_fullsized":"2024-03-08T06:03:21.110323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:31.826322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088884+0000","last_change":"2024-03-08T06:03:20.068500+0000","last_active":"2024-03-08T06:03:22.088884+0000","last_peered":"2024-03-08T06:03:22.088884+0000","last_clean":"2024-03-08T06:03:22.088884+0000","last_became_active":"2024-03-08T06:03:20.068165+0000","last_became_peered":"2024-03-08T06:03:20.068165+0000","last_unstale":"2024-03-08T06:03:22.088884+0000","last_undegraded":"2024-03-08T06:03:22.088884+0000","last_fullsized":"2024-03-08T06:03:22.088884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:30.813078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.110379+0000","last_change":"2024-03-08T06:03:21.100116+0000","last_active":"2024-03-08T06:03:21.110379+0000","last_peered":"2024-03-08T06:03:21.110379+0000","last_clean":"2024-03-08T06:03:21.110379+0000","last_became_active":"2024-03-08T06:03:21.099049+0000","last_became_peered":"2024-03-08T06:03:21.099049+0000","last_unstale":"2024-03-08T06:03:21.110379+0000","last_undegraded":"2024-03-08T06:03:21.110379+0000","last_fullsized":"2024-03-08T06:03:21.110379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:27.959321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.089860+0000","last_change":"2024-03-08T06:03:20.073962+0000","last_active":"2024-03-08T06:03:22.089860+0000","last_peered":"2024-03-08T06:03:22.089860+0000","last_clean":"2024-03-08T06:03:22.089860+0000","last_became_active":"2024-03-08T06:03:20.073658+0000","last_became_peered":"2024-03-08T06:03:20.073658+0000","last_unstale":"2024-03-08T06:03:22.089860+0000","last_undegraded":"2024-03-08T06:03:22.089860+0000","last_fullsized":"2024-03-08T06:03:22.089860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:26.946077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.110935+0000","last_change":"2024-03-08T06:03:21.105031+0000","last_active":"2024-03-08T06:03:21.110935+0000","last_peered":"2024-03-08T06:03:21.110935+0000","last_clean":"2024-03-08T06:03:21.110935+0000","last_became_active":"2024-03-08T06:03:21.104736+0000","last_became_peered":"2024-03-08T06:03:21.104736+0000","last_unstale":"2024-03-08T06:03:21.110935+0000","last_undegraded":"2024-03-08T06:03:21.110935+0000","last_fullsized":"2024-03-08T06:03:21.110935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:21:05.940407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.108518+0000","last_change":"2024-03-08T06:03:20.061969+0000","last_active":"2024-03-08T06:03:21.108518+0000","last_peered":"2024-03-08T06:03:21.108518+0000","last_clean":"2024-03-08T06:03:21.108518+0000","last_became_active":"2024-03-08T06:03:20.061568+0000","last_became_peered":"2024-03-08T06:03:20.061568+0000","last_unstale":"2024-03-08T06:03:21.108518+0000","last_undegraded":"2024-03-08T06:03:21.108518+0000","last_fullsized":"2024-03-08T06:03:21.108518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:14:52.512990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.095766+0000","last_change":"2024-03-08T06:03:21.091233+0000","last_active":"2024-03-08T06:03:21.095766+0000","last_peered":"2024-03-08T06:03:21.095766+0000","last_clean":"2024-03-08T06:03:21.095766+0000","last_became_active":"2024-03-08T06:03:21.090260+0000","last_became_peered":"2024-03-08T06:03:21.090260+0000","last_unstale":"2024-03-08T06:03:21.095766+0000","last_undegraded":"2024-03-08T06:03:21.095766+0000","last_fullsized":"2024-03-08T06:03:21.095766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:42.646547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-08T06:03:21.109066+0000","last_change":"2024-03-08T06:03:20.066538+0000","last_active":"2024-03-08T06:03:21.109066+0000","last_peered":"2024-03-08T06:03:21.109066+0000","last_clean":"2024-03-08T06:03:21.109066+0000","last_became_active":"2024-03-08T06:03:20.065542+0000","last_became_peered":"2024-03-08T06:03:20.065542+0000","last_unstale":"2024-03-08T06:03:21.109066+0000","last_undegraded":"2024-03-08T06:03:21.109066+0000","last_fullsized":"2024-03-08T06:03:21.109066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:14:52.512990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":208896,"data_stored":69395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":70917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":69305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":660311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T06:03:26.093 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-08T06:03:26.093 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-08T06:03:26.093 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-08T06:03:26.093 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-08T06:03:26.094 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-08T06:03:26.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.340+0000 7fe3b8c00640 1 Processor -- start 2024-03-08T06:03:26.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.340+0000 7fe3b8c00640 1 -- start start 2024-03-08T06:03:26.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.342+0000 7fe3b8c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe3b4144030 0x7fe3b40cf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:26.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.342+0000 7fe3b8c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe3b415e580 0x7fe3b406e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:26.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.342+0000 7fe3b8c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe3b406ec50 0x7fe3b4071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:26.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.342+0000 7fe3b8c00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b406f0b0 con 0x7fe3b4144030 2024-03-08T06:03:26.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.342+0000 7fe3b8c00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3b40b3350 con 0x7fe3b406ec50 2024-03-08T06:03:26.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.342+0000 7fe3b8c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b415eaf0 con 0x7fe3b415e580 2024-03-08T06:03:26.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.342+0000 7fe3b1e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe3b4144030 0x7fe3b40cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:26.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.342+0000 7fe3b1e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe3b4144030 0x7fe3b40cf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33430/0 (socket says 172.21.15.19:33430) 2024-03-08T06:03:26.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.342+0000 7fe3b1e00640 1 -- 172.21.15.19:0/3805708786 learned_addr learned my addr 172.21.15.19:0/3805708786 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:26.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.342+0000 7fe3b1e00640 1 -- 172.21.15.19:0/3805708786 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe3b415e580 msgr2=0x7fe3b406e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:26.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.342+0000 7fe3b1e00640 1 --2- 172.21.15.19:0/3805708786 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe3b415e580 0x7fe3b406e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:26.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.342+0000 7fe3b1e00640 1 -- 172.21.15.19:0/3805708786 >> v2:172.21.15.42:3300/0 conn(0x7fe3b406ec50 msgr2=0x7fe3b4071840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:26.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.342+0000 7fe3b1e00640 1 --2- 172.21.15.19:0/3805708786 >> v2:172.21.15.42:3300/0 conn(0x7fe3b406ec50 0x7fe3b4071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:26.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.342+0000 7fe3b1e00640 1 -- 172.21.15.19:0/3805708786 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b415edd0 con 0x7fe3b4144030 2024-03-08T06:03:26.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.344+0000 7fe3b1e00640 1 --2- 172.21.15.19:0/3805708786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3b4144030 0x7fe3b40cf080 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe3b415f670 tx=0x7fe39c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81bbf706afeb20f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:26.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.344+0000 7fe3b0a00640 1 -- 172.21.15.19:0/3805708786 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c035020 con 0x7fe3b4144030 2024-03-08T06:03:26.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.344+0000 7fe3b0a00640 1 -- 172.21.15.19:0/3805708786 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c02d040 con 0x7fe3b4144030 2024-03-08T06:03:26.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.344+0000 7fe3b0a00640 1 -- 172.21.15.19:0/3805708786 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c031a80 con 0x7fe3b4144030 2024-03-08T06:03:26.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.345+0000 7fe3b8c00640 1 -- 172.21.15.19:0/3805708786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3b4144030 msgr2=0x7fe3b40cf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:26.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.345+0000 7fe3b8c00640 1 --2- 172.21.15.19:0/3805708786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3b4144030 0x7fe3b40cf080 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe3b415f670 tx=0x7fe39c02b900 comp rx=0 tx=0).stop 2024-03-08T06:03:26.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.345+0000 7fe3b8c00640 1 -- 172.21.15.19:0/3805708786 shutdown_connections 2024-03-08T06:03:26.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.345+0000 7fe3b8c00640 1 --2- 172.21.15.19:0/3805708786 >> v2:172.21.15.42:3300/0 conn(0x7fe3b406ec50 0x7fe3b4071840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:26.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.345+0000 7fe3b8c00640 1 --2- 172.21.15.19:0/3805708786 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe3b415e580 0x7fe3b406e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:26.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.345+0000 7fe3b8c00640 1 --2- 172.21.15.19:0/3805708786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3b4144030 0x7fe3b40cf080 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:26.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.345+0000 7fe3b8c00640 1 -- 172.21.15.19:0/3805708786 >> 172.21.15.19:0/3805708786 conn(0x7fe3b406ae30 msgr2=0x7fe3b406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:26.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.345+0000 7fe3b8c00640 1 -- 172.21.15.19:0/3805708786 shutdown_connections 2024-03-08T06:03:26.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.345+0000 7fe3b8c00640 1 -- 172.21.15.19:0/3805708786 wait complete. 2024-03-08T06:03:26.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.346+0000 7fe3b8c00640 1 Processor -- start 2024-03-08T06:03:26.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.347+0000 7fe3b8c00640 1 -- start start 2024-03-08T06:03:26.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.348+0000 7fe3b8c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3b406ec50 0x7fe3b41f7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:26.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.348+0000 7fe3b8c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3b4144030 0x7fe3b4159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:26.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.348+0000 7fe3b8c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe3b415e580 0x7fe3b40ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:26.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.348+0000 7fe3b8c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b40cf5c0 con 0x7fe3b4144030 2024-03-08T06:03:26.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.348+0000 7fe3b8c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b415f390 con 0x7fe3b406ec50 2024-03-08T06:03:26.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.348+0000 7fe3b8c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b40cf740 con 0x7fe3b415e580 2024-03-08T06:03:26.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.348+0000 7fe3b1400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3b4144030 0x7fe3b4159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:26.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.348+0000 7fe3b1400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3b4144030 0x7fe3b4159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33442/0 (socket says 172.21.15.19:33442) 2024-03-08T06:03:26.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.348+0000 7fe3b1400640 1 -- 172.21.15.19:0/3014159666 learned_addr learned my addr 172.21.15.19:0/3014159666 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:26.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.348+0000 7fe3b1e00640 1 --2- 172.21.15.19:0/3014159666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3b406ec50 0x7fe3b41f7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:26.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.348+0000 7fe3b1400640 1 -- 172.21.15.19:0/3014159666 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe3b415e580 msgr2=0x7fe3b40ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:26.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.348+0000 7fe3b1400640 1 --2- 172.21.15.19:0/3014159666 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe3b415e580 0x7fe3b40ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:26.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.348+0000 7fe3b1400640 1 -- 172.21.15.19:0/3014159666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3b406ec50 msgr2=0x7fe3b41f7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:26.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.348+0000 7fe3b1400640 1 --2- 172.21.15.19:0/3014159666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3b406ec50 0x7fe3b41f7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:26.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.348+0000 7fe3b1400640 1 -- 172.21.15.19:0/3014159666 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b413b5b0 con 0x7fe3b4144030 2024-03-08T06:03:26.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.348+0000 7fe3b1e00640 1 --2- 172.21.15.19:0/3014159666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3b406ec50 0x7fe3b41f7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:26.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.349+0000 7fe3b1400640 1 --2- 172.21.15.19:0/3014159666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3b4144030 0x7fe3b4159f00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe3a400ba50 tx=0x7fe3a400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:26.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.349+0000 7fe3aa000640 1 -- 172.21.15.19:0/3014159666 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4019070 con 0x7fe3b4144030 2024-03-08T06:03:26.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.349+0000 7fe3aa000640 1 -- 172.21.15.19:0/3014159666 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a400cc00 con 0x7fe3b4144030 2024-03-08T06:03:26.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.349+0000 7fe3aa000640 1 -- 172.21.15.19:0/3014159666 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4014440 con 0x7fe3b4144030 2024-03-08T06:03:26.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.349+0000 7fe3b8c00640 1 -- 172.21.15.19:0/3014159666 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b413b2d0 con 0x7fe3b4144030 2024-03-08T06:03:26.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.349+0000 7fe3b8c00640 1 -- 172.21.15.19:0/3014159666 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b41f7730 con 0x7fe3b4144030 2024-03-08T06:03:26.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.350+0000 7fe3b8c00640 1 -- 172.21.15.19:0/3014159666 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3b4067cb0 con 0x7fe3b4144030 2024-03-08T06:03:26.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.351+0000 7fe3aa000640 1 -- 172.21.15.19:0/3014159666 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe3a401c070 con 0x7fe3b4144030 2024-03-08T06:03:26.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.352+0000 7fe3aa000640 1 --2- 172.21.15.19:0/3014159666 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe39006b4d0 0x7fe39006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:26.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.352+0000 7fe3aa000640 1 -- 172.21.15.19:0/3014159666 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3a4089fe0 con 0x7fe3b4144030 2024-03-08T06:03:26.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.352+0000 7fe3b1e00640 1 --2- 172.21.15.19:0/3014159666 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe39006b4d0 0x7fe39006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:26.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.353+0000 7fe3b1e00640 1 --2- 172.21.15.19:0/3014159666 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe39006b4d0 0x7fe39006d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe39c036000 tx=0x7fe39c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:26.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.357+0000 7fe3aa000640 1 -- 172.21.15.19:0/3014159666 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe3a4058de0 con 0x7fe3b4144030 2024-03-08T06:03:26.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.611+0000 7fe3b8c00640 1 -- 172.21.15.19:0/3014159666 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe3b40b30a0 con 0x7fe3b4144030 2024-03-08T06:03:26.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.620+0000 7fe3aa000640 1 -- 172.21.15.19:0/3014159666 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171784 (secure 0 0 0) 0x7fe3a40586e0 con 0x7fe3b4144030 2024-03-08T06:03:26.622 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:26.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.626+0000 7fe3b8c00640 1 -- 172.21.15.19:0/3014159666 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe39006b4d0 msgr2=0x7fe39006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:26.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.626+0000 7fe3b8c00640 1 --2- 172.21.15.19:0/3014159666 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe39006b4d0 0x7fe39006d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe39c036000 tx=0x7fe39c03c040 comp rx=0 tx=0).stop 2024-03-08T06:03:26.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.626+0000 7fe3b8c00640 1 -- 172.21.15.19:0/3014159666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3b4144030 msgr2=0x7fe3b4159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:26.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.626+0000 7fe3b8c00640 1 --2- 172.21.15.19:0/3014159666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3b4144030 0x7fe3b4159f00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe3a400ba50 tx=0x7fe3a400bf10 comp rx=0 tx=0).stop 2024-03-08T06:03:26.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.626+0000 7fe3b8c00640 1 -- 172.21.15.19:0/3014159666 shutdown_connections 2024-03-08T06:03:26.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.626+0000 7fe3b8c00640 1 --2- 172.21.15.19:0/3014159666 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe39006b4d0 0x7fe39006d990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:26.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.626+0000 7fe3b8c00640 1 --2- 172.21.15.19:0/3014159666 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe3b415e580 0x7fe3b40ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:26.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.626+0000 7fe3b8c00640 1 --2- 172.21.15.19:0/3014159666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3b4144030 0x7fe3b4159f00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:26.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.626+0000 7fe3b8c00640 1 --2- 172.21.15.19:0/3014159666 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3b406ec50 0x7fe3b41f7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:26.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.626+0000 7fe3b8c00640 1 -- 172.21.15.19:0/3014159666 >> 172.21.15.19:0/3014159666 conn(0x7fe3b406ae30 msgr2=0x7fe3b415d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:26.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.626+0000 7fe3b8c00640 1 -- 172.21.15.19:0/3014159666 shutdown_connections 2024-03-08T06:03:26.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.626+0000 7fe3b8c00640 1 -- 172.21.15.19:0/3014159666 wait complete. 2024-03-08T06:03:26.647 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":3589745192},{"type":"v1","addr":"172.21.15.19:6833","nonce":3589745192}]},"active_addr":"172.21.15.19:6833/3589745192","active_change":"2024-03-08T06:03:06.048654+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4112,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":4178830158}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":377747959}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":2325422591}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":1850283362}]}]} 2024-03-08T06:03:26.650 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-08T06:03:26.650 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-08T06:03:26.650 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:03:26.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.875+0000 7f8836a00640 1 Processor -- start 2024-03-08T06:03:26.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.875+0000 7f8836a00640 1 -- start start 2024-03-08T06:03:26.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.877+0000 7f8836a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f883015bea0 0x7f883015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:26.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.877+0000 7f8836a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883015ceb0 con 0x7f8830145520 2024-03-08T06:03:26.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.877+0000 7f8836a00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883015c330 con 0x7f8830071df0 2024-03-08T06:03:26.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.877+0000 7f8836a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883015c610 con 0x7f883015bea0 2024-03-08T06:03:26.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.877+0000 7f8834c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f883015bea0 0x7f883015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:26.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.877+0000 7f8834c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f883015bea0 0x7f883015d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33454/0 (socket says 172.21.15.19:33454) 2024-03-08T06:03:26.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.877+0000 7f8834c00640 1 -- 172.21.15.19:0/3146352242 learned_addr learned my addr 172.21.15.19:0/3146352242 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:26.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.878+0000 7f8834c00640 1 -- 172.21.15.19:0/3146352242 >> v1:172.21.15.42:6789/0 conn(0x7f8830071df0 legacy=0x7f883006d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:26.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.878+0000 7f8834c00640 1 -- 172.21.15.19:0/3146352242 >> v1:172.21.15.19:6789/0 conn(0x7f8830145520 legacy=0x7f88300716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:26.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.878+0000 7f8834c00640 1 -- 172.21.15.19:0/3146352242 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883015c8f0 con 0x7f883015bea0 2024-03-08T06:03:26.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.879+0000 7f8834c00640 1 --2- 172.21.15.19:0/3146352242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f883015bea0 0x7f883015d0a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f881c009870 tx=0x7f881c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bf153bcf1cf41a server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:26.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.879+0000 7f882fe00640 1 -- 172.21.15.19:0/3146352242 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c034070 con 0x7f883015bea0 2024-03-08T06:03:26.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.879+0000 7f882fe00640 1 -- 172.21.15.19:0/3146352242 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c030860 con 0x7f883015bea0 2024-03-08T06:03:26.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.879+0000 7f882fe00640 1 -- 172.21.15.19:0/3146352242 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c030c30 con 0x7f883015bea0 2024-03-08T06:03:26.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.880+0000 7f8836a00640 1 -- 172.21.15.19:0/3146352242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f883015bea0 msgr2=0x7f883015d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:26.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.880+0000 7f8836a00640 1 --2- 172.21.15.19:0/3146352242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f883015bea0 0x7f883015d0a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f881c009870 tx=0x7f881c02b9a0 comp rx=0 tx=0).stop 2024-03-08T06:03:26.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.880+0000 7f8836a00640 1 -- 172.21.15.19:0/3146352242 shutdown_connections 2024-03-08T06:03:26.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.880+0000 7f8836a00640 1 --2- 172.21.15.19:0/3146352242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f883015bea0 0x7f883015d0a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:26.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.880+0000 7f8836a00640 1 -- 172.21.15.19:0/3146352242 >> 172.21.15.19:0/3146352242 conn(0x7f88300b1850 msgr2=0x7f88300b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:26.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.880+0000 7f8836a00640 1 -- 172.21.15.19:0/3146352242 shutdown_connections 2024-03-08T06:03:26.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.880+0000 7f8836a00640 1 -- 172.21.15.19:0/3146352242 wait complete. 2024-03-08T06:03:26.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.882+0000 7f8836a00640 1 Processor -- start 2024-03-08T06:03:26.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.882+0000 7f8836a00640 1 -- start start 2024-03-08T06:03:26.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.883+0000 7f8836a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8830071df0 0x7f883015e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:26.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.883+0000 7f8836a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8830145520 0x7f883013ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:26.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.883+0000 7f8836a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f883015b030 0x7f883013a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:26.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.883+0000 7f8836a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88300af1c0 con 0x7f883015b030 2024-03-08T06:03:26.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.883+0000 7f8836a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88300af040 con 0x7f8830071df0 2024-03-08T06:03:26.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.883+0000 7f8836a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883006e410 con 0x7f8830145520 2024-03-08T06:03:26.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.884+0000 7f8836000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f883015b030 0x7f883013a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:26.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.884+0000 7f8836000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f883015b030 0x7f883013a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33460/0 (socket says 172.21.15.19:33460) 2024-03-08T06:03:26.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.884+0000 7f8836000640 1 -- 172.21.15.19:0/95057320 learned_addr learned my addr 172.21.15.19:0/95057320 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:26.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.884+0000 7f8834c00640 1 --2- 172.21.15.19:0/95057320 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8830145520 0x7f883013ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:26.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.884+0000 7f8835600640 1 --2- 172.21.15.19:0/95057320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8830071df0 0x7f883015e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:26.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.884+0000 7f8836000640 1 -- 172.21.15.19:0/95057320 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8830145520 msgr2=0x7f883013ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:26.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.884+0000 7f8836000640 1 --2- 172.21.15.19:0/95057320 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8830145520 0x7f883013ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:26.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.884+0000 7f8836000640 1 -- 172.21.15.19:0/95057320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8830071df0 msgr2=0x7f883015e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.884+0000 7f8836000640 1 --2- 172.21.15.19:0/95057320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8830071df0 0x7f883015e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.884+0000 7f8836000640 1 -- 172.21.15.19:0/95057320 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883013f2b0 con 0x7f883015b030 2024-03-08T06:03:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.884+0000 7f8836000640 1 --2- 172.21.15.19:0/95057320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f883015b030 0x7f883013a690 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f882800c6d0 tx=0x7f882800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.885+0000 7f882d600640 1 -- 172.21.15.19:0/95057320 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828016020 con 0x7f883015b030 2024-03-08T06:03:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.885+0000 7f882d600640 1 -- 172.21.15.19:0/95057320 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882800a840 con 0x7f883015b030 2024-03-08T06:03:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.885+0000 7f882d600640 1 -- 172.21.15.19:0/95057320 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882800ac70 con 0x7f883015b030 2024-03-08T06:03:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.885+0000 7f8836a00640 1 -- 172.21.15.19:0/95057320 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883015f350 con 0x7f883015b030 2024-03-08T06:03:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.885+0000 7f8836a00640 1 -- 172.21.15.19:0/95057320 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883015f070 con 0x7f883015b030 2024-03-08T06:03:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.886+0000 7f8836a00640 1 -- 172.21.15.19:0/95057320 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8830075100 con 0x7f883015b030 2024-03-08T06:03:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.887+0000 7f882d600640 1 -- 172.21.15.19:0/95057320 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8828019020 con 0x7f883015b030 2024-03-08T06:03:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.888+0000 7f882d600640 1 --2- 172.21.15.19:0/95057320 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f881006b500 0x7f881006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.888+0000 7f882d600640 1 -- 172.21.15.19:0/95057320 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f882808a750 con 0x7f883015b030 2024-03-08T06:03:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.888+0000 7f8835600640 1 --2- 172.21.15.19:0/95057320 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f881006b500 0x7f881006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.889+0000 7f8835600640 1 --2- 172.21.15.19:0/95057320 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f881006b500 0x7f881006d9c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8824001640 tx=0x7f8824009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:26.892+0000 7f882d600640 1 -- 172.21.15.19:0/95057320 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8828020020 con 0x7f883015b030 2024-03-08T06:03:27.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.095+0000 7f8836a00640 1 -- 172.21.15.19:0/95057320 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88300ceff0 con 0x7f883015b030 2024-03-08T06:03:27.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.099+0000 7f882d600640 1 -- 172.21.15.19:0/95057320 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f8828059530 con 0x7f883015b030 2024-03-08T06:03:27.100 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:27.100 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:03:22.069498+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:03:18.392703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T06:03:19.537912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:03:27.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.101+0000 7f8836a00640 1 -- 172.21.15.19:0/95057320 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f881006b500 msgr2=0x7f881006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.101+0000 7f8836a00640 1 --2- 172.21.15.19:0/95057320 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f881006b500 0x7f881006d9c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8824001640 tx=0x7f8824009040 comp rx=0 tx=0).stop 2024-03-08T06:03:27.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.101+0000 7f8836a00640 1 -- 172.21.15.19:0/95057320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f883015b030 msgr2=0x7f883013a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.101+0000 7f8836a00640 1 --2- 172.21.15.19:0/95057320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f883015b030 0x7f883013a690 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f882800c6d0 tx=0x7f882800cb90 comp rx=0 tx=0).stop 2024-03-08T06:03:27.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.102+0000 7f8836a00640 1 -- 172.21.15.19:0/95057320 shutdown_connections 2024-03-08T06:03:27.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.102+0000 7f8836a00640 1 --2- 172.21.15.19:0/95057320 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f881006b500 0x7f881006d9c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.102+0000 7f8836a00640 1 --2- 172.21.15.19:0/95057320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f883015b030 0x7f883013a690 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.102+0000 7f8836a00640 1 --2- 172.21.15.19:0/95057320 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8830145520 0x7f883013ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.102+0000 7f8836a00640 1 --2- 172.21.15.19:0/95057320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8830071df0 0x7f883015e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.102+0000 7f8836a00640 1 -- 172.21.15.19:0/95057320 >> 172.21.15.19:0/95057320 conn(0x7f88300b1850 msgr2=0x7f883013fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:27.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.102+0000 7f8836a00640 1 -- 172.21.15.19:0/95057320 shutdown_connections 2024-03-08T06:03:27.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.102+0000 7f8836a00640 1 -- 172.21.15.19:0/95057320 wait complete. 2024-03-08T06:03:27.125 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-08T06:03:27.125 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:03:27.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.350+0000 7f82a9e00640 1 Processor -- start 2024-03-08T06:03:27.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.350+0000 7f82a9e00640 1 -- start start 2024-03-08T06:03:27.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.352+0000 7f82a9e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f82a415e580 0x7f82a406e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.352+0000 7f82a9e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f82a406ec50 0x7f82a40b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.352+0000 7f82a9e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a415eaf0 con 0x7f82a4144030 2024-03-08T06:03:27.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.352+0000 7f82a9e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a40b3350 con 0x7f82a415e580 2024-03-08T06:03:27.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.352+0000 7f82a9e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a415edd0 con 0x7f82a406ec50 2024-03-08T06:03:27.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.352+0000 7f82a3400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f82a406ec50 0x7f82a40b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.352+0000 7f82a2000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f82a415e580 0x7f82a406e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.352+0000 7f82a3400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f82a406ec50 0x7f82a40b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.19:49646/0 (socket says 172.21.15.19:49646) 2024-03-08T06:03:27.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.352+0000 7f82a3400640 1 -- 172.21.15.19:0/760962430 learned_addr learned my addr 172.21.15.19:0/760962430 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.353+0000 7f82a3400640 1 -- 172.21.15.19:0/760962430 >> v2:172.21.15.42:3300/0 conn(0x7f82a415e580 msgr2=0x7f82a406e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.353+0000 7f82a3400640 1 --2- 172.21.15.19:0/760962430 >> v2:172.21.15.42:3300/0 conn(0x7f82a415e580 0x7f82a406e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.353+0000 7f82a3400640 1 -- 172.21.15.19:0/760962430 >> v1:172.21.15.42:6789/0 conn(0x7f82a4144030 legacy=0x7f82a40cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.353+0000 7f82a3400640 1 -- 172.21.15.19:0/760962430 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a415f0b0 con 0x7f82a406ec50 2024-03-08T06:03:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.353+0000 7f82a2000640 1 --2- 172.21.15.19:0/760962430 >> v2:172.21.15.42:3300/0 conn(0x7f82a415e580 0x7f82a406e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T06:03:27.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.354+0000 7f82a3400640 1 --2- 172.21.15.19:0/760962430 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f82a406ec50 0x7f82a40b37e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f829c009e50 tx=0x7f829c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65ecc0aa9d08a194 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:27.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.355+0000 7f82a1600640 1 -- 172.21.15.19:0/760962430 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c02cb00 con 0x7f82a406ec50 2024-03-08T06:03:27.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.355+0000 7f82a1600640 1 -- 172.21.15.19:0/760962430 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829c02cca0 con 0x7f82a406ec50 2024-03-08T06:03:27.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.355+0000 7f82a1600640 1 -- 172.21.15.19:0/760962430 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c034610 con 0x7f82a406ec50 2024-03-08T06:03:27.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.356+0000 7f82a9e00640 1 -- 172.21.15.19:0/760962430 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f82a406ec50 msgr2=0x7f82a40b37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.356+0000 7f82a9e00640 1 --2- 172.21.15.19:0/760962430 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f82a406ec50 0x7f82a40b37e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f829c009e50 tx=0x7f829c02bf60 comp rx=0 tx=0).stop 2024-03-08T06:03:27.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.356+0000 7f82a9e00640 1 -- 172.21.15.19:0/760962430 shutdown_connections 2024-03-08T06:03:27.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.356+0000 7f82a9e00640 1 --2- 172.21.15.19:0/760962430 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f82a406ec50 0x7f82a40b37e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.356+0000 7f82a9e00640 1 --2- 172.21.15.19:0/760962430 >> v2:172.21.15.42:3300/0 conn(0x7f82a415e580 0x7f82a406e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.356+0000 7f82a9e00640 1 -- 172.21.15.19:0/760962430 >> 172.21.15.19:0/760962430 conn(0x7f82a406ae30 msgr2=0x7f82a406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:27.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.356+0000 7f82a9e00640 1 -- 172.21.15.19:0/760962430 shutdown_connections 2024-03-08T06:03:27.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.356+0000 7f82a9e00640 1 -- 172.21.15.19:0/760962430 wait complete. 2024-03-08T06:03:27.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.357+0000 7f82a9e00640 1 Processor -- start 2024-03-08T06:03:27.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.358+0000 7f82a9e00640 1 -- start start 2024-03-08T06:03:27.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.358+0000 7f82a9e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82a406ec50 0x7f82a4139140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.359+0000 7f82a9e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f82a4144030 0x7f82a413e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.359+0000 7f82a9e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82a415e580 0x7f82a4159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.359+0000 7f82a9e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a4144590 con 0x7f82a415e580 2024-03-08T06:03:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.359+0000 7f82a9e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a4144410 con 0x7f82a406ec50 2024-03-08T06:03:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.359+0000 7f82a9e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40b3d20 con 0x7f82a4144030 2024-03-08T06:03:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.359+0000 7f82a3400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82a415e580 0x7f82a4159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.359+0000 7f82a3400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82a415e580 0x7f82a4159da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33472/0 (socket says 172.21.15.19:33472) 2024-03-08T06:03:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.359+0000 7f82a3400640 1 -- 172.21.15.19:0/3408603682 learned_addr learned my addr 172.21.15.19:0/3408603682 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.359+0000 7f82a2a00640 1 --2- 172.21.15.19:0/3408603682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82a406ec50 0x7f82a4139140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.359+0000 7f82a2000640 1 --2- 172.21.15.19:0/3408603682 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f82a4144030 0x7f82a413e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.359+0000 7f82a3400640 1 -- 172.21.15.19:0/3408603682 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f82a4144030 msgr2=0x7f82a413e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.359+0000 7f82a3400640 1 --2- 172.21.15.19:0/3408603682 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f82a4144030 0x7f82a413e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.359+0000 7f82a3400640 1 -- 172.21.15.19:0/3408603682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82a406ec50 msgr2=0x7f82a4139140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.359+0000 7f82a3400640 1 --2- 172.21.15.19:0/3408603682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82a406ec50 0x7f82a4139140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.359+0000 7f82a3400640 1 -- 172.21.15.19:0/3408603682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a4158f70 con 0x7f82a415e580 2024-03-08T06:03:27.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.360+0000 7f82a3400640 1 --2- 172.21.15.19:0/3408603682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82a415e580 0x7f82a4159da0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f829c036040 tx=0x7f829c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:27.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.360+0000 7f829b400640 1 -- 172.21.15.19:0/3408603682 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c043020 con 0x7f82a415e580 2024-03-08T06:03:27.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.360+0000 7f829b400640 1 -- 172.21.15.19:0/3408603682 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829c02ce50 con 0x7f82a415e580 2024-03-08T06:03:27.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.360+0000 7f829b400640 1 -- 172.21.15.19:0/3408603682 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c03e690 con 0x7f82a415e580 2024-03-08T06:03:27.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.360+0000 7f82a9e00640 1 -- 172.21.15.19:0/3408603682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a4159250 con 0x7f82a415e580 2024-03-08T06:03:27.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.360+0000 7f82a9e00640 1 -- 172.21.15.19:0/3408603682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a4159810 con 0x7f82a415e580 2024-03-08T06:03:27.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.362+0000 7f82a9e00640 1 -- 172.21.15.19:0/3408603682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a4067cb0 con 0x7f82a415e580 2024-03-08T06:03:27.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.362+0000 7f829b400640 1 -- 172.21.15.19:0/3408603682 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f829c046020 con 0x7f82a415e580 2024-03-08T06:03:27.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.363+0000 7f829b400640 1 --2- 172.21.15.19:0/3408603682 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f828006b500 0x7f828006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.363+0000 7f829b400640 1 -- 172.21.15.19:0/3408603682 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f829c0ac760 con 0x7f82a415e580 2024-03-08T06:03:27.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.364+0000 7f82a2a00640 1 --2- 172.21.15.19:0/3408603682 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f828006b500 0x7f828006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.364+0000 7f82a2a00640 1 --2- 172.21.15.19:0/3408603682 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f828006b500 0x7f828006d9c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8294000f60 tx=0x7f8294009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:27.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.368+0000 7f829b400640 1 -- 172.21.15.19:0/3408603682 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f829c04d030 con 0x7f82a415e580 2024-03-08T06:03:27.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.573+0000 7f82a9e00640 1 -- 172.21.15.19:0/3408603682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82a40aeec0 con 0x7f82a415e580 2024-03-08T06:03:27.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.576+0000 7f829b400640 1 -- 172.21.15.19:0/3408603682 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f829c07b5d0 con 0x7f82a415e580 2024-03-08T06:03:27.577 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:27.578 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:03:22.069498+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:03:18.392703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T06:03:19.537912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:03:27.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.578+0000 7f82a9e00640 1 -- 172.21.15.19:0/3408603682 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f828006b500 msgr2=0x7f828006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.578+0000 7f82a9e00640 1 --2- 172.21.15.19:0/3408603682 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f828006b500 0x7f828006d9c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8294000f60 tx=0x7f8294009040 comp rx=0 tx=0).stop 2024-03-08T06:03:27.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.578+0000 7f82a9e00640 1 -- 172.21.15.19:0/3408603682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82a415e580 msgr2=0x7f82a4159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.578+0000 7f82a9e00640 1 --2- 172.21.15.19:0/3408603682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82a415e580 0x7f82a4159da0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f829c036040 tx=0x7f829c004a40 comp rx=0 tx=0).stop 2024-03-08T06:03:27.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.579+0000 7f82a9e00640 1 -- 172.21.15.19:0/3408603682 shutdown_connections 2024-03-08T06:03:27.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.579+0000 7f82a9e00640 1 --2- 172.21.15.19:0/3408603682 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f828006b500 0x7f828006d9c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.579+0000 7f82a9e00640 1 --2- 172.21.15.19:0/3408603682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82a415e580 0x7f82a4159da0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.579+0000 7f82a9e00640 1 --2- 172.21.15.19:0/3408603682 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f82a4144030 0x7f82a413e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.579+0000 7f82a9e00640 1 --2- 172.21.15.19:0/3408603682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82a406ec50 0x7f82a4139140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.579+0000 7f82a9e00640 1 -- 172.21.15.19:0/3408603682 >> 172.21.15.19:0/3408603682 conn(0x7f82a406ae30 msgr2=0x7f82a413c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:27.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.579+0000 7f82a9e00640 1 -- 172.21.15.19:0/3408603682 shutdown_connections 2024-03-08T06:03:27.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.579+0000 7f82a9e00640 1 -- 172.21.15.19:0/3408603682 wait complete. 2024-03-08T06:03:27.600 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-08T06:03:27.601 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-08T06:03:27.601 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-08T06:03:27.602 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-08T06:03:27.602 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-08T06:03:27.603 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-08T06:03:27.603 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-08T06:03:27.604 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-08T06:03:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.908+0000 7ffa82e00640 1 Processor -- start 2024-03-08T06:03:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.908+0000 7ffa82e00640 1 -- start start 2024-03-08T06:03:27.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.910+0000 7ffa82e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffa7c0b4b30 0x7ffa7c15e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.911+0000 7ffa81a00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ffa7c071e70 0x7ffa7c0b4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.19:51278/0 (socket says 172.21.15.19:51278) 2024-03-08T06:03:27.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.911+0000 7ffa81a00640 1 -- 172.21.15.19:0/2776834273 learned_addr learned my addr 172.21.15.19:0/2776834273 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:27.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.911+0000 7ffa82e00640 1 -- 172.21.15.19:0/2776834273 --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7c06d590 con 0x7ffa7c15ea70 2024-03-08T06:03:27.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.912+0000 7ffa82e00640 1 -- 172.21.15.19:0/2776834273 --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7c06d870 con 0x7ffa7c071e70 2024-03-08T06:03:27.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.912+0000 7ffa81000640 1 --2- 172.21.15.19:0/2776834273 >> v2:172.21.15.19:3300/0 conn(0x7ffa7c0b4b30 0x7ffa7c15e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.912+0000 7ffa7be00640 1 -- 172.21.15.19:0/2776834273 <== mon.1 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538469667 0 0) 0x7ffa7c06d870 con 0x7ffa7c071e70 2024-03-08T06:03:27.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.913+0000 7ffa82e00640 1 -- 172.21.15.19:0/2776834273 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7c15f2a0 con 0x7ffa7c0b4b30 2024-03-08T06:03:27.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.915+0000 7ffa7be00640 1 -- 172.21.15.19:0/2776834273 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa64003520 con 0x7ffa7c071e70 2024-03-08T06:03:27.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.915+0000 7ffa7be00640 1 -- 172.21.15.19:0/2776834273 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998267728 0 0) 0x7ffa7c06d590 con 0x7ffa7c15ea70 2024-03-08T06:03:27.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.915+0000 7ffa7be00640 1 -- 172.21.15.19:0/2776834273 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa7c06d870 con 0x7ffa7c15ea70 2024-03-08T06:03:27.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.915+0000 7ffa81000640 1 -- 172.21.15.19:0/2776834273 >> v1:172.21.15.42:6789/0 conn(0x7ffa7c071e70 legacy=0x7ffa7c0b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.915+0000 7ffa81000640 1 -- 172.21.15.19:0/2776834273 >> v1:172.21.15.19:6789/0 conn(0x7ffa7c15ea70 legacy=0x7ffa7c0adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.915+0000 7ffa81000640 1 -- 172.21.15.19:0/2776834273 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c06db50 con 0x7ffa7c0b4b30 2024-03-08T06:03:27.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.918+0000 7ffa81000640 1 --2- 172.21.15.19:0/2776834273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa7c0b4b30 0x7ffa7c15e530 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffa700097a0 tx=0x7ffa7002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd89122fedf8d64 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:27.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.916+0000 7f7ca1800640 1 Processor -- start 2024-03-08T06:03:27.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.916+0000 7f7ca1800640 1 -- start start 2024-03-08T06:03:27.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.918+0000 7ffa7be00640 1 -- 172.21.15.19:0/2776834273 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa700315a0 con 0x7ffa7c0b4b30 2024-03-08T06:03:27.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.919+0000 7ffa7be00640 1 -- 172.21.15.19:0/2776834273 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa70037070 con 0x7ffa7c0b4b30 2024-03-08T06:03:27.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.919+0000 7ffa7be00640 1 -- 172.21.15.19:0/2776834273 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa700315a0 con 0x7ffa7c0b4b30 2024-03-08T06:03:27.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.919+0000 7f4d31000640 1 Processor -- start 2024-03-08T06:03:27.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.919+0000 7f7ca1800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7c940501a0 0x7f7c94038080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.919+0000 7f7ca1800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7c94053c70 0x7f7c94006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.919+0000 7f7ca1800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c940544c0 con 0x7f7c940df220 2024-03-08T06:03:27.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.919+0000 7f7ca1800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c940541e0 con 0x7f7c94053c70 2024-03-08T06:03:27.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.919+0000 7f7ca1800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c94005f80 con 0x7f7c940501a0 2024-03-08T06:03:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.919+0000 7ffa82e00640 1 -- 172.21.15.19:0/2776834273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa7c0b4b30 msgr2=0x7ffa7c15e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.919+0000 7ffa82e00640 1 --2- 172.21.15.19:0/2776834273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa7c0b4b30 0x7ffa7c15e530 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffa700097a0 tx=0x7ffa7002b840 comp rx=0 tx=0).stop 2024-03-08T06:03:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.920+0000 7f7c9be00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f7c940df220 0x7f7c9404fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.19:51286/0 (socket says 172.21.15.19:51286) 2024-03-08T06:03:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.920+0000 7f7c9be00640 1 -- 172.21.15.19:0/1367206533 learned_addr learned my addr 172.21.15.19:0/1367206533 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.920+0000 7f7c9b400640 1 --2- 172.21.15.19:0/1367206533 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7c940501a0 0x7f7c94038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.920+0000 7f7ca0e00640 1 --2- 172.21.15.19:0/1367206533 >> v2:172.21.15.42:3300/0 conn(0x7f7c94053c70 0x7f7c94006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.920+0000 7ffa82e00640 1 -- 172.21.15.19:0/2776834273 shutdown_connections 2024-03-08T06:03:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.920+0000 7ffa82e00640 1 --2- 172.21.15.19:0/2776834273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa7c0b4b30 0x7ffa7c15e530 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.920+0000 7ffa82e00640 1 -- 172.21.15.19:0/2776834273 >> 172.21.15.19:0/2776834273 conn(0x7ffa7c0b1590 msgr2=0x7ffa7c0b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:27.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.920+0000 7f6868a00640 1 Processor -- start 2024-03-08T06:03:27.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.920+0000 7f4d31000640 1 -- start start 2024-03-08T06:03:27.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.920+0000 7fdeea200640 1 Processor -- start 2024-03-08T06:03:27.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.921+0000 7fdeea200640 1 -- start start 2024-03-08T06:03:27.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.922+0000 7f7ca0e00640 1 -- 172.21.15.19:0/1367206533 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7c940501a0 msgr2=0x7f7c94038080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:27.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.922+0000 7f7ca0e00640 1 --2- 172.21.15.19:0/1367206533 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7c940501a0 0x7f7c94038080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.922+0000 7f7ca0e00640 1 -- 172.21.15.19:0/1367206533 >> v1:172.21.15.42:6789/0 conn(0x7f7c940df220 legacy=0x7f7c9404fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.922+0000 7f7ca0e00640 1 -- 172.21.15.19:0/1367206533 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c94006260 con 0x7f7c94053c70 2024-03-08T06:03:27.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.922+0000 7fdeea200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdedc050180 0x7fdedc0df070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.922+0000 7fdeea200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdedc0530a0 0x7fdedc0e0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.922+0000 7fdeea200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdedc0535f0 con 0x7fdedc00aad0 2024-03-08T06:03:27.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.923+0000 7fdeea200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdedc0538d0 con 0x7fdedc050180 2024-03-08T06:03:27.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.923+0000 7fdeea200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc053bb0 con 0x7fdedc0530a0 2024-03-08T06:03:27.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.921+0000 7f6868a00640 1 -- start start 2024-03-08T06:03:27.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.922+0000 7f6868a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f68641611f0 0x7f68640b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.923+0000 7f6868a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f68640d0ff0 0x7f68640b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.923+0000 7f6868a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68640d3410 con 0x7f68640b5a20 2024-03-08T06:03:27.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.923+0000 7f6868a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68640ceac0 con 0x7f68641611f0 2024-03-08T06:03:27.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.923+0000 7f6868a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68640cf080 con 0x7f68640d0ff0 2024-03-08T06:03:27.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.920+0000 7ffa82e00640 1 -- 172.21.15.19:0/2776834273 shutdown_connections 2024-03-08T06:03:27.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.920+0000 7ffa82e00640 1 -- 172.21.15.19:0/2776834273 wait complete. 2024-03-08T06:03:27.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.923+0000 7f6859e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f68640d0ff0 0x7f68640b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.922+0000 7f4d31000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4d2c14b560 0x7f4d2c165ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.923+0000 7f6863200640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f68640b5a20 0x7f68641619e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35442/0 (socket says 172.21.15.19:35442) 2024-03-08T06:03:27.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.924+0000 7f6859e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f68640d0ff0 0x7f68640b54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.19:49668/0 (socket says 172.21.15.19:49668) 2024-03-08T06:03:27.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.923+0000 7fdee8e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdedc00aad0 0x7fdedc04fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35434/0 (socket says 172.21.15.19:35434) 2024-03-08T06:03:27.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.923+0000 7fdee8e00640 1 -- 172.21.15.19:0/1703321048 learned_addr learned my addr 172.21.15.19:0/1703321048 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:27.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.924+0000 7ffa82e00640 1 Processor -- start 2024-03-08T06:03:27.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.924+0000 7f6859e00640 1 -- 172.21.15.19:0/402213041 learned_addr learned my addr 172.21.15.19:0/402213041 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:27.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.924+0000 7f6862800640 1 --2- 172.21.15.19:0/402213041 >> v2:172.21.15.19:3300/0 conn(0x7f68641611f0 0x7f68640b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.924+0000 7f4d31000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4d2c14bbe0 0x7f4d2c0cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.924+0000 7f4d31000640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2c166530 con 0x7f4d2c0ce150 2024-03-08T06:03:27.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.924+0000 7f4d31000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2c0b2dc0 con 0x7f4d2c14bbe0 2024-03-08T06:03:27.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.924+0000 7f4d31000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c166810 con 0x7f4d2c14b560 2024-03-08T06:03:27.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.924+0000 7fdee3400640 1 -- 172.21.15.19:0/1703321048 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550197169 0 0) 0x7fdedc0535f0 con 0x7fdedc00aad0 2024-03-08T06:03:27.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.924+0000 7fdee3400640 1 -- 172.21.15.19:0/1703321048 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdecc003520 con 0x7fdedc00aad0 2024-03-08T06:03:27.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.924+0000 7fdee3e00640 1 --2- 172.21.15.19:0/1703321048 >> v2:172.21.15.19:3300/0 conn(0x7fdedc050180 0x7fdedc0df070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.924+0000 7fdee9800640 1 --2- 172.21.15.19:0/1703321048 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdedc0530a0 0x7fdedc0e0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.924+0000 7f4d29e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4d2c14b560 0x7f4d2c165ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.925+0000 7f4d29400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4d2c14bbe0 0x7f4d2c0cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.925+0000 7f4d29400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4d2c14bbe0 0x7f4d2c0cdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.19:39958/0 (socket says 172.21.15.19:39958) 2024-03-08T06:03:27.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.925+0000 7f4d29400640 1 -- 172.21.15.19:0/950502458 learned_addr learned my addr 172.21.15.19:0/950502458 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:27.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.925+0000 7fd471e00640 1 Processor -- start 2024-03-08T06:03:27.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.925+0000 7f6859e00640 1 -- 172.21.15.19:0/402213041 >> v2:172.21.15.19:3300/0 conn(0x7f68641611f0 msgr2=0x7f68640b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:27.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.925+0000 7fdee9800640 1 -- 172.21.15.19:0/1703321048 >> v2:172.21.15.19:3300/0 conn(0x7fdedc050180 msgr2=0x7fdedc0df070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:27.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.925+0000 7fdee9800640 1 --2- 172.21.15.19:0/1703321048 >> v2:172.21.15.19:3300/0 conn(0x7fdedc050180 0x7fdedc0df070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.925+0000 7fdee9800640 1 -- 172.21.15.19:0/1703321048 >> v1:172.21.15.19:6789/0 conn(0x7fdedc00aad0 legacy=0x7fdedc04fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.925+0000 7fdee9800640 1 -- 172.21.15.19:0/1703321048 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc053e90 con 0x7fdedc0530a0 2024-03-08T06:03:27.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.925+0000 7f6861e00640 1 -- 172.21.15.19:0/402213041 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693409555 0 0) 0x7f68640d3410 con 0x7f68640b5a20 2024-03-08T06:03:27.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.925+0000 7f6859e00640 1 --2- 172.21.15.19:0/402213041 >> v2:172.21.15.19:3300/0 conn(0x7f68641611f0 0x7f68640b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.925+0000 7f6859e00640 1 -- 172.21.15.19:0/402213041 >> v1:172.21.15.19:6789/0 conn(0x7f68640b5a20 legacy=0x7f68641619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.925+0000 7fdee3e00640 1 --2- 172.21.15.19:0/1703321048 >> v2:172.21.15.19:3300/0 conn(0x7fdedc050180 0x7fdedc0df070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T06:03:27.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.925+0000 7fd471e00640 1 -- start start 2024-03-08T06:03:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.925+0000 7f6859e00640 1 -- 172.21.15.19:0/402213041 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68640d36f0 con 0x7f68640d0ff0 2024-03-08T06:03:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.926+0000 7f6862800640 1 --2- 172.21.15.19:0/402213041 >> v2:172.21.15.19:3300/0 conn(0x7f68641611f0 0x7f68640b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:03:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.926+0000 7f4d28a00640 1 -- 172.21.15.19:0/950502458 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220642001 0 0) 0x7f4d2c166530 con 0x7f4d2c0ce150 2024-03-08T06:03:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.924+0000 7ffa82e00640 1 -- start start 2024-03-08T06:03:27.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.926+0000 7ffa82e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ffa7c071e70 0x7ffa7c0af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.926+0000 7ffa82e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa7c0b4b30 0x7ffa7c0adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.926+0000 7f4d28a00640 1 -- 172.21.15.19:0/950502458 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d10003520 con 0x7f4d2c0ce150 2024-03-08T06:03:27.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.926+0000 7ffa82e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa7c15ea70 0x7ffa7c14fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.926+0000 7ffa82e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c06e350 con 0x7ffa7c0b4b30 2024-03-08T06:03:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.926+0000 7ffa82e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c072250 con 0x7ffa7c15ea70 2024-03-08T06:03:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.926+0000 7ffa82e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c15ee80 con 0x7ffa7c071e70 2024-03-08T06:03:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.926+0000 7f7ca0e00640 1 --2- 172.21.15.19:0/1367206533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c94053c70 0x7f7c94006a60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c880097a0 tx=0x7f7c8802b660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d07eef2939168334 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.926+0000 7f4d29400640 1 -- 172.21.15.19:0/950502458 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4d2c14b560 msgr2=0x7f4d2c165ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.926+0000 7f4d29400640 1 --2- 172.21.15.19:0/950502458 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4d2c14b560 0x7f4d2c165ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.926+0000 7f4d29400640 1 -- 172.21.15.19:0/950502458 >> v1:172.21.15.19:6789/0 conn(0x7f4d2c0ce150 legacy=0x7f4d2c0717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.926+0000 7f4d29400640 1 -- 172.21.15.19:0/950502458 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c166af0 con 0x7f4d2c14bbe0 2024-03-08T06:03:27.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.927+0000 7ffa81000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa7c0b4b30 0x7ffa7c0adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.927+0000 7ffa81000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa7c0b4b30 0x7ffa7c0adf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33508/0 (socket says 172.21.15.19:33508) 2024-03-08T06:03:27.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.927+0000 7ffa81000640 1 -- 172.21.15.19:0/2621470478 learned_addr learned my addr 172.21.15.19:0/2621470478 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:27.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.927+0000 7ffa82400640 1 --2- 172.21.15.19:0/2621470478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa7c15ea70 0x7ffa7c14fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.927+0000 7ffa81a00640 1 --2- 172.21.15.19:0/2621470478 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ffa7c071e70 0x7ffa7c0af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.927+0000 7ffa81000640 1 -- 172.21.15.19:0/2621470478 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ffa7c071e70 msgr2=0x7ffa7c0af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.927+0000 7f7c9aa00640 1 -- 172.21.15.19:0/1367206533 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88037070 con 0x7f7c94053c70 2024-03-08T06:03:27.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.927+0000 7f7c9aa00640 1 -- 172.21.15.19:0/1367206533 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c88030710 con 0x7f7c94053c70 2024-03-08T06:03:27.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.927+0000 7f7c9aa00640 1 -- 172.21.15.19:0/1367206533 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8802be60 con 0x7f7c94053c70 2024-03-08T06:03:27.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.927+0000 7ffa81000640 1 --2- 172.21.15.19:0/2621470478 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ffa7c071e70 0x7ffa7c0af360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.927+0000 7ffa81000640 1 -- 172.21.15.19:0/2621470478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa7c15ea70 msgr2=0x7ffa7c14fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.927+0000 7ffa81000640 1 --2- 172.21.15.19:0/2621470478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa7c15ea70 0x7ffa7c14fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.927+0000 7ffa81000640 1 -- 172.21.15.19:0/2621470478 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c150380 con 0x7ffa7c0b4b30 2024-03-08T06:03:27.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.927+0000 7ffa82400640 1 --2- 172.21.15.19:0/2621470478 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa7c15ea70 0x7ffa7c14fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:27.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.927+0000 7ffa81a00640 1 --2- 172.21.15.19:0/2621470478 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ffa7c071e70 0x7ffa7c0af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:27.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.928+0000 7f60cde00640 1 Processor -- start 2024-03-08T06:03:27.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.928+0000 7fd471e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd46403afd0 0x7fd464007c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.928+0000 7fd471e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46400cb30 con 0x7fd4640e0020 2024-03-08T06:03:27.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.928+0000 7fd471e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4640565d0 con 0x7fd46400b1d0 2024-03-08T06:03:27.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.928+0000 7fd471e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4640568b0 con 0x7fd46403afd0 2024-03-08T06:03:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.928+0000 7f6859e00640 1 --2- 172.21.15.19:0/402213041 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f68640d0ff0 0x7f68640b54e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f684c009870 tx=0x7f684c02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef77685d52efcb4c server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.928+0000 7ffa81000640 1 --2- 172.21.15.19:0/2621470478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa7c0b4b30 0x7ffa7c0adf60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffa7002b880 tx=0x7ffa700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.928+0000 7f60cde00640 1 -- start start 2024-03-08T06:03:27.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.928+0000 7fdee9800640 1 --2- 172.21.15.19:0/1703321048 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdedc0530a0 0x7fdedc0e0100 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdee4000b60 tx=0x7fdee40a6ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5fc2a6c049d4543 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:27.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.928+0000 7fd470a00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd4640e0020 0x7fd464008f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35456/0 (socket says 172.21.15.19:35456) 2024-03-08T06:03:27.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.928+0000 7fd470a00640 1 -- 172.21.15.19:0/1615707757 learned_addr learned my addr 172.21.15.19:0/1615707757 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.928+0000 7f6861e00640 1 -- 172.21.15.19:0/402213041 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c0317c0 con 0x7f68640d0ff0 2024-03-08T06:03:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.929+0000 7f4d29400640 1 --2- 172.21.15.19:0/950502458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d2c14bbe0 0x7f4d2c0cdc10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009870 tx=0x7f4d1802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91ce3f96302a8476 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:27.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.929+0000 7ffa79600640 1 -- 172.21.15.19:0/2621470478 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa700315a0 con 0x7ffa7c0b4b30 2024-03-08T06:03:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.929+0000 7f7ca1800640 1 -- 172.21.15.19:0/1367206533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c94053c70 msgr2=0x7f7c94006a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.929+0000 7f7ca1800640 1 --2- 172.21.15.19:0/1367206533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c94053c70 0x7f7c94006a60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c880097a0 tx=0x7f7c8802b660 comp rx=0 tx=0).stop 2024-03-08T06:03:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.929+0000 7f6861e00640 1 -- 172.21.15.19:0/402213041 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c037070 con 0x7f68640d0ff0 2024-03-08T06:03:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.929+0000 7f6861e00640 1 -- 172.21.15.19:0/402213041 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684c031b80 con 0x7f68640d0ff0 2024-03-08T06:03:27.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.929+0000 7fdee3400640 1 -- 172.21.15.19:0/1703321048 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee40a88e0 con 0x7fdedc0530a0 2024-03-08T06:03:27.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.929+0000 7fdee3400640 1 -- 172.21.15.19:0/1703321048 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee40a8a80 con 0x7fdedc0530a0 2024-03-08T06:03:27.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.929+0000 7fdee3400640 1 -- 172.21.15.19:0/1703321048 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee40b2400 con 0x7fdedc0530a0 2024-03-08T06:03:27.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.929+0000 7fd471400640 1 --2- 172.21.15.19:0/1615707757 >> v2:172.21.15.19:3300/0 conn(0x7fd46403afd0 0x7fd464007c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.929+0000 7fd46b400640 1 -- 172.21.15.19:0/1615707757 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4004101617 0 0) 0x7fd460001110 con 0x7fd4640e0020 2024-03-08T06:03:27.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.929+0000 7fd46b400640 1 -- 172.21.15.19:0/1615707757 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd454003520 con 0x7fd4640e0020 2024-03-08T06:03:27.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.929+0000 7fd46b400640 1 -- 172.21.15.19:0/1615707757 <== mon.1 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3030407791 0 0) 0x7fd4640565d0 con 0x7fd46400b1d0 2024-03-08T06:03:27.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.929+0000 7fd46b400640 1 -- 172.21.15.19:0/1615707757 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd460001110 con 0x7fd46400b1d0 2024-03-08T06:03:27.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.929+0000 7f7ca1800640 1 -- 172.21.15.19:0/1367206533 shutdown_connections 2024-03-08T06:03:27.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7f7ca1800640 1 --2- 172.21.15.19:0/1367206533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c94053c70 0x7f7c94006a60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7f7ca1800640 1 --2- 172.21.15.19:0/1367206533 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7c940501a0 0x7f7c94038080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7f7ca1800640 1 -- 172.21.15.19:0/1367206533 >> 172.21.15.19:0/1367206533 conn(0x7f7c94009fb0 msgr2=0x7f7c9400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:27.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7f6868a00640 1 -- 172.21.15.19:0/402213041 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f68640d0ff0 msgr2=0x7f68640b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7f6868a00640 1 --2- 172.21.15.19:0/402213041 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f68640d0ff0 0x7f68640b54e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f684c009870 tx=0x7f684c02b860 comp rx=0 tx=0).stop 2024-03-08T06:03:27.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7f7ca1800640 1 -- 172.21.15.19:0/1367206533 shutdown_connections 2024-03-08T06:03:27.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7f7ca1800640 1 -- 172.21.15.19:0/1367206533 wait complete. 2024-03-08T06:03:27.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7ffa82e00640 1 -- 172.21.15.19:0/2621470478 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7c0ae660 con 0x7ffa7c0b4b30 2024-03-08T06:03:27.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7ffa82e00640 1 -- 172.21.15.19:0/2621470478 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7c0aec20 con 0x7ffa7c0b4b30 2024-03-08T06:03:27.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7f6868a00640 1 -- 172.21.15.19:0/402213041 shutdown_connections 2024-03-08T06:03:27.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7f6868a00640 1 --2- 172.21.15.19:0/402213041 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f68640d0ff0 0x7f68640b54e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7f6868a00640 1 --2- 172.21.15.19:0/402213041 >> v2:172.21.15.19:3300/0 conn(0x7f68641611f0 0x7f68640b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7f6868a00640 1 -- 172.21.15.19:0/402213041 >> 172.21.15.19:0/402213041 conn(0x7f686406c700 msgr2=0x7f686406cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:27.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7ffa79600640 1 -- 172.21.15.19:0/2621470478 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa70031e90 con 0x7ffa7c0b4b30 2024-03-08T06:03:27.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7ffa79600640 1 -- 172.21.15.19:0/2621470478 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70032880 con 0x7ffa7c0b4b30 2024-03-08T06:03:27.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7f6868a00640 1 -- 172.21.15.19:0/402213041 shutdown_connections 2024-03-08T06:03:27.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7f6868a00640 1 -- 172.21.15.19:0/402213041 wait complete. 2024-03-08T06:03:27.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7f4d28a00640 1 -- 172.21.15.19:0/950502458 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18034070 con 0x7f4d2c14bbe0 2024-03-08T06:03:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7fd471400640 1 -- 172.21.15.19:0/1615707757 >> v1:172.21.15.42:6789/0 conn(0x7fd46400b1d0 legacy=0x7fd46403a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.931+0000 7f60cde00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f60c00ead00 0x7f60c004fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.931+0000 7f60cde00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f60c004ffd0 0x7f60c0037bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.931+0000 7f60cde00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f60c0038110 0x7f60c00385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.931+0000 7f60cde00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c0054330 con 0x7f60c004ffd0 2024-03-08T06:03:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.931+0000 7f60cde00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c0053720 con 0x7f60c0038110 2024-03-08T06:03:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.931+0000 7f60cde00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c0053a00 con 0x7f60c00ead00 2024-03-08T06:03:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.932+0000 7f6868a00640 1 Processor -- start 2024-03-08T06:03:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7fd471400640 1 -- 172.21.15.19:0/1615707757 >> v1:172.21.15.19:6789/0 conn(0x7fd4640e0020 legacy=0x7fd464008f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.930+0000 7fd471400640 1 -- 172.21.15.19:0/1615707757 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46400cdb0 con 0x7fd46403afd0 2024-03-08T06:03:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.931+0000 7f60cd400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f60c0038110 0x7f60c00385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.932+0000 7f60cd400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f60c0038110 0x7f60c00385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.19:39976/0 (socket says 172.21.15.19:39976) 2024-03-08T06:03:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.932+0000 7f60cd400640 1 -- 172.21.15.19:0/1775851937 learned_addr learned my addr 172.21.15.19:0/1775851937 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.932+0000 7f60c7e00640 1 --2- 172.21.15.19:0/1775851937 >> v2:172.21.15.19:3300/0 conn(0x7f60c004ffd0 0x7f60c0037bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.932+0000 7f6868a00640 1 -- start start 2024-03-08T06:03:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.932+0000 7f7ca1800640 1 Processor -- start 2024-03-08T06:03:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.932+0000 7f4d28a00640 1 -- 172.21.15.19:0/950502458 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d18030840 con 0x7f4d2c14bbe0 2024-03-08T06:03:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.933+0000 7f60cca00640 1 --2- 172.21.15.19:0/1775851937 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f60c00ead00 0x7f60c004fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.933+0000 7f7ca1800640 1 -- start start 2024-03-08T06:03:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.932+0000 7f4d28a00640 1 -- 172.21.15.19:0/950502458 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18030bf0 con 0x7f4d2c14bbe0 2024-03-08T06:03:27.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.933+0000 7ffa82e00640 1 -- 172.21.15.19:0/2621470478 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffa58001030 con 0x7ffa7c0b4b30 2024-03-08T06:03:27.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.933+0000 7f60cd400640 1 -- 172.21.15.19:0/1775851937 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f60c00ead00 msgr2=0x7f60c004fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:27.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.933+0000 7f60cd400640 1 --2- 172.21.15.19:0/1775851937 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f60c00ead00 0x7f60c004fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.933+0000 7f60cd400640 1 -- 172.21.15.19:0/1775851937 >> v2:172.21.15.19:3300/0 conn(0x7f60c004ffd0 msgr2=0x7f60c0037bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:27.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.932+0000 7fdeea200640 1 -- 172.21.15.19:0/1703321048 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdedc0530a0 msgr2=0x7fdedc0e0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.932+0000 7fdeea200640 1 --2- 172.21.15.19:0/1703321048 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdedc0530a0 0x7fdedc0e0100 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdee4000b60 tx=0x7fdee40a6ac0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.933+0000 7f4d31000640 1 -- 172.21.15.19:0/950502458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d2c14bbe0 msgr2=0x7f4d2c0cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.933+0000 7f4d31000640 1 --2- 172.21.15.19:0/950502458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d2c14bbe0 0x7f4d2c0cdc10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009870 tx=0x7f4d1802b980 comp rx=0 tx=0).stop 2024-03-08T06:03:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.934+0000 7f6868a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68640b5a20 0x7f6864154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.933+0000 7f4d31000640 1 -- 172.21.15.19:0/950502458 shutdown_connections 2024-03-08T06:03:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.933+0000 7f4d31000640 1 --2- 172.21.15.19:0/950502458 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d2c14bbe0 0x7f4d2c0cdc10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.933+0000 7f4d31000640 1 --2- 172.21.15.19:0/950502458 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4d2c14b560 0x7f4d2c165ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.933+0000 7f4d31000640 1 -- 172.21.15.19:0/950502458 >> 172.21.15.19:0/950502458 conn(0x7f4d2c06ae30 msgr2=0x7f4d2c06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.933+0000 7f60cd400640 1 --2- 172.21.15.19:0/1775851937 >> v2:172.21.15.19:3300/0 conn(0x7f60c004ffd0 0x7f60c0037bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.933+0000 7f60cd400640 1 -- 172.21.15.19:0/1775851937 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c0053ce0 con 0x7f60c0038110 2024-03-08T06:03:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.933+0000 7f60c7e00640 1 --2- 172.21.15.19:0/1775851937 >> v2:172.21.15.19:3300/0 conn(0x7f60c004ffd0 0x7f60c0037bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T06:03:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.934+0000 7f4d31000640 1 -- 172.21.15.19:0/950502458 shutdown_connections 2024-03-08T06:03:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.934+0000 7fdeea200640 1 -- 172.21.15.19:0/1703321048 shutdown_connections 2024-03-08T06:03:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.934+0000 7fdeea200640 1 --2- 172.21.15.19:0/1703321048 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdedc0530a0 0x7fdedc0e0100 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.934+0000 7fdeea200640 1 --2- 172.21.15.19:0/1703321048 >> v2:172.21.15.19:3300/0 conn(0x7fdedc050180 0x7fdedc0df070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.934+0000 7fdeea200640 1 -- 172.21.15.19:0/1703321048 >> 172.21.15.19:0/1703321048 conn(0x7fdedc009fb0 msgr2=0x7fdedc00a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.934+0000 7fd471400640 1 --2- 172.21.15.19:0/1615707757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd46403afd0 0x7fd464007c10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd46c000b60 tx=0x7fd46c0a8cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834b3e0ff48472d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.934+0000 7f6868a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68640d0ff0 0x7f686406edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.934+0000 7f6868a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f68641611f0 0x7f68641fb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.934+0000 7f6868a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68641615d0 con 0x7f68640b5a20 2024-03-08T06:03:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.934+0000 7f6868a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68640d1450 con 0x7f68640d0ff0 2024-03-08T06:03:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.934+0000 7f6868a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6864161750 con 0x7f68641611f0 2024-03-08T06:03:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.934+0000 7fdeea200640 1 -- 172.21.15.19:0/1703321048 shutdown_connections 2024-03-08T06:03:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.934+0000 7fd46b400640 1 -- 172.21.15.19:0/1615707757 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0b6070 con 0x7fd46403afd0 2024-03-08T06:03:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.934+0000 7fd46b400640 1 -- 172.21.15.19:0/1615707757 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46c0a9ac0 con 0x7fd46403afd0 2024-03-08T06:03:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.934+0000 7fd46b400640 1 -- 172.21.15.19:0/1615707757 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c0b1440 con 0x7fd46403afd0 2024-03-08T06:03:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.934+0000 7f6863200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f68641611f0 0x7f68641fb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.934+0000 7f6863200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f68641611f0 0x7f68641fb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.19:49718/0 (socket says 172.21.15.19:49718) 2024-03-08T06:03:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.934+0000 7f6863200640 1 -- 172.21.15.19:0/1412663069 learned_addr learned my addr 172.21.15.19:0/1412663069 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.935+0000 7f6859e00640 1 --2- 172.21.15.19:0/1412663069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68640d0ff0 0x7f686406edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.935+0000 7f7ca1800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c940501a0 0x7f7c940e11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.935+0000 7f7ca1800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7c94053c70 0x7f7c940355c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.935+0000 7f7ca1800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c940df220 0x7f7c94035b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.935+0000 7f7ca1800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c94037a90 con 0x7f7c940df220 2024-03-08T06:03:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.935+0000 7f7ca1800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c94037910 con 0x7f7c940501a0 2024-03-08T06:03:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.935+0000 7f7ca1800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c940df600 con 0x7f7c94053c70 2024-03-08T06:03:27.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.935+0000 7f6862800640 1 --2- 172.21.15.19:0/1412663069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68640b5a20 0x7f6864154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.935+0000 7fd471e00640 1 -- 172.21.15.19:0/1615707757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd46403afd0 msgr2=0x7fd464007c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.935+0000 7fd471e00640 1 --2- 172.21.15.19:0/1615707757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd46403afd0 0x7fd464007c10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd46c000b60 tx=0x7fd46c0a8cb0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.935+0000 7f6863200640 1 -- 172.21.15.19:0/1412663069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68640d0ff0 msgr2=0x7f686406edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.935+0000 7f6863200640 1 --2- 172.21.15.19:0/1412663069 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68640d0ff0 0x7f686406edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.935+0000 7f6863200640 1 -- 172.21.15.19:0/1412663069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68640b5a20 msgr2=0x7f6864154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.935+0000 7f60cd400640 1 --2- 172.21.15.19:0/1775851937 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60c0038110 0x7f60c00385a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f60c8075d80 tx=0x7f60c80a6a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4bf24a52f0460ff server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.935+0000 7f7ca0e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c940df220 0x7f7c94035b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.936+0000 7fd471e00640 1 -- 172.21.15.19:0/1615707757 shutdown_connections 2024-03-08T06:03:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.936+0000 7fd471e00640 1 --2- 172.21.15.19:0/1615707757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd46403afd0 0x7fd464007c10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.936+0000 7fd471e00640 1 -- 172.21.15.19:0/1615707757 >> 172.21.15.19:0/1615707757 conn(0x7fd46401ef70 msgr2=0x7fd464055c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.935+0000 7f7c9be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c940501a0 0x7f7c940e11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.936+0000 7f7c9be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c940501a0 0x7f7c940e11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.19:39988/0 (socket says 172.21.15.19:39988) 2024-03-08T06:03:27.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.936+0000 7f7c9be00640 1 -- 172.21.15.19:0/2384289771 learned_addr learned my addr 172.21.15.19:0/2384289771 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.936+0000 7f60c7400640 1 -- 172.21.15.19:0/1775851937 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c80aa8e0 con 0x7f60c0038110 2024-03-08T06:03:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.936+0000 7f60c7400640 1 -- 172.21.15.19:0/1775851937 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c80aaa80 con 0x7f60c0038110 2024-03-08T06:03:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.936+0000 7f60c7400640 1 -- 172.21.15.19:0/1775851937 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c80b2400 con 0x7f60c0038110 2024-03-08T06:03:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.936+0000 7f6863200640 1 --2- 172.21.15.19:0/1412663069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68640b5a20 0x7f6864154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.936+0000 7f6863200640 1 -- 172.21.15.19:0/1412663069 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68641e7830 con 0x7f68641611f0 2024-03-08T06:03:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.935+0000 7ffa79600640 1 -- 172.21.15.19:0/2621470478 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ffa70032a20 con 0x7ffa7c0b4b30 2024-03-08T06:03:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.936+0000 7ffa79600640 1 --2- 172.21.15.19:0/2621470478 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ffa5c06b4d0 0x7ffa5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7ffa79600640 1 -- 172.21.15.19:0/2621470478 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa700ac000 con 0x7ffa7c0b4b30 2024-03-08T06:03:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7f6862800640 1 --2- 172.21.15.19:0/1412663069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68640b5a20 0x7f6864154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.934+0000 7fdeea200640 1 -- 172.21.15.19:0/1703321048 wait complete. 2024-03-08T06:03:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7f60cde00640 1 -- 172.21.15.19:0/1775851937 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60c0038110 msgr2=0x7f60c00385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7f60cde00640 1 --2- 172.21.15.19:0/1775851937 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60c0038110 0x7f60c00385a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f60c8075d80 tx=0x7f60c80a6a60 comp rx=0 tx=0).stop 2024-03-08T06:03:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7fdeea200640 1 Processor -- start 2024-03-08T06:03:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7ffa79600640 1 --2- 172.21.15.19:0/2621470478 >> [v2:172.21.15.19:6808/3105613222,v1:172.21.15.19:6809/3105613222] conn(0x7ffa5c0736d0 0x7ffa5c075af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7ffa79600640 1 -- 172.21.15.19:0/2621470478 --> [v2:172.21.15.19:6808/3105613222,v1:172.21.15.19:6809/3105613222] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa7004fec0 con 0x7ffa5c0736d0 2024-03-08T06:03:27.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7ffa79600640 1 -- 172.21.15.19:0/2621470478 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa700ac3f0 con 0x7ffa7c0b4b30 2024-03-08T06:03:27.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7f60cde00640 1 -- 172.21.15.19:0/1775851937 shutdown_connections 2024-03-08T06:03:27.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7f60cde00640 1 --2- 172.21.15.19:0/1775851937 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60c0038110 0x7f60c00385a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7f60cde00640 1 --2- 172.21.15.19:0/1775851937 >> v2:172.21.15.19:3300/0 conn(0x7f60c004ffd0 0x7f60c0037bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7f60cde00640 1 --2- 172.21.15.19:0/1775851937 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f60c00ead00 0x7f60c004fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7f60cde00640 1 -- 172.21.15.19:0/1775851937 >> 172.21.15.19:0/1775851937 conn(0x7f60c0009fb0 msgr2=0x7f60c000a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:27.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7fdeea200640 1 -- start start 2024-03-08T06:03:27.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7ffa81a00640 1 --2- 172.21.15.19:0/2621470478 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ffa5c06b4d0 0x7ffa5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7f7c9be00640 1 -- 172.21.15.19:0/2384289771 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7c94053c70 msgr2=0x7f7c940355c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7f7c9b400640 1 --2- 172.21.15.19:0/2384289771 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7c94053c70 0x7f7c940355c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.935+0000 7f4d31000640 1 -- 172.21.15.19:0/950502458 wait complete. 2024-03-08T06:03:27.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7f15a5e00640 1 Processor -- start 2024-03-08T06:03:27.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7f60cde00640 1 -- 172.21.15.19:0/1775851937 shutdown_connections 2024-03-08T06:03:27.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7f4d31000640 1 Processor -- start 2024-03-08T06:03:27.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.938+0000 7fd471e00640 1 -- 172.21.15.19:0/1615707757 shutdown_connections 2024-03-08T06:03:27.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7f15a5e00640 1 -- start start 2024-03-08T06:03:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.938+0000 7f4d31000640 1 -- start start 2024-03-08T06:03:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7f7c9be00640 1 --2- 172.21.15.19:0/2384289771 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7c94053c70 0x7f7c940355c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7f7c9be00640 1 -- 172.21.15.19:0/2384289771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c940df220 msgr2=0x7f7c94035b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7f7c9be00640 1 --2- 172.21.15.19:0/2384289771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c940df220 0x7f7c94035b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7f7c9be00640 1 -- 172.21.15.19:0/2384289771 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c940e1870 con 0x7f7c940501a0 2024-03-08T06:03:27.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.938+0000 7fd471e00640 1 -- 172.21.15.19:0/1615707757 wait complete. 2024-03-08T06:03:27.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.938+0000 7f6863200640 1 --2- 172.21.15.19:0/1412663069 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f68641611f0 0x7f68641fb7b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f685c00c780 tx=0x7f685c00cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:27.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.938+0000 7f7ca0e00640 1 --2- 172.21.15.19:0/2384289771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c940df220 0x7f7c94035b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T06:03:27.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.938+0000 7ffa82400640 1 --2- 172.21.15.19:0/2621470478 >> [v2:172.21.15.19:6808/3105613222,v1:172.21.15.19:6809/3105613222] conn(0x7ffa5c0736d0 0x7ffa5c075af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.939+0000 7f7c9b400640 1 --2- 172.21.15.19:0/2384289771 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7c94053c70 0x7f7c940355c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:27.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.939+0000 7fdeea200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdedc00aad0 0x7fdedc0c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.939+0000 7fdeea200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdedc050180 0x7fdedc04bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.939+0000 7f7c9be00640 1 --2- 172.21.15.19:0/2384289771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c940501a0 0x7f7c940e11e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0507a0 tx=0x7f7c9c0747e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:27.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.939+0000 7f685b400640 1 -- 172.21.15.19:0/1412663069 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c018070 con 0x7f68641611f0 2024-03-08T06:03:27.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.937+0000 7f60cde00640 1 -- 172.21.15.19:0/1775851937 wait complete. 2024-03-08T06:03:27.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.939+0000 7f60cde00640 1 Processor -- start 2024-03-08T06:03:27.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.940+0000 7f685b400640 1 -- 172.21.15.19:0/1412663069 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c00a640 con 0x7f68641611f0 2024-03-08T06:03:27.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.940+0000 7f685b400640 1 -- 172.21.15.19:0/1412663069 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c00aa30 con 0x7f68641611f0 2024-03-08T06:03:27.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.940+0000 7f6868a00640 1 -- 172.21.15.19:0/1412663069 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686406f7a0 con 0x7f68641611f0 2024-03-08T06:03:27.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.940+0000 7ffa82400640 1 --2- 172.21.15.19:0/2621470478 >> [v2:172.21.15.19:6808/3105613222,v1:172.21.15.19:6809/3105613222] conn(0x7ffa5c0736d0 0x7ffa5c075af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:27.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.940+0000 7ffa81a00640 1 --2- 172.21.15.19:0/2621470478 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ffa5c06b4d0 0x7ffa5c06d990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffa680011e0 tx=0x7ffa68009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:27.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.940+0000 7f7c8fe00640 1 -- 172.21.15.19:0/2384289771 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c06c110 con 0x7f7c940501a0 2024-03-08T06:03:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7f6868a00640 1 -- 172.21.15.19:0/1412663069 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6864154db0 con 0x7f68641611f0 2024-03-08T06:03:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.940+0000 7f4d31000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d2c0ce150 0x7f4d2c1438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.940+0000 7f4d31000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d2c14b560 0x7f4d2c200120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.940+0000 7f4d31000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4d2c14bbe0 0x7f4d2c140350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.940+0000 7f4d29e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d2c0ce150 0x7f4d2c1438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7f4d29e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d2c0ce150 0x7f4d2c1438d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.19:39998/0 (socket says 172.21.15.19:39998) 2024-03-08T06:03:27.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7f4d31000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c14b940 con 0x7f4d2c14b560 2024-03-08T06:03:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7f4d31000640 1 -- 172.21.15.19:0/1053617985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c166220 con 0x7f4d2c0ce150 2024-03-08T06:03:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7f4d29e00640 1 -- 172.21.15.19:0/1053617985 learned_addr learned my addr 172.21.15.19:0/1053617985 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7f4d31000640 1 -- 172.21.15.19:0/1053617985 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c071ee0 con 0x7f4d2c14bbe0 2024-03-08T06:03:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.940+0000 7f60cde00640 1 -- start start 2024-03-08T06:03:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7f60cde00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f60c0038110 0x7f60c002dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7fd471e00640 1 Processor -- start 2024-03-08T06:03:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7fd471e00640 1 -- start start 2024-03-08T06:03:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.940+0000 7f15a5e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f15a00717d0 0x7f15a0071c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7f159e000640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f15a014bbe0 0x7f15a00cdc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.19:51298/0 (socket says 172.21.15.19:51298) 2024-03-08T06:03:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7f159e000640 1 -- 172.21.15.19:0/2209166517 learned_addr learned my addr 172.21.15.19:0/2209166517 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7f15a5e00640 1 -- 172.21.15.19:0/2209166517 --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a0166530 con 0x7f15a014b560 2024-03-08T06:03:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7f15a5e00640 1 -- 172.21.15.19:0/2209166517 --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a0166810 con 0x7f15a014bbe0 2024-03-08T06:03:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7f15a5e00640 1 -- 172.21.15.19:0/2209166517 --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a0072180 con 0x7f15a00717d0 2024-03-08T06:03:27.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7f7c8fe00640 1 -- 172.21.15.19:0/2384289771 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c08f020 con 0x7f7c940501a0 2024-03-08T06:03:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7f4d2a800640 1 --2- 172.21.15.19:0/1053617985 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4d2c14bbe0 0x7f4d2c140350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.942+0000 7ffa79600640 1 -- 172.21.15.19:0/2621470478 <== osd.0 v2:172.21.15.19:6808/3105613222 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ffa7004fec0 con 0x7ffa5c0736d0 2024-03-08T06:03:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7f7ca1800640 1 -- 172.21.15.19:0/2384289771 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c940e1b50 con 0x7f7c940501a0 2024-03-08T06:03:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7f7ca1800640 1 -- 172.21.15.19:0/2384289771 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c940e2110 con 0x7f7c940501a0 2024-03-08T06:03:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7f7c8fe00640 1 -- 172.21.15.19:0/2384289771 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c06c4f0 con 0x7f7c940501a0 2024-03-08T06:03:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.940+0000 7fdee8e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdedc00aad0 0x7fdedc0c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7fdee8e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdedc00aad0 0x7fdedc0c92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.19:39994/0 (socket says 172.21.15.19:39994) 2024-03-08T06:03:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.941+0000 7fdee8e00640 1 -- 172.21.15.19:0/3644595749 learned_addr learned my addr 172.21.15.19:0/3644595749 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.942+0000 7f4d29e00640 1 -- 172.21.15.19:0/1053617985 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4d2c14bbe0 msgr2=0x7f4d2c140350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.942+0000 7f60cde00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60c004ffd0 0x7f60c002e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.942+0000 7f60cde00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60c00ead00 0x7f60c00d6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.942+0000 7f60cde00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c0054940 con 0x7f60c004ffd0 2024-03-08T06:03:27.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.942+0000 7f60cde00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c00547c0 con 0x7f60c00ead00 2024-03-08T06:03:27.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.942+0000 7f60cde00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c004f550 con 0x7f60c0038110 2024-03-08T06:03:27.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.942+0000 7fdeea200640 1 --2- 172.21.15.19:0/3644595749 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdedc0530a0 0x7fdedc0e1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.942+0000 7f159f400640 1 --2- 172.21.15.19:0/2209166517 >> v2:172.21.15.19:3300/0 conn(0x7f15a00717d0 0x7f15a0071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.942+0000 7fdee3e00640 1 --2- 172.21.15.19:0/3644595749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdedc050180 0x7fdedc04bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.942+0000 7f4d29e00640 1 --2- 172.21.15.19:0/1053617985 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4d2c14bbe0 0x7f4d2c140350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.942+0000 7f4d29e00640 1 -- 172.21.15.19:0/1053617985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d2c14b560 msgr2=0x7f4d2c200120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.942+0000 7f4d29e00640 1 --2- 172.21.15.19:0/1053617985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d2c14b560 0x7f4d2c200120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.942+0000 7f4d29e00640 1 -- 172.21.15.19:0/1053617985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c13e320 con 0x7f4d2c0ce150 2024-03-08T06:03:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.942+0000 7f6868a00640 1 -- 172.21.15.19:0/1412663069 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6864075090 con 0x7f68641611f0 2024-03-08T06:03:27.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.943+0000 7fdeea200640 1 -- 172.21.15.19:0/3644595749 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc006160 con 0x7fdedc050180 2024-03-08T06:03:27.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.943+0000 7fd471e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd46400b1d0 0x7fd464035fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.943+0000 7f7ca1800640 1 -- 172.21.15.19:0/2384289771 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7c78001030 con 0x7f7c940501a0 2024-03-08T06:03:27.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.943+0000 7fdeea200640 1 -- 172.21.15.19:0/3644595749 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc005fe0 con 0x7fdedc00aad0 2024-03-08T06:03:27.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.943+0000 7fdeea200640 1 -- 172.21.15.19:0/3644595749 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0062e0 con 0x7fdedc0530a0 2024-03-08T06:03:27.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.943+0000 7fd471e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd46403afd0 0x7fd464033070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.943+0000 7fd471e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd4640e0020 0x7fd46404b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.943+0000 7fd471e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4640e0400 con 0x7fd46403afd0 2024-03-08T06:03:27.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.943+0000 7fd471e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4640534a0 con 0x7fd46400b1d0 2024-03-08T06:03:27.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.943+0000 7fd471e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46403b610 con 0x7fd4640e0020 2024-03-08T06:03:27.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.943+0000 7f159d600640 1 -- 172.21.15.19:0/2209166517 <== mon.1 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1904382553 0 0) 0x7f15a0166810 con 0x7f15a014bbe0 2024-03-08T06:03:27.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.943+0000 7f159d600640 1 -- 172.21.15.19:0/2209166517 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1584003520 con 0x7f15a014bbe0 2024-03-08T06:03:27.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.943+0000 7f4d29e00640 1 --2- 172.21.15.19:0/1053617985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d2c0ce150 0x7f4d2c1438d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00e8a0 tx=0x7f4d1c00ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:27.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.943+0000 7f159f400640 1 -- 172.21.15.19:0/2209166517 >> v1:172.21.15.42:6789/0 conn(0x7f15a014bbe0 legacy=0x7f15a00cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.943+0000 7f159f400640 1 -- 172.21.15.19:0/2209166517 >> v1:172.21.15.19:6789/0 conn(0x7f15a014b560 legacy=0x7f15a0165ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.943+0000 7f60cd400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60c00ead00 0x7f60c00d6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.943+0000 7f60cd400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60c00ead00 0x7f60c00d6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.19:40004/0 (socket says 172.21.15.19:40004) 2024-03-08T06:03:27.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.943+0000 7f60cd400640 1 -- 172.21.15.19:0/1060699975 learned_addr learned my addr 172.21.15.19:0/1060699975 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:27.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.943+0000 7f60c7e00640 1 --2- 172.21.15.19:0/1060699975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60c004ffd0 0x7f60c002e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.944+0000 7fd46be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd46403afd0 0x7fd464033070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.943+0000 7f159f400640 1 -- 172.21.15.19:0/2209166517 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a0166af0 con 0x7f15a00717d0 2024-03-08T06:03:27.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.944+0000 7f4d22000640 1 -- 172.21.15.19:0/1053617985 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c017070 con 0x7f4d2c0ce150 2024-03-08T06:03:27.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.944+0000 7fd46be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd46403afd0 0x7fd464033070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33586/0 (socket says 172.21.15.19:33586) 2024-03-08T06:03:27.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.944+0000 7fd46be00640 1 -- 172.21.15.19:0/1551610502 learned_addr learned my addr 172.21.15.19:0/1551610502 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:27.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.944+0000 7f4d22000640 1 -- 172.21.15.19:0/1053617985 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c00c940 con 0x7f4d2c0ce150 2024-03-08T06:03:27.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.944+0000 7f4d22000640 1 -- 172.21.15.19:0/1053617985 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c00cd30 con 0x7f4d2c0ce150 2024-03-08T06:03:27.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.944+0000 7f60c7e00640 1 -- 172.21.15.19:0/1060699975 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f60c0038110 msgr2=0x7f60c002dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.944+0000 7f60c7e00640 1 --2- 172.21.15.19:0/1060699975 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f60c0038110 0x7f60c002dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.944+0000 7f60c7e00640 1 -- 172.21.15.19:0/1060699975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60c00ead00 msgr2=0x7f60c00d6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.944+0000 7f60c7e00640 1 --2- 172.21.15.19:0/1060699975 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f60c00ead00 0x7f60c00d6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.944+0000 7f60c7e00640 1 -- 172.21.15.19:0/1060699975 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c00d6170 con 0x7f60c004ffd0 2024-03-08T06:03:27.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.944+0000 7fd470a00640 1 --2- 172.21.15.19:0/1551610502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd46400b1d0 0x7fd464035fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.945+0000 7fdee9800640 1 --2- 172.21.15.19:0/3644595749 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdedc0530a0 0x7fdedc0e1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:27.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.944+0000 7f4d31000640 1 -- 172.21.15.19:0/1053617985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2c143280 con 0x7f4d2c0ce150 2024-03-08T06:03:27.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.944+0000 7f4d31000640 1 -- 172.21.15.19:0/1053617985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2c13e5e0 con 0x7f4d2c0ce150 2024-03-08T06:03:27.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.945+0000 7f60c7e00640 1 --2- 172.21.15.19:0/1060699975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60c004ffd0 0x7f60c002e1b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009fd0 tx=0x7f60b400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:27.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.945+0000 7fd46be00640 1 -- 172.21.15.19:0/1551610502 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd4640e0020 msgr2=0x7fd46404b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.945+0000 7fd46be00640 1 --2- 172.21.15.19:0/1551610502 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd4640e0020 0x7fd46404b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.945+0000 7fd46be00640 1 -- 172.21.15.19:0/1551610502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd46400b1d0 msgr2=0x7fd464035fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.945+0000 7fd46be00640 1 --2- 172.21.15.19:0/1551610502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd46400b1d0 0x7fd464035fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.945+0000 7fd46be00640 1 -- 172.21.15.19:0/1551610502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd464034f00 con 0x7fd46403afd0 2024-03-08T06:03:27.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.945+0000 7f60c4c00640 1 -- 172.21.15.19:0/1060699975 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b4004030 con 0x7f60c004ffd0 2024-03-08T06:03:27.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.945+0000 7f60c4c00640 1 -- 172.21.15.19:0/1060699975 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b40041d0 con 0x7f60c004ffd0 2024-03-08T06:03:27.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.945+0000 7f60c4c00640 1 -- 172.21.15.19:0/1060699975 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b400c940 con 0x7f60c004ffd0 2024-03-08T06:03:27.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.946+0000 7fd46be00640 1 --2- 172.21.15.19:0/1551610502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd46403afd0 0x7fd464033070 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd45800c480 tx=0x7fd45800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:27.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.946+0000 7f159f400640 1 --2- 172.21.15.19:0/2209166517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a00717d0 0x7f15a0071c40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f15900097a0 tx=0x7f159002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f3265dc6ec7c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:27.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.946+0000 7fdee3e00640 1 -- 172.21.15.19:0/3644595749 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdedc0530a0 msgr2=0x7fdedc0e1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.946+0000 7fdee3e00640 1 --2- 172.21.15.19:0/3644595749 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdedc0530a0 0x7fdedc0e1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.946+0000 7fdee3e00640 1 -- 172.21.15.19:0/3644595749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdedc00aad0 msgr2=0x7fdedc0c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:27.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.946+0000 7fdee3e00640 1 --2- 172.21.15.19:0/3644595749 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdedc00aad0 0x7fdedc0c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:27.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.946+0000 7fdee3e00640 1 -- 172.21.15.19:0/3644595749 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc0cb050 con 0x7fdedc050180 2024-03-08T06:03:27.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.946+0000 7f159d600640 1 -- 172.21.15.19:0/2209166517 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1590034070 con 0x7f15a00717d0 2024-03-08T06:03:27.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.946+0000 7f159d600640 1 -- 172.21.15.19:0/2209166517 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1590030610 con 0x7f15a00717d0 2024-03-08T06:03:27.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.946+0000 7f159d600640 1 -- 172.21.15.19:0/2209166517 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15900309e0 con 0x7f15a00717d0 2024-03-08T06:03:27.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.947+0000 7f60cde00640 1 -- 172.21.15.19:0/1060699975 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c00d6450 con 0x7f60c004ffd0 2024-03-08T06:03:27.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.947+0000 7fdee3e00640 1 --2- 172.21.15.19:0/3644595749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdedc050180 0x7fdedc04bb90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fded800e900 tx=0x7fded800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:27.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.946+0000 7fd468c00640 1 -- 172.21.15.19:0/1551610502 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458017070 con 0x7fd46403afd0 2024-03-08T06:03:27.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.947+0000 7fd471e00640 1 -- 172.21.15.19:0/1551610502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4640351e0 con 0x7fd46403afd0 2024-03-08T06:03:27.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.947+0000 7fdee0c00640 1 -- 172.21.15.19:0/3644595749 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8017070 con 0x7fdedc050180 2024-03-08T06:03:27.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.946+0000 7f685b400640 1 -- 172.21.15.19:0/1412663069 <== mon.2 v2:172.21.15.42:3301/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f685c00abd0 con 0x7f68641611f0 2024-03-08T06:03:27.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.948+0000 7f685b400640 1 --2- 172.21.15.19:0/1412663069 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f684006b4d0 0x7f684006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.948+0000 7f685b400640 1 -- 172.21.15.19:0/1412663069 <== mon.2 v2:172.21.15.42:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f685c089d60 con 0x7f68641611f0 2024-03-08T06:03:27.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.949+0000 7f685b400640 1 --2- 172.21.15.19:0/1412663069 >> [v2:172.21.15.19:6800/2805787689,v1:172.21.15.19:6801/2805787689] conn(0x7f68400736f0 0x7f6840075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:27.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.949+0000 7f685b400640 1 -- 172.21.15.19:0/1412663069 --> [v2:172.21.15.19:6800/2805787689,v1:172.21.15.19:6801/2805787689] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68400761c0 con 0x7f68400736f0 2024-03-08T06:03:27.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.949+0000 7f685b400640 1 -- 172.21.15.19:0/1412663069 <== mon.2 v2:172.21.15.42:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f685c08a150 con 0x7f68641611f0 2024-03-08T06:03:27.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.947+0000 7f4d31000640 1 -- 172.21.15.19:0/1053617985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d04001030 con 0x7f4d2c0ce150 2024-03-08T06:03:27.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.949+0000 7f60cde00640 1 -- 172.21.15.19:0/1060699975 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c002b470 con 0x7f60c004ffd0 2024-03-08T06:03:27.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.947+0000 7fd468c00640 1 -- 172.21.15.19:0/1551610502 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4580052d0 con 0x7fd46403afd0 2024-03-08T06:03:27.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.947+0000 7fd471e00640 1 -- 172.21.15.19:0/1551610502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4640357a0 con 0x7fd46403afd0 2024-03-08T06:03:27.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.947+0000 7fd468c00640 1 -- 172.21.15.19:0/1551610502 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd458012870 con 0x7fd46403afd0 2024-03-08T06:03:27.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.947+0000 7fdee0c00640 1 -- 172.21.15.19:0/3644595749 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded800ca00 con 0x7fdedc050180 2024-03-08T06:03:27.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.950+0000 7f60ba000640 1 -- 172.21.15.19:0/1060699975 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f60c00d5f20 con 0x7f60c004ffd0 2024-03-08T06:03:27.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.950+0000 7f6859e00640 1 --2- 172.21.15.19:0/1412663069 >> [v2:172.21.15.19:6800/2805787689,v1:172.21.15.19:6801/2805787689] conn(0x7f68400736f0 0x7f6840075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.950+0000 7f60c4c00640 1 -- 172.21.15.19:0/1060699975 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f60b400cae0 con 0x7f60c004ffd0 2024-03-08T06:03:28.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.947+0000 7f15a5e00640 1 -- 172.21.15.19:0/2209166517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a00717d0 msgr2=0x7f15a0071c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.947+0000 7f15a5e00640 1 --2- 172.21.15.19:0/2209166517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a00717d0 0x7f15a0071c40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f15900097a0 tx=0x7f159002b960 comp rx=0 tx=0).stop 2024-03-08T06:03:28.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.948+0000 7f15a5e00640 1 -- 172.21.15.19:0/2209166517 shutdown_connections 2024-03-08T06:03:28.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.948+0000 7f15a5e00640 1 --2- 172.21.15.19:0/2209166517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a00717d0 0x7f15a0071c40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.948+0000 7f15a5e00640 1 -- 172.21.15.19:0/2209166517 >> 172.21.15.19:0/2209166517 conn(0x7f15a006ae30 msgr2=0x7f15a006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.948+0000 7f15a5e00640 1 -- 172.21.15.19:0/2209166517 shutdown_connections 2024-03-08T06:03:28.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.948+0000 7f15a5e00640 1 -- 172.21.15.19:0/2209166517 wait complete. 2024-03-08T06:03:28.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.951+0000 7fd471e00640 1 -- 172.21.15.19:0/1551610502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd448001030 con 0x7fd46403afd0 2024-03-08T06:03:28.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.950+0000 7f4d22000640 1 -- 172.21.15.19:0/1053617985 <== mon.1 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4d1c01a070 con 0x7f4d2c0ce150 2024-03-08T06:03:28.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.951+0000 7f4d22000640 1 --2- 172.21.15.19:0/1053617985 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f4d0c06b5a0 0x7f4d0c06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.951+0000 7f60c4c00640 1 --2- 172.21.15.19:0/1060699975 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f60a806b520 0x7f60a806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.951+0000 7fdee0c00640 1 -- 172.21.15.19:0/3644595749 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded800cdf0 con 0x7fdedc050180 2024-03-08T06:03:28.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.951+0000 7fdeea200640 1 -- 172.21.15.19:0/3644595749 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdedc0cb330 con 0x7fdedc050180 2024-03-08T06:03:28.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.951+0000 7fdeea200640 1 -- 172.21.15.19:0/3644595749 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdedc0cb8f0 con 0x7fdedc050180 2024-03-08T06:03:28.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.951+0000 7f6859e00640 1 --2- 172.21.15.19:0/1412663069 >> [v2:172.21.15.19:6800/2805787689,v1:172.21.15.19:6801/2805787689] conn(0x7f68400736f0 0x7f6840075b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.951+0000 7f4d22000640 1 -- 172.21.15.19:0/1053617985 <== mon.1 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d1c08a430 con 0x7f4d2c0ce150 2024-03-08T06:03:28.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.951+0000 7f60c4c00640 1 -- 172.21.15.19:0/1060699975 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60b408d490 con 0x7f60c004ffd0 2024-03-08T06:03:28.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.952+0000 7f4d22000640 1 --2- 172.21.15.19:0/1053617985 >> [v2:172.21.15.19:6816/3547775856,v1:172.21.15.19:6818/3547775856] conn(0x7f4d0c0737c0 0x7f4d0c075be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.952+0000 7f4d22000640 1 -- 172.21.15.19:0/1053617985 --> [v2:172.21.15.19:6816/3547775856,v1:172.21.15.19:6818/3547775856] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d0c076290 con 0x7f4d0c0737c0 2024-03-08T06:03:28.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.952+0000 7f4d22000640 1 -- 172.21.15.19:0/1053617985 <== mon.1 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d1c08a820 con 0x7f4d2c0ce150 2024-03-08T06:03:28.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.947+0000 7f7c8fe00640 1 -- 172.21.15.19:0/2384289771 <== mon.1 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7c9c06c690 con 0x7f7c940501a0 2024-03-08T06:03:28.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.949+0000 7f7c8fe00640 1 --2- 172.21.15.19:0/2384289771 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7c7c06b4d0 0x7f7c7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.949+0000 7f7c8fe00640 1 -- 172.21.15.19:0/2384289771 <== mon.1 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c9c1055f0 con 0x7f7c940501a0 2024-03-08T06:03:28.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.949+0000 7f7c8fe00640 1 --2- 172.21.15.19:0/2384289771 >> [v2:172.21.15.19:6817/2806517817,v1:172.21.15.19:6819/2806517817] conn(0x7f7c7c0736f0 0x7f7c7c075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.949+0000 7f7c8fe00640 1 -- 172.21.15.19:0/2384289771 --> [v2:172.21.15.19:6817/2806517817,v1:172.21.15.19:6819/2806517817] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7c9c071e50 con 0x7f7c7c0736f0 2024-03-08T06:03:28.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.949+0000 7f7c8fe00640 1 -- 172.21.15.19:0/2384289771 <== mon.1 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c9c1059e0 con 0x7f7c940501a0 2024-03-08T06:03:28.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.952+0000 7f7c9b400640 1 --2- 172.21.15.19:0/2384289771 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7c7c06b4d0 0x7f7c7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.952+0000 7fd468c00640 1 -- 172.21.15.19:0/1551610502 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd45801a070 con 0x7fd46403afd0 2024-03-08T06:03:28.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.952+0000 7f4d2a800640 1 --2- 172.21.15.19:0/1053617985 >> [v2:172.21.15.19:6816/3547775856,v1:172.21.15.19:6818/3547775856] conn(0x7f4d0c0737c0 0x7f4d0c075be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.953+0000 7f6862800640 1 --2- 172.21.15.19:0/1412663069 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f684006b4d0 0x7f684006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.953+0000 7f685b400640 1 -- 172.21.15.19:0/1412663069 <== osd.2 v2:172.21.15.19:6800/2805787689 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f68400761c0 con 0x7f68400736f0 2024-03-08T06:03:28.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.953+0000 7f4d2a800640 1 --2- 172.21.15.19:0/1053617985 >> [v2:172.21.15.19:6816/3547775856,v1:172.21.15.19:6818/3547775856] conn(0x7f4d0c0737c0 0x7f4d0c075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.953+0000 7f4d29400640 1 --2- 172.21.15.19:0/1053617985 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f4d0c06b5a0 0x7f4d0c06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.953+0000 7f15a5e00640 1 Processor -- start 2024-03-08T06:03:28.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.953+0000 7f15a5e00640 1 -- start start 2024-03-08T06:03:28.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.954+0000 7fd468c00640 1 --2- 172.21.15.19:0/1551610502 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd44c06b4d0 0x7fd44c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.954+0000 7fd468c00640 1 -- 172.21.15.19:0/1551610502 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd458089510 con 0x7fd46403afd0 2024-03-08T06:03:28.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.954+0000 7f7ca0e00640 1 --2- 172.21.15.19:0/2384289771 >> [v2:172.21.15.19:6817/2806517817,v1:172.21.15.19:6819/2806517817] conn(0x7f7c7c0736f0 0x7f7c7c075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.952+0000 7f60c4c00640 1 --2- 172.21.15.19:0/1060699975 >> [v2:172.21.15.42:6800/1656053258,v1:172.21.15.42:6801/1656053258] conn(0x7f60a8073740 0x7f60a8075b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.952+0000 7f60c4c00640 1 -- 172.21.15.19:0/1060699975 --> [v2:172.21.15.42:6800/1656053258,v1:172.21.15.42:6801/1656053258] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f60b400be50 con 0x7f60a8073740 2024-03-08T06:03:28.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.952+0000 7f60c4c00640 1 -- 172.21.15.19:0/1060699975 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60b408d890 con 0x7f60c004ffd0 2024-03-08T06:03:28.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.953+0000 7f60cca00640 1 --2- 172.21.15.19:0/1060699975 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f60a806b520 0x7f60a806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.953+0000 7f60cd400640 1 --2- 172.21.15.19:0/1060699975 >> [v2:172.21.15.42:6800/1656053258,v1:172.21.15.42:6801/1656053258] conn(0x7f60a8073740 0x7f60a8075b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.955+0000 7fd468c00640 1 --2- 172.21.15.19:0/1551610502 >> [v2:172.21.15.42:6821/93809742,v1:172.21.15.42:6824/93809742] conn(0x7fd44c0736d0 0x7fd44c075af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.955+0000 7fd468c00640 1 -- 172.21.15.19:0/1551610502 --> [v2:172.21.15.42:6821/93809742,v1:172.21.15.42:6824/93809742] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd44c0761a0 con 0x7fd44c0736d0 2024-03-08T06:03:28.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.955+0000 7fd468c00640 1 -- 172.21.15.19:0/1551610502 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd458090050 con 0x7fd46403afd0 2024-03-08T06:03:28.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.955+0000 7f60cd400640 1 --2- 172.21.15.19:0/1060699975 >> [v2:172.21.15.42:6800/1656053258,v1:172.21.15.42:6801/1656053258] conn(0x7f60a8073740 0x7f60a8075b60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.954+0000 7f15a5e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f15a00717d0 0x7f15a0204de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.954+0000 7f15a5e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f15a014b560 0x7f15a0148b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.954+0000 7f15a5e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a014bbe0 0x7f15a01490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.954+0000 7f15a5e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a014b940 con 0x7f15a014bbe0 2024-03-08T06:03:28.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.954+0000 7f15a5e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a00b2dc0 con 0x7f15a014b560 2024-03-08T06:03:28.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.954+0000 7f15a5e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a00ce320 con 0x7f15a00717d0 2024-03-08T06:03:28.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.955+0000 7f159ea00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f15a00717d0 0x7f15a0204de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.955+0000 7f159ea00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f15a00717d0 0x7f15a0204de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.19:49766/0 (socket says 172.21.15.19:49766) 2024-03-08T06:03:28.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.955+0000 7f159ea00640 1 -- 172.21.15.19:0/2534072576 learned_addr learned my addr 172.21.15.19:0/2534072576 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:28.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.955+0000 7f159e000640 1 --2- 172.21.15.19:0/2534072576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f15a014b560 0x7f15a0148b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.955+0000 7f159f400640 1 --2- 172.21.15.19:0/2534072576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a014bbe0 0x7f15a01490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.956+0000 7f60cca00640 1 --2- 172.21.15.19:0/1060699975 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f60a806b520 0x7f60a806d9e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f60bc006a90 tx=0x7f60bc006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.956+0000 7f159f400640 1 -- 172.21.15.19:0/2534072576 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f15a00717d0 msgr2=0x7f15a0204de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.956+0000 7f159f400640 1 --2- 172.21.15.19:0/2534072576 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f15a00717d0 0x7f15a0204de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.956+0000 7f159f400640 1 -- 172.21.15.19:0/2534072576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f15a014b560 msgr2=0x7f15a0148b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.956+0000 7fd470a00640 1 --2- 172.21.15.19:0/1551610502 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd44c06b4d0 0x7fd44c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.952+0000 7fdeea200640 1 -- 172.21.15.19:0/3644595749 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdedc0e3af0 con 0x7fdedc050180 2024-03-08T06:03:28.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.956+0000 7f159f400640 1 --2- 172.21.15.19:0/2534072576 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f15a014b560 0x7f15a0148b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.956+0000 7f159f400640 1 -- 172.21.15.19:0/2534072576 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a0205320 con 0x7f15a014bbe0 2024-03-08T06:03:28.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.956+0000 7f159f400640 1 --2- 172.21.15.19:0/2534072576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a014bbe0 0x7f15a01490b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f15a0166e00 tx=0x7f15900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.955+0000 7f4d29400640 1 --2- 172.21.15.19:0/1053617985 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f4d0c06b5a0 0x7f4d0c06da60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d18036000 tx=0x7f4d18030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.956+0000 7f4d22000640 1 -- 172.21.15.19:0/1053617985 <== osd.3 v2:172.21.15.19:6816/3547775856 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4d0c076290 con 0x7f4d0c0737c0 2024-03-08T06:03:28.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.957+0000 7f6862800640 1 --2- 172.21.15.19:0/1412663069 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f684006b4d0 0x7f684006d990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6854006fd0 tx=0x7f6854008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.957+0000 7f1597400640 1 -- 172.21.15.19:0/2534072576 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1590034040 con 0x7f15a014bbe0 2024-03-08T06:03:28.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.957+0000 7f15a5e00640 1 -- 172.21.15.19:0/2534072576 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a0201810 con 0x7f15a014bbe0 2024-03-08T06:03:28.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.957+0000 7fd471400640 1 --2- 172.21.15.19:0/1551610502 >> [v2:172.21.15.42:6821/93809742,v1:172.21.15.42:6824/93809742] conn(0x7fd44c0736d0 0x7fd44c075af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.957+0000 7fd470a00640 1 --2- 172.21.15.19:0/1551610502 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd44c06b4d0 0x7fd44c06d990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd460005880 tx=0x7fd460009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.957+0000 7f15a5e00640 1 -- 172.21.15.19:0/2534072576 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a02045e0 con 0x7f15a014bbe0 2024-03-08T06:03:28.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.958+0000 7f7c9b400640 1 --2- 172.21.15.19:0/2384289771 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7c7c06b4d0 0x7f7c7c06d990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7c9404fb60 tx=0x7f7c90008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.958+0000 7f1597400640 1 -- 172.21.15.19:0/2534072576 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15900304d0 con 0x7f15a014bbe0 2024-03-08T06:03:28.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.958+0000 7f1597400640 1 -- 172.21.15.19:0/2534072576 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159003ada0 con 0x7f15a014bbe0 2024-03-08T06:03:28.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.958+0000 7f7ca0e00640 1 --2- 172.21.15.19:0/2384289771 >> [v2:172.21.15.19:6817/2806517817,v1:172.21.15.19:6819/2806517817] conn(0x7f7c7c0736f0 0x7f7c7c075b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.958+0000 7f60c4c00640 1 -- 172.21.15.19:0/1060699975 <== osd.4 v2:172.21.15.42:6800/1656053258 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f60b400be50 con 0x7f60a8073740 2024-03-08T06:03:28.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.959+0000 7fd471400640 1 --2- 172.21.15.19:0/1551610502 >> [v2:172.21.15.42:6821/93809742,v1:172.21.15.42:6824/93809742] conn(0x7fd44c0736d0 0x7fd44c075af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.959+0000 7fdee0c00640 1 -- 172.21.15.19:0/3644595749 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fded801a070 con 0x7fdedc050180 2024-03-08T06:03:28.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.960+0000 7f7c8fe00640 1 -- 172.21.15.19:0/2384289771 <== osd.1 v2:172.21.15.19:6817/2806517817 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7c9c071e50 con 0x7f7c7c0736f0 2024-03-08T06:03:28.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.960+0000 7fdee0c00640 1 --2- 172.21.15.19:0/3644595749 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fdec406b550 0x7fdec406da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.961+0000 7fdee0c00640 1 -- 172.21.15.19:0/3644595749 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fded8089ee0 con 0x7fdedc050180 2024-03-08T06:03:28.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.961+0000 7fdee0c00640 1 --2- 172.21.15.19:0/3644595749 >> [v2:172.21.15.42:6816/1354526460,v1:172.21.15.42:6817/1354526460] conn(0x7fdec4073750 0x7fdec4075b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.961+0000 7fdee0c00640 1 -- 172.21.15.19:0/3644595749 --> [v2:172.21.15.42:6816/1354526460,v1:172.21.15.42:6817/1354526460] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fded8022e50 con 0x7fdec4073750 2024-03-08T06:03:28.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.961+0000 7fdee8e00640 1 --2- 172.21.15.19:0/3644595749 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fdec406b550 0x7fdec406da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.962+0000 7fdee9800640 1 --2- 172.21.15.19:0/3644595749 >> [v2:172.21.15.42:6816/1354526460,v1:172.21.15.42:6817/1354526460] conn(0x7fdec4073750 0x7fdec4075b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.962+0000 7fd468c00640 1 -- 172.21.15.19:0/1551610502 <== osd.6 v2:172.21.15.42:6821/93809742 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd44c0761a0 con 0x7fd44c0736d0 2024-03-08T06:03:28.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.962+0000 7fdee0c00640 1 -- 172.21.15.19:0/3644595749 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fded8054a10 con 0x7fdedc050180 2024-03-08T06:03:28.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.962+0000 7fdee8e00640 1 --2- 172.21.15.19:0/3644595749 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fdec406b550 0x7fdec406da10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fded0000c00 tx=0x7fded0007d70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.963+0000 7fdee9800640 1 --2- 172.21.15.19:0/3644595749 >> [v2:172.21.15.42:6816/1354526460,v1:172.21.15.42:6817/1354526460] conn(0x7fdec4073750 0x7fdec4075b70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.959+0000 7f15a5e00640 1 -- 172.21.15.19:0/2534072576 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1578001030 con 0x7f15a014bbe0 2024-03-08T06:03:28.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.964+0000 7f1597400640 1 -- 172.21.15.19:0/2534072576 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f159004b060 con 0x7f15a014bbe0 2024-03-08T06:03:28.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.965+0000 7fdee0c00640 1 -- 172.21.15.19:0/3644595749 <== osd.5 v2:172.21.15.42:6816/1354526460 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fded8022e50 con 0x7fdec4073750 2024-03-08T06:03:28.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.965+0000 7f1597400640 1 --2- 172.21.15.19:0/2534072576 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f158006b4d0 0x7f158006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.966+0000 7f1597400640 1 -- 172.21.15.19:0/2534072576 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15900abe50 con 0x7f15a014bbe0 2024-03-08T06:03:28.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.966+0000 7f1597400640 1 --2- 172.21.15.19:0/2534072576 >> [v2:172.21.15.42:6808/3799661037,v1:172.21.15.42:6809/3799661037] conn(0x7f1580073670 0x7f1580075a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.966+0000 7f1597400640 1 -- 172.21.15.19:0/2534072576 --> [v2:172.21.15.42:6808/3799661037,v1:172.21.15.42:6809/3799661037] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f159000af30 con 0x7f1580073670 2024-03-08T06:03:28.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.966+0000 7f159ea00640 1 --2- 172.21.15.19:0/2534072576 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f158006b4d0 0x7f158006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.967+0000 7f1597400640 1 -- 172.21.15.19:0/2534072576 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1590076880 con 0x7f15a014bbe0 2024-03-08T06:03:28.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.967+0000 7f159e000640 1 --2- 172.21.15.19:0/2534072576 >> [v2:172.21.15.42:6808/3799661037,v1:172.21.15.42:6809/3799661037] conn(0x7f1580073670 0x7f1580075a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.969+0000 7f159ea00640 1 --2- 172.21.15.19:0/2534072576 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f158006b4d0 0x7f158006d990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1598001ef0 tx=0x7f1598009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.970+0000 7f159e000640 1 --2- 172.21.15.19:0/2534072576 >> [v2:172.21.15.42:6808/3799661037,v1:172.21.15.42:6809/3799661037] conn(0x7f1580073670 0x7f1580075a90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.970+0000 7ffa82e00640 1 -- 172.21.15.19:0/2621470478 --> [v2:172.21.15.19:6808/3105613222,v1:172.21.15.19:6809/3105613222] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffa58002dd0 con 0x7ffa5c0736d0 2024-03-08T06:03:28.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.971+0000 7ffa79600640 1 -- 172.21.15.19:0/2621470478 <== osd.0 v2:172.21.15.19:6808/3105613222 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffa58002dd0 con 0x7ffa5c0736d0 2024-03-08T06:03:28.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.972+0000 7ffa82e00640 1 -- 172.21.15.19:0/2621470478 >> [v2:172.21.15.19:6808/3105613222,v1:172.21.15.19:6809/3105613222] conn(0x7ffa5c0736d0 msgr2=0x7ffa5c075af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.972+0000 7ffa82e00640 1 --2- 172.21.15.19:0/2621470478 >> [v2:172.21.15.19:6808/3105613222,v1:172.21.15.19:6809/3105613222] conn(0x7ffa5c0736d0 0x7ffa5c075af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.973+0000 7f1597400640 1 -- 172.21.15.19:0/2534072576 <== osd.7 v2:172.21.15.42:6808/3799661037 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f159000af30 con 0x7f1580073670 2024-03-08T06:03:28.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.975+0000 7ffa82e00640 1 -- 172.21.15.19:0/2621470478 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ffa5c06b4d0 msgr2=0x7ffa5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.975+0000 7ffa82e00640 1 --2- 172.21.15.19:0/2621470478 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ffa5c06b4d0 0x7ffa5c06d990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffa680011e0 tx=0x7ffa68009040 comp rx=0 tx=0).stop 2024-03-08T06:03:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.975+0000 7ffa82e00640 1 -- 172.21.15.19:0/2621470478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa7c0b4b30 msgr2=0x7ffa7c0adf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.975+0000 7ffa82e00640 1 --2- 172.21.15.19:0/2621470478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa7c0b4b30 0x7ffa7c0adf60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffa7002b880 tx=0x7ffa700046c0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.975+0000 7ffa82400640 1 -- 172.21.15.19:0/2621470478 reap_dead start 2024-03-08T06:03:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.975+0000 7ffa82e00640 1 -- 172.21.15.19:0/2621470478 shutdown_connections 2024-03-08T06:03:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.975+0000 7ffa82e00640 1 -- 172.21.15.19:0/2621470478 >> 172.21.15.19:0/2621470478 conn(0x7ffa7c0b1590 msgr2=0x7ffa7c15f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.977+0000 7ffa82e00640 1 -- 172.21.15.19:0/2621470478 shutdown_connections 2024-03-08T06:03:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.977+0000 7ffa82e00640 1 -- 172.21.15.19:0/2621470478 wait complete. 2024-03-08T06:03:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.979+0000 7f6868a00640 1 -- 172.21.15.19:0/1412663069 --> [v2:172.21.15.19:6800/2805787689,v1:172.21.15.19:6801/2805787689] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f68640b3710 con 0x7f68400736f0 2024-03-08T06:03:28.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.979+0000 7f685b400640 1 -- 172.21.15.19:0/1412663069 <== osd.2 v2:172.21.15.19:6800/2805787689 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f68640b3710 con 0x7f68400736f0 2024-03-08T06:03:28.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.980+0000 7f6868a00640 1 -- 172.21.15.19:0/1412663069 >> [v2:172.21.15.19:6800/2805787689,v1:172.21.15.19:6801/2805787689] conn(0x7f68400736f0 msgr2=0x7f6840075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.980+0000 7f6868a00640 1 --2- 172.21.15.19:0/1412663069 >> [v2:172.21.15.19:6800/2805787689,v1:172.21.15.19:6801/2805787689] conn(0x7f68400736f0 0x7f6840075b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.980+0000 7f6868a00640 1 -- 172.21.15.19:0/1412663069 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f684006b4d0 msgr2=0x7f684006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.980+0000 7f6868a00640 1 --2- 172.21.15.19:0/1412663069 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f684006b4d0 0x7f684006d990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6854006fd0 tx=0x7f6854008040 comp rx=0 tx=0).stop 2024-03-08T06:03:28.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.980+0000 7f6868a00640 1 -- 172.21.15.19:0/1412663069 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f68641611f0 msgr2=0x7f68641fb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.980+0000 7f6868a00640 1 --2- 172.21.15.19:0/1412663069 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f68641611f0 0x7f68641fb7b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f685c00c780 tx=0x7f685c00cc40 comp rx=0 tx=0).stop 2024-03-08T06:03:28.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.980+0000 7f6863200640 1 -- 172.21.15.19:0/1412663069 reap_dead start 2024-03-08T06:03:28.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.982+0000 7fd471e00640 1 -- 172.21.15.19:0/1551610502 --> [v2:172.21.15.42:6821/93809742,v1:172.21.15.42:6824/93809742] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd448002dd0 con 0x7fd44c0736d0 2024-03-08T06:03:28.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.983+0000 7fd468c00640 1 -- 172.21.15.19:0/1551610502 <== osd.6 v2:172.21.15.42:6821/93809742 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd448002dd0 con 0x7fd44c0736d0 2024-03-08T06:03:28.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.984+0000 7f6868a00640 1 -- 172.21.15.19:0/1412663069 shutdown_connections 2024-03-08T06:03:28.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.984+0000 7f6868a00640 1 -- 172.21.15.19:0/1412663069 >> 172.21.15.19:0/1412663069 conn(0x7f686406c700 msgr2=0x7f68640b6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.986+0000 7f6868a00640 1 -- 172.21.15.19:0/1412663069 shutdown_connections 2024-03-08T06:03:28.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.986+0000 7fd471e00640 1 -- 172.21.15.19:0/1551610502 >> [v2:172.21.15.42:6821/93809742,v1:172.21.15.42:6824/93809742] conn(0x7fd44c0736d0 msgr2=0x7fd44c075af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.986+0000 7fd471e00640 1 --2- 172.21.15.19:0/1551610502 >> [v2:172.21.15.42:6821/93809742,v1:172.21.15.42:6824/93809742] conn(0x7fd44c0736d0 0x7fd44c075af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.986+0000 7fd471e00640 1 -- 172.21.15.19:0/1551610502 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd44c06b4d0 msgr2=0x7fd44c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.986+0000 7fd471e00640 1 --2- 172.21.15.19:0/1551610502 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd44c06b4d0 0x7fd44c06d990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd460005880 tx=0x7fd460009040 comp rx=0 tx=0).stop 2024-03-08T06:03:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.986+0000 7fd471e00640 1 -- 172.21.15.19:0/1551610502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd46403afd0 msgr2=0x7fd464033070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.986+0000 7fd471e00640 1 --2- 172.21.15.19:0/1551610502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd46403afd0 0x7fd464033070 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd45800c480 tx=0x7fd45800c940 comp rx=0 tx=0).stop 2024-03-08T06:03:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.986+0000 7fd471400640 1 -- 172.21.15.19:0/1551610502 reap_dead start 2024-03-08T06:03:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.986+0000 7fd471e00640 1 -- 172.21.15.19:0/1551610502 shutdown_connections 2024-03-08T06:03:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.986+0000 7fd471e00640 1 -- 172.21.15.19:0/1551610502 >> 172.21.15.19:0/1551610502 conn(0x7fd46401ef70 msgr2=0x7fd4640df2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.986+0000 7fd471e00640 1 -- 172.21.15.19:0/1551610502 shutdown_connections 2024-03-08T06:03:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.987+0000 7fd471e00640 1 -- 172.21.15.19:0/1551610502 wait complete. 2024-03-08T06:03:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.988+0000 7f6868a00640 1 -- 172.21.15.19:0/1412663069 wait complete. 2024-03-08T06:03:28.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.992+0000 7f7ca1800640 1 -- 172.21.15.19:0/2384289771 --> [v2:172.21.15.19:6817/2806517817,v1:172.21.15.19:6819/2806517817] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7c78002dd0 con 0x7f7c7c0736f0 2024-03-08T06:03:28.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.993+0000 7f7c8fe00640 1 -- 172.21.15.19:0/2384289771 <== osd.1 v2:172.21.15.19:6817/2806517817 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7c78002dd0 con 0x7f7c7c0736f0 2024-03-08T06:03:28.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.994+0000 7f60ba000640 1 -- 172.21.15.19:0/1060699975 --> [v2:172.21.15.42:6800/1656053258,v1:172.21.15.42:6801/1656053258] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f60c002b730 con 0x7f60a8073740 2024-03-08T06:03:28.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.996+0000 7f60c4c00640 1 -- 172.21.15.19:0/1060699975 <== osd.4 v2:172.21.15.42:6800/1656053258 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f60c002b730 con 0x7f60a8073740 2024-03-08T06:03:28.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.996+0000 7f60ba000640 1 -- 172.21.15.19:0/1060699975 >> [v2:172.21.15.42:6800/1656053258,v1:172.21.15.42:6801/1656053258] conn(0x7f60a8073740 msgr2=0x7f60a8075b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.996+0000 7f60ba000640 1 --2- 172.21.15.19:0/1060699975 >> [v2:172.21.15.42:6800/1656053258,v1:172.21.15.42:6801/1656053258] conn(0x7f60a8073740 0x7f60a8075b60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.996+0000 7f7ca1800640 1 -- 172.21.15.19:0/2384289771 >> [v2:172.21.15.19:6817/2806517817,v1:172.21.15.19:6819/2806517817] conn(0x7f7c7c0736f0 msgr2=0x7f7c7c075b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.996+0000 7f7ca1800640 1 --2- 172.21.15.19:0/2384289771 >> [v2:172.21.15.19:6817/2806517817,v1:172.21.15.19:6819/2806517817] conn(0x7f7c7c0736f0 0x7f7c7c075b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.996+0000 7f4d31000640 1 -- 172.21.15.19:0/1053617985 --> [v2:172.21.15.19:6816/3547775856,v1:172.21.15.19:6818/3547775856] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4d04002dd0 con 0x7f4d0c0737c0 2024-03-08T06:03:28.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.997+0000 7f7ca1800640 1 -- 172.21.15.19:0/2384289771 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7c7c06b4d0 msgr2=0x7f7c7c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.997+0000 7f7ca1800640 1 --2- 172.21.15.19:0/2384289771 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7c7c06b4d0 0x7f7c7c06d990 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7c9404fb60 tx=0x7f7c90008040 comp rx=0 tx=0).stop 2024-03-08T06:03:28.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.997+0000 7f7ca1800640 1 -- 172.21.15.19:0/2384289771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c940501a0 msgr2=0x7f7c940e11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.997+0000 7f7ca1800640 1 --2- 172.21.15.19:0/2384289771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c940501a0 0x7f7c940e11e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0507a0 tx=0x7f7c9c0747e0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.997+0000 7f7ca0e00640 1 -- 172.21.15.19:0/2384289771 reap_dead start 2024-03-08T06:03:28.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.997+0000 7f7ca1800640 1 -- 172.21.15.19:0/2384289771 shutdown_connections 2024-03-08T06:03:28.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.997+0000 7f7ca1800640 1 -- 172.21.15.19:0/2384289771 >> 172.21.15.19:0/2384289771 conn(0x7f7c94009fb0 msgr2=0x7f7c94033f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.997+0000 7f7ca1800640 1 -- 172.21.15.19:0/2384289771 shutdown_connections 2024-03-08T06:03:28.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.997+0000 7f7ca1800640 1 -- 172.21.15.19:0/2384289771 wait complete. 2024-03-08T06:03:28.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.998+0000 7f4d22000640 1 -- 172.21.15.19:0/1053617985 <== osd.3 v2:172.21.15.19:6816/3547775856 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4d04002dd0 con 0x7f4d0c0737c0 2024-03-08T06:03:28.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.999+0000 7f60ba000640 1 -- 172.21.15.19:0/1060699975 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f60a806b520 msgr2=0x7f60a806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.999+0000 7f4d31000640 1 -- 172.21.15.19:0/1053617985 >> [v2:172.21.15.19:6816/3547775856,v1:172.21.15.19:6818/3547775856] conn(0x7f4d0c0737c0 msgr2=0x7f4d0c075be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.999+0000 7f4d31000640 1 --2- 172.21.15.19:0/1053617985 >> [v2:172.21.15.19:6816/3547775856,v1:172.21.15.19:6818/3547775856] conn(0x7f4d0c0737c0 0x7f4d0c075be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.999+0000 7f60ba000640 1 --2- 172.21.15.19:0/1060699975 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f60a806b520 0x7f60a806d9e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f60bc006a90 tx=0x7f60bc006a20 comp rx=0 tx=0).stop 2024-03-08T06:03:28.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.999+0000 7f4d31000640 1 -- 172.21.15.19:0/1053617985 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f4d0c06b5a0 msgr2=0x7f4d0c06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.999+0000 7f4d31000640 1 --2- 172.21.15.19:0/1053617985 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f4d0c06b5a0 0x7f4d0c06da60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4d18036000 tx=0x7f4d18030000 comp rx=0 tx=0).stop 2024-03-08T06:03:28.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.999+0000 7f4d31000640 1 -- 172.21.15.19:0/1053617985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d2c0ce150 msgr2=0x7f4d2c1438d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.999+0000 7f4d31000640 1 --2- 172.21.15.19:0/1053617985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d2c0ce150 0x7f4d2c1438d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00e8a0 tx=0x7f4d1c00ed60 comp rx=0 tx=0).stop 2024-03-08T06:03:28.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.999+0000 7f60ba000640 1 -- 172.21.15.19:0/1060699975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60c004ffd0 msgr2=0x7f60c002e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.999+0000 7f60ba000640 1 --2- 172.21.15.19:0/1060699975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60c004ffd0 0x7f60c002e1b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009fd0 tx=0x7f60b400ed40 comp rx=0 tx=0).stop 2024-03-08T06:03:28.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.999+0000 7f60cd400640 1 -- 172.21.15.19:0/1060699975 reap_dead start 2024-03-08T06:03:28.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.999+0000 7f60ba000640 1 -- 172.21.15.19:0/1060699975 shutdown_connections 2024-03-08T06:03:28.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:27.999+0000 7f60ba000640 1 -- 172.21.15.19:0/1060699975 >> 172.21.15.19:0/1060699975 conn(0x7f60c0009fb0 msgr2=0x7f60c0005e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.001+0000 7fdeea200640 1 -- 172.21.15.19:0/3644595749 --> [v2:172.21.15.42:6816/1354526460,v1:172.21.15.42:6817/1354526460] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdedc0052c0 con 0x7fdec4073750 2024-03-08T06:03:28.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.001+0000 7f60ba000640 1 -- 172.21.15.19:0/1060699975 shutdown_connections 2024-03-08T06:03:28.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.001+0000 7f60ba000640 1 -- 172.21.15.19:0/1060699975 wait complete. 2024-03-08T06:03:28.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.002+0000 7fdee0c00640 1 -- 172.21.15.19:0/3644595749 <== osd.5 v2:172.21.15.42:6816/1354526460 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdedc0052c0 con 0x7fdec4073750 2024-03-08T06:03:28.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.003+0000 7fdeea200640 1 -- 172.21.15.19:0/3644595749 >> [v2:172.21.15.42:6816/1354526460,v1:172.21.15.42:6817/1354526460] conn(0x7fdec4073750 msgr2=0x7fdec4075b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.003+0000 7fdeea200640 1 --2- 172.21.15.19:0/3644595749 >> [v2:172.21.15.42:6816/1354526460,v1:172.21.15.42:6817/1354526460] conn(0x7fdec4073750 0x7fdec4075b70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.003+0000 7f4d2a800640 1 -- 172.21.15.19:0/1053617985 reap_dead start 2024-03-08T06:03:28.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.003+0000 7f4d31000640 1 -- 172.21.15.19:0/1053617985 shutdown_connections 2024-03-08T06:03:28.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.003+0000 7f4d31000640 1 -- 172.21.15.19:0/1053617985 >> 172.21.15.19:0/1053617985 conn(0x7f4d2c06ae30 msgr2=0x7f4d2c0b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.003+0000 7fdeea200640 1 -- 172.21.15.19:0/3644595749 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fdec406b550 msgr2=0x7fdec406da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.003+0000 7fdeea200640 1 --2- 172.21.15.19:0/3644595749 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fdec406b550 0x7fdec406da10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fded0000c00 tx=0x7fded0007d70 comp rx=0 tx=0).stop 2024-03-08T06:03:28.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.003+0000 7fdeea200640 1 -- 172.21.15.19:0/3644595749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdedc050180 msgr2=0x7fdedc04bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.003+0000 7fdeea200640 1 --2- 172.21.15.19:0/3644595749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdedc050180 0x7fdedc04bb90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fded800e900 tx=0x7fded800edc0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.003+0000 7fdee9800640 1 -- 172.21.15.19:0/3644595749 reap_dead start 2024-03-08T06:03:28.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.003+0000 7fdeea200640 1 -- 172.21.15.19:0/3644595749 shutdown_connections 2024-03-08T06:03:28.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.003+0000 7fdeea200640 1 -- 172.21.15.19:0/3644595749 >> 172.21.15.19:0/3644595749 conn(0x7fdedc009fb0 msgr2=0x7fdedc039600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.004+0000 7fdeea200640 1 -- 172.21.15.19:0/3644595749 shutdown_connections 2024-03-08T06:03:28.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.004+0000 7fdeea200640 1 -- 172.21.15.19:0/3644595749 wait complete. 2024-03-08T06:03:28.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.005+0000 7f4d31000640 1 -- 172.21.15.19:0/1053617985 shutdown_connections 2024-03-08T06:03:28.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.005+0000 7f4d31000640 1 -- 172.21.15.19:0/1053617985 wait complete. 2024-03-08T06:03:28.036 INFO:teuthology.orchestra.run.smithi019.stdout:55834574854 2024-03-08T06:03:28.036 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-08T06:03:28.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.007+0000 7f15a5e00640 1 -- 172.21.15.19:0/2534072576 --> [v2:172.21.15.42:6808/3799661037,v1:172.21.15.42:6809/3799661037] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1578002dd0 con 0x7f1580073670 2024-03-08T06:03:28.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.009+0000 7f1597400640 1 -- 172.21.15.19:0/2534072576 <== osd.7 v2:172.21.15.42:6808/3799661037 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1578002dd0 con 0x7f1580073670 2024-03-08T06:03:28.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.009+0000 7f15a5e00640 1 -- 172.21.15.19:0/2534072576 >> [v2:172.21.15.42:6808/3799661037,v1:172.21.15.42:6809/3799661037] conn(0x7f1580073670 msgr2=0x7f1580075a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.009+0000 7f15a5e00640 1 --2- 172.21.15.19:0/2534072576 >> [v2:172.21.15.42:6808/3799661037,v1:172.21.15.42:6809/3799661037] conn(0x7f1580073670 0x7f1580075a90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.010+0000 7f15a5e00640 1 -- 172.21.15.19:0/2534072576 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f158006b4d0 msgr2=0x7f158006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.010+0000 7f15a5e00640 1 --2- 172.21.15.19:0/2534072576 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f158006b4d0 0x7f158006d990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1598001ef0 tx=0x7f1598009040 comp rx=0 tx=0).stop 2024-03-08T06:03:28.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.010+0000 7f15a5e00640 1 -- 172.21.15.19:0/2534072576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a014bbe0 msgr2=0x7f15a01490b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.010+0000 7f15a5e00640 1 --2- 172.21.15.19:0/2534072576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15a014bbe0 0x7f15a01490b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f15a0166e00 tx=0x7f15900046c0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.010+0000 7f159f400640 1 -- 172.21.15.19:0/2534072576 reap_dead start 2024-03-08T06:03:28.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.010+0000 7f15a5e00640 1 -- 172.21.15.19:0/2534072576 shutdown_connections 2024-03-08T06:03:28.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.010+0000 7f15a5e00640 1 -- 172.21.15.19:0/2534072576 >> 172.21.15.19:0/2534072576 conn(0x7f15a006ae30 msgr2=0x7f15a0147280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.010+0000 7f15a5e00640 1 -- 172.21.15.19:0/2534072576 shutdown_connections 2024-03-08T06:03:28.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.011+0000 7f15a5e00640 1 -- 172.21.15.19:0/2534072576 wait complete. 2024-03-08T06:03:28.039 INFO:teuthology.orchestra.run.smithi019.stdout:55834574852 2024-03-08T06:03:28.039 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-08T06:03:28.040 INFO:teuthology.orchestra.run.smithi019.stdout:55834574854 2024-03-08T06:03:28.040 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-08T06:03:28.041 INFO:teuthology.orchestra.run.smithi019.stdout:55834574852 2024-03-08T06:03:28.041 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-08T06:03:28.041 INFO:teuthology.orchestra.run.smithi019.stdout:55834574852 2024-03-08T06:03:28.042 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-08T06:03:28.042 INFO:teuthology.orchestra.run.smithi019.stdout:55834574854 2024-03-08T06:03:28.042 INFO:teuthology.orchestra.run.smithi019.stdout:55834574854 2024-03-08T06:03:28.043 INFO:teuthology.orchestra.run.smithi019.stdout:55834574852 2024-03-08T06:03:28.044 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-08T06:03:28.044 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-08T06:03:28.044 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-08T06:03:28.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.376+0000 7f197b200640 1 Processor -- start 2024-03-08T06:03:28.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.376+0000 7f197b200640 1 -- start start 2024-03-08T06:03:28.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.379+0000 7f197b200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f196c0e32f0 0x7f196c0572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.379+0000 7f197b200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f196c053740 0x7f196c053bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.379+0000 7f197b200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f196c054100 0x7f196c0061e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.379+0000 7f197b200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196c0e36d0 con 0x7f196c0e32f0 2024-03-08T06:03:28.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.379+0000 7f197b200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196c054550 con 0x7f196c054100 2024-03-08T06:03:28.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.379+0000 7f197b200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c057b30 con 0x7f196c053740 2024-03-08T06:03:28.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.379+0000 7f1973e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f196c0e32f0 0x7f196c0572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.379+0000 7f1973e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f196c0e32f0 0x7f196c0572e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33618/0 (socket says 172.21.15.19:33618) 2024-03-08T06:03:28.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.379+0000 7f1973e00640 1 -- 172.21.15.19:0/4213466088 learned_addr learned my addr 172.21.15.19:0/4213466088 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:28.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.380+0000 7f1973e00640 1 -- 172.21.15.19:0/4213466088 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f196c053740 msgr2=0x7f196c053bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:28.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.380+0000 7f1973e00640 1 --2- 172.21.15.19:0/4213466088 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f196c053740 0x7f196c053bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.380+0000 7f1973e00640 1 -- 172.21.15.19:0/4213466088 >> v2:172.21.15.42:3300/0 conn(0x7f196c054100 msgr2=0x7f196c0061e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:28.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.380+0000 7f1973e00640 1 --2- 172.21.15.19:0/4213466088 >> v2:172.21.15.42:3300/0 conn(0x7f196c054100 0x7f196c0061e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.380+0000 7f1973e00640 1 -- 172.21.15.19:0/4213466088 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c057e10 con 0x7f196c0e32f0 2024-03-08T06:03:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.382+0000 7f1973e00640 1 --2- 172.21.15.19:0/4213466088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c0e32f0 0x7f196c0572e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f196c059f40 tx=0x7f19680340c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1be64e3aec87cb server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.383+0000 7f1972a00640 1 -- 172.21.15.19:0/4213466088 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19680110d0 con 0x7f196c0e32f0 2024-03-08T06:03:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.383+0000 7f1972a00640 1 -- 172.21.15.19:0/4213466088 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1968011270 con 0x7f196c0e32f0 2024-03-08T06:03:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.383+0000 7f1972a00640 1 -- 172.21.15.19:0/4213466088 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968011620 con 0x7f196c0e32f0 2024-03-08T06:03:28.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.383+0000 7f197b200640 1 -- 172.21.15.19:0/4213466088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c0e32f0 msgr2=0x7f196c0572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.383+0000 7f197b200640 1 --2- 172.21.15.19:0/4213466088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c0e32f0 0x7f196c0572e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f196c059f40 tx=0x7f19680340c0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.384+0000 7f197b200640 1 -- 172.21.15.19:0/4213466088 shutdown_connections 2024-03-08T06:03:28.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.384+0000 7f197b200640 1 --2- 172.21.15.19:0/4213466088 >> v2:172.21.15.42:3300/0 conn(0x7f196c054100 0x7f196c0061e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.384+0000 7f197b200640 1 --2- 172.21.15.19:0/4213466088 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f196c053740 0x7f196c053bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.384+0000 7f197b200640 1 --2- 172.21.15.19:0/4213466088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c0e32f0 0x7f196c0572e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.384+0000 7f197b200640 1 -- 172.21.15.19:0/4213466088 >> 172.21.15.19:0/4213466088 conn(0x7f196c058ee0 msgr2=0x7f196c0592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.384+0000 7f197b200640 1 -- 172.21.15.19:0/4213466088 shutdown_connections 2024-03-08T06:03:28.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.384+0000 7f197b200640 1 -- 172.21.15.19:0/4213466088 wait complete. 2024-03-08T06:03:28.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.386+0000 7f197b200640 1 Processor -- start 2024-03-08T06:03:28.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.386+0000 7f197b200640 1 -- start start 2024-03-08T06:03:28.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.388+0000 7f197b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f196c053740 0x7f196c0dd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.388+0000 7f197b200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c054100 0x7f196c0d3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.388+0000 7f197b200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f196c0e32f0 0x7f196c050a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.388+0000 7f197b200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c057820 con 0x7f196c054100 2024-03-08T06:03:28.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.388+0000 7f197b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c0583d0 con 0x7f196c053740 2024-03-08T06:03:28.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.388+0000 7f197b200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c058bd0 con 0x7f196c0e32f0 2024-03-08T06:03:28.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.388+0000 7f1973e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f196c053740 0x7f196c0dd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.388+0000 7f6217a00640 1 Processor -- start 2024-03-08T06:03:28.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.389+0000 7f1973e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f196c053740 0x7f196c0dd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.19:40036/0 (socket says 172.21.15.19:40036) 2024-03-08T06:03:28.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.389+0000 7f1973400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c054100 0x7f196c0d3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.389+0000 7f1979200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f196c0e32f0 0x7f196c050a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.389+0000 7f1979200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f196c0e32f0 0x7f196c050a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.19:49778/0 (socket says 172.21.15.19:49778) 2024-03-08T06:03:28.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.389+0000 7f1979200640 1 -- 172.21.15.19:0/3536919307 learned_addr learned my addr 172.21.15.19:0/3536919307 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:28.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.389+0000 7f6217a00640 1 -- start start 2024-03-08T06:03:28.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.389+0000 7fa9c1c00640 1 Processor -- start 2024-03-08T06:03:28.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.390+0000 7f1973400640 1 -- 172.21.15.19:0/3536919307 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f196c0e32f0 msgr2=0x7f196c050a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.390+0000 7f1973400640 1 --2- 172.21.15.19:0/3536919307 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f196c0e32f0 0x7f196c050a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.390+0000 7f1973400640 1 -- 172.21.15.19:0/3536919307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f196c053740 msgr2=0x7f196c0dd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.391+0000 7f1973400640 1 --2- 172.21.15.19:0/3536919307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f196c053740 0x7f196c0dd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.391+0000 7f1973400640 1 -- 172.21.15.19:0/3536919307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c0e5c80 con 0x7f196c054100 2024-03-08T06:03:28.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.391+0000 7f6217a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f62100b6e30 0x7f62100d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.391+0000 7f6217a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6210161ae0 0x7f62100d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.391+0000 7f6217a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62100cec40 con 0x7f621015df80 2024-03-08T06:03:28.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.391+0000 7f6217a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62100d2000 con 0x7f6210161ae0 2024-03-08T06:03:28.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.391+0000 7f6217a00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62100d34a0 con 0x7f62100b6e30 2024-03-08T06:03:28.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.391+0000 7f6215a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6210161ae0 0x7f62100d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.391+0000 7f6215a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6210161ae0 0x7f62100d0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33640/0 (socket says 172.21.15.19:33640) 2024-03-08T06:03:28.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.391+0000 7f6215a00640 1 -- 172.21.15.19:0/4062026127 learned_addr learned my addr 172.21.15.19:0/4062026127 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:28.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.390+0000 7fa9c1c00640 1 -- start start 2024-03-08T06:03:28.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.392+0000 7fa9c1c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa9bc14bbe0 0x7fa9bc0cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.392+0000 7fa9c1c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9bc0ce150 0x7fa9bc0717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.392+0000 7fa9c1c00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9bc166530 con 0x7fa9bc14b560 2024-03-08T06:03:28.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.392+0000 7fa9c1c00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9bc0b2dc0 con 0x7fa9bc14bbe0 2024-03-08T06:03:28.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.392+0000 7fa9c1c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc166810 con 0x7fa9bc0ce150 2024-03-08T06:03:28.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.392+0000 7f6215a00640 1 -- 172.21.15.19:0/4062026127 >> v2:172.21.15.42:3300/0 conn(0x7f62100b6e30 msgr2=0x7f62100d09d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-08T06:03:28.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.392+0000 7f6215a00640 1 --2- 172.21.15.19:0/4062026127 >> v2:172.21.15.42:3300/0 conn(0x7f62100b6e30 0x7f62100d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.392+0000 7f6215a00640 1 -- 172.21.15.19:0/4062026127 >> v1:172.21.15.19:6789/0 conn(0x7f621015df80 legacy=0x7f62100ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:28.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.392+0000 7f6215a00640 1 -- 172.21.15.19:0/4062026127 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62100cef20 con 0x7f6210161ae0 2024-03-08T06:03:28.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.393+0000 7fa9bb400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9bc0ce150 0x7fa9bc0717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.393+0000 7fa9b3e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa9bc14bbe0 0x7fa9bc0cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.393+0000 7fa9b3e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa9bc14bbe0 0x7fa9bc0cdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.19:40052/0 (socket says 172.21.15.19:40052) 2024-03-08T06:03:28.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.393+0000 7fa9b3e00640 1 -- 172.21.15.19:0/3397066678 learned_addr learned my addr 172.21.15.19:0/3397066678 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:28.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.392+0000 7f1973400640 1 --2- 172.21.15.19:0/3536919307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c054100 0x7f196c0d3cb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f196000b440 tx=0x7f196000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.393+0000 7f1967e00640 1 -- 172.21.15.19:0/3536919307 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960011830 con 0x7f196c054100 2024-03-08T06:03:28.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.393+0000 7f1967e00640 1 -- 172.21.15.19:0/3536919307 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1960016070 con 0x7f196c054100 2024-03-08T06:03:28.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.393+0000 7f1967e00640 1 -- 172.21.15.19:0/3536919307 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960011c10 con 0x7f196c054100 2024-03-08T06:03:28.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.393+0000 7f197b200640 1 -- 172.21.15.19:0/3536919307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c0e5f60 con 0x7f196c054100 2024-03-08T06:03:28.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.394+0000 7f197b200640 1 -- 172.21.15.19:0/3536919307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c050290 con 0x7f196c054100 2024-03-08T06:03:28.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.395+0000 7f3364000640 1 Processor -- start 2024-03-08T06:03:28.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.394+0000 7fa9ba000640 1 -- 172.21.15.19:0/3397066678 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325538843 0 0) 0x7fa9bc166530 con 0x7fa9bc14b560 2024-03-08T06:03:28.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.395+0000 7f3364000640 1 -- start start 2024-03-08T06:03:28.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.395+0000 7fa9ba000640 1 -- 172.21.15.19:0/3397066678 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9a0003520 con 0x7fa9bc14b560 2024-03-08T06:03:28.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.396+0000 7fa9b3e00640 1 -- 172.21.15.19:0/3397066678 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9bc0ce150 msgr2=0x7fa9bc0717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:28.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.396+0000 7fa9b3e00640 1 --2- 172.21.15.19:0/3397066678 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9bc0ce150 0x7fa9bc0717d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.396+0000 7fa9b3e00640 1 -- 172.21.15.19:0/3397066678 >> v1:172.21.15.19:6789/0 conn(0x7fa9bc14b560 legacy=0x7fa9bc165ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.396+0000 7fa9b3e00640 1 -- 172.21.15.19:0/3397066678 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9bc166af0 con 0x7fa9bc14bbe0 2024-03-08T06:03:28.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.396+0000 7f05c6800640 1 Processor -- start 2024-03-08T06:03:28.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.396+0000 7f05c6800640 1 -- start start 2024-03-08T06:03:28.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.397+0000 7f3364000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f335c15df80 0x7f335c0ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.397+0000 7f3364000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f335c0d10e0 0x7f335c0d2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.397+0000 7f3364000640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f335c0ce9a0 con 0x7f335c0b6e30 2024-03-08T06:03:28.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.397+0000 7f3364000640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f335c0d2000 con 0x7f335c15df80 2024-03-08T06:03:28.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.397+0000 7f3364000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f335c0cec40 con 0x7f335c0d10e0 2024-03-08T06:03:28.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.397+0000 7f6215a00640 1 --2- 172.21.15.19:0/4062026127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6210161ae0 0x7f62100d0f10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f62100c7530 tx=0x7f620802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68efcf3a8c5e8a4b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.398+0000 7fa9b3e00640 1 --2- 172.21.15.19:0/3397066678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9bc14bbe0 0x7fa9bc0cdc10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009870 tx=0x7fa9ac02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f01e1e48d24f3a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.398+0000 7f3361600640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f335c15df80 0x7f335c0ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.397+0000 7f197b200640 1 -- 172.21.15.19:0/3536919307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c005700 con 0x7f196c054100 2024-03-08T06:03:28.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.398+0000 7f1967e00640 1 -- 172.21.15.19:0/3536919307 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f196001b460 con 0x7f196c054100 2024-03-08T06:03:28.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.398+0000 7f620fe00640 1 -- 172.21.15.19:0/4062026127 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620802ca80 con 0x7f6210161ae0 2024-03-08T06:03:28.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.398+0000 7f620fe00640 1 -- 172.21.15.19:0/4062026127 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620802cc20 con 0x7f6210161ae0 2024-03-08T06:03:28.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.398+0000 7f620fe00640 1 -- 172.21.15.19:0/4062026127 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62080343f0 con 0x7f6210161ae0 2024-03-08T06:03:28.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.398+0000 7f3362000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f335c0d10e0 0x7f335c0d2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.398+0000 7f3360c00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f335c0b6e30 0x7f335c0d09d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35500/0 (socket says 172.21.15.19:35500) 2024-03-08T06:03:28.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.398+0000 7f3360c00640 1 -- 172.21.15.19:0/3168963144 learned_addr learned my addr 172.21.15.19:0/3168963144 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:28.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.398+0000 7f05c6800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f05c00aee90 0x7f05c01631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.398+0000 7f05c6800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f05c00b44c0 0x7f05c0071400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.398+0000 7f05c6800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c00b38a0 con 0x7f05c0071940 2024-03-08T06:03:28.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.398+0000 7f05c6800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c006de30 con 0x7f05c00b44c0 2024-03-08T06:03:28.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.398+0000 7f05c6800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c0071d70 con 0x7f05c00aee90 2024-03-08T06:03:28.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.399+0000 7fa9ba000640 1 -- 172.21.15.19:0/3397066678 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac034070 con 0x7fa9bc14bbe0 2024-03-08T06:03:28.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.399+0000 7fa9ba000640 1 -- 172.21.15.19:0/3397066678 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ac030840 con 0x7fa9bc14bbe0 2024-03-08T06:03:28.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.399+0000 7fa9ba000640 1 -- 172.21.15.19:0/3397066678 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac030c10 con 0x7fa9bc14bbe0 2024-03-08T06:03:28.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.399+0000 7f3361600640 1 -- 172.21.15.19:0/3168963144 >> v2:172.21.15.42:3300/0 conn(0x7f335c0d10e0 msgr2=0x7f335c0d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:28.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.399+0000 7f05c5400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f05c00aee90 0x7f05c01631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.399+0000 7f3361600640 1 --2- 172.21.15.19:0/3168963144 >> v2:172.21.15.42:3300/0 conn(0x7f335c0d10e0 0x7f335c0d2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.399+0000 7f05c4a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f05c00b44c0 0x7f05c0071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.399+0000 7f05c4a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f05c00b44c0 0x7f05c0071400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33660/0 (socket says 172.21.15.19:33660) 2024-03-08T06:03:28.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.399+0000 7f05c4a00640 1 -- 172.21.15.19:0/1868252661 learned_addr learned my addr 172.21.15.19:0/1868252661 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:28.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.399+0000 7f6217a00640 1 -- 172.21.15.19:0/4062026127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6210161ae0 msgr2=0x7f62100d0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.399+0000 7f6217a00640 1 --2- 172.21.15.19:0/4062026127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6210161ae0 0x7f62100d0f10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f62100c7530 tx=0x7f620802bee0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.399+0000 7f80a3e00640 1 Processor -- start 2024-03-08T06:03:28.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.400+0000 7f6217a00640 1 -- 172.21.15.19:0/4062026127 shutdown_connections 2024-03-08T06:03:28.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.400+0000 7f6217a00640 1 --2- 172.21.15.19:0/4062026127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6210161ae0 0x7f62100d0f10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.400+0000 7f1967e00640 1 --2- 172.21.15.19:0/3536919307 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f195406b4d0 0x7f195406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.400+0000 7fa9c1c00640 1 -- 172.21.15.19:0/3397066678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9bc14bbe0 msgr2=0x7fa9bc0cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.400+0000 7fa9c1c00640 1 --2- 172.21.15.19:0/3397066678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9bc14bbe0 0x7fa9bc0cdc10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009870 tx=0x7fa9ac02b980 comp rx=0 tx=0).stop 2024-03-08T06:03:28.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.400+0000 7f6217a00640 1 --2- 172.21.15.19:0/4062026127 >> v2:172.21.15.42:3300/0 conn(0x7f62100b6e30 0x7f62100d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.400+0000 7f6217a00640 1 -- 172.21.15.19:0/4062026127 >> 172.21.15.19:0/4062026127 conn(0x7f621006c5e0 msgr2=0x7f621006c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.400+0000 7f05c4a00640 1 -- 172.21.15.19:0/1868252661 >> v2:172.21.15.42:3300/0 conn(0x7f05c00aee90 msgr2=0x7f05c01631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:28.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.400+0000 7f05c4a00640 1 --2- 172.21.15.19:0/1868252661 >> v2:172.21.15.42:3300/0 conn(0x7f05c00aee90 0x7f05c01631c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.400+0000 7f05c4a00640 1 -- 172.21.15.19:0/1868252661 >> v1:172.21.15.42:6789/0 conn(0x7f05c0071940 legacy=0x7f05c0165c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:28.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.400+0000 7f05c4a00640 1 -- 172.21.15.19:0/1868252661 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c006d500 con 0x7f05c00b44c0 2024-03-08T06:03:28.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.401+0000 7f1967e00640 1 -- 172.21.15.19:0/3536919307 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f196008e060 con 0x7f196c054100 2024-03-08T06:03:28.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.399+0000 7f80a3e00640 1 -- start start 2024-03-08T06:03:28.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.401+0000 7f1973e00640 1 --2- 172.21.15.19:0/3536919307 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f195406b4d0 0x7f195406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.399+0000 7f3361600640 1 -- 172.21.15.19:0/3168963144 >> v1:172.21.15.19:6789/0 conn(0x7f335c0b6e30 legacy=0x7f335c0d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:28.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.402+0000 7fa9c1c00640 1 -- 172.21.15.19:0/3397066678 shutdown_connections 2024-03-08T06:03:28.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.402+0000 7fa9c1c00640 1 --2- 172.21.15.19:0/3397066678 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9bc0ce150 0x7fa9bc0717d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.402+0000 7fa9c1c00640 1 --2- 172.21.15.19:0/3397066678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9bc14bbe0 0x7fa9bc0cdc10 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009870 tx=0x7fa9ac02b980 comp rx=0 tx=0).stop 2024-03-08T06:03:28.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.402+0000 7fa9c1c00640 1 -- 172.21.15.19:0/3397066678 >> 172.21.15.19:0/3397066678 conn(0x7fa9bc06ae30 msgr2=0x7fa9bc06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.402+0000 7f3361600640 1 -- 172.21.15.19:0/3168963144 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c0cef20 con 0x7f335c15df80 2024-03-08T06:03:28.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.401+0000 7f80a3e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f809c0e3300 0x7f809c0572f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.401+0000 7f80a3e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f809c053750 0x7f809c053bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.401+0000 7f80a3e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f809c054110 0x7f809c0061f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.402+0000 7f1973e00640 1 --2- 172.21.15.19:0/3536919307 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f195406b4d0 0x7f195406d990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f196803d000 tx=0x7f1968038000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.401+0000 7f80a3e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809c0e36e0 con 0x7f809c053750 2024-03-08T06:03:28.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.402+0000 7f80a3e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809c054560 con 0x7f809c054110 2024-03-08T06:03:28.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.402+0000 7f80a3e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809c057b40 con 0x7f809c0e3300 2024-03-08T06:03:28.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.402+0000 7f80a2000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f809c053750 0x7f809c053bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.402+0000 7f80a2000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f809c053750 0x7f809c053bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33668/0 (socket says 172.21.15.19:33668) 2024-03-08T06:03:28.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.402+0000 7f80a2000640 1 -- 172.21.15.19:0/1930962940 learned_addr learned my addr 172.21.15.19:0/1930962940 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:28.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.402+0000 7f6217a00640 1 -- 172.21.15.19:0/4062026127 shutdown_connections 2024-03-08T06:03:28.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.402+0000 7fa9c1c00640 1 -- 172.21.15.19:0/3397066678 shutdown_connections 2024-03-08T06:03:28.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.403+0000 7f80a2000640 1 -- 172.21.15.19:0/1930962940 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f809c0e3300 msgr2=0x7f809c0572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:28.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.403+0000 7f80a2000640 1 --2- 172.21.15.19:0/1930962940 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f809c0e3300 0x7f809c0572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.403+0000 7f80a2000640 1 -- 172.21.15.19:0/1930962940 >> v2:172.21.15.42:3300/0 conn(0x7f809c054110 msgr2=0x7f809c0061f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:28.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.403+0000 7f80a2000640 1 --2- 172.21.15.19:0/1930962940 >> v2:172.21.15.42:3300/0 conn(0x7f809c054110 0x7f809c0061f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.403+0000 7f80a2000640 1 -- 172.21.15.19:0/1930962940 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c057e20 con 0x7f809c053750 2024-03-08T06:03:28.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.403+0000 7f05c4a00640 1 --2- 172.21.15.19:0/1868252661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c00b44c0 0x7f05c0071400 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f05c00b25c0 tx=0x7f05ac02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd6fcb1237546aa server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.403+0000 7fa9c1c00640 1 -- 172.21.15.19:0/3397066678 wait complete. 2024-03-08T06:03:28.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.403+0000 7f6217a00640 1 -- 172.21.15.19:0/4062026127 wait complete. 2024-03-08T06:03:28.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.404+0000 7f3361600640 1 --2- 172.21.15.19:0/3168963144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f335c15df80 0x7f335c0ce460 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f335c0d2180 tx=0x7f335002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c72f4ad6c70d7ab server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.404+0000 7f80a2000640 1 --2- 172.21.15.19:0/1930962940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f809c053750 0x7f809c053bd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f809c059f50 tx=0x7f809002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650171c56fa4a371 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.405+0000 7f743e600640 1 Processor -- start 2024-03-08T06:03:28.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.405+0000 7fa9c1c00640 1 Processor -- start 2024-03-08T06:03:28.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.405+0000 7f743e600640 1 -- start start 2024-03-08T06:03:28.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.405+0000 7fa9c1c00640 1 -- start start 2024-03-08T06:03:28.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.406+0000 7fa9c1c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9bc0ce150 0x7fa9bc14a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.406+0000 7f6217a00640 1 Processor -- start 2024-03-08T06:03:28.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.406+0000 7fa9c1c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9bc14b560 0x7fa9bc149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.407+0000 7f743e600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f743815dd40 0x7f74381624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.407+0000 7f6217a00640 1 -- start start 2024-03-08T06:03:28.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.407+0000 7fa9c1c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9bc1456b0 0x7fa9bc0a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.407+0000 7fa9c1c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc071d10 con 0x7fa9bc14b560 2024-03-08T06:03:28.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.407+0000 7f743e600640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f74380d1080 0x7f74380d2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.407+0000 7f743e600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74380ce9e0 con 0x7f743815e120 2024-03-08T06:03:28.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.407+0000 7f743e600640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74381629f0 con 0x7f74380d1080 2024-03-08T06:03:28.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.407+0000 7f743e600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74380d1db0 con 0x7f743815dd40 2024-03-08T06:03:28.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.407+0000 7fa9c1c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc14b940 con 0x7fa9bc0ce150 2024-03-08T06:03:28.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.407+0000 7fa9c1c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9bc071e90 con 0x7fa9bc1456b0 2024-03-08T06:03:28.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.407+0000 7fa9b3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9bc14b560 0x7fa9bc149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.407+0000 7f05bfe00640 1 -- 172.21.15.19:0/1868252661 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac035020 con 0x7f05c00b44c0 2024-03-08T06:03:28.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.407+0000 7fa9b3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9bc14b560 0x7fa9bc149640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33684/0 (socket says 172.21.15.19:33684) 2024-03-08T06:03:28.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.407+0000 7fa9b3e00640 1 -- 172.21.15.19:0/364485276 learned_addr learned my addr 172.21.15.19:0/364485276 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:28.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7f335be00640 1 -- 172.21.15.19:0/3168963144 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33500315a0 con 0x7f335c15df80 2024-03-08T06:03:28.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7f05bfe00640 1 -- 172.21.15.19:0/1868252661 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac031870 con 0x7f05c00b44c0 2024-03-08T06:03:28.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7f05bfe00640 1 -- 172.21.15.19:0/1868252661 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac031c40 con 0x7f05c00b44c0 2024-03-08T06:03:28.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7f7437400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f743815dd40 0x7f74381624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7f7436a00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f743815e120 0x7f74380d0970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.19:51320/0 (socket says 172.21.15.19:51320) 2024-03-08T06:03:28.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7f7436a00640 1 -- 172.21.15.19:0/3586722851 learned_addr learned my addr 172.21.15.19:0/3586722851 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:28.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7f1967e00640 1 -- 172.21.15.19:0/3536919307 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1960057c90 con 0x7f196c054100 2024-03-08T06:03:28.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7f335be00640 1 -- 172.21.15.19:0/3168963144 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3350037070 con 0x7f335c15df80 2024-03-08T06:03:28.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7f335be00640 1 -- 172.21.15.19:0/3168963144 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3350031960 con 0x7f335c15df80 2024-03-08T06:03:28.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7f6217a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f621015df80 0x7f6210150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7f6217a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6210161ae0 0x7f62100c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7f6217a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f62100c6a40 0x7f6210156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7f6217a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62100d2490 con 0x7f6210161ae0 2024-03-08T06:03:28.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7f6217a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621015e360 con 0x7f621015df80 2024-03-08T06:03:28.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7f6217a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62100d2610 con 0x7f62100c6a40 2024-03-08T06:03:28.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7f7437e00640 1 --2- 172.21.15.19:0/3586722851 >> v2:172.21.15.19:3300/0 conn(0x7f74380d1080 0x7f74380d2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7f80a1600640 1 -- 172.21.15.19:0/1930962940 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090035020 con 0x7f809c053750 2024-03-08T06:03:28.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7f80a1600640 1 -- 172.21.15.19:0/1930962940 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8090031810 con 0x7f809c053750 2024-03-08T06:03:28.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7fa9baa00640 1 --2- 172.21.15.19:0/364485276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9bc0ce150 0x7fa9bc14a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7fa9bb400640 1 --2- 172.21.15.19:0/364485276 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9bc1456b0 0x7fa9bc0a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7fa9b3e00640 1 -- 172.21.15.19:0/364485276 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9bc1456b0 msgr2=0x7fa9bc0a84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7f7437400640 1 -- 172.21.15.19:0/3586722851 >> v2:172.21.15.19:3300/0 conn(0x7f74380d1080 msgr2=0x7f74380d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:28.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7fa9b3e00640 1 --2- 172.21.15.19:0/364485276 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9bc1456b0 0x7fa9bc0a84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7fa9b3e00640 1 -- 172.21.15.19:0/364485276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9bc0ce150 msgr2=0x7fa9bc14a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7fa9b3e00640 1 --2- 172.21.15.19:0/364485276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9bc0ce150 0x7fa9bc14a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.408+0000 7fa9b3e00640 1 -- 172.21.15.19:0/364485276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9bc149e20 con 0x7fa9bc14b560 2024-03-08T06:03:28.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7fa9b3e00640 1 --2- 172.21.15.19:0/364485276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9bc14b560 0x7fa9bc149640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac0090b0 tx=0x7fa9ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7f3364000640 1 -- 172.21.15.19:0/3168963144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f335c15df80 msgr2=0x7f335c0ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7f3364000640 1 --2- 172.21.15.19:0/3168963144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f335c15df80 0x7f335c0ce460 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f335c0d2180 tx=0x7f335002b840 comp rx=0 tx=0).stop 2024-03-08T06:03:28.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7f05c6800640 1 -- 172.21.15.19:0/1868252661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c00b44c0 msgr2=0x7f05c0071400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7f05c6800640 1 --2- 172.21.15.19:0/1868252661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c00b44c0 0x7f05c0071400 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f05c00b25c0 tx=0x7f05ac02b910 comp rx=0 tx=0).stop 2024-03-08T06:03:28.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7fa9bb400640 1 --2- 172.21.15.19:0/364485276 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9bc1456b0 0x7fa9bc0a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:28.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7f6207e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6210161ae0 0x7f62100c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7f6207e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6210161ae0 0x7f62100c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33712/0 (socket says 172.21.15.19:33712) 2024-03-08T06:03:28.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7f6207e00640 1 -- 172.21.15.19:0/2681074451 learned_addr learned my addr 172.21.15.19:0/2681074451 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:28.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7f6215000640 1 --2- 172.21.15.19:0/2681074451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f621015df80 0x7f6210150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7f6215a00640 1 --2- 172.21.15.19:0/2681074451 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f62100c6a40 0x7f6210156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7f6207e00640 1 -- 172.21.15.19:0/2681074451 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f62100c6a40 msgr2=0x7f6210156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7f6207e00640 1 --2- 172.21.15.19:0/2681074451 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f62100c6a40 0x7f6210156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7f6207e00640 1 -- 172.21.15.19:0/2681074451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f621015df80 msgr2=0x7f6210150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7f6207e00640 1 --2- 172.21.15.19:0/2681074451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f621015df80 0x7f6210150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7f6207e00640 1 -- 172.21.15.19:0/2681074451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62100c7490 con 0x7f6210161ae0 2024-03-08T06:03:28.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7f6207e00640 1 --2- 172.21.15.19:0/2681074451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6210161ae0 0x7f62100c9420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f620000b4a0 tx=0x7f620000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7f05c6800640 1 -- 172.21.15.19:0/1868252661 shutdown_connections 2024-03-08T06:03:28.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7f05c6800640 1 --2- 172.21.15.19:0/1868252661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c00b44c0 0x7f05c0071400 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7f05c6800640 1 --2- 172.21.15.19:0/1868252661 >> v2:172.21.15.42:3300/0 conn(0x7f05c00aee90 0x7f05c01631c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7f05c6800640 1 -- 172.21.15.19:0/1868252661 >> 172.21.15.19:0/1868252661 conn(0x7f05c00b1590 msgr2=0x7f05c00b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7fa9b2a00640 1 -- 172.21.15.19:0/364485276 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac034040 con 0x7fa9bc14b560 2024-03-08T06:03:28.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7fa9c1c00640 1 -- 172.21.15.19:0/364485276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9bc149b80 con 0x7fa9bc14b560 2024-03-08T06:03:28.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7fa9c1c00640 1 -- 172.21.15.19:0/364485276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9bc138ad0 con 0x7fa9bc14b560 2024-03-08T06:03:28.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7fa9b2a00640 1 -- 172.21.15.19:0/364485276 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ac030640 con 0x7fa9bc14b560 2024-03-08T06:03:28.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7fa9b2a00640 1 -- 172.21.15.19:0/364485276 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac039d80 con 0x7fa9bc14b560 2024-03-08T06:03:28.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7f620d600640 1 -- 172.21.15.19:0/2681074451 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200014070 con 0x7f6210161ae0 2024-03-08T06:03:28.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.411+0000 7f620d600640 1 -- 172.21.15.19:0/2681074451 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6200010610 con 0x7f6210161ae0 2024-03-08T06:03:28.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.411+0000 7f620d600640 1 -- 172.21.15.19:0/2681074451 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200010a00 con 0x7f6210161ae0 2024-03-08T06:03:28.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.411+0000 7f6217a00640 1 -- 172.21.15.19:0/2681074451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62100c9b20 con 0x7f6210161ae0 2024-03-08T06:03:28.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.411+0000 7f6217a00640 1 -- 172.21.15.19:0/2681074451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62100ca0e0 con 0x7f6210161ae0 2024-03-08T06:03:28.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7f05c6800640 1 -- 172.21.15.19:0/1868252661 shutdown_connections 2024-03-08T06:03:28.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7f05c6800640 1 -- 172.21.15.19:0/1868252661 wait complete. 2024-03-08T06:03:28.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7f80a1600640 1 -- 172.21.15.19:0/1930962940 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090035020 con 0x7f809c053750 2024-03-08T06:03:28.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7f80a3e00640 1 -- 172.21.15.19:0/1930962940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f809c053750 msgr2=0x7f809c053bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7f80a3e00640 1 --2- 172.21.15.19:0/1930962940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f809c053750 0x7f809c053bd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f809c059f50 tx=0x7f809002b8b0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.411+0000 7f80a3e00640 1 -- 172.21.15.19:0/1930962940 shutdown_connections 2024-03-08T06:03:28.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.411+0000 7f80a3e00640 1 --2- 172.21.15.19:0/1930962940 >> v2:172.21.15.42:3300/0 conn(0x7f809c054110 0x7f809c0061f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.411+0000 7f80a3e00640 1 --2- 172.21.15.19:0/1930962940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f809c053750 0x7f809c053bd0 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f809c059f50 tx=0x7f809002b8b0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.411+0000 7f80a3e00640 1 --2- 172.21.15.19:0/1930962940 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f809c0e3300 0x7f809c0572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.411+0000 7f80a3e00640 1 -- 172.21.15.19:0/1930962940 >> 172.21.15.19:0/1930962940 conn(0x7f809c058ef0 msgr2=0x7f809c059300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7f3364000640 1 -- 172.21.15.19:0/3168963144 shutdown_connections 2024-03-08T06:03:28.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7f3364000640 1 --2- 172.21.15.19:0/3168963144 >> v2:172.21.15.42:3300/0 conn(0x7f335c0d10e0 0x7f335c0d2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7f3364000640 1 --2- 172.21.15.19:0/3168963144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f335c15df80 0x7f335c0ce460 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7f3364000640 1 -- 172.21.15.19:0/3168963144 >> 172.21.15.19:0/3168963144 conn(0x7f335c06c5e0 msgr2=0x7f335c06c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.411+0000 7f3364000640 1 -- 172.21.15.19:0/3168963144 shutdown_connections 2024-03-08T06:03:28.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.411+0000 7f3364000640 1 -- 172.21.15.19:0/3168963144 wait complete. 2024-03-08T06:03:28.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.409+0000 7f7436000640 1 -- 172.21.15.19:0/3586722851 <== mon.1 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577215608 0 0) 0x7f74380ce9e0 con 0x7f743815e120 2024-03-08T06:03:28.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7f7437400640 1 --2- 172.21.15.19:0/3586722851 >> v2:172.21.15.19:3300/0 conn(0x7f74380d1080 0x7f74380d2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7f7437400640 1 -- 172.21.15.19:0/3586722851 >> v1:172.21.15.42:6789/0 conn(0x7f743815e120 legacy=0x7f74380d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7f7437400640 1 -- 172.21.15.19:0/3586722851 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74380cecc0 con 0x7f743815dd40 2024-03-08T06:03:28.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.412+0000 7f518ae00640 1 Processor -- start 2024-03-08T06:03:28.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.410+0000 7f7437e00640 1 --2- 172.21.15.19:0/3586722851 >> v2:172.21.15.19:3300/0 conn(0x7f74380d1080 0x7f74380d2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:28.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.412+0000 7fa9c1c00640 1 -- 172.21.15.19:0/364485276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa994005290 con 0x7fa9bc14b560 2024-03-08T06:03:28.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.412+0000 7f518ae00640 1 -- start start 2024-03-08T06:03:28.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.413+0000 7f05c6800640 1 Processor -- start 2024-03-08T06:03:28.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.413+0000 7f05c6800640 1 -- start start 2024-03-08T06:03:28.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.413+0000 7f7437400640 1 --2- 172.21.15.19:0/3586722851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f743815dd40 0x7f74381624b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f74380b67b0 tx=0x7f743002bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da502fd823ad0e82 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.414+0000 7f6217a00640 1 -- 172.21.15.19:0/2681074451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6210067cb0 con 0x7f6210161ae0 2024-03-08T06:03:28.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.413+0000 7f3364000640 1 Processor -- start 2024-03-08T06:03:28.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.414+0000 7f3364000640 1 -- start start 2024-03-08T06:03:28.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.414+0000 7f518ae00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f517c056810 0x7f517c054fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.414+0000 7f518ae00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f517c0520f0 0x7f517c039dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.415+0000 7f05c6800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c0071940 0x7f05c00b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.415+0000 7f05c6800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f05c00aee90 0x7f05c00b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.415+0000 7f05c6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c00b44c0 0x7f05c015c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.415+0000 7f518ae00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f517c03cc50 con 0x7f517c051d10 2024-03-08T06:03:28.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.415+0000 7f518ae00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517c03c970 con 0x7f517c0520f0 2024-03-08T06:03:28.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.415+0000 7f518ae00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517c055950 con 0x7f517c056810 2024-03-08T06:03:28.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.415+0000 7f518a400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f517c0520f0 0x7f517c039dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.415+0000 7f5189a00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f517c051d10 0x7f517c0548a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.19:51328/0 (socket says 172.21.15.19:51328) 2024-03-08T06:03:28.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.415+0000 7f5189a00640 1 -- 172.21.15.19:0/4012141513 learned_addr learned my addr 172.21.15.19:0/4012141513 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:28.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.415+0000 7f05c6800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c00af270 con 0x7f05c0071940 2024-03-08T06:03:28.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.415+0000 7f05c6800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c006dac0 con 0x7f05c00b44c0 2024-03-08T06:03:28.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.415+0000 7f05c6800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c00b4d10 con 0x7f05c00aee90 2024-03-08T06:03:28.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.415+0000 7f05c5400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c0071940 0x7f05c00b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.415+0000 7f5189000640 1 --2- 172.21.15.19:0/4012141513 >> v2:172.21.15.42:3300/0 conn(0x7f517c056810 0x7f517c054fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.415+0000 7f518a400640 1 -- 172.21.15.19:0/4012141513 >> v2:172.21.15.42:3300/0 conn(0x7f517c056810 msgr2=0x7f517c054fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:28.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.415+0000 7f518a400640 1 --2- 172.21.15.19:0/4012141513 >> v2:172.21.15.42:3300/0 conn(0x7f517c056810 0x7f517c054fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.415+0000 7f518a400640 1 -- 172.21.15.19:0/4012141513 >> v1:172.21.15.42:6789/0 conn(0x7f517c051d10 legacy=0x7f517c0548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.415+0000 7f518a400640 1 -- 172.21.15.19:0/4012141513 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c055c30 con 0x7f517c0520f0 2024-03-08T06:03:28.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.415+0000 7f05c5400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c0071940 0x7f05c00b0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33726/0 (socket says 172.21.15.19:33726) 2024-03-08T06:03:28.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.415+0000 7f05c5400640 1 -- 172.21.15.19:0/2461380818 learned_addr learned my addr 172.21.15.19:0/2461380818 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:28.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.416+0000 7f05c5e00640 1 --2- 172.21.15.19:0/2461380818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c00b44c0 0x7f05c015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.416+0000 7f5189000640 1 --2- 172.21.15.19:0/4012141513 >> v2:172.21.15.42:3300/0 conn(0x7f517c056810 0x7f517c054fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:28.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.416+0000 7f05c5400640 1 -- 172.21.15.19:0/2461380818 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f05c00aee90 msgr2=0x7f05c00b0980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-08T06:03:28.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.416+0000 7f05c5400640 1 --2- 172.21.15.19:0/2461380818 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f05c00aee90 0x7f05c00b0980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.416+0000 7f05c5400640 1 -- 172.21.15.19:0/2461380818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c00b44c0 msgr2=0x7f05c015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.416+0000 7f05c5400640 1 --2- 172.21.15.19:0/2461380818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c00b44c0 0x7f05c015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.416+0000 7f05c5400640 1 -- 172.21.15.19:0/2461380818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c015d4b0 con 0x7f05c0071940 2024-03-08T06:03:28.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.416+0000 7f05c5e00640 1 --2- 172.21.15.19:0/2461380818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c00b44c0 0x7f05c015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:03:28.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.416+0000 7f7436000640 1 -- 172.21.15.19:0/3586722851 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7430039070 con 0x7f743815dd40 2024-03-08T06:03:28.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.416+0000 7f7436000640 1 -- 172.21.15.19:0/3586722851 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743002cd40 con 0x7f743815dd40 2024-03-08T06:03:28.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.416+0000 7f7436000640 1 -- 172.21.15.19:0/3586722851 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7430034640 con 0x7f743815dd40 2024-03-08T06:03:28.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.416+0000 7f80a3e00640 1 -- 172.21.15.19:0/1930962940 shutdown_connections 2024-03-08T06:03:28.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.416+0000 7f05c5400640 1 --2- 172.21.15.19:0/2461380818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c0071940 0x7f05c00b0440 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f05b400e9b0 tx=0x7f05b400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.417+0000 7f80a3e00640 1 -- 172.21.15.19:0/1930962940 wait complete. 2024-03-08T06:03:28.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.417+0000 7f518a400640 1 --2- 172.21.15.19:0/4012141513 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f517c0520f0 0x7f517c039dc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5184000b60 tx=0x7f51840a6aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3749ee99507840e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.417+0000 7f3364000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f335c0d10e0 0x7f335c200110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.417+0000 7f743e600640 1 -- 172.21.15.19:0/3586722851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f743815dd40 msgr2=0x7f74381624b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.417+0000 7f743e600640 1 --2- 172.21.15.19:0/3586722851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f743815dd40 0x7f74381624b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f74380b67b0 tx=0x7f743002bf90 comp rx=0 tx=0).stop 2024-03-08T06:03:28.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.417+0000 7f3364000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f335c15df80 0x7f335c0cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.417+0000 7f3364000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f335c0c9270 0x7f335c0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.418+0000 7f3362000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f335c0c9270 0x7f335c0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.418+0000 7f3360c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f335c15df80 0x7f335c0cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.418+0000 7f3362000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f335c0c9270 0x7f335c0c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33742/0 (socket says 172.21.15.19:33742) 2024-03-08T06:03:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.418+0000 7f3360c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f335c15df80 0x7f335c0cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.19:49838/0 (socket says 172.21.15.19:49838) 2024-03-08T06:03:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.418+0000 7f3361600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f335c0d10e0 0x7f335c200110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.418+0000 7f3360c00640 1 -- 172.21.15.19:0/337301439 learned_addr learned my addr 172.21.15.19:0/337301439 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.418+0000 7f3364000640 1 -- 172.21.15.19:0/337301439 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c161ae0 con 0x7f335c0c9270 2024-03-08T06:03:28.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.419+0000 7f3364000640 1 -- 172.21.15.19:0/337301439 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c15e360 con 0x7f335c0d10e0 2024-03-08T06:03:28.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.419+0000 7f743e600640 1 -- 172.21.15.19:0/3586722851 shutdown_connections 2024-03-08T06:03:28.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.419+0000 7f743e600640 1 --2- 172.21.15.19:0/3586722851 >> v2:172.21.15.19:3300/0 conn(0x7f74380d1080 0x7f74380d2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.419+0000 7f3364000640 1 -- 172.21.15.19:0/337301439 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335c161c60 con 0x7f335c15df80 2024-03-08T06:03:28.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.419+0000 7f743e600640 1 --2- 172.21.15.19:0/3586722851 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f743815dd40 0x7f74381624b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.419+0000 7f743e600640 1 -- 172.21.15.19:0/3586722851 >> 172.21.15.19:0/3586722851 conn(0x7f743806c5e0 msgr2=0x7f743806c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.420+0000 7f80a3e00640 1 Processor -- start 2024-03-08T06:03:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.419+0000 7f3362000640 1 -- 172.21.15.19:0/337301439 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f335c15df80 msgr2=0x7f335c0cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.419+0000 7f3362000640 1 --2- 172.21.15.19:0/337301439 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f335c15df80 0x7f335c0cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.419+0000 7f3362000640 1 -- 172.21.15.19:0/337301439 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f335c0d10e0 msgr2=0x7f335c200110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.419+0000 7f3362000640 1 --2- 172.21.15.19:0/337301439 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f335c0d10e0 0x7f335c200110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.419+0000 7f3362000640 1 -- 172.21.15.19:0/337301439 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c0720a0 con 0x7f335c0c9270 2024-03-08T06:03:28.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.420+0000 7f743e600640 1 -- 172.21.15.19:0/3586722851 shutdown_connections 2024-03-08T06:03:28.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.420+0000 7f743e600640 1 -- 172.21.15.19:0/3586722851 wait complete. 2024-03-08T06:03:28.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.420+0000 7f3362000640 1 --2- 172.21.15.19:0/337301439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f335c0c9270 0x7f335c0c9700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3354009d90 tx=0x7f335400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.420+0000 7f3360c00640 1 --2- 172.21.15.19:0/337301439 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f335c15df80 0x7f335c0cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:28.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.420+0000 7f3361600640 1 --2- 172.21.15.19:0/337301439 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f335c0d10e0 0x7f335c200110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:28.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.420+0000 7f80a3e00640 1 -- start start 2024-03-08T06:03:28.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.421+0000 7f80a3e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f809c054110 0x7f809c16b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.421+0000 7f80a3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f809c0e3300 0x7f809c16bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.421+0000 7f80a3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f809c052670 0x7f809c0d3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.421+0000 7f80a3e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c057830 con 0x7f809c0e3300 2024-03-08T06:03:28.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.421+0000 7f80a3e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c0583e0 con 0x7f809c052670 2024-03-08T06:03:28.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.421+0000 7f80a3e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809c058be0 con 0x7f809c054110 2024-03-08T06:03:28.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.421+0000 7f80a2000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f809c0e3300 0x7f809c16bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.421+0000 7f80a2a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f809c054110 0x7f809c16b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.422+0000 7f80a2a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f809c054110 0x7f809c16b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.19:49850/0 (socket says 172.21.15.19:49850) 2024-03-08T06:03:28.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.422+0000 7f80a2a00640 1 -- 172.21.15.19:0/196041165 learned_addr learned my addr 172.21.15.19:0/196041165 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:28.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.422+0000 7f80a3400640 1 --2- 172.21.15.19:0/196041165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f809c052670 0x7f809c0d3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.422+0000 7f80a2000640 1 -- 172.21.15.19:0/196041165 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f809c054110 msgr2=0x7f809c16b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.422+0000 7f80a2000640 1 --2- 172.21.15.19:0/196041165 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f809c054110 0x7f809c16b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.422+0000 7f80a2000640 1 -- 172.21.15.19:0/196041165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f809c052670 msgr2=0x7f809c0d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.422+0000 7f80a2000640 1 --2- 172.21.15.19:0/196041165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f809c052670 0x7f809c0d3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.422+0000 7f80a2000640 1 -- 172.21.15.19:0/196041165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c0515d0 con 0x7f809c0e3300 2024-03-08T06:03:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.422+0000 7f743e600640 1 Processor -- start 2024-03-08T06:03:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.423+0000 7f743e600640 1 -- start start 2024-03-08T06:03:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.423+0000 7f80a2000640 1 --2- 172.21.15.19:0/196041165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f809c0e3300 0x7f809c16bdf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8090033000 tx=0x7f80900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.423+0000 7f620d600640 1 -- 172.21.15.19:0/2681074451 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6200017070 con 0x7f6210161ae0 2024-03-08T06:03:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.422+0000 7fa9b2a00640 1 -- 172.21.15.19:0/364485276 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa9ac04a060 con 0x7fa9bc14b560 2024-03-08T06:03:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.424+0000 7f620d600640 1 --2- 172.21.15.19:0/2681074451 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f61ec06b4d0 0x7f61ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.424+0000 7f620d600640 1 -- 172.21.15.19:0/2681074451 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f620008a020 con 0x7f6210161ae0 2024-03-08T06:03:28.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.424+0000 7f3359600640 1 -- 172.21.15.19:0/337301439 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3354018020 con 0x7f335c0c9270 2024-03-08T06:03:28.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.424+0000 7f809aa00640 1 -- 172.21.15.19:0/196041165 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090031e40 con 0x7f809c0e3300 2024-03-08T06:03:28.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.424+0000 7f80a3e00640 1 -- 172.21.15.19:0/196041165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809c0518b0 con 0x7f809c0e3300 2024-03-08T06:03:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.425+0000 7f3364000640 1 -- 172.21.15.19:0/337301439 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f335c200650 con 0x7f335c0c9270 2024-03-08T06:03:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.425+0000 7f80a3e00640 1 -- 172.21.15.19:0/196041165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809c051e70 con 0x7f809c0e3300 2024-03-08T06:03:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.425+0000 7f3364000640 1 -- 172.21.15.19:0/337301439 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335c0cbda0 con 0x7f335c0c9270 2024-03-08T06:03:28.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.425+0000 7fa9b2a00640 1 --2- 172.21.15.19:0/364485276 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa99806b5a0 0x7fa99806da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.425+0000 7fa9b2a00640 1 -- 172.21.15.19:0/364485276 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9ac0abbe0 con 0x7fa9bc14b560 2024-03-08T06:03:28.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.426+0000 7fa9baa00640 1 --2- 172.21.15.19:0/364485276 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa99806b5a0 0x7fa99806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.426+0000 7fa9b2a00640 1 -- 172.21.15.19:0/364485276 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa9bc149e20 con 0x7fa9bc14b560 2024-03-08T06:03:28.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.425+0000 7f743e600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74380d1080 0x7f74381f7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.425+0000 7f743e600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f743815dd40 0x7f7438070d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.425+0000 7f743e600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f743815e120 0x7f74380712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.425+0000 7f743e600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74380ce420 con 0x7f743815dd40 2024-03-08T06:03:28.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.425+0000 7f743e600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74380cf280 con 0x7f743815e120 2024-03-08T06:03:28.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.425+0000 7f743e600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74380ce5a0 con 0x7f74380d1080 2024-03-08T06:03:28.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.425+0000 7f7436a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f743815dd40 0x7f7438070d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.425+0000 7f7436a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f743815dd40 0x7f7438070d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33758/0 (socket says 172.21.15.19:33758) 2024-03-08T06:03:28.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.425+0000 7f7436a00640 1 -- 172.21.15.19:0/2501616372 learned_addr learned my addr 172.21.15.19:0/2501616372 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:28.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.425+0000 7f7437e00640 1 --2- 172.21.15.19:0/2501616372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f743815e120 0x7f74380712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.426+0000 7f7436a00640 1 -- 172.21.15.19:0/2501616372 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74380d1080 msgr2=0x7f74381f7fd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-08T06:03:28.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.426+0000 7f7436a00640 1 --2- 172.21.15.19:0/2501616372 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74380d1080 0x7f74381f7fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.426+0000 7f7436a00640 1 -- 172.21.15.19:0/2501616372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f743815e120 msgr2=0x7f74380712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.426+0000 7f7436a00640 1 --2- 172.21.15.19:0/2501616372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f743815e120 0x7f74380712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.426+0000 7f7436a00640 1 -- 172.21.15.19:0/2501616372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7438160f10 con 0x7f743815dd40 2024-03-08T06:03:28.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.426+0000 7f80a3e00640 1 -- 172.21.15.19:0/196041165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f809c005710 con 0x7f809c0e3300 2024-03-08T06:03:28.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.427+0000 7f05bd600640 1 -- 172.21.15.19:0/2461380818 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4017070 con 0x7f05c0071940 2024-03-08T06:03:28.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.426+0000 7f3364000640 1 -- 172.21.15.19:0/337301439 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f335c067cb0 con 0x7f335c0c9270 2024-03-08T06:03:28.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.426+0000 7f6215000640 1 --2- 172.21.15.19:0/2681074451 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f61ec06b4d0 0x7f61ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.427+0000 7f7436a00640 1 --2- 172.21.15.19:0/2501616372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f743815dd40 0x7f7438070d70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f742000c4e0 tx=0x7f742000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.427+0000 7f05c6800640 1 -- 172.21.15.19:0/2461380818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c0157e60 con 0x7f05c0071940 2024-03-08T06:03:28.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.427+0000 7f05c6800640 1 -- 172.21.15.19:0/2461380818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c0158420 con 0x7f05c0071940 2024-03-08T06:03:28.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.428+0000 7f6215000640 1 --2- 172.21.15.19:0/2681074451 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f61ec06b4d0 0x7f61ec06d990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f61f80017f0 tx=0x7f61f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.428+0000 7fa9baa00640 1 --2- 172.21.15.19:0/364485276 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa99806b5a0 0x7fa99806da60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa9a40011e0 tx=0x7fa9a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.428+0000 7f05c6800640 1 -- 172.21.15.19:0/2461380818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c0075090 con 0x7f05c0071940 2024-03-08T06:03:28.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.433+0000 7f3359600640 1 -- 172.21.15.19:0/337301439 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3354014480 con 0x7f335c0c9270 2024-03-08T06:03:28.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.433+0000 7f3359600640 1 -- 172.21.15.19:0/337301439 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3354014830 con 0x7f335c0c9270 2024-03-08T06:03:28.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.433+0000 7f5183e00640 1 -- 172.21.15.19:0/4012141513 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51840aa920 con 0x7f517c0520f0 2024-03-08T06:03:28.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.433+0000 7f5183e00640 1 -- 172.21.15.19:0/4012141513 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51840aaac0 con 0x7f517c0520f0 2024-03-08T06:03:28.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.433+0000 7f5183e00640 1 -- 172.21.15.19:0/4012141513 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51840b2400 con 0x7f517c0520f0 2024-03-08T06:03:28.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.433+0000 7f620d600640 1 -- 172.21.15.19:0/2681074451 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6200058830 con 0x7f6210161ae0 2024-03-08T06:03:28.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.434+0000 7f518ae00640 1 -- 172.21.15.19:0/4012141513 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f517c0520f0 msgr2=0x7f517c039dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.433+0000 7f05bd600640 1 -- 172.21.15.19:0/2461380818 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b400c9a0 con 0x7f05c0071940 2024-03-08T06:03:28.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.433+0000 7f05bd600640 1 -- 172.21.15.19:0/2461380818 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b4021060 con 0x7f05c0071940 2024-03-08T06:03:28.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.434+0000 7f518ae00640 1 --2- 172.21.15.19:0/4012141513 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f517c0520f0 0x7f517c039dc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5184000b60 tx=0x7f51840a6aa0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.434+0000 7f518ae00640 1 -- 172.21.15.19:0/4012141513 shutdown_connections 2024-03-08T06:03:28.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.434+0000 7f518ae00640 1 --2- 172.21.15.19:0/4012141513 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f517c0520f0 0x7f517c039dc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.434+0000 7f518ae00640 1 --2- 172.21.15.19:0/4012141513 >> v2:172.21.15.42:3300/0 conn(0x7f517c056810 0x7f517c054fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.434+0000 7f742f400640 1 -- 172.21.15.19:0/2501616372 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7420029070 con 0x7f743815dd40 2024-03-08T06:03:28.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.435+0000 7f518ae00640 1 -- 172.21.15.19:0/4012141513 >> 172.21.15.19:0/4012141513 conn(0x7f517c053750 msgr2=0x7f517c053b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.435+0000 7f743e600640 1 -- 172.21.15.19:0/2501616372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743806e4b0 con 0x7f743815dd40 2024-03-08T06:03:28.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.435+0000 7f743e600640 1 -- 172.21.15.19:0/2501616372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743806ea70 con 0x7f743815dd40 2024-03-08T06:03:28.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.435+0000 7f518ae00640 1 -- 172.21.15.19:0/4012141513 shutdown_connections 2024-03-08T06:03:28.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.435+0000 7f742f400640 1 -- 172.21.15.19:0/2501616372 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74200072e0 con 0x7f743815dd40 2024-03-08T06:03:28.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.435+0000 7f742f400640 1 -- 172.21.15.19:0/2501616372 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74200047e0 con 0x7f743815dd40 2024-03-08T06:03:28.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.435+0000 7f518ae00640 1 -- 172.21.15.19:0/4012141513 wait complete. 2024-03-08T06:03:28.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.437+0000 7f743e600640 1 -- 172.21.15.19:0/2501616372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74380b9270 con 0x7f743815dd40 2024-03-08T06:03:28.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.436+0000 7f3359600640 1 -- 172.21.15.19:0/337301439 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3354005d10 con 0x7f335c0c9270 2024-03-08T06:03:28.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.439+0000 7f3359600640 1 --2- 172.21.15.19:0/337301439 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f333c06b500 0x7f333c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.437+0000 7f05bd600640 1 -- 172.21.15.19:0/2461380818 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f05b401a070 con 0x7f05c0071940 2024-03-08T06:03:28.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.439+0000 7f518ae00640 1 Processor -- start 2024-03-08T06:03:28.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.439+0000 7f3359600640 1 -- 172.21.15.19:0/337301439 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f335408b4d0 con 0x7f335c0c9270 2024-03-08T06:03:28.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.439+0000 7f05bd600640 1 --2- 172.21.15.19:0/2461380818 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f05a006b4d0 0x7f05a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.439+0000 7f518ae00640 1 -- start start 2024-03-08T06:03:28.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.439+0000 7f05bd600640 1 -- 172.21.15.19:0/2461380818 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05b408a9f0 con 0x7f05c0071940 2024-03-08T06:03:28.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.440+0000 7f05c4a00640 1 --2- 172.21.15.19:0/2461380818 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f05a006b4d0 0x7f05a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.440+0000 7f3361600640 1 --2- 172.21.15.19:0/337301439 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f333c06b500 0x7f333c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.441+0000 7f518ae00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f517c051d10 0x7f517c030990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.441+0000 7f518ae00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f517c0520f0 0x7f517c0de9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.441+0000 7f518ae00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f517c056810 0x7f517c02f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.442+0000 7f5189a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f517c051d10 0x7f517c030990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.442+0000 7f518ae00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c056430 con 0x7f517c051d10 2024-03-08T06:03:28.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.442+0000 7f5189a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f517c051d10 0x7f517c030990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33768/0 (socket says 172.21.15.19:33768) 2024-03-08T06:03:28.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.442+0000 7f5189a00640 1 -- 172.21.15.19:0/763681970 learned_addr learned my addr 172.21.15.19:0/763681970 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:28.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.442+0000 7f518ae00640 1 -- 172.21.15.19:0/763681970 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c03c640 con 0x7f517c0520f0 2024-03-08T06:03:28.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.442+0000 7f518ae00640 1 -- 172.21.15.19:0/763681970 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517c0554f0 con 0x7f517c056810 2024-03-08T06:03:28.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.442+0000 7f5189000640 1 --2- 172.21.15.19:0/763681970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f517c0520f0 0x7f517c0de9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.442+0000 7f518a400640 1 --2- 172.21.15.19:0/763681970 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f517c056810 0x7f517c02f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.442+0000 7f809aa00640 1 -- 172.21.15.19:0/196041165 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8090031810 con 0x7f809c0e3300 2024-03-08T06:03:28.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.442+0000 7f809aa00640 1 -- 172.21.15.19:0/196041165 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090003c40 con 0x7f809c0e3300 2024-03-08T06:03:28.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.442+0000 7f809aa00640 1 -- 172.21.15.19:0/196041165 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8090038020 con 0x7f809c0e3300 2024-03-08T06:03:28.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.443+0000 7f5189a00640 1 -- 172.21.15.19:0/763681970 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f517c056810 msgr2=0x7f517c02f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.443+0000 7f5189a00640 1 --2- 172.21.15.19:0/763681970 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f517c056810 0x7f517c02f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.443+0000 7f5189a00640 1 -- 172.21.15.19:0/763681970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f517c0520f0 msgr2=0x7f517c0de9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.443+0000 7f5189a00640 1 --2- 172.21.15.19:0/763681970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f517c0520f0 0x7f517c0de9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.443+0000 7f3361600640 1 --2- 172.21.15.19:0/337301439 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f333c06b500 0x7f333c06d9c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3350036000 tx=0x7f3350008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.443+0000 7f05c4a00640 1 --2- 172.21.15.19:0/2461380818 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f05a006b4d0 0x7f05a006d990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f05ac036000 tx=0x7f05ac008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.443+0000 7f5189a00640 1 -- 172.21.15.19:0/763681970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c02f8f0 con 0x7f517c051d10 2024-03-08T06:03:28.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.443+0000 7f5189a00640 1 --2- 172.21.15.19:0/763681970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f517c051d10 0x7f517c030990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f517800c4a0 tx=0x7f517800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.444+0000 7f809aa00640 1 --2- 172.21.15.19:0/196041165 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f808406b530 0x7f808406d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.445+0000 7f809aa00640 1 -- 172.21.15.19:0/196041165 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80900ac870 con 0x7f809c0e3300 2024-03-08T06:03:28.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.445+0000 7f05bd600640 1 -- 172.21.15.19:0/2461380818 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f05b40598e0 con 0x7f05c0071940 2024-03-08T06:03:28.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.445+0000 7f80a2a00640 1 --2- 172.21.15.19:0/196041165 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f808406b530 0x7f808406d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.446+0000 7f80a2a00640 1 --2- 172.21.15.19:0/196041165 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f808406b530 0x7f808406d9f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f80940099a0 tx=0x7f8094006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.450+0000 7f3359600640 1 -- 172.21.15.19:0/337301439 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3354022030 con 0x7f335c0c9270 2024-03-08T06:03:28.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.454+0000 7f5181600640 1 -- 172.21.15.19:0/763681970 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5178017070 con 0x7f517c051d10 2024-03-08T06:03:28.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.455+0000 7f809aa00640 1 -- 172.21.15.19:0/196041165 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f809004b060 con 0x7f809c0e3300 2024-03-08T06:03:28.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.454+0000 7f5181600640 1 -- 172.21.15.19:0/763681970 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5178005ce0 con 0x7f517c051d10 2024-03-08T06:03:28.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.454+0000 7f5181600640 1 -- 172.21.15.19:0/763681970 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5178007270 con 0x7f517c051d10 2024-03-08T06:03:28.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.455+0000 7f518ae00640 1 -- 172.21.15.19:0/763681970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517c02fbd0 con 0x7f517c051d10 2024-03-08T06:03:28.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.455+0000 7f518ae00640 1 -- 172.21.15.19:0/763681970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517c030190 con 0x7f517c051d10 2024-03-08T06:03:28.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.456+0000 7f742f400640 1 -- 172.21.15.19:0/2501616372 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f742002c070 con 0x7f743815dd40 2024-03-08T06:03:28.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.457+0000 7f518ae00640 1 -- 172.21.15.19:0/763681970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517c005710 con 0x7f517c051d10 2024-03-08T06:03:28.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.458+0000 7f742f400640 1 --2- 172.21.15.19:0/2501616372 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f741406b4d0 0x7f741406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.458+0000 7f742f400640 1 -- 172.21.15.19:0/2501616372 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f742009a6b0 con 0x7f743815dd40 2024-03-08T06:03:28.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.459+0000 7f7437400640 1 --2- 172.21.15.19:0/2501616372 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f741406b4d0 0x7f741406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.461+0000 7f7437400640 1 --2- 172.21.15.19:0/2501616372 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f741406b4d0 0x7f741406d990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7430036000 tx=0x7f7430030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.464+0000 7f742f400640 1 -- 172.21.15.19:0/2501616372 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f74380b9270 con 0x7f743815dd40 2024-03-08T06:03:28.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.468+0000 7f5181600640 1 -- 172.21.15.19:0/763681970 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f517801a070 con 0x7f517c051d10 2024-03-08T06:03:28.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.469+0000 7f5181600640 1 --2- 172.21.15.19:0/763681970 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f516406b520 0x7f516406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:28.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.470+0000 7f5181600640 1 -- 172.21.15.19:0/763681970 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51780899f0 con 0x7f517c051d10 2024-03-08T06:03:28.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.473+0000 7f5189000640 1 --2- 172.21.15.19:0/763681970 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f516406b520 0x7f516406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:28.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.475+0000 7f5189000640 1 --2- 172.21.15.19:0/763681970 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f516406b520 0x7f516406d9e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f517c039730 tx=0x7f5170008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:28.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.476+0000 7f5181600640 1 -- 172.21.15.19:0/763681970 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5178058200 con 0x7f517c051d10 2024-03-08T06:03:28.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.841+0000 7f197b200640 1 -- 172.21.15.19:0/3536919307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f196c03d2f0 con 0x7f196c054100 2024-03-08T06:03:28.845 INFO:teuthology.orchestra.run.smithi019.stdout:55834574854 2024-03-08T06:03:28.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.841+0000 7f1967e00640 1 -- 172.21.15.19:0/3536919307 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f196005bd30 con 0x7f196c054100 2024-03-08T06:03:28.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.846+0000 7f1965600640 1 -- 172.21.15.19:0/3536919307 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f195406b4d0 msgr2=0x7f195406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.846+0000 7f1965600640 1 --2- 172.21.15.19:0/3536919307 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f195406b4d0 0x7f195406d990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f196803d000 tx=0x7f1968038000 comp rx=0 tx=0).stop 2024-03-08T06:03:28.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.846+0000 7f1965600640 1 -- 172.21.15.19:0/3536919307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c054100 msgr2=0x7f196c0d3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.846+0000 7f1965600640 1 --2- 172.21.15.19:0/3536919307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c054100 0x7f196c0d3cb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f196000b440 tx=0x7f196000b900 comp rx=0 tx=0).stop 2024-03-08T06:03:28.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.847+0000 7f1965600640 1 -- 172.21.15.19:0/3536919307 shutdown_connections 2024-03-08T06:03:28.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.847+0000 7f1965600640 1 --2- 172.21.15.19:0/3536919307 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f195406b4d0 0x7f195406d990 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.847+0000 7f1965600640 1 --2- 172.21.15.19:0/3536919307 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f196c0e32f0 0x7f196c050a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.847+0000 7f1965600640 1 --2- 172.21.15.19:0/3536919307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c054100 0x7f196c0d3cb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.847+0000 7f1965600640 1 --2- 172.21.15.19:0/3536919307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f196c053740 0x7f196c0dd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.847+0000 7f1965600640 1 -- 172.21.15.19:0/3536919307 >> 172.21.15.19:0/3536919307 conn(0x7f196c058ee0 msgr2=0x7f196c03d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.848+0000 7f1965600640 1 -- 172.21.15.19:0/3536919307 shutdown_connections 2024-03-08T06:03:28.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.848+0000 7f1965600640 1 -- 172.21.15.19:0/3536919307 wait complete. 2024-03-08T06:03:28.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.856+0000 7f6217a00640 1 -- 172.21.15.19:0/2681074451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6210072160 con 0x7f6210161ae0 2024-03-08T06:03:28.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.857+0000 7f620d600640 1 -- 172.21.15.19:0/2681074451 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f620005c8d0 con 0x7f6210161ae0 2024-03-08T06:03:28.859 INFO:teuthology.orchestra.run.smithi019.stdout:55834574854 2024-03-08T06:03:28.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.859+0000 7fa9c1c00640 1 -- 172.21.15.19:0/364485276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa994005850 con 0x7fa9bc14b560 2024-03-08T06:03:28.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.860+0000 7fa9b2a00640 1 -- 172.21.15.19:0/364485276 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa9ac07aad0 con 0x7fa9bc14b560 2024-03-08T06:03:28.864 INFO:teuthology.orchestra.run.smithi019.stdout:55834574852 2024-03-08T06:03:28.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.861+0000 7f6217a00640 1 -- 172.21.15.19:0/2681074451 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f61ec06b4d0 msgr2=0x7f61ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.861+0000 7f6217a00640 1 --2- 172.21.15.19:0/2681074451 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f61ec06b4d0 0x7f61ec06d990 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f61f80017f0 tx=0x7f61f8009040 comp rx=0 tx=0).stop 2024-03-08T06:03:28.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.861+0000 7f6217a00640 1 -- 172.21.15.19:0/2681074451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6210161ae0 msgr2=0x7f62100c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.861+0000 7f6217a00640 1 --2- 172.21.15.19:0/2681074451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6210161ae0 0x7f62100c9420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f620000b4a0 tx=0x7f620000b960 comp rx=0 tx=0).stop 2024-03-08T06:03:28.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.862+0000 7f6217a00640 1 -- 172.21.15.19:0/2681074451 shutdown_connections 2024-03-08T06:03:28.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.862+0000 7f6217a00640 1 --2- 172.21.15.19:0/2681074451 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f61ec06b4d0 0x7f61ec06d990 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.862+0000 7f6217a00640 1 --2- 172.21.15.19:0/2681074451 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f62100c6a40 0x7f6210156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.862+0000 7f6217a00640 1 --2- 172.21.15.19:0/2681074451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6210161ae0 0x7f62100c9420 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.862+0000 7f6217a00640 1 --2- 172.21.15.19:0/2681074451 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f621015df80 0x7f6210150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.862+0000 7f6217a00640 1 -- 172.21.15.19:0/2681074451 >> 172.21.15.19:0/2681074451 conn(0x7f621006c5e0 msgr2=0x7f62100b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.862+0000 7f6217a00640 1 -- 172.21.15.19:0/2681074451 shutdown_connections 2024-03-08T06:03:28.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.862+0000 7f6217a00640 1 -- 172.21.15.19:0/2681074451 wait complete. 2024-03-08T06:03:28.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.865+0000 7fa9abe00640 1 -- 172.21.15.19:0/364485276 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa99806b5a0 msgr2=0x7fa99806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.865+0000 7fa9abe00640 1 --2- 172.21.15.19:0/364485276 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa99806b5a0 0x7fa99806da60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa9a40011e0 tx=0x7fa9a4009040 comp rx=0 tx=0).stop 2024-03-08T06:03:28.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.865+0000 7fa9abe00640 1 -- 172.21.15.19:0/364485276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9bc14b560 msgr2=0x7fa9bc149640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.865+0000 7fa9abe00640 1 --2- 172.21.15.19:0/364485276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9bc14b560 0x7fa9bc149640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac0090b0 tx=0x7fa9ac004730 comp rx=0 tx=0).stop 2024-03-08T06:03:28.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.868+0000 7fa9abe00640 1 -- 172.21.15.19:0/364485276 shutdown_connections 2024-03-08T06:03:28.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.868+0000 7fa9abe00640 1 --2- 172.21.15.19:0/364485276 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa99806b5a0 0x7fa99806da60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.868+0000 7fa9abe00640 1 --2- 172.21.15.19:0/364485276 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9bc1456b0 0x7fa9bc0a84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.868+0000 7fa9abe00640 1 --2- 172.21.15.19:0/364485276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9bc14b560 0x7fa9bc149640 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.868+0000 7fa9abe00640 1 --2- 172.21.15.19:0/364485276 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9bc0ce150 0x7fa9bc14a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.868+0000 7fa9abe00640 1 -- 172.21.15.19:0/364485276 >> 172.21.15.19:0/364485276 conn(0x7fa9bc06ae30 msgr2=0x7fa9bc0cf180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.869+0000 7fa9abe00640 1 -- 172.21.15.19:0/364485276 shutdown_connections 2024-03-08T06:03:28.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.869+0000 7fa9abe00640 1 -- 172.21.15.19:0/364485276 wait complete. 2024-03-08T06:03:28.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-03-08T06:03:28.876 DEBUG:teuthology.parallel:result is None 2024-03-08T06:03:28.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.879+0000 7f3364000640 1 -- 172.21.15.19:0/337301439 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f335c0d43e0 con 0x7f335c0c9270 2024-03-08T06:03:28.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.880+0000 7f3359600640 1 -- 172.21.15.19:0/337301439 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3354010040 con 0x7f335c0c9270 2024-03-08T06:03:28.884 INFO:teuthology.orchestra.run.smithi019.stdout:55834574852 2024-03-08T06:03:28.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.883+0000 7f3364000640 1 -- 172.21.15.19:0/337301439 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f333c06b500 msgr2=0x7f333c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.883+0000 7f3364000640 1 --2- 172.21.15.19:0/337301439 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f333c06b500 0x7f333c06d9c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3350036000 tx=0x7f3350008030 comp rx=0 tx=0).stop 2024-03-08T06:03:28.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.883+0000 7f3364000640 1 -- 172.21.15.19:0/337301439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f335c0c9270 msgr2=0x7f335c0c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.883+0000 7f3364000640 1 --2- 172.21.15.19:0/337301439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f335c0c9270 0x7f335c0c9700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3354009d90 tx=0x7f335400c490 comp rx=0 tx=0).stop 2024-03-08T06:03:28.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-03-08T06:03:28.886 DEBUG:teuthology.parallel:result is None 2024-03-08T06:03:28.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.884+0000 7f3364000640 1 -- 172.21.15.19:0/337301439 shutdown_connections 2024-03-08T06:03:28.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.884+0000 7f3364000640 1 --2- 172.21.15.19:0/337301439 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f333c06b500 0x7f333c06d9c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.884+0000 7f3364000640 1 --2- 172.21.15.19:0/337301439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f335c0c9270 0x7f335c0c9700 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.884+0000 7f3364000640 1 --2- 172.21.15.19:0/337301439 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f335c15df80 0x7f335c0cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.884+0000 7f3364000640 1 --2- 172.21.15.19:0/337301439 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f335c0d10e0 0x7f335c200110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.884+0000 7f3364000640 1 -- 172.21.15.19:0/337301439 >> 172.21.15.19:0/337301439 conn(0x7f335c06c5e0 msgr2=0x7f335c160310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.884+0000 7f3364000640 1 -- 172.21.15.19:0/337301439 shutdown_connections 2024-03-08T06:03:28.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.884+0000 7f3364000640 1 -- 172.21.15.19:0/337301439 wait complete. 2024-03-08T06:03:28.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.887+0000 7f05c6800640 1 -- 172.21.15.19:0/2461380818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f05c00723b0 con 0x7f05c0071940 2024-03-08T06:03:28.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.887+0000 7f05bd600640 1 -- 172.21.15.19:0/2461380818 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f05b40591e0 con 0x7f05c0071940 2024-03-08T06:03:28.889 INFO:teuthology.orchestra.run.smithi019.stdout:55834574852 2024-03-08T06:03:28.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.890+0000 7f05c6800640 1 -- 172.21.15.19:0/2461380818 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f05a006b4d0 msgr2=0x7f05a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.890+0000 7f05c6800640 1 --2- 172.21.15.19:0/2461380818 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f05a006b4d0 0x7f05a006d990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f05ac036000 tx=0x7f05ac008030 comp rx=0 tx=0).stop 2024-03-08T06:03:28.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.890+0000 7f05c6800640 1 -- 172.21.15.19:0/2461380818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c0071940 msgr2=0x7f05c00b0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.890+0000 7f05c6800640 1 --2- 172.21.15.19:0/2461380818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c0071940 0x7f05c00b0440 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f05b400e9b0 tx=0x7f05b400ee70 comp rx=0 tx=0).stop 2024-03-08T06:03:28.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.890+0000 7f05c6800640 1 -- 172.21.15.19:0/2461380818 shutdown_connections 2024-03-08T06:03:28.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.890+0000 7f05c6800640 1 --2- 172.21.15.19:0/2461380818 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f05a006b4d0 0x7f05a006d990 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.890+0000 7f05c6800640 1 --2- 172.21.15.19:0/2461380818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05c00b44c0 0x7f05c015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.890+0000 7f05c6800640 1 --2- 172.21.15.19:0/2461380818 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f05c00aee90 0x7f05c00b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.890+0000 7f05c6800640 1 --2- 172.21.15.19:0/2461380818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05c0071940 0x7f05c00b0440 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.890+0000 7f05c6800640 1 -- 172.21.15.19:0/2461380818 >> 172.21.15.19:0/2461380818 conn(0x7f05c00b1590 msgr2=0x7f05c0156260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.891+0000 7f05c6800640 1 -- 172.21.15.19:0/2461380818 shutdown_connections 2024-03-08T06:03:28.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.891+0000 7f05c6800640 1 -- 172.21.15.19:0/2461380818 wait complete. 2024-03-08T06:03:28.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2024-03-08T06:03:28.893 DEBUG:teuthology.parallel:result is None 2024-03-08T06:03:28.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.895+0000 7f80a3e00640 1 -- 172.21.15.19:0/196041165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f809c0520b0 con 0x7f809c0e3300 2024-03-08T06:03:28.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.895+0000 7f809aa00640 1 -- 172.21.15.19:0/196041165 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f809007b760 con 0x7f809c0e3300 2024-03-08T06:03:28.896 INFO:teuthology.orchestra.run.smithi019.stdout:55834574854 2024-03-08T06:03:28.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.898+0000 7f80a3e00640 1 -- 172.21.15.19:0/196041165 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f808406b530 msgr2=0x7f808406d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.898+0000 7f80a3e00640 1 --2- 172.21.15.19:0/196041165 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f808406b530 0x7f808406d9f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f80940099a0 tx=0x7f8094006f90 comp rx=0 tx=0).stop 2024-03-08T06:03:28.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.898+0000 7f80a3e00640 1 -- 172.21.15.19:0/196041165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f809c0e3300 msgr2=0x7f809c16bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.898+0000 7f80a3e00640 1 --2- 172.21.15.19:0/196041165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f809c0e3300 0x7f809c16bdf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8090033000 tx=0x7f80900046c0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.898+0000 7f80a3e00640 1 -- 172.21.15.19:0/196041165 shutdown_connections 2024-03-08T06:03:28.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.898+0000 7f80a3e00640 1 --2- 172.21.15.19:0/196041165 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f808406b530 0x7f808406d9f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.898+0000 7f80a3e00640 1 --2- 172.21.15.19:0/196041165 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f809c052670 0x7f809c0d3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.898+0000 7f80a3e00640 1 --2- 172.21.15.19:0/196041165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f809c0e3300 0x7f809c16bdf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.898+0000 7f80a3e00640 1 --2- 172.21.15.19:0/196041165 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f809c054110 0x7f809c16b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.898+0000 7f80a3e00640 1 -- 172.21.15.19:0/196041165 >> 172.21.15.19:0/196041165 conn(0x7f809c058ef0 msgr2=0x7f809c054b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.898+0000 7f80a3e00640 1 -- 172.21.15.19:0/196041165 shutdown_connections 2024-03-08T06:03:28.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.898+0000 7f80a3e00640 1 -- 172.21.15.19:0/196041165 wait complete. 2024-03-08T06:03:28.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.1 2024-03-08T06:03:28.908 DEBUG:teuthology.parallel:result is None 2024-03-08T06:03:28.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2024-03-08T06:03:28.910 DEBUG:teuthology.parallel:result is None 2024-03-08T06:03:28.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.912+0000 7f743e600640 1 -- 172.21.15.19:0/2501616372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f74381f8510 con 0x7f743815dd40 2024-03-08T06:03:28.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.913+0000 7f742f400640 1 -- 172.21.15.19:0/2501616372 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7420033080 con 0x7f743815dd40 2024-03-08T06:03:28.913 INFO:teuthology.orchestra.run.smithi019.stdout:55834574854 2024-03-08T06:03:28.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.916+0000 7f743e600640 1 -- 172.21.15.19:0/2501616372 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f741406b4d0 msgr2=0x7f741406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.916+0000 7f743e600640 1 --2- 172.21.15.19:0/2501616372 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f741406b4d0 0x7f741406d990 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7430036000 tx=0x7f7430030000 comp rx=0 tx=0).stop 2024-03-08T06:03:28.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.916+0000 7f743e600640 1 -- 172.21.15.19:0/2501616372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f743815dd40 msgr2=0x7f7438070d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.916+0000 7f743e600640 1 --2- 172.21.15.19:0/2501616372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f743815dd40 0x7f7438070d70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f742000c4e0 tx=0x7f742000c9a0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.916+0000 7f743e600640 1 -- 172.21.15.19:0/2501616372 shutdown_connections 2024-03-08T06:03:28.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.916+0000 7f743e600640 1 --2- 172.21.15.19:0/2501616372 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f741406b4d0 0x7f741406d990 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.916+0000 7f743e600640 1 --2- 172.21.15.19:0/2501616372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f743815e120 0x7f74380712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.916+0000 7f743e600640 1 --2- 172.21.15.19:0/2501616372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f743815dd40 0x7f7438070d70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.916+0000 7f743e600640 1 --2- 172.21.15.19:0/2501616372 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74380d1080 0x7f74381f7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.916+0000 7f743e600640 1 -- 172.21.15.19:0/2501616372 >> 172.21.15.19:0/2501616372 conn(0x7f743806c5e0 msgr2=0x7f74380ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.916+0000 7f518ae00640 1 -- 172.21.15.19:0/763681970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f517c169cc0 con 0x7f517c051d10 2024-03-08T06:03:28.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.916+0000 7f743e600640 1 -- 172.21.15.19:0/2501616372 shutdown_connections 2024-03-08T06:03:28.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.916+0000 7f743e600640 1 -- 172.21.15.19:0/2501616372 wait complete. 2024-03-08T06:03:28.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.917+0000 7f5181600640 1 -- 172.21.15.19:0/763681970 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f517805c2a0 con 0x7f517c051d10 2024-03-08T06:03:28.919 INFO:teuthology.orchestra.run.smithi019.stdout:55834574852 2024-03-08T06:03:28.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-03-08T06:03:28.919 DEBUG:teuthology.parallel:result is None 2024-03-08T06:03:28.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.919+0000 7f518ae00640 1 -- 172.21.15.19:0/763681970 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f516406b520 msgr2=0x7f516406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.919+0000 7f518ae00640 1 --2- 172.21.15.19:0/763681970 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f516406b520 0x7f516406d9e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f517c039730 tx=0x7f5170008040 comp rx=0 tx=0).stop 2024-03-08T06:03:28.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.919+0000 7f518ae00640 1 -- 172.21.15.19:0/763681970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f517c051d10 msgr2=0x7f517c030990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:28.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.919+0000 7f518ae00640 1 --2- 172.21.15.19:0/763681970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f517c051d10 0x7f517c030990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f517800c4a0 tx=0x7f517800c960 comp rx=0 tx=0).stop 2024-03-08T06:03:28.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.919+0000 7f518ae00640 1 -- 172.21.15.19:0/763681970 shutdown_connections 2024-03-08T06:03:28.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.919+0000 7f518ae00640 1 --2- 172.21.15.19:0/763681970 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f516406b520 0x7f516406d9e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.919+0000 7f518ae00640 1 --2- 172.21.15.19:0/763681970 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f517c056810 0x7f517c02f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.919+0000 7f518ae00640 1 --2- 172.21.15.19:0/763681970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f517c0520f0 0x7f517c0de9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.919+0000 7f518ae00640 1 --2- 172.21.15.19:0/763681970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f517c051d10 0x7f517c030990 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:28.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.919+0000 7f518ae00640 1 -- 172.21.15.19:0/763681970 >> 172.21.15.19:0/763681970 conn(0x7f517c053750 msgr2=0x7f517c0dfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:28.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.919+0000 7f518ae00640 1 -- 172.21.15.19:0/763681970 shutdown_connections 2024-03-08T06:03:28.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:28.919+0000 7f518ae00640 1 -- 172.21.15.19:0/763681970 wait complete. 2024-03-08T06:03:28.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-03-08T06:03:28.934 DEBUG:teuthology.parallel:result is None 2024-03-08T06:03:28.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.7 2024-03-08T06:03:28.939 DEBUG:teuthology.parallel:result is None 2024-03-08T06:03:28.939 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-08T06:03:28.939 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T06:03:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.192+0000 7fec48c00640 1 Processor -- start 2024-03-08T06:03:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.192+0000 7fec48c00640 1 -- start start 2024-03-08T06:03:29.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.193+0000 7fec48c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fec4406ea40 0x7fec44165770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:29.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.193+0000 7fec48c00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec440cd020 con 0x7fec4415a770 2024-03-08T06:03:29.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.193+0000 7fec48c00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec440cd300 con 0x7fec4415ed80 2024-03-08T06:03:29.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.193+0000 7fec48c00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec440ccdd0 con 0x7fec4406ea40 2024-03-08T06:03:29.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.194+0000 7fec43400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fec4415a770 0x7fec440cc310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35508/0 (socket says 172.21.15.19:35508) 2024-03-08T06:03:29.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.194+0000 7fec43400640 1 -- 172.21.15.19:0/1167545036 learned_addr learned my addr 172.21.15.19:0/1167545036 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:29.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.194+0000 7fec43e00640 1 --2- 172.21.15.19:0/1167545036 >> v2:172.21.15.19:3300/0 conn(0x7fec4406ea40 0x7fec44165770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:29.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.194+0000 7fec42a00640 1 -- 172.21.15.19:0/1167545036 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1573808571 0 0) 0x7fec440cd020 con 0x7fec4415a770 2024-03-08T06:03:29.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.194+0000 7fec42a00640 1 -- 172.21.15.19:0/1167545036 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec28003520 con 0x7fec4415a770 2024-03-08T06:03:29.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.194+0000 7fec43e00640 1 -- 172.21.15.19:0/1167545036 >> v1:172.21.15.42:6789/0 conn(0x7fec4415ed80 legacy=0x7fec4406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:29.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.194+0000 7fec43e00640 1 -- 172.21.15.19:0/1167545036 >> v1:172.21.15.19:6789/0 conn(0x7fec4415a770 legacy=0x7fec440cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:29.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.194+0000 7fec43e00640 1 -- 172.21.15.19:0/1167545036 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4415e580 con 0x7fec4406ea40 2024-03-08T06:03:29.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.195+0000 7fec43e00640 1 --2- 172.21.15.19:0/1167545036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec4406ea40 0x7fec44165770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fec440ccf50 tx=0x7fec3c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0f66ece822cccf server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:29.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.196+0000 7fec42a00640 1 -- 172.21.15.19:0/1167545036 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c039070 con 0x7fec4406ea40 2024-03-08T06:03:29.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.196+0000 7fec42a00640 1 -- 172.21.15.19:0/1167545036 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3c02cc50 con 0x7fec4406ea40 2024-03-08T06:03:29.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.196+0000 7fec42a00640 1 -- 172.21.15.19:0/1167545036 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c034440 con 0x7fec4406ea40 2024-03-08T06:03:29.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.196+0000 7fec48c00640 1 -- 172.21.15.19:0/1167545036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec4406ea40 msgr2=0x7fec44165770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:29.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.196+0000 7fec48c00640 1 --2- 172.21.15.19:0/1167545036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec4406ea40 0x7fec44165770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fec440ccf50 tx=0x7fec3c02bea0 comp rx=0 tx=0).stop 2024-03-08T06:03:29.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.196+0000 7fec48c00640 1 -- 172.21.15.19:0/1167545036 shutdown_connections 2024-03-08T06:03:29.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.196+0000 7fec48c00640 1 --2- 172.21.15.19:0/1167545036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec4406ea40 0x7fec44165770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:29.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.196+0000 7fec48c00640 1 -- 172.21.15.19:0/1167545036 >> 172.21.15.19:0/1167545036 conn(0x7fec440b1850 msgr2=0x7fec440b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:29.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.196+0000 7fec48c00640 1 -- 172.21.15.19:0/1167545036 shutdown_connections 2024-03-08T06:03:29.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.196+0000 7fec48c00640 1 -- 172.21.15.19:0/1167545036 wait complete. 2024-03-08T06:03:29.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.198+0000 7fec48c00640 1 Processor -- start 2024-03-08T06:03:29.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.198+0000 7fec48c00640 1 -- start start 2024-03-08T06:03:29.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.199+0000 7fec48c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec4406ea40 0x7fec4413ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:29.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.199+0000 7fec48c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec4415a770 0x7fec4413de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:29.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.199+0000 7fec48c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fec4415ed80 0x7fec4406ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:29.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.199+0000 7fec48c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec440b4e00 con 0x7fec4406ea40 2024-03-08T06:03:29.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.199+0000 7fec48c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4415e8f0 con 0x7fec4415a770 2024-03-08T06:03:29.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.199+0000 7fec48c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec44165cb0 con 0x7fec4415ed80 2024-03-08T06:03:29.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.199+0000 7fec43400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec4406ea40 0x7fec4413ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:29.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.199+0000 7fec43400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec4406ea40 0x7fec4413ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33792/0 (socket says 172.21.15.19:33792) 2024-03-08T06:03:29.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.199+0000 7fec43400640 1 -- 172.21.15.19:0/651855286 learned_addr learned my addr 172.21.15.19:0/651855286 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:29.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.200+0000 7fec3be00640 1 --2- 172.21.15.19:0/651855286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec4415a770 0x7fec4413de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:29.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.200+0000 7fec43e00640 1 --2- 172.21.15.19:0/651855286 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fec4415ed80 0x7fec4406ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.200+0000 7fec43400640 1 -- 172.21.15.19:0/651855286 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fec4415ed80 msgr2=0x7fec4406ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.200+0000 7fec43400640 1 --2- 172.21.15.19:0/651855286 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fec4415ed80 0x7fec4406ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.200+0000 7fec43400640 1 -- 172.21.15.19:0/651855286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec4415a770 msgr2=0x7fec4413de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.200+0000 7fec43400640 1 --2- 172.21.15.19:0/651855286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec4415a770 0x7fec4413de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.200+0000 7fec43400640 1 -- 172.21.15.19:0/651855286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec44157bd0 con 0x7fec4406ea40 2024-03-08T06:03:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.200+0000 7fec3be00640 1 --2- 172.21.15.19:0/651855286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec4415a770 0x7fec4413de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.200+0000 7fec43400640 1 --2- 172.21.15.19:0/651855286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec4406ea40 0x7fec4413ada0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fec3400c430 tx=0x7fec3400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.200+0000 7fec3b400640 1 -- 172.21.15.19:0/651855286 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec34017070 con 0x7fec4406ea40 2024-03-08T06:03:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.200+0000 7fec3b400640 1 -- 172.21.15.19:0/651855286 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec34005ce0 con 0x7fec4406ea40 2024-03-08T06:03:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.200+0000 7fec3b400640 1 -- 172.21.15.19:0/651855286 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec340072f0 con 0x7fec4406ea40 2024-03-08T06:03:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.200+0000 7fec48c00640 1 -- 172.21.15.19:0/651855286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec44157e70 con 0x7fec4406ea40 2024-03-08T06:03:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.200+0000 7fec48c00640 1 -- 172.21.15.19:0/651855286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec44158430 con 0x7fec4406ea40 2024-03-08T06:03:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.202+0000 7fec48c00640 1 -- 172.21.15.19:0/651855286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4406f260 con 0x7fec4406ea40 2024-03-08T06:03:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.202+0000 7fec3b400640 1 -- 172.21.15.19:0/651855286 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fec3401a070 con 0x7fec4406ea40 2024-03-08T06:03:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.203+0000 7fec3b400640 1 --2- 172.21.15.19:0/651855286 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fec2006b500 0x7fec2006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.203+0000 7fec3b400640 1 -- 172.21.15.19:0/651855286 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec34089720 con 0x7fec4406ea40 2024-03-08T06:03:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.204+0000 7fec3be00640 1 --2- 172.21.15.19:0/651855286 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fec2006b500 0x7fec2006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.204+0000 7fec3be00640 1 --2- 172.21.15.19:0/651855286 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fec2006b500 0x7fec2006d9c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec441579c0 tx=0x7fec2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:29.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.208+0000 7fec3b400640 1 -- 172.21.15.19:0/651855286 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fec4406f260 con 0x7fec4406ea40 2024-03-08T06:03:29.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.394+0000 7fec48c00640 1 -- 172.21.15.19:0/651855286 --> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fec440b2f50 con 0x7fec2006b500 2024-03-08T06:03:29.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.402+0000 7fec3b400640 1 -- 172.21.15.19:0/651855286 <== mgr.4107 v2:172.21.15.19:6832/3589745192 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251915 (secure 0 0 0) 0x7fec440b2f50 con 0x7fec2006b500 2024-03-08T06:03:29.406 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:29.408 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-08T06:03:29.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.407+0000 7fec48c00640 1 -- 172.21.15.19:0/651855286 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fec2006b500 msgr2=0x7fec2006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:29.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.407+0000 7fec48c00640 1 --2- 172.21.15.19:0/651855286 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fec2006b500 0x7fec2006d9c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fec441579c0 tx=0x7fec2c008040 comp rx=0 tx=0).stop 2024-03-08T06:03:29.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.407+0000 7fec48c00640 1 -- 172.21.15.19:0/651855286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec4406ea40 msgr2=0x7fec4413ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:29.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.407+0000 7fec48c00640 1 --2- 172.21.15.19:0/651855286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec4406ea40 0x7fec4413ada0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fec3400c430 tx=0x7fec3400c8f0 comp rx=0 tx=0).stop 2024-03-08T06:03:29.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.407+0000 7fec48c00640 1 -- 172.21.15.19:0/651855286 shutdown_connections 2024-03-08T06:03:29.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.407+0000 7fec48c00640 1 --2- 172.21.15.19:0/651855286 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fec2006b500 0x7fec2006d9c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:29.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.407+0000 7fec48c00640 1 --2- 172.21.15.19:0/651855286 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fec4415ed80 0x7fec4406ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:29.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.407+0000 7fec48c00640 1 --2- 172.21.15.19:0/651855286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec4415a770 0x7fec4413de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:29.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.407+0000 7fec48c00640 1 --2- 172.21.15.19:0/651855286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec4406ea40 0x7fec4413ada0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:29.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.407+0000 7fec48c00640 1 -- 172.21.15.19:0/651855286 >> 172.21.15.19:0/651855286 conn(0x7fec440b1850 msgr2=0x7fec440b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:29.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.407+0000 7fec48c00640 1 -- 172.21.15.19:0/651855286 shutdown_connections 2024-03-08T06:03:29.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.407+0000 7fec48c00640 1 -- 172.21.15.19:0/651855286 wait complete. 2024-03-08T06:03:29.425 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-03-08T06:03:28.077846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235872,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738848,"statfs":{"total":773094113280,"available":772852580352,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":20,"num_read_kb":18,"num_write":81,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002424"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090939+0000","last_change":"2024-03-08T06:03:21.089349+0000","last_active":"2024-03-08T06:03:22.090939+0000","last_peered":"2024-03-08T06:03:22.090939+0000","last_clean":"2024-03-08T06:03:22.090939+0000","last_became_active":"2024-03-08T06:03:21.085662+0000","last_became_peered":"2024-03-08T06:03:21.085662+0000","last_unstale":"2024-03-08T06:03:22.090939+0000","last_undegraded":"2024-03-08T06:03:22.090939+0000","last_fullsized":"2024-03-08T06:03:22.090939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:18:48.558283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087395+0000","last_change":"2024-03-08T06:03:21.089313+0000","last_active":"2024-03-08T06:03:22.087395+0000","last_peered":"2024-03-08T06:03:22.087395+0000","last_clean":"2024-03-08T06:03:22.087395+0000","last_became_active":"2024-03-08T06:03:21.088958+0000","last_became_peered":"2024-03-08T06:03:21.088958+0000","last_unstale":"2024-03-08T06:03:22.087395+0000","last_undegraded":"2024-03-08T06:03:22.087395+0000","last_fullsized":"2024-03-08T06:03:22.087395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:23:37.355382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.272947+0000","last_change":"2024-03-08T06:03:21.098797+0000","last_active":"2024-03-08T06:03:23.272947+0000","last_peered":"2024-03-08T06:03:23.272947+0000","last_clean":"2024-03-08T06:03:23.272947+0000","last_became_active":"2024-03-08T06:03:21.098387+0000","last_became_peered":"2024-03-08T06:03:21.098387+0000","last_unstale":"2024-03-08T06:03:23.272947+0000","last_undegraded":"2024-03-08T06:03:23.272947+0000","last_fullsized":"2024-03-08T06:03:23.272947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:23:37.355382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.298964+0000","last_change":"2024-03-08T06:03:21.099948+0000","last_active":"2024-03-08T06:03:23.298964+0000","last_peered":"2024-03-08T06:03:23.298964+0000","last_clean":"2024-03-08T06:03:23.298964+0000","last_became_active":"2024-03-08T06:03:21.097388+0000","last_became_peered":"2024-03-08T06:03:21.097388+0000","last_unstale":"2024-03-08T06:03:23.298964+0000","last_undegraded":"2024-03-08T06:03:23.298964+0000","last_fullsized":"2024-03-08T06:03:23.298964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:00:39.301215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088264+0000","last_change":"2024-03-08T06:03:21.080856+0000","last_active":"2024-03-08T06:03:22.088264+0000","last_peered":"2024-03-08T06:03:22.088264+0000","last_clean":"2024-03-08T06:03:22.088264+0000","last_became_active":"2024-03-08T06:03:21.080513+0000","last_became_peered":"2024-03-08T06:03:21.080513+0000","last_unstale":"2024-03-08T06:03:22.088264+0000","last_undegraded":"2024-03-08T06:03:22.088264+0000","last_fullsized":"2024-03-08T06:03:22.088264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:49:03.245653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.298447+0000","last_change":"2024-03-08T06:03:21.106729+0000","last_active":"2024-03-08T06:03:23.298447+0000","last_peered":"2024-03-08T06:03:23.298447+0000","last_clean":"2024-03-08T06:03:23.298447+0000","last_became_active":"2024-03-08T06:03:21.106444+0000","last_became_peered":"2024-03-08T06:03:21.106444+0000","last_unstale":"2024-03-08T06:03:23.298447+0000","last_undegraded":"2024-03-08T06:03:23.298447+0000","last_fullsized":"2024-03-08T06:03:23.298447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:48:37.493932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087914+0000","last_change":"2024-03-08T06:03:21.091772+0000","last_active":"2024-03-08T06:03:22.087914+0000","last_peered":"2024-03-08T06:03:22.087914+0000","last_clean":"2024-03-08T06:03:22.087914+0000","last_became_active":"2024-03-08T06:03:21.091340+0000","last_became_peered":"2024-03-08T06:03:21.091340+0000","last_unstale":"2024-03-08T06:03:22.087914+0000","last_undegraded":"2024-03-08T06:03:22.087914+0000","last_fullsized":"2024-03-08T06:03:22.087914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:48:37.493932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.922963+0000","last_change":"2024-03-08T06:03:21.091248+0000","last_active":"2024-03-08T06:03:23.922963+0000","last_peered":"2024-03-08T06:03:23.922963+0000","last_clean":"2024-03-08T06:03:23.922963+0000","last_became_active":"2024-03-08T06:03:21.090881+0000","last_became_peered":"2024-03-08T06:03:21.090881+0000","last_unstale":"2024-03-08T06:03:23.922963+0000","last_undegraded":"2024-03-08T06:03:23.922963+0000","last_fullsized":"2024-03-08T06:03:23.922963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:17:51.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090833+0000","last_change":"2024-03-08T06:03:21.116525+0000","last_active":"2024-03-08T06:03:22.090833+0000","last_peered":"2024-03-08T06:03:22.090833+0000","last_clean":"2024-03-08T06:03:22.090833+0000","last_became_active":"2024-03-08T06:03:21.116143+0000","last_became_peered":"2024-03-08T06:03:21.116143+0000","last_unstale":"2024-03-08T06:03:22.090833+0000","last_undegraded":"2024-03-08T06:03:22.090833+0000","last_fullsized":"2024-03-08T06:03:22.090833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:19:57.197522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.344189+0000","last_change":"2024-03-08T06:03:21.108467+0000","last_active":"2024-03-08T06:03:23.344189+0000","last_peered":"2024-03-08T06:03:23.344189+0000","last_clean":"2024-03-08T06:03:23.344189+0000","last_became_active":"2024-03-08T06:03:21.108167+0000","last_became_peered":"2024-03-08T06:03:21.108167+0000","last_unstale":"2024-03-08T06:03:23.344189+0000","last_undegraded":"2024-03-08T06:03:23.344189+0000","last_fullsized":"2024-03-08T06:03:23.344189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:57:16.249537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.343758+0000","last_change":"2024-03-08T06:03:21.097402+0000","last_active":"2024-03-08T06:03:23.343758+0000","last_peered":"2024-03-08T06:03:23.343758+0000","last_clean":"2024-03-08T06:03:23.343758+0000","last_became_active":"2024-03-08T06:03:21.097092+0000","last_became_peered":"2024-03-08T06:03:21.097092+0000","last_unstale":"2024-03-08T06:03:23.343758+0000","last_undegraded":"2024-03-08T06:03:23.343758+0000","last_fullsized":"2024-03-08T06:03:23.343758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:29:07.055814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.089691+0000","last_change":"2024-03-08T06:03:21.094282+0000","last_active":"2024-03-08T06:03:22.089691+0000","last_peered":"2024-03-08T06:03:22.089691+0000","last_clean":"2024-03-08T06:03:22.089691+0000","last_became_active":"2024-03-08T06:03:21.093991+0000","last_became_peered":"2024-03-08T06:03:21.093991+0000","last_unstale":"2024-03-08T06:03:22.089691+0000","last_undegraded":"2024-03-08T06:03:22.089691+0000","last_fullsized":"2024-03-08T06:03:22.089691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:42.646547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.925405+0000","last_change":"2024-03-08T06:03:21.089482+0000","last_active":"2024-03-08T06:03:23.925405+0000","last_peered":"2024-03-08T06:03:23.925405+0000","last_clean":"2024-03-08T06:03:23.925405+0000","last_became_active":"2024-03-08T06:03:21.088934+0000","last_became_peered":"2024-03-08T06:03:21.088934+0000","last_unstale":"2024-03-08T06:03:23.925405+0000","last_undegraded":"2024-03-08T06:03:23.925405+0000","last_fullsized":"2024-03-08T06:03:23.925405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:49:03.245653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.272359+0000","last_change":"2024-03-08T06:03:21.100913+0000","last_active":"2024-03-08T06:03:23.272359+0000","last_peered":"2024-03-08T06:03:23.272359+0000","last_clean":"2024-03-08T06:03:23.272359+0000","last_became_active":"2024-03-08T06:03:21.097463+0000","last_became_peered":"2024-03-08T06:03:21.097463+0000","last_unstale":"2024-03-08T06:03:23.272359+0000","last_undegraded":"2024-03-08T06:03:23.272359+0000","last_fullsized":"2024-03-08T06:03:23.272359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:24:30.832300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087416+0000","last_change":"2024-03-08T06:03:21.073630+0000","last_active":"2024-03-08T06:03:22.087416+0000","last_peered":"2024-03-08T06:03:22.087416+0000","last_clean":"2024-03-08T06:03:22.087416+0000","last_became_active":"2024-03-08T06:03:21.073333+0000","last_became_peered":"2024-03-08T06:03:21.073333+0000","last_unstale":"2024-03-08T06:03:22.087416+0000","last_undegraded":"2024-03-08T06:03:22.087416+0000","last_fullsized":"2024-03-08T06:03:22.087416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:27:57.207381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.298282+0000","last_change":"2024-03-08T06:03:21.096870+0000","last_active":"2024-03-08T06:03:23.298282+0000","last_peered":"2024-03-08T06:03:23.298282+0000","last_clean":"2024-03-08T06:03:23.298282+0000","last_became_active":"2024-03-08T06:03:21.096623+0000","last_became_peered":"2024-03-08T06:03:21.096623+0000","last_unstale":"2024-03-08T06:03:23.298282+0000","last_undegraded":"2024-03-08T06:03:23.298282+0000","last_fullsized":"2024-03-08T06:03:23.298282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:57:16.249537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.300147+0000","last_change":"2024-03-08T06:03:21.113130+0000","last_active":"2024-03-08T06:03:23.300147+0000","last_peered":"2024-03-08T06:03:23.300147+0000","last_clean":"2024-03-08T06:03:23.300147+0000","last_became_active":"2024-03-08T06:03:21.110951+0000","last_became_peered":"2024-03-08T06:03:21.110951+0000","last_unstale":"2024-03-08T06:03:23.300147+0000","last_undegraded":"2024-03-08T06:03:23.300147+0000","last_fullsized":"2024-03-08T06:03:23.300147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:17:15.821002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.925606+0000","last_change":"2024-03-08T06:03:21.093041+0000","last_active":"2024-03-08T06:03:23.925606+0000","last_peered":"2024-03-08T06:03:23.925606+0000","last_clean":"2024-03-08T06:03:23.925606+0000","last_became_active":"2024-03-08T06:03:21.092766+0000","last_became_peered":"2024-03-08T06:03:21.092766+0000","last_unstale":"2024-03-08T06:03:23.925606+0000","last_undegraded":"2024-03-08T06:03:23.925606+0000","last_fullsized":"2024-03-08T06:03:23.925606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:27.959321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090177+0000","last_change":"2024-03-08T06:03:21.083536+0000","last_active":"2024-03-08T06:03:22.090177+0000","last_peered":"2024-03-08T06:03:22.090177+0000","last_clean":"2024-03-08T06:03:22.090177+0000","last_became_active":"2024-03-08T06:03:21.083203+0000","last_became_peered":"2024-03-08T06:03:21.083203+0000","last_unstale":"2024-03-08T06:03:22.090177+0000","last_undegraded":"2024-03-08T06:03:22.090177+0000","last_fullsized":"2024-03-08T06:03:22.090177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:17:34.427952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.343706+0000","last_change":"2024-03-08T06:03:21.099174+0000","last_active":"2024-03-08T06:03:23.343706+0000","last_peered":"2024-03-08T06:03:23.343706+0000","last_clean":"2024-03-08T06:03:23.343706+0000","last_became_active":"2024-03-08T06:03:21.098562+0000","last_became_peered":"2024-03-08T06:03:21.098562+0000","last_unstale":"2024-03-08T06:03:23.343706+0000","last_undegraded":"2024-03-08T06:03:23.343706+0000","last_fullsized":"2024-03-08T06:03:23.343706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:27:57.207381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.272168+0000","last_change":"2024-03-08T06:03:21.090407+0000","last_active":"2024-03-08T06:03:23.272168+0000","last_peered":"2024-03-08T06:03:23.272168+0000","last_clean":"2024-03-08T06:03:23.272168+0000","last_became_active":"2024-03-08T06:03:21.090050+0000","last_became_peered":"2024-03-08T06:03:21.090050+0000","last_unstale":"2024-03-08T06:03:23.272168+0000","last_undegraded":"2024-03-08T06:03:23.272168+0000","last_fullsized":"2024-03-08T06:03:23.272168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:33:15.887777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.298764+0000","last_change":"2024-03-08T06:03:21.103042+0000","last_active":"2024-03-08T06:03:23.298764+0000","last_peered":"2024-03-08T06:03:23.298764+0000","last_clean":"2024-03-08T06:03:23.298764+0000","last_became_active":"2024-03-08T06:03:21.102711+0000","last_became_peered":"2024-03-08T06:03:21.102711+0000","last_unstale":"2024-03-08T06:03:23.298764+0000","last_undegraded":"2024-03-08T06:03:23.298764+0000","last_fullsized":"2024-03-08T06:03:23.298764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:49:03.245653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.923302+0000","last_change":"2024-03-08T06:03:21.094816+0000","last_active":"2024-03-08T06:03:23.923302+0000","last_peered":"2024-03-08T06:03:23.923302+0000","last_clean":"2024-03-08T06:03:23.923302+0000","last_became_active":"2024-03-08T06:03:21.092861+0000","last_became_peered":"2024-03-08T06:03:21.092861+0000","last_unstale":"2024-03-08T06:03:23.923302+0000","last_undegraded":"2024-03-08T06:03:23.923302+0000","last_fullsized":"2024-03-08T06:03:23.923302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:24:30.832300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.298426+0000","last_change":"2024-03-08T06:03:21.096814+0000","last_active":"2024-03-08T06:03:23.298426+0000","last_peered":"2024-03-08T06:03:23.298426+0000","last_clean":"2024-03-08T06:03:23.298426+0000","last_became_active":"2024-03-08T06:03:21.096448+0000","last_became_peered":"2024-03-08T06:03:21.096448+0000","last_unstale":"2024-03-08T06:03:23.298426+0000","last_undegraded":"2024-03-08T06:03:23.298426+0000","last_fullsized":"2024-03-08T06:03:23.298426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:57:49.623008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.924372+0000","last_change":"2024-03-08T06:03:21.101873+0000","last_active":"2024-03-08T06:03:23.924372+0000","last_peered":"2024-03-08T06:03:23.924372+0000","last_clean":"2024-03-08T06:03:23.924372+0000","last_became_active":"2024-03-08T06:03:21.101436+0000","last_became_peered":"2024-03-08T06:03:21.101436+0000","last_unstale":"2024-03-08T06:03:23.924372+0000","last_undegraded":"2024-03-08T06:03:23.924372+0000","last_fullsized":"2024-03-08T06:03:23.924372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:29:07.055814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.344341+0000","last_change":"2024-03-08T06:03:21.093616+0000","last_active":"2024-03-08T06:03:23.344341+0000","last_peered":"2024-03-08T06:03:23.344341+0000","last_clean":"2024-03-08T06:03:23.344341+0000","last_became_active":"2024-03-08T06:03:21.093287+0000","last_became_peered":"2024-03-08T06:03:21.093287+0000","last_unstale":"2024-03-08T06:03:23.344341+0000","last_undegraded":"2024-03-08T06:03:23.344341+0000","last_fullsized":"2024-03-08T06:03:23.344341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:57:49.623008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087812+0000","last_change":"2024-03-08T06:03:21.081645+0000","last_active":"2024-03-08T06:03:22.087812+0000","last_peered":"2024-03-08T06:03:22.087812+0000","last_clean":"2024-03-08T06:03:22.087812+0000","last_became_active":"2024-03-08T06:03:21.079927+0000","last_became_peered":"2024-03-08T06:03:21.079927+0000","last_unstale":"2024-03-08T06:03:22.087812+0000","last_undegraded":"2024-03-08T06:03:22.087812+0000","last_fullsized":"2024-03-08T06:03:22.087812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:29:07.055814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.923847+0000","last_change":"2024-03-08T06:03:21.101884+0000","last_active":"2024-03-08T06:03:23.923847+0000","last_peered":"2024-03-08T06:03:23.923847+0000","last_clean":"2024-03-08T06:03:23.923847+0000","last_became_active":"2024-03-08T06:03:21.101536+0000","last_became_peered":"2024-03-08T06:03:21.101536+0000","last_unstale":"2024-03-08T06:03:23.923847+0000","last_undegraded":"2024-03-08T06:03:23.923847+0000","last_fullsized":"2024-03-08T06:03:23.923847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:28:13.130043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.272512+0000","last_change":"2024-03-08T06:03:21.096440+0000","last_active":"2024-03-08T06:03:23.272512+0000","last_peered":"2024-03-08T06:03:23.272512+0000","last_clean":"2024-03-08T06:03:23.272512+0000","last_became_active":"2024-03-08T06:03:21.095943+0000","last_became_peered":"2024-03-08T06:03:21.095943+0000","last_unstale":"2024-03-08T06:03:23.272512+0000","last_undegraded":"2024-03-08T06:03:23.272512+0000","last_fullsized":"2024-03-08T06:03:23.272512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:27:57.207381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.298964+0000","last_change":"2024-03-08T06:03:21.100381+0000","last_active":"2024-03-08T06:03:23.298964+0000","last_peered":"2024-03-08T06:03:23.298964+0000","last_clean":"2024-03-08T06:03:23.298964+0000","last_became_active":"2024-03-08T06:03:21.095958+0000","last_became_peered":"2024-03-08T06:03:21.095958+0000","last_unstale":"2024-03-08T06:03:23.298964+0000","last_undegraded":"2024-03-08T06:03:23.298964+0000","last_fullsized":"2024-03-08T06:03:23.298964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:52:15.212911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.923668+0000","last_change":"2024-03-08T06:03:21.105006+0000","last_active":"2024-03-08T06:03:23.923668+0000","last_peered":"2024-03-08T06:03:23.923668+0000","last_clean":"2024-03-08T06:03:23.923668+0000","last_became_active":"2024-03-08T06:03:21.104720+0000","last_became_peered":"2024-03-08T06:03:21.104720+0000","last_unstale":"2024-03-08T06:03:23.923668+0000","last_undegraded":"2024-03-08T06:03:23.923668+0000","last_fullsized":"2024-03-08T06:03:23.923668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:42.646547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.343242+0000","last_change":"2024-03-08T06:03:21.096533+0000","last_active":"2024-03-08T06:03:23.343242+0000","last_peered":"2024-03-08T06:03:23.343242+0000","last_clean":"2024-03-08T06:03:23.343242+0000","last_became_active":"2024-03-08T06:03:21.096204+0000","last_became_peered":"2024-03-08T06:03:21.096204+0000","last_unstale":"2024-03-08T06:03:23.343242+0000","last_undegraded":"2024-03-08T06:03:23.343242+0000","last_fullsized":"2024-03-08T06:03:23.343242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:17:51.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087486+0000","last_change":"2024-03-08T06:03:21.076936+0000","last_active":"2024-03-08T06:03:22.087486+0000","last_peered":"2024-03-08T06:03:22.087486+0000","last_clean":"2024-03-08T06:03:22.087486+0000","last_became_active":"2024-03-08T06:03:21.076550+0000","last_became_peered":"2024-03-08T06:03:21.076550+0000","last_unstale":"2024-03-08T06:03:22.087486+0000","last_undegraded":"2024-03-08T06:03:22.087486+0000","last_fullsized":"2024-03-08T06:03:22.087486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:23.037684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.925664+0000","last_change":"2024-03-08T06:03:20.068219+0000","last_active":"2024-03-08T06:03:23.925664+0000","last_peered":"2024-03-08T06:03:23.925664+0000","last_clean":"2024-03-08T06:03:23.925664+0000","last_became_active":"2024-03-08T06:03:20.067429+0000","last_became_peered":"2024-03-08T06:03:20.067429+0000","last_unstale":"2024-03-08T06:03:23.925664+0000","last_undegraded":"2024-03-08T06:03:23.925664+0000","last_fullsized":"2024-03-08T06:03:23.925664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:54:20.527395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.272397+0000","last_change":"2024-03-08T06:03:21.101698+0000","last_active":"2024-03-08T06:03:23.272397+0000","last_peered":"2024-03-08T06:03:23.272397+0000","last_clean":"2024-03-08T06:03:23.272397+0000","last_became_active":"2024-03-08T06:03:21.101361+0000","last_became_peered":"2024-03-08T06:03:21.101361+0000","last_unstale":"2024-03-08T06:03:23.272397+0000","last_undegraded":"2024-03-08T06:03:23.272397+0000","last_fullsized":"2024-03-08T06:03:23.272397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:28:13.130043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.343376+0000","last_change":"2024-03-08T06:03:20.055111+0000","last_active":"2024-03-08T06:03:23.343376+0000","last_peered":"2024-03-08T06:03:23.343376+0000","last_clean":"2024-03-08T06:03:23.343376+0000","last_became_active":"2024-03-08T06:03:20.054685+0000","last_became_peered":"2024-03-08T06:03:20.054685+0000","last_unstale":"2024-03-08T06:03:23.343376+0000","last_undegraded":"2024-03-08T06:03:23.343376+0000","last_fullsized":"2024-03-08T06:03:23.343376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:54:47.826647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.923121+0000","last_change":"2024-03-08T06:03:20.069995+0000","last_active":"2024-03-08T06:03:23.923121+0000","last_peered":"2024-03-08T06:03:23.923121+0000","last_clean":"2024-03-08T06:03:23.923121+0000","last_became_active":"2024-03-08T06:03:20.069729+0000","last_became_peered":"2024-03-08T06:03:20.069729+0000","last_unstale":"2024-03-08T06:03:23.923121+0000","last_undegraded":"2024-03-08T06:03:23.923121+0000","last_fullsized":"2024-03-08T06:03:23.923121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:44:31.139813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.923228+0000","last_change":"2024-03-08T06:03:21.096605+0000","last_active":"2024-03-08T06:03:23.923228+0000","last_peered":"2024-03-08T06:03:23.923228+0000","last_clean":"2024-03-08T06:03:23.923228+0000","last_became_active":"2024-03-08T06:03:21.096303+0000","last_became_peered":"2024-03-08T06:03:21.096303+0000","last_unstale":"2024-03-08T06:03:23.923228+0000","last_undegraded":"2024-03-08T06:03:23.923228+0000","last_fullsized":"2024-03-08T06:03:23.923228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:23:37.355382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.298608+0000","last_change":"2024-03-08T06:03:20.061872+0000","last_active":"2024-03-08T06:03:23.298608+0000","last_peered":"2024-03-08T06:03:23.298608+0000","last_clean":"2024-03-08T06:03:23.298608+0000","last_became_active":"2024-03-08T06:03:20.061611+0000","last_became_peered":"2024-03-08T06:03:20.061611+0000","last_unstale":"2024-03-08T06:03:23.298608+0000","last_undegraded":"2024-03-08T06:03:23.298608+0000","last_fullsized":"2024-03-08T06:03:23.298608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:23:36.342138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088422+0000","last_change":"2024-03-08T06:03:21.079662+0000","last_active":"2024-03-08T06:03:22.088422+0000","last_peered":"2024-03-08T06:03:22.088422+0000","last_clean":"2024-03-08T06:03:22.088422+0000","last_became_active":"2024-03-08T06:03:21.079269+0000","last_became_peered":"2024-03-08T06:03:21.079269+0000","last_unstale":"2024-03-08T06:03:22.088422+0000","last_undegraded":"2024-03-08T06:03:22.088422+0000","last_fullsized":"2024-03-08T06:03:22.088422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:57:16.249537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.343685+0000","last_change":"2024-03-08T06:03:20.070774+0000","last_active":"2024-03-08T06:03:23.343685+0000","last_peered":"2024-03-08T06:03:23.343685+0000","last_clean":"2024-03-08T06:03:23.343685+0000","last_became_active":"2024-03-08T06:03:20.070284+0000","last_became_peered":"2024-03-08T06:03:20.070284+0000","last_unstale":"2024-03-08T06:03:23.343685+0000","last_undegraded":"2024-03-08T06:03:23.343685+0000","last_fullsized":"2024-03-08T06:03:23.343685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:41.633303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.299738+0000","last_change":"2024-03-08T06:03:21.112968+0000","last_active":"2024-03-08T06:03:23.299738+0000","last_peered":"2024-03-08T06:03:23.299738+0000","last_clean":"2024-03-08T06:03:23.299738+0000","last_became_active":"2024-03-08T06:03:21.110774+0000","last_became_peered":"2024-03-08T06:03:21.110774+0000","last_unstale":"2024-03-08T06:03:23.299738+0000","last_undegraded":"2024-03-08T06:03:23.299738+0000","last_fullsized":"2024-03-08T06:03:23.299738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:18:48.558283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.299833+0000","last_change":"2024-03-08T06:03:20.060802+0000","last_active":"2024-03-08T06:03:23.299833+0000","last_peered":"2024-03-08T06:03:23.299833+0000","last_clean":"2024-03-08T06:03:23.299833+0000","last_became_active":"2024-03-08T06:03:20.060402+0000","last_became_peered":"2024-03-08T06:03:20.060402+0000","last_unstale":"2024-03-08T06:03:23.299833+0000","last_undegraded":"2024-03-08T06:03:23.299833+0000","last_fullsized":"2024-03-08T06:03:23.299833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:27:56.194137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.274023+0000","last_change":"2024-03-08T06:03:21.105833+0000","last_active":"2024-03-08T06:03:23.274023+0000","last_peered":"2024-03-08T06:03:23.274023+0000","last_clean":"2024-03-08T06:03:23.274023+0000","last_became_active":"2024-03-08T06:03:21.105465+0000","last_became_peered":"2024-03-08T06:03:21.105465+0000","last_unstale":"2024-03-08T06:03:23.274023+0000","last_undegraded":"2024-03-08T06:03:23.274023+0000","last_fullsized":"2024-03-08T06:03:23.274023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:57:49.623008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087739+0000","last_change":"2024-03-08T06:03:20.072273+0000","last_active":"2024-03-08T06:03:22.087739+0000","last_peered":"2024-03-08T06:03:22.087739+0000","last_clean":"2024-03-08T06:03:22.087739+0000","last_became_active":"2024-03-08T06:03:20.071389+0000","last_became_peered":"2024-03-08T06:03:20.071389+0000","last_unstale":"2024-03-08T06:03:22.087739+0000","last_undegraded":"2024-03-08T06:03:22.087739+0000","last_fullsized":"2024-03-08T06:03:22.087739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:30.813078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090022+0000","last_change":"2024-03-08T06:03:21.089054+0000","last_active":"2024-03-08T06:03:22.090022+0000","last_peered":"2024-03-08T06:03:22.090022+0000","last_clean":"2024-03-08T06:03:22.090022+0000","last_became_active":"2024-03-08T06:03:21.080309+0000","last_became_peered":"2024-03-08T06:03:21.080309+0000","last_unstale":"2024-03-08T06:03:22.090022+0000","last_undegraded":"2024-03-08T06:03:22.090022+0000","last_fullsized":"2024-03-08T06:03:22.090022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:27.959321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.344070+0000","last_change":"2024-03-08T06:03:20.068126+0000","last_active":"2024-03-08T06:03:23.344070+0000","last_peered":"2024-03-08T06:03:23.344070+0000","last_clean":"2024-03-08T06:03:23.344070+0000","last_became_active":"2024-03-08T06:03:20.067828+0000","last_became_peered":"2024-03-08T06:03:20.067828+0000","last_unstale":"2024-03-08T06:03:23.344070+0000","last_undegraded":"2024-03-08T06:03:23.344070+0000","last_fullsized":"2024-03-08T06:03:23.344070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:26.946077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.089371+0000","last_change":"2024-03-08T06:03:21.082117+0000","last_active":"2024-03-08T06:03:22.089371+0000","last_peered":"2024-03-08T06:03:22.089371+0000","last_clean":"2024-03-08T06:03:22.089371+0000","last_became_active":"2024-03-08T06:03:21.081852+0000","last_became_peered":"2024-03-08T06:03:21.081852+0000","last_unstale":"2024-03-08T06:03:22.089371+0000","last_undegraded":"2024-03-08T06:03:22.089371+0000","last_fullsized":"2024-03-08T06:03:22.089371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:52:15.212911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.272822+0000","last_change":"2024-03-08T06:03:20.055291+0000","last_active":"2024-03-08T06:03:23.272822+0000","last_peered":"2024-03-08T06:03:23.272822+0000","last_clean":"2024-03-08T06:03:23.272822+0000","last_became_active":"2024-03-08T06:03:20.054907+0000","last_became_peered":"2024-03-08T06:03:20.054907+0000","last_unstale":"2024-03-08T06:03:23.272822+0000","last_undegraded":"2024-03-08T06:03:23.272822+0000","last_fullsized":"2024-03-08T06:03:23.272822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:04:32.971131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.272467+0000","last_change":"2024-03-08T06:03:21.092104+0000","last_active":"2024-03-08T06:03:23.272467+0000","last_peered":"2024-03-08T06:03:23.272467+0000","last_clean":"2024-03-08T06:03:23.272467+0000","last_became_active":"2024-03-08T06:03:21.091723+0000","last_became_peered":"2024-03-08T06:03:21.091723+0000","last_unstale":"2024-03-08T06:03:23.272467+0000","last_undegraded":"2024-03-08T06:03:23.272467+0000","last_fullsized":"2024-03-08T06:03:23.272467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:17:51.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.299087+0000","last_change":"2024-03-08T06:03:20.068308+0000","last_active":"2024-03-08T06:03:23.299087+0000","last_peered":"2024-03-08T06:03:23.299087+0000","last_clean":"2024-03-08T06:03:23.299087+0000","last_became_active":"2024-03-08T06:03:20.068036+0000","last_became_peered":"2024-03-08T06:03:20.068036+0000","last_unstale":"2024-03-08T06:03:23.299087+0000","last_undegraded":"2024-03-08T06:03:23.299087+0000","last_fullsized":"2024-03-08T06:03:23.299087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:28:12.116799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088404+0000","last_change":"2024-03-08T06:03:21.102514+0000","last_active":"2024-03-08T06:03:22.088404+0000","last_peered":"2024-03-08T06:03:22.088404+0000","last_clean":"2024-03-08T06:03:22.088404+0000","last_became_active":"2024-03-08T06:03:21.101780+0000","last_became_peered":"2024-03-08T06:03:21.101780+0000","last_unstale":"2024-03-08T06:03:22.088404+0000","last_undegraded":"2024-03-08T06:03:22.088404+0000","last_fullsized":"2024-03-08T06:03:22.088404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:00:39.301215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.343145+0000","last_change":"2024-03-08T06:03:20.049517+0000","last_active":"2024-03-08T06:03:23.343145+0000","last_peered":"2024-03-08T06:03:23.343145+0000","last_clean":"2024-03-08T06:03:23.343145+0000","last_became_active":"2024-03-08T06:03:20.047972+0000","last_became_peered":"2024-03-08T06:03:20.047972+0000","last_unstale":"2024-03-08T06:03:23.343145+0000","last_undegraded":"2024-03-08T06:03:23.343145+0000","last_fullsized":"2024-03-08T06:03:23.343145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:54:20.527395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.343246+0000","last_change":"2024-03-08T06:03:21.085035+0000","last_active":"2024-03-08T06:03:23.343246+0000","last_peered":"2024-03-08T06:03:23.343246+0000","last_clean":"2024-03-08T06:03:23.343246+0000","last_became_active":"2024-03-08T06:03:21.084676+0000","last_became_peered":"2024-03-08T06:03:21.084676+0000","last_unstale":"2024-03-08T06:03:23.343246+0000","last_undegraded":"2024-03-08T06:03:23.343246+0000","last_fullsized":"2024-03-08T06:03:23.343246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:24:30.832300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.923273+0000","last_change":"2024-03-08T06:03:20.065172+0000","last_active":"2024-03-08T06:03:23.923273+0000","last_peered":"2024-03-08T06:03:23.923273+0000","last_clean":"2024-03-08T06:03:23.923273+0000","last_became_active":"2024-03-08T06:03:20.064854+0000","last_became_peered":"2024-03-08T06:03:20.064854+0000","last_unstale":"2024-03-08T06:03:23.923273+0000","last_undegraded":"2024-03-08T06:03:23.923273+0000","last_fullsized":"2024-03-08T06:03:23.923273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:54:20.527395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087834+0000","last_change":"2024-03-08T06:03:21.101352+0000","last_active":"2024-03-08T06:03:22.087834+0000","last_peered":"2024-03-08T06:03:22.087834+0000","last_clean":"2024-03-08T06:03:22.087834+0000","last_became_active":"2024-03-08T06:03:21.101040+0000","last_became_peered":"2024-03-08T06:03:21.101040+0000","last_unstale":"2024-03-08T06:03:22.087834+0000","last_undegraded":"2024-03-08T06:03:22.087834+0000","last_fullsized":"2024-03-08T06:03:22.087834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:57:49.623008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087854+0000","last_change":"2024-03-08T06:03:20.057635+0000","last_active":"2024-03-08T06:03:22.087854+0000","last_peered":"2024-03-08T06:03:22.087854+0000","last_clean":"2024-03-08T06:03:22.087854+0000","last_became_active":"2024-03-08T06:03:20.057209+0000","last_became_peered":"2024-03-08T06:03:20.057209+0000","last_unstale":"2024-03-08T06:03:22.087854+0000","last_undegraded":"2024-03-08T06:03:22.087854+0000","last_fullsized":"2024-03-08T06:03:22.087854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:46:53.297684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090632+0000","last_change":"2024-03-08T06:03:21.100194+0000","last_active":"2024-03-08T06:03:22.090632+0000","last_peered":"2024-03-08T06:03:22.090632+0000","last_clean":"2024-03-08T06:03:22.090632+0000","last_became_active":"2024-03-08T06:03:21.099871+0000","last_became_peered":"2024-03-08T06:03:21.099871+0000","last_unstale":"2024-03-08T06:03:22.090632+0000","last_undegraded":"2024-03-08T06:03:22.090632+0000","last_fullsized":"2024-03-08T06:03:22.090632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:05:42.148812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.925550+0000","last_change":"2024-03-08T06:03:20.063658+0000","last_active":"2024-03-08T06:03:23.925550+0000","last_peered":"2024-03-08T06:03:23.925550+0000","last_clean":"2024-03-08T06:03:23.925550+0000","last_became_active":"2024-03-08T06:03:20.063364+0000","last_became_peered":"2024-03-08T06:03:20.063364+0000","last_unstale":"2024-03-08T06:03:23.925550+0000","last_undegraded":"2024-03-08T06:03:23.925550+0000","last_fullsized":"2024-03-08T06:03:23.925550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:48.579937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090948+0000","last_change":"2024-03-08T06:03:21.100719+0000","last_active":"2024-03-08T06:03:22.090948+0000","last_peered":"2024-03-08T06:03:22.090948+0000","last_clean":"2024-03-08T06:03:22.090948+0000","last_became_active":"2024-03-08T06:03:21.100356+0000","last_became_peered":"2024-03-08T06:03:21.100356+0000","last_unstale":"2024-03-08T06:03:22.090948+0000","last_undegraded":"2024-03-08T06:03:22.090948+0000","last_fullsized":"2024-03-08T06:03:22.090948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:17:15.821002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088072+0000","last_change":"2024-03-08T06:03:20.053836+0000","last_active":"2024-03-08T06:03:22.088072+0000","last_peered":"2024-03-08T06:03:22.088072+0000","last_clean":"2024-03-08T06:03:22.088072+0000","last_became_active":"2024-03-08T06:03:20.053485+0000","last_became_peered":"2024-03-08T06:03:20.053485+0000","last_unstale":"2024-03-08T06:03:22.088072+0000","last_undegraded":"2024-03-08T06:03:22.088072+0000","last_fullsized":"2024-03-08T06:03:22.088072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:41.633303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.299456+0000","last_change":"2024-03-08T06:03:21.097727+0000","last_active":"2024-03-08T06:03:23.299456+0000","last_peered":"2024-03-08T06:03:23.299456+0000","last_clean":"2024-03-08T06:03:23.299456+0000","last_became_active":"2024-03-08T06:03:21.096995+0000","last_became_peered":"2024-03-08T06:03:21.096995+0000","last_unstale":"2024-03-08T06:03:23.299456+0000","last_undegraded":"2024-03-08T06:03:23.299456+0000","last_fullsized":"2024-03-08T06:03:23.299456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:05:42.148812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.924541+0000","last_change":"2024-03-08T06:03:20.067426+0000","last_active":"2024-03-08T06:03:23.924541+0000","last_peered":"2024-03-08T06:03:23.924541+0000","last_clean":"2024-03-08T06:03:23.924541+0000","last_became_active":"2024-03-08T06:03:20.067090+0000","last_became_peered":"2024-03-08T06:03:20.067090+0000","last_unstale":"2024-03-08T06:03:23.924541+0000","last_undegraded":"2024-03-08T06:03:23.924541+0000","last_fullsized":"2024-03-08T06:03:23.924541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:54:47.826647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.089774+0000","last_change":"2024-03-08T06:03:21.107588+0000","last_active":"2024-03-08T06:03:22.089774+0000","last_peered":"2024-03-08T06:03:22.089774+0000","last_clean":"2024-03-08T06:03:22.089774+0000","last_became_active":"2024-03-08T06:03:21.107204+0000","last_became_peered":"2024-03-08T06:03:21.107204+0000","last_unstale":"2024-03-08T06:03:22.089774+0000","last_undegraded":"2024-03-08T06:03:22.089774+0000","last_fullsized":"2024-03-08T06:03:22.089774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:36:22.740638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088160+0000","last_change":"2024-03-08T06:03:16.679654+0000","last_active":"2024-03-08T06:03:22.088160+0000","last_peered":"2024-03-08T06:03:22.088160+0000","last_clean":"2024-03-08T06:03:22.088160+0000","last_became_active":"2024-03-08T06:03:16.676829+0000","last_became_peered":"2024-03-08T06:03:16.676829+0000","last_unstale":"2024-03-08T06:03:22.088160+0000","last_undegraded":"2024-03-08T06:03:22.088160+0000","last_fullsized":"2024-03-08T06:03:22.088160+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:14.800941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:14.800941+0000","last_clean_scrub_stamp":"2024-03-08T06:03:14.800941+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:20:09.927678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.298470+0000","last_change":"2024-03-08T06:03:20.066015+0000","last_active":"2024-03-08T06:03:23.298470+0000","last_peered":"2024-03-08T06:03:23.298470+0000","last_clean":"2024-03-08T06:03:23.298470+0000","last_became_active":"2024-03-08T06:03:20.065647+0000","last_became_peered":"2024-03-08T06:03:20.065647+0000","last_unstale":"2024-03-08T06:03:23.298470+0000","last_undegraded":"2024-03-08T06:03:23.298470+0000","last_fullsized":"2024-03-08T06:03:23.298470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:24:29.819056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.923778+0000","last_change":"2024-03-08T06:03:21.092065+0000","last_active":"2024-03-08T06:03:23.923778+0000","last_peered":"2024-03-08T06:03:23.923778+0000","last_clean":"2024-03-08T06:03:23.923778+0000","last_became_active":"2024-03-08T06:03:21.091753+0000","last_became_peered":"2024-03-08T06:03:21.091753+0000","last_unstale":"2024-03-08T06:03:23.923778+0000","last_undegraded":"2024-03-08T06:03:23.923778+0000","last_fullsized":"2024-03-08T06:03:23.923778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:27:57.207381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088016+0000","last_change":"2024-03-08T06:03:20.074566+0000","last_active":"2024-03-08T06:03:22.088016+0000","last_peered":"2024-03-08T06:03:22.088016+0000","last_clean":"2024-03-08T06:03:22.088016+0000","last_became_active":"2024-03-08T06:03:20.074234+0000","last_became_peered":"2024-03-08T06:03:20.074234+0000","last_unstale":"2024-03-08T06:03:22.088016+0000","last_undegraded":"2024-03-08T06:03:22.088016+0000","last_fullsized":"2024-03-08T06:03:22.088016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:22.024440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.272192+0000","last_change":"2024-03-08T06:03:21.100866+0000","last_active":"2024-03-08T06:03:23.272192+0000","last_peered":"2024-03-08T06:03:23.272192+0000","last_clean":"2024-03-08T06:03:23.272192+0000","last_became_active":"2024-03-08T06:03:21.100541+0000","last_became_peered":"2024-03-08T06:03:21.100541+0000","last_unstale":"2024-03-08T06:03:23.272192+0000","last_undegraded":"2024-03-08T06:03:23.272192+0000","last_fullsized":"2024-03-08T06:03:23.272192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:10:52.112651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.923754+0000","last_change":"2024-03-08T06:03:20.062458+0000","last_active":"2024-03-08T06:03:23.923754+0000","last_peered":"2024-03-08T06:03:23.923754+0000","last_clean":"2024-03-08T06:03:23.923754+0000","last_became_active":"2024-03-08T06:03:20.062017+0000","last_became_peered":"2024-03-08T06:03:20.062017+0000","last_unstale":"2024-03-08T06:03:23.923754+0000","last_undegraded":"2024-03-08T06:03:23.923754+0000","last_fullsized":"2024-03-08T06:03:23.923754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:44:31.139813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087236+0000","last_change":"2024-03-08T06:03:21.083073+0000","last_active":"2024-03-08T06:03:22.087236+0000","last_peered":"2024-03-08T06:03:22.087236+0000","last_clean":"2024-03-08T06:03:22.087236+0000","last_became_active":"2024-03-08T06:03:21.082544+0000","last_became_peered":"2024-03-08T06:03:21.082544+0000","last_unstale":"2024-03-08T06:03:22.087236+0000","last_undegraded":"2024-03-08T06:03:22.087236+0000","last_fullsized":"2024-03-08T06:03:22.087236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:17:51.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.299313+0000","last_change":"2024-03-08T06:03:20.065501+0000","last_active":"2024-03-08T06:03:23.299313+0000","last_peered":"2024-03-08T06:03:23.299313+0000","last_clean":"2024-03-08T06:03:23.299313+0000","last_became_active":"2024-03-08T06:03:20.065200+0000","last_became_peered":"2024-03-08T06:03:20.065200+0000","last_unstale":"2024-03-08T06:03:23.299313+0000","last_undegraded":"2024-03-08T06:03:23.299313+0000","last_fullsized":"2024-03-08T06:03:23.299313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:17:50.510674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087483+0000","last_change":"2024-03-08T06:03:21.091986+0000","last_active":"2024-03-08T06:03:22.087483+0000","last_peered":"2024-03-08T06:03:22.087483+0000","last_clean":"2024-03-08T06:03:22.087483+0000","last_became_active":"2024-03-08T06:03:21.091675+0000","last_became_peered":"2024-03-08T06:03:21.091675+0000","last_unstale":"2024-03-08T06:03:22.087483+0000","last_undegraded":"2024-03-08T06:03:22.087483+0000","last_fullsized":"2024-03-08T06:03:22.087483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:31.826322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.086969+0000","last_change":"2024-03-08T06:03:20.065327+0000","last_active":"2024-03-08T06:03:22.086969+0000","last_peered":"2024-03-08T06:03:22.086969+0000","last_clean":"2024-03-08T06:03:22.086969+0000","last_became_active":"2024-03-08T06:03:20.064891+0000","last_became_peered":"2024-03-08T06:03:20.064891+0000","last_unstale":"2024-03-08T06:03:22.086969+0000","last_undegraded":"2024-03-08T06:03:22.086969+0000","last_fullsized":"2024-03-08T06:03:22.086969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:26.946077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.299660+0000","last_change":"2024-03-08T06:03:21.097867+0000","last_active":"2024-03-08T06:03:23.299660+0000","last_peered":"2024-03-08T06:03:23.299660+0000","last_clean":"2024-03-08T06:03:23.299660+0000","last_became_active":"2024-03-08T06:03:21.097495+0000","last_became_peered":"2024-03-08T06:03:21.097495+0000","last_unstale":"2024-03-08T06:03:23.299660+0000","last_undegraded":"2024-03-08T06:03:23.299660+0000","last_fullsized":"2024-03-08T06:03:23.299660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:19:57.197522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090113+0000","last_change":"2024-03-08T06:03:20.069667+0000","last_active":"2024-03-08T06:03:22.090113+0000","last_peered":"2024-03-08T06:03:22.090113+0000","last_clean":"2024-03-08T06:03:22.090113+0000","last_became_active":"2024-03-08T06:03:20.069428+0000","last_became_peered":"2024-03-08T06:03:20.069428+0000","last_unstale":"2024-03-08T06:03:22.090113+0000","last_undegraded":"2024-03-08T06:03:22.090113+0000","last_fullsized":"2024-03-08T06:03:22.090113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:21:04.927163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.086921+0000","last_change":"2024-03-08T06:03:21.084065+0000","last_active":"2024-03-08T06:03:22.086921+0000","last_peered":"2024-03-08T06:03:22.086921+0000","last_clean":"2024-03-08T06:03:22.086921+0000","last_became_active":"2024-03-08T06:03:21.083747+0000","last_became_peered":"2024-03-08T06:03:21.083747+0000","last_unstale":"2024-03-08T06:03:22.086921+0000","last_undegraded":"2024-03-08T06:03:22.086921+0000","last_fullsized":"2024-03-08T06:03:22.086921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:24:30.832300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087595+0000","last_change":"2024-03-08T06:03:20.059341+0000","last_active":"2024-03-08T06:03:22.087595+0000","last_peered":"2024-03-08T06:03:22.087595+0000","last_clean":"2024-03-08T06:03:22.087595+0000","last_became_active":"2024-03-08T06:03:20.059016+0000","last_became_peered":"2024-03-08T06:03:20.059016+0000","last_unstale":"2024-03-08T06:03:22.087595+0000","last_undegraded":"2024-03-08T06:03:22.087595+0000","last_fullsized":"2024-03-08T06:03:22.087595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:22.024440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.924777+0000","last_change":"2024-03-08T06:03:21.088353+0000","last_active":"2024-03-08T06:03:23.924777+0000","last_peered":"2024-03-08T06:03:23.924777+0000","last_clean":"2024-03-08T06:03:23.924777+0000","last_became_active":"2024-03-08T06:03:21.088046+0000","last_became_peered":"2024-03-08T06:03:21.088046+0000","last_unstale":"2024-03-08T06:03:23.924777+0000","last_undegraded":"2024-03-08T06:03:23.924777+0000","last_fullsized":"2024-03-08T06:03:23.924777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:48:37.493932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.343930+0000","last_change":"2024-03-08T06:03:20.071250+0000","last_active":"2024-03-08T06:03:23.343930+0000","last_peered":"2024-03-08T06:03:23.343930+0000","last_clean":"2024-03-08T06:03:23.343930+0000","last_became_active":"2024-03-08T06:03:20.070870+0000","last_became_peered":"2024-03-08T06:03:20.070870+0000","last_unstale":"2024-03-08T06:03:23.343930+0000","last_undegraded":"2024-03-08T06:03:23.343930+0000","last_fullsized":"2024-03-08T06:03:23.343930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:30.813078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.273344+0000","last_change":"2024-03-08T06:03:21.097827+0000","last_active":"2024-03-08T06:03:23.273344+0000","last_peered":"2024-03-08T06:03:23.273344+0000","last_clean":"2024-03-08T06:03:23.273344+0000","last_became_active":"2024-03-08T06:03:21.097542+0000","last_became_peered":"2024-03-08T06:03:21.097542+0000","last_unstale":"2024-03-08T06:03:23.273344+0000","last_undegraded":"2024-03-08T06:03:23.273344+0000","last_fullsized":"2024-03-08T06:03:23.273344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:29:07.055814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087648+0000","last_change":"2024-03-08T06:03:20.064310+0000","last_active":"2024-03-08T06:03:22.087648+0000","last_peered":"2024-03-08T06:03:22.087648+0000","last_clean":"2024-03-08T06:03:22.087648+0000","last_became_active":"2024-03-08T06:03:20.063983+0000","last_became_peered":"2024-03-08T06:03:20.063983+0000","last_unstale":"2024-03-08T06:03:22.087648+0000","last_undegraded":"2024-03-08T06:03:22.087648+0000","last_fullsized":"2024-03-08T06:03:22.087648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:48.579937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087328+0000","last_change":"2024-03-08T06:03:21.085108+0000","last_active":"2024-03-08T06:03:22.087328+0000","last_peered":"2024-03-08T06:03:22.087328+0000","last_clean":"2024-03-08T06:03:22.087328+0000","last_became_active":"2024-03-08T06:03:21.084673+0000","last_became_peered":"2024-03-08T06:03:21.084673+0000","last_unstale":"2024-03-08T06:03:22.087328+0000","last_undegraded":"2024-03-08T06:03:22.087328+0000","last_fullsized":"2024-03-08T06:03:22.087328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:49.593181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088223+0000","last_change":"2024-03-08T06:03:20.054745+0000","last_active":"2024-03-08T06:03:22.088223+0000","last_peered":"2024-03-08T06:03:22.088223+0000","last_clean":"2024-03-08T06:03:22.088223+0000","last_became_active":"2024-03-08T06:03:20.054461+0000","last_became_peered":"2024-03-08T06:03:20.054461+0000","last_unstale":"2024-03-08T06:03:22.088223+0000","last_undegraded":"2024-03-08T06:03:22.088223+0000","last_fullsized":"2024-03-08T06:03:22.088223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:54:47.826647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.924423+0000","last_change":"2024-03-08T06:03:21.079197+0000","last_active":"2024-03-08T06:03:23.924423+0000","last_peered":"2024-03-08T06:03:23.924423+0000","last_clean":"2024-03-08T06:03:23.924423+0000","last_became_active":"2024-03-08T06:03:21.078822+0000","last_became_peered":"2024-03-08T06:03:21.078822+0000","last_unstale":"2024-03-08T06:03:23.924423+0000","last_undegraded":"2024-03-08T06:03:23.924423+0000","last_fullsized":"2024-03-08T06:03:23.924423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:57:16.249537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087455+0000","last_change":"2024-03-08T06:03:20.071672+0000","last_active":"2024-03-08T06:03:22.087455+0000","last_peered":"2024-03-08T06:03:22.087455+0000","last_clean":"2024-03-08T06:03:22.087455+0000","last_became_active":"2024-03-08T06:03:20.070816+0000","last_became_peered":"2024-03-08T06:03:20.070816+0000","last_unstale":"2024-03-08T06:03:22.087455+0000","last_undegraded":"2024-03-08T06:03:22.087455+0000","last_fullsized":"2024-03-08T06:03:22.087455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:48.579937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.925568+0000","last_change":"2024-03-08T06:03:21.089795+0000","last_active":"2024-03-08T06:03:23.925568+0000","last_peered":"2024-03-08T06:03:23.925568+0000","last_clean":"2024-03-08T06:03:23.925568+0000","last_became_active":"2024-03-08T06:03:21.089491+0000","last_became_peered":"2024-03-08T06:03:21.089491+0000","last_unstale":"2024-03-08T06:03:23.925568+0000","last_undegraded":"2024-03-08T06:03:23.925568+0000","last_fullsized":"2024-03-08T06:03:23.925568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:00:39.301215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088562+0000","last_change":"2024-03-08T06:03:20.063251+0000","last_active":"2024-03-08T06:03:22.088562+0000","last_peered":"2024-03-08T06:03:22.088562+0000","last_clean":"2024-03-08T06:03:22.088562+0000","last_became_active":"2024-03-08T06:03:20.061931+0000","last_became_peered":"2024-03-08T06:03:20.061931+0000","last_unstale":"2024-03-08T06:03:22.088562+0000","last_undegraded":"2024-03-08T06:03:22.088562+0000","last_fullsized":"2024-03-08T06:03:22.088562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:41.633303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.343248+0000","last_change":"2024-03-08T06:03:21.087608+0000","last_active":"2024-03-08T06:03:23.343248+0000","last_peered":"2024-03-08T06:03:23.343248+0000","last_clean":"2024-03-08T06:03:23.343248+0000","last_became_active":"2024-03-08T06:03:21.086636+0000","last_became_peered":"2024-03-08T06:03:21.086636+0000","last_unstale":"2024-03-08T06:03:23.343248+0000","last_undegraded":"2024-03-08T06:03:23.343248+0000","last_fullsized":"2024-03-08T06:03:23.343248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:23:37.355382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.299458+0000","last_change":"2024-03-08T06:03:21.099738+0000","last_active":"2024-03-08T06:03:23.299458+0000","last_peered":"2024-03-08T06:03:23.299458+0000","last_clean":"2024-03-08T06:03:23.299458+0000","last_became_active":"2024-03-08T06:03:21.098798+0000","last_became_peered":"2024-03-08T06:03:21.098798+0000","last_unstale":"2024-03-08T06:03:23.299458+0000","last_undegraded":"2024-03-08T06:03:23.299458+0000","last_fullsized":"2024-03-08T06:03:23.299458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:17:34.427952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088884+0000","last_change":"2024-03-08T06:03:20.068500+0000","last_active":"2024-03-08T06:03:22.088884+0000","last_peered":"2024-03-08T06:03:22.088884+0000","last_clean":"2024-03-08T06:03:22.088884+0000","last_became_active":"2024-03-08T06:03:20.068165+0000","last_became_peered":"2024-03-08T06:03:20.068165+0000","last_unstale":"2024-03-08T06:03:22.088884+0000","last_undegraded":"2024-03-08T06:03:22.088884+0000","last_fullsized":"2024-03-08T06:03:22.088884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:30.813078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.299229+0000","last_change":"2024-03-08T06:03:21.100116+0000","last_active":"2024-03-08T06:03:23.299229+0000","last_peered":"2024-03-08T06:03:23.299229+0000","last_clean":"2024-03-08T06:03:23.299229+0000","last_became_active":"2024-03-08T06:03:21.099049+0000","last_became_peered":"2024-03-08T06:03:21.099049+0000","last_unstale":"2024-03-08T06:03:23.299229+0000","last_undegraded":"2024-03-08T06:03:23.299229+0000","last_fullsized":"2024-03-08T06:03:23.299229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:36:22.740638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.089860+0000","last_change":"2024-03-08T06:03:20.073962+0000","last_active":"2024-03-08T06:03:22.089860+0000","last_peered":"2024-03-08T06:03:22.089860+0000","last_clean":"2024-03-08T06:03:22.089860+0000","last_became_active":"2024-03-08T06:03:20.073658+0000","last_became_peered":"2024-03-08T06:03:20.073658+0000","last_unstale":"2024-03-08T06:03:22.089860+0000","last_undegraded":"2024-03-08T06:03:22.089860+0000","last_fullsized":"2024-03-08T06:03:22.089860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:26.946077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.273644+0000","last_change":"2024-03-08T06:03:21.105031+0000","last_active":"2024-03-08T06:03:23.273644+0000","last_peered":"2024-03-08T06:03:23.273644+0000","last_clean":"2024-03-08T06:03:23.273644+0000","last_became_active":"2024-03-08T06:03:21.104736+0000","last_became_peered":"2024-03-08T06:03:21.104736+0000","last_unstale":"2024-03-08T06:03:23.273644+0000","last_undegraded":"2024-03-08T06:03:23.273644+0000","last_fullsized":"2024-03-08T06:03:23.273644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:57:16.249537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.924886+0000","last_change":"2024-03-08T06:03:20.061969+0000","last_active":"2024-03-08T06:03:23.924886+0000","last_peered":"2024-03-08T06:03:23.924886+0000","last_clean":"2024-03-08T06:03:23.924886+0000","last_became_active":"2024-03-08T06:03:20.061568+0000","last_became_peered":"2024-03-08T06:03:20.061568+0000","last_unstale":"2024-03-08T06:03:23.924886+0000","last_undegraded":"2024-03-08T06:03:23.924886+0000","last_fullsized":"2024-03-08T06:03:23.924886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:14:52.512990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.924692+0000","last_change":"2024-03-08T06:03:21.091233+0000","last_active":"2024-03-08T06:03:23.924692+0000","last_peered":"2024-03-08T06:03:23.924692+0000","last_clean":"2024-03-08T06:03:23.924692+0000","last_became_active":"2024-03-08T06:03:21.090260+0000","last_became_peered":"2024-03-08T06:03:21.090260+0000","last_unstale":"2024-03-08T06:03:23.924692+0000","last_undegraded":"2024-03-08T06:03:23.924692+0000","last_fullsized":"2024-03-08T06:03:23.924692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:57:49.623008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.274355+0000","last_change":"2024-03-08T06:03:20.066538+0000","last_active":"2024-03-08T06:03:23.274355+0000","last_peered":"2024-03-08T06:03:23.274355+0000","last_clean":"2024-03-08T06:03:23.274355+0000","last_became_active":"2024-03-08T06:03:20.065542+0000","last_became_peered":"2024-03-08T06:03:20.065542+0000","last_unstale":"2024-03-08T06:03:23.274355+0000","last_undegraded":"2024-03-08T06:03:23.274355+0000","last_fullsized":"2024-03-08T06:03:23.274355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:14:52.512990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T06:03:29.429 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T06:03:29.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.683+0000 7f1790a00640 1 Processor -- start 2024-03-08T06:03:29.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.683+0000 7f1790a00640 1 -- start start 2024-03-08T06:03:29.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.685+0000 7f1790a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f178c15a770 0x7f178c15ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:29.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.685+0000 7f1790a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f178c06ea40 0x7f178c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:29.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.685+0000 7f1790a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178c0cd020 con 0x7f178c0cc310 2024-03-08T06:03:29.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.685+0000 7f1790a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178c0ccdd0 con 0x7f178c06ea40 2024-03-08T06:03:29.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.685+0000 7f1790a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c15e8f0 con 0x7f178c15a770 2024-03-08T06:03:29.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.685+0000 7f178be00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f178c06ea40 0x7f178c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:29.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.685+0000 7f178be00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f178c06ea40 0x7f178c15ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33806/0 (socket says 172.21.15.19:33806) 2024-03-08T06:03:29.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.685+0000 7f178be00640 1 -- 172.21.15.19:0/2300938678 learned_addr learned my addr 172.21.15.19:0/2300938678 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:29.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.686+0000 7f178b400640 1 --2- 172.21.15.19:0/2300938678 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f178c15a770 0x7f178c15ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:29.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.686+0000 7f178be00640 1 -- 172.21.15.19:0/2300938678 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f178c15a770 msgr2=0x7f178c15ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:29.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.686+0000 7f178be00640 1 --2- 172.21.15.19:0/2300938678 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f178c15a770 0x7f178c15ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:29.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.686+0000 7f178be00640 1 -- 172.21.15.19:0/2300938678 >> v1:172.21.15.19:6789/0 conn(0x7f178c0cc310 legacy=0x7f178c06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:29.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.686+0000 7f178be00640 1 -- 172.21.15.19:0/2300938678 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c0cd300 con 0x7f178c06ea40 2024-03-08T06:03:29.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.686+0000 7f178a000640 1 -- 172.21.15.19:0/2300938678 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807074958 0 0) 0x7f178c0cd020 con 0x7f178c0cc310 2024-03-08T06:03:29.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.687+0000 7f178be00640 1 --2- 172.21.15.19:0/2300938678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f178c06ea40 0x7f178c15ab50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1784009e50 tx=0x7f178402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c76ba1e3b91303b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:29.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.687+0000 7f178a000640 1 -- 172.21.15.19:0/2300938678 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178402cb00 con 0x7f178c06ea40 2024-03-08T06:03:29.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.687+0000 7f178a000640 1 -- 172.21.15.19:0/2300938678 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178402cca0 con 0x7f178c06ea40 2024-03-08T06:03:29.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.687+0000 7f178a000640 1 -- 172.21.15.19:0/2300938678 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784034610 con 0x7f178c06ea40 2024-03-08T06:03:29.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.688+0000 7f1790a00640 1 -- 172.21.15.19:0/2300938678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f178c06ea40 msgr2=0x7f178c15ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:29.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.688+0000 7f1790a00640 1 --2- 172.21.15.19:0/2300938678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f178c06ea40 0x7f178c15ab50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1784009e50 tx=0x7f178402bf60 comp rx=0 tx=0).stop 2024-03-08T06:03:29.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.688+0000 7f1790a00640 1 -- 172.21.15.19:0/2300938678 shutdown_connections 2024-03-08T06:03:29.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.688+0000 7f1790a00640 1 --2- 172.21.15.19:0/2300938678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f178c06ea40 0x7f178c15ab50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:29.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.688+0000 7f1790a00640 1 --2- 172.21.15.19:0/2300938678 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f178c15a770 0x7f178c15ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:29.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.688+0000 7f1790a00640 1 -- 172.21.15.19:0/2300938678 >> 172.21.15.19:0/2300938678 conn(0x7f178c0b1850 msgr2=0x7f178c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:29.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.688+0000 7f1790a00640 1 -- 172.21.15.19:0/2300938678 shutdown_connections 2024-03-08T06:03:29.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.688+0000 7f1790a00640 1 -- 172.21.15.19:0/2300938678 wait complete. 2024-03-08T06:03:29.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.689+0000 7f1790a00640 1 Processor -- start 2024-03-08T06:03:29.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.690+0000 7f1790a00640 1 -- start start 2024-03-08T06:03:29.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.690+0000 7f1790a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f178c06ea40 0x7f178c1419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:29.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.690+0000 7f1790a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f178c0cc310 0x7f178c153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:29.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.690+0000 7f1790a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f178c15a770 0x7f178c15cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:29.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.690+0000 7f1790a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c0b4e00 con 0x7f178c15a770 2024-03-08T06:03:29.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.690+0000 7f1790a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c15f2c0 con 0x7f178c06ea40 2024-03-08T06:03:29.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.690+0000 7f1790a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c0cc790 con 0x7f178c0cc310 2024-03-08T06:03:29.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.691+0000 7f178be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f178c15a770 0x7f178c15cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:29.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.691+0000 7f178be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f178c15a770 0x7f178c15cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33814/0 (socket says 172.21.15.19:33814) 2024-03-08T06:03:29.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.691+0000 7f178be00640 1 -- 172.21.15.19:0/1256601324 learned_addr learned my addr 172.21.15.19:0/1256601324 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:29.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.691+0000 7f178b400640 1 --2- 172.21.15.19:0/1256601324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f178c06ea40 0x7f178c1419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:29.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.691+0000 7f178aa00640 1 --2- 172.21.15.19:0/1256601324 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f178c0cc310 0x7f178c153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:29.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.691+0000 7f178be00640 1 -- 172.21.15.19:0/1256601324 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f178c0cc310 msgr2=0x7f178c153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:29.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.691+0000 7f178be00640 1 --2- 172.21.15.19:0/1256601324 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f178c0cc310 0x7f178c153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:29.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.691+0000 7f178be00640 1 -- 172.21.15.19:0/1256601324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f178c06ea40 msgr2=0x7f178c1419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:29.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.691+0000 7f178be00640 1 --2- 172.21.15.19:0/1256601324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f178c06ea40 0x7f178c1419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:29.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.691+0000 7f178be00640 1 -- 172.21.15.19:0/1256601324 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c14d320 con 0x7f178c15a770 2024-03-08T06:03:29.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.691+0000 7f178aa00640 1 --2- 172.21.15.19:0/1256601324 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f178c0cc310 0x7f178c153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:29.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.691+0000 7f178b400640 1 --2- 172.21.15.19:0/1256601324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f178c06ea40 0x7f178c1419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:29.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.691+0000 7f178be00640 1 --2- 172.21.15.19:0/1256601324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f178c15a770 0x7f178c15cf40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1784036040 tx=0x7f1784004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:29.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.692+0000 7f1783400640 1 -- 172.21.15.19:0/1256601324 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784043030 con 0x7f178c15a770 2024-03-08T06:03:29.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.692+0000 7f1783400640 1 -- 172.21.15.19:0/1256601324 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178402ce50 con 0x7f178c15a770 2024-03-08T06:03:29.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.692+0000 7f1783400640 1 -- 172.21.15.19:0/1256601324 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784009510 con 0x7f178c15a770 2024-03-08T06:03:29.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.692+0000 7f1790a00640 1 -- 172.21.15.19:0/1256601324 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178c14d600 con 0x7f178c15a770 2024-03-08T06:03:29.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.692+0000 7f1790a00640 1 -- 172.21.15.19:0/1256601324 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f178c14dbc0 con 0x7f178c15a770 2024-03-08T06:03:29.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.693+0000 7f1790a00640 1 -- 172.21.15.19:0/1256601324 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178c075100 con 0x7f178c15a770 2024-03-08T06:03:29.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.694+0000 7f1783400640 1 -- 172.21.15.19:0/1256601324 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1784046070 con 0x7f178c15a770 2024-03-08T06:03:29.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.695+0000 7f1783400640 1 --2- 172.21.15.19:0/1256601324 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f176c06b4d0 0x7f176c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:29.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.695+0000 7f1783400640 1 -- 172.21.15.19:0/1256601324 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17840ac540 con 0x7f178c15a770 2024-03-08T06:03:29.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.695+0000 7f178b400640 1 --2- 172.21.15.19:0/1256601324 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f176c06b4d0 0x7f176c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:29.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.696+0000 7f178b400640 1 --2- 172.21.15.19:0/1256601324 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f176c06b4d0 0x7f176c06d990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f177c006fd0 tx=0x7f177c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:29.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.699+0000 7f1783400640 1 -- 172.21.15.19:0/1256601324 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f178404d070 con 0x7f178c15a770 2024-03-08T06:03:29.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.888+0000 7f1790a00640 1 -- 172.21.15.19:0/1256601324 --> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f178c14d0d0 con 0x7f176c06b4d0 2024-03-08T06:03:29.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.907+0000 7f1783400640 1 -- 172.21.15.19:0/1256601324 <== mgr.4107 v2:172.21.15.19:6832/3589745192 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251915 (secure 0 0 0) 0x7f178c14d0d0 con 0x7f176c06b4d0 2024-03-08T06:03:29.912 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:29.913 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-08T06:03:29.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.912+0000 7f1790a00640 1 -- 172.21.15.19:0/1256601324 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f176c06b4d0 msgr2=0x7f176c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:29.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.912+0000 7f1790a00640 1 --2- 172.21.15.19:0/1256601324 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f176c06b4d0 0x7f176c06d990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f177c006fd0 tx=0x7f177c008040 comp rx=0 tx=0).stop 2024-03-08T06:03:29.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.912+0000 7f1790a00640 1 -- 172.21.15.19:0/1256601324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f178c15a770 msgr2=0x7f178c15cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:29.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.912+0000 7f1790a00640 1 --2- 172.21.15.19:0/1256601324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f178c15a770 0x7f178c15cf40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1784036040 tx=0x7f1784004a40 comp rx=0 tx=0).stop 2024-03-08T06:03:29.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.913+0000 7f1790a00640 1 -- 172.21.15.19:0/1256601324 shutdown_connections 2024-03-08T06:03:29.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.913+0000 7f1790a00640 1 --2- 172.21.15.19:0/1256601324 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f176c06b4d0 0x7f176c06d990 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:29.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.913+0000 7f1790a00640 1 --2- 172.21.15.19:0/1256601324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f178c15a770 0x7f178c15cf40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:29.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.913+0000 7f1790a00640 1 --2- 172.21.15.19:0/1256601324 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f178c0cc310 0x7f178c153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:29.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.913+0000 7f1790a00640 1 --2- 172.21.15.19:0/1256601324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f178c06ea40 0x7f178c1419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:29.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.913+0000 7f1790a00640 1 -- 172.21.15.19:0/1256601324 >> 172.21.15.19:0/1256601324 conn(0x7f178c0b1850 msgr2=0x7f178c071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:29.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.913+0000 7f1790a00640 1 -- 172.21.15.19:0/1256601324 shutdown_connections 2024-03-08T06:03:29.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:29.913+0000 7f1790a00640 1 -- 172.21.15.19:0/1256601324 wait complete. 2024-03-08T06:03:29.930 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-03-08T06:03:28.077846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235872,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738848,"statfs":{"total":773094113280,"available":772852580352,"internally_reserved":0,"allocated":2990080,"data_stored":1790396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":20,"num_read_kb":18,"num_write":81,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002424"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090939+0000","last_change":"2024-03-08T06:03:21.089349+0000","last_active":"2024-03-08T06:03:22.090939+0000","last_peered":"2024-03-08T06:03:22.090939+0000","last_clean":"2024-03-08T06:03:22.090939+0000","last_became_active":"2024-03-08T06:03:21.085662+0000","last_became_peered":"2024-03-08T06:03:21.085662+0000","last_unstale":"2024-03-08T06:03:22.090939+0000","last_undegraded":"2024-03-08T06:03:22.090939+0000","last_fullsized":"2024-03-08T06:03:22.090939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:18:48.558283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087395+0000","last_change":"2024-03-08T06:03:21.089313+0000","last_active":"2024-03-08T06:03:22.087395+0000","last_peered":"2024-03-08T06:03:22.087395+0000","last_clean":"2024-03-08T06:03:22.087395+0000","last_became_active":"2024-03-08T06:03:21.088958+0000","last_became_peered":"2024-03-08T06:03:21.088958+0000","last_unstale":"2024-03-08T06:03:22.087395+0000","last_undegraded":"2024-03-08T06:03:22.087395+0000","last_fullsized":"2024-03-08T06:03:22.087395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:23:37.355382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.272947+0000","last_change":"2024-03-08T06:03:21.098797+0000","last_active":"2024-03-08T06:03:23.272947+0000","last_peered":"2024-03-08T06:03:23.272947+0000","last_clean":"2024-03-08T06:03:23.272947+0000","last_became_active":"2024-03-08T06:03:21.098387+0000","last_became_peered":"2024-03-08T06:03:21.098387+0000","last_unstale":"2024-03-08T06:03:23.272947+0000","last_undegraded":"2024-03-08T06:03:23.272947+0000","last_fullsized":"2024-03-08T06:03:23.272947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:23:37.355382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.298964+0000","last_change":"2024-03-08T06:03:21.099948+0000","last_active":"2024-03-08T06:03:23.298964+0000","last_peered":"2024-03-08T06:03:23.298964+0000","last_clean":"2024-03-08T06:03:23.298964+0000","last_became_active":"2024-03-08T06:03:21.097388+0000","last_became_peered":"2024-03-08T06:03:21.097388+0000","last_unstale":"2024-03-08T06:03:23.298964+0000","last_undegraded":"2024-03-08T06:03:23.298964+0000","last_fullsized":"2024-03-08T06:03:23.298964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:00:39.301215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088264+0000","last_change":"2024-03-08T06:03:21.080856+0000","last_active":"2024-03-08T06:03:22.088264+0000","last_peered":"2024-03-08T06:03:22.088264+0000","last_clean":"2024-03-08T06:03:22.088264+0000","last_became_active":"2024-03-08T06:03:21.080513+0000","last_became_peered":"2024-03-08T06:03:21.080513+0000","last_unstale":"2024-03-08T06:03:22.088264+0000","last_undegraded":"2024-03-08T06:03:22.088264+0000","last_fullsized":"2024-03-08T06:03:22.088264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:49:03.245653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.298447+0000","last_change":"2024-03-08T06:03:21.106729+0000","last_active":"2024-03-08T06:03:23.298447+0000","last_peered":"2024-03-08T06:03:23.298447+0000","last_clean":"2024-03-08T06:03:23.298447+0000","last_became_active":"2024-03-08T06:03:21.106444+0000","last_became_peered":"2024-03-08T06:03:21.106444+0000","last_unstale":"2024-03-08T06:03:23.298447+0000","last_undegraded":"2024-03-08T06:03:23.298447+0000","last_fullsized":"2024-03-08T06:03:23.298447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:48:37.493932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087914+0000","last_change":"2024-03-08T06:03:21.091772+0000","last_active":"2024-03-08T06:03:22.087914+0000","last_peered":"2024-03-08T06:03:22.087914+0000","last_clean":"2024-03-08T06:03:22.087914+0000","last_became_active":"2024-03-08T06:03:21.091340+0000","last_became_peered":"2024-03-08T06:03:21.091340+0000","last_unstale":"2024-03-08T06:03:22.087914+0000","last_undegraded":"2024-03-08T06:03:22.087914+0000","last_fullsized":"2024-03-08T06:03:22.087914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:48:37.493932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.922963+0000","last_change":"2024-03-08T06:03:21.091248+0000","last_active":"2024-03-08T06:03:23.922963+0000","last_peered":"2024-03-08T06:03:23.922963+0000","last_clean":"2024-03-08T06:03:23.922963+0000","last_became_active":"2024-03-08T06:03:21.090881+0000","last_became_peered":"2024-03-08T06:03:21.090881+0000","last_unstale":"2024-03-08T06:03:23.922963+0000","last_undegraded":"2024-03-08T06:03:23.922963+0000","last_fullsized":"2024-03-08T06:03:23.922963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:17:51.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090833+0000","last_change":"2024-03-08T06:03:21.116525+0000","last_active":"2024-03-08T06:03:22.090833+0000","last_peered":"2024-03-08T06:03:22.090833+0000","last_clean":"2024-03-08T06:03:22.090833+0000","last_became_active":"2024-03-08T06:03:21.116143+0000","last_became_peered":"2024-03-08T06:03:21.116143+0000","last_unstale":"2024-03-08T06:03:22.090833+0000","last_undegraded":"2024-03-08T06:03:22.090833+0000","last_fullsized":"2024-03-08T06:03:22.090833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:19:57.197522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.344189+0000","last_change":"2024-03-08T06:03:21.108467+0000","last_active":"2024-03-08T06:03:23.344189+0000","last_peered":"2024-03-08T06:03:23.344189+0000","last_clean":"2024-03-08T06:03:23.344189+0000","last_became_active":"2024-03-08T06:03:21.108167+0000","last_became_peered":"2024-03-08T06:03:21.108167+0000","last_unstale":"2024-03-08T06:03:23.344189+0000","last_undegraded":"2024-03-08T06:03:23.344189+0000","last_fullsized":"2024-03-08T06:03:23.344189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:57:16.249537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.343758+0000","last_change":"2024-03-08T06:03:21.097402+0000","last_active":"2024-03-08T06:03:23.343758+0000","last_peered":"2024-03-08T06:03:23.343758+0000","last_clean":"2024-03-08T06:03:23.343758+0000","last_became_active":"2024-03-08T06:03:21.097092+0000","last_became_peered":"2024-03-08T06:03:21.097092+0000","last_unstale":"2024-03-08T06:03:23.343758+0000","last_undegraded":"2024-03-08T06:03:23.343758+0000","last_fullsized":"2024-03-08T06:03:23.343758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:29:07.055814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.089691+0000","last_change":"2024-03-08T06:03:21.094282+0000","last_active":"2024-03-08T06:03:22.089691+0000","last_peered":"2024-03-08T06:03:22.089691+0000","last_clean":"2024-03-08T06:03:22.089691+0000","last_became_active":"2024-03-08T06:03:21.093991+0000","last_became_peered":"2024-03-08T06:03:21.093991+0000","last_unstale":"2024-03-08T06:03:22.089691+0000","last_undegraded":"2024-03-08T06:03:22.089691+0000","last_fullsized":"2024-03-08T06:03:22.089691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:42.646547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.925405+0000","last_change":"2024-03-08T06:03:21.089482+0000","last_active":"2024-03-08T06:03:23.925405+0000","last_peered":"2024-03-08T06:03:23.925405+0000","last_clean":"2024-03-08T06:03:23.925405+0000","last_became_active":"2024-03-08T06:03:21.088934+0000","last_became_peered":"2024-03-08T06:03:21.088934+0000","last_unstale":"2024-03-08T06:03:23.925405+0000","last_undegraded":"2024-03-08T06:03:23.925405+0000","last_fullsized":"2024-03-08T06:03:23.925405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:49:03.245653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.272359+0000","last_change":"2024-03-08T06:03:21.100913+0000","last_active":"2024-03-08T06:03:23.272359+0000","last_peered":"2024-03-08T06:03:23.272359+0000","last_clean":"2024-03-08T06:03:23.272359+0000","last_became_active":"2024-03-08T06:03:21.097463+0000","last_became_peered":"2024-03-08T06:03:21.097463+0000","last_unstale":"2024-03-08T06:03:23.272359+0000","last_undegraded":"2024-03-08T06:03:23.272359+0000","last_fullsized":"2024-03-08T06:03:23.272359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:24:30.832300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087416+0000","last_change":"2024-03-08T06:03:21.073630+0000","last_active":"2024-03-08T06:03:22.087416+0000","last_peered":"2024-03-08T06:03:22.087416+0000","last_clean":"2024-03-08T06:03:22.087416+0000","last_became_active":"2024-03-08T06:03:21.073333+0000","last_became_peered":"2024-03-08T06:03:21.073333+0000","last_unstale":"2024-03-08T06:03:22.087416+0000","last_undegraded":"2024-03-08T06:03:22.087416+0000","last_fullsized":"2024-03-08T06:03:22.087416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:27:57.207381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.298282+0000","last_change":"2024-03-08T06:03:21.096870+0000","last_active":"2024-03-08T06:03:23.298282+0000","last_peered":"2024-03-08T06:03:23.298282+0000","last_clean":"2024-03-08T06:03:23.298282+0000","last_became_active":"2024-03-08T06:03:21.096623+0000","last_became_peered":"2024-03-08T06:03:21.096623+0000","last_unstale":"2024-03-08T06:03:23.298282+0000","last_undegraded":"2024-03-08T06:03:23.298282+0000","last_fullsized":"2024-03-08T06:03:23.298282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:57:16.249537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.300147+0000","last_change":"2024-03-08T06:03:21.113130+0000","last_active":"2024-03-08T06:03:23.300147+0000","last_peered":"2024-03-08T06:03:23.300147+0000","last_clean":"2024-03-08T06:03:23.300147+0000","last_became_active":"2024-03-08T06:03:21.110951+0000","last_became_peered":"2024-03-08T06:03:21.110951+0000","last_unstale":"2024-03-08T06:03:23.300147+0000","last_undegraded":"2024-03-08T06:03:23.300147+0000","last_fullsized":"2024-03-08T06:03:23.300147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:17:15.821002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.925606+0000","last_change":"2024-03-08T06:03:21.093041+0000","last_active":"2024-03-08T06:03:23.925606+0000","last_peered":"2024-03-08T06:03:23.925606+0000","last_clean":"2024-03-08T06:03:23.925606+0000","last_became_active":"2024-03-08T06:03:21.092766+0000","last_became_peered":"2024-03-08T06:03:21.092766+0000","last_unstale":"2024-03-08T06:03:23.925606+0000","last_undegraded":"2024-03-08T06:03:23.925606+0000","last_fullsized":"2024-03-08T06:03:23.925606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:27.959321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090177+0000","last_change":"2024-03-08T06:03:21.083536+0000","last_active":"2024-03-08T06:03:22.090177+0000","last_peered":"2024-03-08T06:03:22.090177+0000","last_clean":"2024-03-08T06:03:22.090177+0000","last_became_active":"2024-03-08T06:03:21.083203+0000","last_became_peered":"2024-03-08T06:03:21.083203+0000","last_unstale":"2024-03-08T06:03:22.090177+0000","last_undegraded":"2024-03-08T06:03:22.090177+0000","last_fullsized":"2024-03-08T06:03:22.090177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:17:34.427952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.343706+0000","last_change":"2024-03-08T06:03:21.099174+0000","last_active":"2024-03-08T06:03:23.343706+0000","last_peered":"2024-03-08T06:03:23.343706+0000","last_clean":"2024-03-08T06:03:23.343706+0000","last_became_active":"2024-03-08T06:03:21.098562+0000","last_became_peered":"2024-03-08T06:03:21.098562+0000","last_unstale":"2024-03-08T06:03:23.343706+0000","last_undegraded":"2024-03-08T06:03:23.343706+0000","last_fullsized":"2024-03-08T06:03:23.343706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:27:57.207381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.272168+0000","last_change":"2024-03-08T06:03:21.090407+0000","last_active":"2024-03-08T06:03:23.272168+0000","last_peered":"2024-03-08T06:03:23.272168+0000","last_clean":"2024-03-08T06:03:23.272168+0000","last_became_active":"2024-03-08T06:03:21.090050+0000","last_became_peered":"2024-03-08T06:03:21.090050+0000","last_unstale":"2024-03-08T06:03:23.272168+0000","last_undegraded":"2024-03-08T06:03:23.272168+0000","last_fullsized":"2024-03-08T06:03:23.272168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:33:15.887777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.298764+0000","last_change":"2024-03-08T06:03:21.103042+0000","last_active":"2024-03-08T06:03:23.298764+0000","last_peered":"2024-03-08T06:03:23.298764+0000","last_clean":"2024-03-08T06:03:23.298764+0000","last_became_active":"2024-03-08T06:03:21.102711+0000","last_became_peered":"2024-03-08T06:03:21.102711+0000","last_unstale":"2024-03-08T06:03:23.298764+0000","last_undegraded":"2024-03-08T06:03:23.298764+0000","last_fullsized":"2024-03-08T06:03:23.298764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:49:03.245653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.923302+0000","last_change":"2024-03-08T06:03:21.094816+0000","last_active":"2024-03-08T06:03:23.923302+0000","last_peered":"2024-03-08T06:03:23.923302+0000","last_clean":"2024-03-08T06:03:23.923302+0000","last_became_active":"2024-03-08T06:03:21.092861+0000","last_became_peered":"2024-03-08T06:03:21.092861+0000","last_unstale":"2024-03-08T06:03:23.923302+0000","last_undegraded":"2024-03-08T06:03:23.923302+0000","last_fullsized":"2024-03-08T06:03:23.923302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:24:30.832300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.298426+0000","last_change":"2024-03-08T06:03:21.096814+0000","last_active":"2024-03-08T06:03:23.298426+0000","last_peered":"2024-03-08T06:03:23.298426+0000","last_clean":"2024-03-08T06:03:23.298426+0000","last_became_active":"2024-03-08T06:03:21.096448+0000","last_became_peered":"2024-03-08T06:03:21.096448+0000","last_unstale":"2024-03-08T06:03:23.298426+0000","last_undegraded":"2024-03-08T06:03:23.298426+0000","last_fullsized":"2024-03-08T06:03:23.298426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:57:49.623008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.924372+0000","last_change":"2024-03-08T06:03:21.101873+0000","last_active":"2024-03-08T06:03:23.924372+0000","last_peered":"2024-03-08T06:03:23.924372+0000","last_clean":"2024-03-08T06:03:23.924372+0000","last_became_active":"2024-03-08T06:03:21.101436+0000","last_became_peered":"2024-03-08T06:03:21.101436+0000","last_unstale":"2024-03-08T06:03:23.924372+0000","last_undegraded":"2024-03-08T06:03:23.924372+0000","last_fullsized":"2024-03-08T06:03:23.924372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:29:07.055814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.344341+0000","last_change":"2024-03-08T06:03:21.093616+0000","last_active":"2024-03-08T06:03:23.344341+0000","last_peered":"2024-03-08T06:03:23.344341+0000","last_clean":"2024-03-08T06:03:23.344341+0000","last_became_active":"2024-03-08T06:03:21.093287+0000","last_became_peered":"2024-03-08T06:03:21.093287+0000","last_unstale":"2024-03-08T06:03:23.344341+0000","last_undegraded":"2024-03-08T06:03:23.344341+0000","last_fullsized":"2024-03-08T06:03:23.344341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:57:49.623008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087812+0000","last_change":"2024-03-08T06:03:21.081645+0000","last_active":"2024-03-08T06:03:22.087812+0000","last_peered":"2024-03-08T06:03:22.087812+0000","last_clean":"2024-03-08T06:03:22.087812+0000","last_became_active":"2024-03-08T06:03:21.079927+0000","last_became_peered":"2024-03-08T06:03:21.079927+0000","last_unstale":"2024-03-08T06:03:22.087812+0000","last_undegraded":"2024-03-08T06:03:22.087812+0000","last_fullsized":"2024-03-08T06:03:22.087812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:29:07.055814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.923847+0000","last_change":"2024-03-08T06:03:21.101884+0000","last_active":"2024-03-08T06:03:23.923847+0000","last_peered":"2024-03-08T06:03:23.923847+0000","last_clean":"2024-03-08T06:03:23.923847+0000","last_became_active":"2024-03-08T06:03:21.101536+0000","last_became_peered":"2024-03-08T06:03:21.101536+0000","last_unstale":"2024-03-08T06:03:23.923847+0000","last_undegraded":"2024-03-08T06:03:23.923847+0000","last_fullsized":"2024-03-08T06:03:23.923847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:28:13.130043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.272512+0000","last_change":"2024-03-08T06:03:21.096440+0000","last_active":"2024-03-08T06:03:23.272512+0000","last_peered":"2024-03-08T06:03:23.272512+0000","last_clean":"2024-03-08T06:03:23.272512+0000","last_became_active":"2024-03-08T06:03:21.095943+0000","last_became_peered":"2024-03-08T06:03:21.095943+0000","last_unstale":"2024-03-08T06:03:23.272512+0000","last_undegraded":"2024-03-08T06:03:23.272512+0000","last_fullsized":"2024-03-08T06:03:23.272512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:27:57.207381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.298964+0000","last_change":"2024-03-08T06:03:21.100381+0000","last_active":"2024-03-08T06:03:23.298964+0000","last_peered":"2024-03-08T06:03:23.298964+0000","last_clean":"2024-03-08T06:03:23.298964+0000","last_became_active":"2024-03-08T06:03:21.095958+0000","last_became_peered":"2024-03-08T06:03:21.095958+0000","last_unstale":"2024-03-08T06:03:23.298964+0000","last_undegraded":"2024-03-08T06:03:23.298964+0000","last_fullsized":"2024-03-08T06:03:23.298964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:52:15.212911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.923668+0000","last_change":"2024-03-08T06:03:21.105006+0000","last_active":"2024-03-08T06:03:23.923668+0000","last_peered":"2024-03-08T06:03:23.923668+0000","last_clean":"2024-03-08T06:03:23.923668+0000","last_became_active":"2024-03-08T06:03:21.104720+0000","last_became_peered":"2024-03-08T06:03:21.104720+0000","last_unstale":"2024-03-08T06:03:23.923668+0000","last_undegraded":"2024-03-08T06:03:23.923668+0000","last_fullsized":"2024-03-08T06:03:23.923668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:42.646547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.343242+0000","last_change":"2024-03-08T06:03:21.096533+0000","last_active":"2024-03-08T06:03:23.343242+0000","last_peered":"2024-03-08T06:03:23.343242+0000","last_clean":"2024-03-08T06:03:23.343242+0000","last_became_active":"2024-03-08T06:03:21.096204+0000","last_became_peered":"2024-03-08T06:03:21.096204+0000","last_unstale":"2024-03-08T06:03:23.343242+0000","last_undegraded":"2024-03-08T06:03:23.343242+0000","last_fullsized":"2024-03-08T06:03:23.343242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:17:51.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087486+0000","last_change":"2024-03-08T06:03:21.076936+0000","last_active":"2024-03-08T06:03:22.087486+0000","last_peered":"2024-03-08T06:03:22.087486+0000","last_clean":"2024-03-08T06:03:22.087486+0000","last_became_active":"2024-03-08T06:03:21.076550+0000","last_became_peered":"2024-03-08T06:03:21.076550+0000","last_unstale":"2024-03-08T06:03:22.087486+0000","last_undegraded":"2024-03-08T06:03:22.087486+0000","last_fullsized":"2024-03-08T06:03:22.087486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:23.037684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.925664+0000","last_change":"2024-03-08T06:03:20.068219+0000","last_active":"2024-03-08T06:03:23.925664+0000","last_peered":"2024-03-08T06:03:23.925664+0000","last_clean":"2024-03-08T06:03:23.925664+0000","last_became_active":"2024-03-08T06:03:20.067429+0000","last_became_peered":"2024-03-08T06:03:20.067429+0000","last_unstale":"2024-03-08T06:03:23.925664+0000","last_undegraded":"2024-03-08T06:03:23.925664+0000","last_fullsized":"2024-03-08T06:03:23.925664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:54:20.527395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.272397+0000","last_change":"2024-03-08T06:03:21.101698+0000","last_active":"2024-03-08T06:03:23.272397+0000","last_peered":"2024-03-08T06:03:23.272397+0000","last_clean":"2024-03-08T06:03:23.272397+0000","last_became_active":"2024-03-08T06:03:21.101361+0000","last_became_peered":"2024-03-08T06:03:21.101361+0000","last_unstale":"2024-03-08T06:03:23.272397+0000","last_undegraded":"2024-03-08T06:03:23.272397+0000","last_fullsized":"2024-03-08T06:03:23.272397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:28:13.130043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.343376+0000","last_change":"2024-03-08T06:03:20.055111+0000","last_active":"2024-03-08T06:03:23.343376+0000","last_peered":"2024-03-08T06:03:23.343376+0000","last_clean":"2024-03-08T06:03:23.343376+0000","last_became_active":"2024-03-08T06:03:20.054685+0000","last_became_peered":"2024-03-08T06:03:20.054685+0000","last_unstale":"2024-03-08T06:03:23.343376+0000","last_undegraded":"2024-03-08T06:03:23.343376+0000","last_fullsized":"2024-03-08T06:03:23.343376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:54:47.826647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.923121+0000","last_change":"2024-03-08T06:03:20.069995+0000","last_active":"2024-03-08T06:03:23.923121+0000","last_peered":"2024-03-08T06:03:23.923121+0000","last_clean":"2024-03-08T06:03:23.923121+0000","last_became_active":"2024-03-08T06:03:20.069729+0000","last_became_peered":"2024-03-08T06:03:20.069729+0000","last_unstale":"2024-03-08T06:03:23.923121+0000","last_undegraded":"2024-03-08T06:03:23.923121+0000","last_fullsized":"2024-03-08T06:03:23.923121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:44:31.139813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.923228+0000","last_change":"2024-03-08T06:03:21.096605+0000","last_active":"2024-03-08T06:03:23.923228+0000","last_peered":"2024-03-08T06:03:23.923228+0000","last_clean":"2024-03-08T06:03:23.923228+0000","last_became_active":"2024-03-08T06:03:21.096303+0000","last_became_peered":"2024-03-08T06:03:21.096303+0000","last_unstale":"2024-03-08T06:03:23.923228+0000","last_undegraded":"2024-03-08T06:03:23.923228+0000","last_fullsized":"2024-03-08T06:03:23.923228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:23:37.355382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.298608+0000","last_change":"2024-03-08T06:03:20.061872+0000","last_active":"2024-03-08T06:03:23.298608+0000","last_peered":"2024-03-08T06:03:23.298608+0000","last_clean":"2024-03-08T06:03:23.298608+0000","last_became_active":"2024-03-08T06:03:20.061611+0000","last_became_peered":"2024-03-08T06:03:20.061611+0000","last_unstale":"2024-03-08T06:03:23.298608+0000","last_undegraded":"2024-03-08T06:03:23.298608+0000","last_fullsized":"2024-03-08T06:03:23.298608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:23:36.342138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088422+0000","last_change":"2024-03-08T06:03:21.079662+0000","last_active":"2024-03-08T06:03:22.088422+0000","last_peered":"2024-03-08T06:03:22.088422+0000","last_clean":"2024-03-08T06:03:22.088422+0000","last_became_active":"2024-03-08T06:03:21.079269+0000","last_became_peered":"2024-03-08T06:03:21.079269+0000","last_unstale":"2024-03-08T06:03:22.088422+0000","last_undegraded":"2024-03-08T06:03:22.088422+0000","last_fullsized":"2024-03-08T06:03:22.088422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:57:16.249537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.343685+0000","last_change":"2024-03-08T06:03:20.070774+0000","last_active":"2024-03-08T06:03:23.343685+0000","last_peered":"2024-03-08T06:03:23.343685+0000","last_clean":"2024-03-08T06:03:23.343685+0000","last_became_active":"2024-03-08T06:03:20.070284+0000","last_became_peered":"2024-03-08T06:03:20.070284+0000","last_unstale":"2024-03-08T06:03:23.343685+0000","last_undegraded":"2024-03-08T06:03:23.343685+0000","last_fullsized":"2024-03-08T06:03:23.343685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:41.633303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.299738+0000","last_change":"2024-03-08T06:03:21.112968+0000","last_active":"2024-03-08T06:03:23.299738+0000","last_peered":"2024-03-08T06:03:23.299738+0000","last_clean":"2024-03-08T06:03:23.299738+0000","last_became_active":"2024-03-08T06:03:21.110774+0000","last_became_peered":"2024-03-08T06:03:21.110774+0000","last_unstale":"2024-03-08T06:03:23.299738+0000","last_undegraded":"2024-03-08T06:03:23.299738+0000","last_fullsized":"2024-03-08T06:03:23.299738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:18:48.558283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.299833+0000","last_change":"2024-03-08T06:03:20.060802+0000","last_active":"2024-03-08T06:03:23.299833+0000","last_peered":"2024-03-08T06:03:23.299833+0000","last_clean":"2024-03-08T06:03:23.299833+0000","last_became_active":"2024-03-08T06:03:20.060402+0000","last_became_peered":"2024-03-08T06:03:20.060402+0000","last_unstale":"2024-03-08T06:03:23.299833+0000","last_undegraded":"2024-03-08T06:03:23.299833+0000","last_fullsized":"2024-03-08T06:03:23.299833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:27:56.194137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.274023+0000","last_change":"2024-03-08T06:03:21.105833+0000","last_active":"2024-03-08T06:03:23.274023+0000","last_peered":"2024-03-08T06:03:23.274023+0000","last_clean":"2024-03-08T06:03:23.274023+0000","last_became_active":"2024-03-08T06:03:21.105465+0000","last_became_peered":"2024-03-08T06:03:21.105465+0000","last_unstale":"2024-03-08T06:03:23.274023+0000","last_undegraded":"2024-03-08T06:03:23.274023+0000","last_fullsized":"2024-03-08T06:03:23.274023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:57:49.623008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087739+0000","last_change":"2024-03-08T06:03:20.072273+0000","last_active":"2024-03-08T06:03:22.087739+0000","last_peered":"2024-03-08T06:03:22.087739+0000","last_clean":"2024-03-08T06:03:22.087739+0000","last_became_active":"2024-03-08T06:03:20.071389+0000","last_became_peered":"2024-03-08T06:03:20.071389+0000","last_unstale":"2024-03-08T06:03:22.087739+0000","last_undegraded":"2024-03-08T06:03:22.087739+0000","last_fullsized":"2024-03-08T06:03:22.087739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:30.813078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090022+0000","last_change":"2024-03-08T06:03:21.089054+0000","last_active":"2024-03-08T06:03:22.090022+0000","last_peered":"2024-03-08T06:03:22.090022+0000","last_clean":"2024-03-08T06:03:22.090022+0000","last_became_active":"2024-03-08T06:03:21.080309+0000","last_became_peered":"2024-03-08T06:03:21.080309+0000","last_unstale":"2024-03-08T06:03:22.090022+0000","last_undegraded":"2024-03-08T06:03:22.090022+0000","last_fullsized":"2024-03-08T06:03:22.090022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:27.959321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.344070+0000","last_change":"2024-03-08T06:03:20.068126+0000","last_active":"2024-03-08T06:03:23.344070+0000","last_peered":"2024-03-08T06:03:23.344070+0000","last_clean":"2024-03-08T06:03:23.344070+0000","last_became_active":"2024-03-08T06:03:20.067828+0000","last_became_peered":"2024-03-08T06:03:20.067828+0000","last_unstale":"2024-03-08T06:03:23.344070+0000","last_undegraded":"2024-03-08T06:03:23.344070+0000","last_fullsized":"2024-03-08T06:03:23.344070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:26.946077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.089371+0000","last_change":"2024-03-08T06:03:21.082117+0000","last_active":"2024-03-08T06:03:22.089371+0000","last_peered":"2024-03-08T06:03:22.089371+0000","last_clean":"2024-03-08T06:03:22.089371+0000","last_became_active":"2024-03-08T06:03:21.081852+0000","last_became_peered":"2024-03-08T06:03:21.081852+0000","last_unstale":"2024-03-08T06:03:22.089371+0000","last_undegraded":"2024-03-08T06:03:22.089371+0000","last_fullsized":"2024-03-08T06:03:22.089371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:52:15.212911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.272822+0000","last_change":"2024-03-08T06:03:20.055291+0000","last_active":"2024-03-08T06:03:23.272822+0000","last_peered":"2024-03-08T06:03:23.272822+0000","last_clean":"2024-03-08T06:03:23.272822+0000","last_became_active":"2024-03-08T06:03:20.054907+0000","last_became_peered":"2024-03-08T06:03:20.054907+0000","last_unstale":"2024-03-08T06:03:23.272822+0000","last_undegraded":"2024-03-08T06:03:23.272822+0000","last_fullsized":"2024-03-08T06:03:23.272822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:04:32.971131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.272467+0000","last_change":"2024-03-08T06:03:21.092104+0000","last_active":"2024-03-08T06:03:23.272467+0000","last_peered":"2024-03-08T06:03:23.272467+0000","last_clean":"2024-03-08T06:03:23.272467+0000","last_became_active":"2024-03-08T06:03:21.091723+0000","last_became_peered":"2024-03-08T06:03:21.091723+0000","last_unstale":"2024-03-08T06:03:23.272467+0000","last_undegraded":"2024-03-08T06:03:23.272467+0000","last_fullsized":"2024-03-08T06:03:23.272467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:17:51.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.299087+0000","last_change":"2024-03-08T06:03:20.068308+0000","last_active":"2024-03-08T06:03:23.299087+0000","last_peered":"2024-03-08T06:03:23.299087+0000","last_clean":"2024-03-08T06:03:23.299087+0000","last_became_active":"2024-03-08T06:03:20.068036+0000","last_became_peered":"2024-03-08T06:03:20.068036+0000","last_unstale":"2024-03-08T06:03:23.299087+0000","last_undegraded":"2024-03-08T06:03:23.299087+0000","last_fullsized":"2024-03-08T06:03:23.299087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:28:12.116799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088404+0000","last_change":"2024-03-08T06:03:21.102514+0000","last_active":"2024-03-08T06:03:22.088404+0000","last_peered":"2024-03-08T06:03:22.088404+0000","last_clean":"2024-03-08T06:03:22.088404+0000","last_became_active":"2024-03-08T06:03:21.101780+0000","last_became_peered":"2024-03-08T06:03:21.101780+0000","last_unstale":"2024-03-08T06:03:22.088404+0000","last_undegraded":"2024-03-08T06:03:22.088404+0000","last_fullsized":"2024-03-08T06:03:22.088404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:00:39.301215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.343145+0000","last_change":"2024-03-08T06:03:20.049517+0000","last_active":"2024-03-08T06:03:23.343145+0000","last_peered":"2024-03-08T06:03:23.343145+0000","last_clean":"2024-03-08T06:03:23.343145+0000","last_became_active":"2024-03-08T06:03:20.047972+0000","last_became_peered":"2024-03-08T06:03:20.047972+0000","last_unstale":"2024-03-08T06:03:23.343145+0000","last_undegraded":"2024-03-08T06:03:23.343145+0000","last_fullsized":"2024-03-08T06:03:23.343145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:54:20.527395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.343246+0000","last_change":"2024-03-08T06:03:21.085035+0000","last_active":"2024-03-08T06:03:23.343246+0000","last_peered":"2024-03-08T06:03:23.343246+0000","last_clean":"2024-03-08T06:03:23.343246+0000","last_became_active":"2024-03-08T06:03:21.084676+0000","last_became_peered":"2024-03-08T06:03:21.084676+0000","last_unstale":"2024-03-08T06:03:23.343246+0000","last_undegraded":"2024-03-08T06:03:23.343246+0000","last_fullsized":"2024-03-08T06:03:23.343246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:24:30.832300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.923273+0000","last_change":"2024-03-08T06:03:20.065172+0000","last_active":"2024-03-08T06:03:23.923273+0000","last_peered":"2024-03-08T06:03:23.923273+0000","last_clean":"2024-03-08T06:03:23.923273+0000","last_became_active":"2024-03-08T06:03:20.064854+0000","last_became_peered":"2024-03-08T06:03:20.064854+0000","last_unstale":"2024-03-08T06:03:23.923273+0000","last_undegraded":"2024-03-08T06:03:23.923273+0000","last_fullsized":"2024-03-08T06:03:23.923273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:54:20.527395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087834+0000","last_change":"2024-03-08T06:03:21.101352+0000","last_active":"2024-03-08T06:03:22.087834+0000","last_peered":"2024-03-08T06:03:22.087834+0000","last_clean":"2024-03-08T06:03:22.087834+0000","last_became_active":"2024-03-08T06:03:21.101040+0000","last_became_peered":"2024-03-08T06:03:21.101040+0000","last_unstale":"2024-03-08T06:03:22.087834+0000","last_undegraded":"2024-03-08T06:03:22.087834+0000","last_fullsized":"2024-03-08T06:03:22.087834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:57:49.623008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087854+0000","last_change":"2024-03-08T06:03:20.057635+0000","last_active":"2024-03-08T06:03:22.087854+0000","last_peered":"2024-03-08T06:03:22.087854+0000","last_clean":"2024-03-08T06:03:22.087854+0000","last_became_active":"2024-03-08T06:03:20.057209+0000","last_became_peered":"2024-03-08T06:03:20.057209+0000","last_unstale":"2024-03-08T06:03:22.087854+0000","last_undegraded":"2024-03-08T06:03:22.087854+0000","last_fullsized":"2024-03-08T06:03:22.087854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:46:53.297684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090632+0000","last_change":"2024-03-08T06:03:21.100194+0000","last_active":"2024-03-08T06:03:22.090632+0000","last_peered":"2024-03-08T06:03:22.090632+0000","last_clean":"2024-03-08T06:03:22.090632+0000","last_became_active":"2024-03-08T06:03:21.099871+0000","last_became_peered":"2024-03-08T06:03:21.099871+0000","last_unstale":"2024-03-08T06:03:22.090632+0000","last_undegraded":"2024-03-08T06:03:22.090632+0000","last_fullsized":"2024-03-08T06:03:22.090632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:05:42.148812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.925550+0000","last_change":"2024-03-08T06:03:20.063658+0000","last_active":"2024-03-08T06:03:23.925550+0000","last_peered":"2024-03-08T06:03:23.925550+0000","last_clean":"2024-03-08T06:03:23.925550+0000","last_became_active":"2024-03-08T06:03:20.063364+0000","last_became_peered":"2024-03-08T06:03:20.063364+0000","last_unstale":"2024-03-08T06:03:23.925550+0000","last_undegraded":"2024-03-08T06:03:23.925550+0000","last_fullsized":"2024-03-08T06:03:23.925550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:48.579937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090948+0000","last_change":"2024-03-08T06:03:21.100719+0000","last_active":"2024-03-08T06:03:22.090948+0000","last_peered":"2024-03-08T06:03:22.090948+0000","last_clean":"2024-03-08T06:03:22.090948+0000","last_became_active":"2024-03-08T06:03:21.100356+0000","last_became_peered":"2024-03-08T06:03:21.100356+0000","last_unstale":"2024-03-08T06:03:22.090948+0000","last_undegraded":"2024-03-08T06:03:22.090948+0000","last_fullsized":"2024-03-08T06:03:22.090948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:17:15.821002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088072+0000","last_change":"2024-03-08T06:03:20.053836+0000","last_active":"2024-03-08T06:03:22.088072+0000","last_peered":"2024-03-08T06:03:22.088072+0000","last_clean":"2024-03-08T06:03:22.088072+0000","last_became_active":"2024-03-08T06:03:20.053485+0000","last_became_peered":"2024-03-08T06:03:20.053485+0000","last_unstale":"2024-03-08T06:03:22.088072+0000","last_undegraded":"2024-03-08T06:03:22.088072+0000","last_fullsized":"2024-03-08T06:03:22.088072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:41.633303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.299456+0000","last_change":"2024-03-08T06:03:21.097727+0000","last_active":"2024-03-08T06:03:23.299456+0000","last_peered":"2024-03-08T06:03:23.299456+0000","last_clean":"2024-03-08T06:03:23.299456+0000","last_became_active":"2024-03-08T06:03:21.096995+0000","last_became_peered":"2024-03-08T06:03:21.096995+0000","last_unstale":"2024-03-08T06:03:23.299456+0000","last_undegraded":"2024-03-08T06:03:23.299456+0000","last_fullsized":"2024-03-08T06:03:23.299456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:05:42.148812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.924541+0000","last_change":"2024-03-08T06:03:20.067426+0000","last_active":"2024-03-08T06:03:23.924541+0000","last_peered":"2024-03-08T06:03:23.924541+0000","last_clean":"2024-03-08T06:03:23.924541+0000","last_became_active":"2024-03-08T06:03:20.067090+0000","last_became_peered":"2024-03-08T06:03:20.067090+0000","last_unstale":"2024-03-08T06:03:23.924541+0000","last_undegraded":"2024-03-08T06:03:23.924541+0000","last_fullsized":"2024-03-08T06:03:23.924541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:54:47.826647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.089774+0000","last_change":"2024-03-08T06:03:21.107588+0000","last_active":"2024-03-08T06:03:22.089774+0000","last_peered":"2024-03-08T06:03:22.089774+0000","last_clean":"2024-03-08T06:03:22.089774+0000","last_became_active":"2024-03-08T06:03:21.107204+0000","last_became_peered":"2024-03-08T06:03:21.107204+0000","last_unstale":"2024-03-08T06:03:22.089774+0000","last_undegraded":"2024-03-08T06:03:22.089774+0000","last_fullsized":"2024-03-08T06:03:22.089774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:36:22.740638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088160+0000","last_change":"2024-03-08T06:03:16.679654+0000","last_active":"2024-03-08T06:03:22.088160+0000","last_peered":"2024-03-08T06:03:22.088160+0000","last_clean":"2024-03-08T06:03:22.088160+0000","last_became_active":"2024-03-08T06:03:16.676829+0000","last_became_peered":"2024-03-08T06:03:16.676829+0000","last_unstale":"2024-03-08T06:03:22.088160+0000","last_undegraded":"2024-03-08T06:03:22.088160+0000","last_fullsized":"2024-03-08T06:03:22.088160+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:14.800941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:14.800941+0000","last_clean_scrub_stamp":"2024-03-08T06:03:14.800941+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:20:09.927678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.298470+0000","last_change":"2024-03-08T06:03:20.066015+0000","last_active":"2024-03-08T06:03:23.298470+0000","last_peered":"2024-03-08T06:03:23.298470+0000","last_clean":"2024-03-08T06:03:23.298470+0000","last_became_active":"2024-03-08T06:03:20.065647+0000","last_became_peered":"2024-03-08T06:03:20.065647+0000","last_unstale":"2024-03-08T06:03:23.298470+0000","last_undegraded":"2024-03-08T06:03:23.298470+0000","last_fullsized":"2024-03-08T06:03:23.298470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:24:29.819056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.923778+0000","last_change":"2024-03-08T06:03:21.092065+0000","last_active":"2024-03-08T06:03:23.923778+0000","last_peered":"2024-03-08T06:03:23.923778+0000","last_clean":"2024-03-08T06:03:23.923778+0000","last_became_active":"2024-03-08T06:03:21.091753+0000","last_became_peered":"2024-03-08T06:03:21.091753+0000","last_unstale":"2024-03-08T06:03:23.923778+0000","last_undegraded":"2024-03-08T06:03:23.923778+0000","last_fullsized":"2024-03-08T06:03:23.923778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:27:57.207381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088016+0000","last_change":"2024-03-08T06:03:20.074566+0000","last_active":"2024-03-08T06:03:22.088016+0000","last_peered":"2024-03-08T06:03:22.088016+0000","last_clean":"2024-03-08T06:03:22.088016+0000","last_became_active":"2024-03-08T06:03:20.074234+0000","last_became_peered":"2024-03-08T06:03:20.074234+0000","last_unstale":"2024-03-08T06:03:22.088016+0000","last_undegraded":"2024-03-08T06:03:22.088016+0000","last_fullsized":"2024-03-08T06:03:22.088016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:22.024440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.272192+0000","last_change":"2024-03-08T06:03:21.100866+0000","last_active":"2024-03-08T06:03:23.272192+0000","last_peered":"2024-03-08T06:03:23.272192+0000","last_clean":"2024-03-08T06:03:23.272192+0000","last_became_active":"2024-03-08T06:03:21.100541+0000","last_became_peered":"2024-03-08T06:03:21.100541+0000","last_unstale":"2024-03-08T06:03:23.272192+0000","last_undegraded":"2024-03-08T06:03:23.272192+0000","last_fullsized":"2024-03-08T06:03:23.272192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:10:52.112651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.923754+0000","last_change":"2024-03-08T06:03:20.062458+0000","last_active":"2024-03-08T06:03:23.923754+0000","last_peered":"2024-03-08T06:03:23.923754+0000","last_clean":"2024-03-08T06:03:23.923754+0000","last_became_active":"2024-03-08T06:03:20.062017+0000","last_became_peered":"2024-03-08T06:03:20.062017+0000","last_unstale":"2024-03-08T06:03:23.923754+0000","last_undegraded":"2024-03-08T06:03:23.923754+0000","last_fullsized":"2024-03-08T06:03:23.923754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:44:31.139813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087236+0000","last_change":"2024-03-08T06:03:21.083073+0000","last_active":"2024-03-08T06:03:22.087236+0000","last_peered":"2024-03-08T06:03:22.087236+0000","last_clean":"2024-03-08T06:03:22.087236+0000","last_became_active":"2024-03-08T06:03:21.082544+0000","last_became_peered":"2024-03-08T06:03:21.082544+0000","last_unstale":"2024-03-08T06:03:22.087236+0000","last_undegraded":"2024-03-08T06:03:22.087236+0000","last_fullsized":"2024-03-08T06:03:22.087236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:17:51.523918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.299313+0000","last_change":"2024-03-08T06:03:20.065501+0000","last_active":"2024-03-08T06:03:23.299313+0000","last_peered":"2024-03-08T06:03:23.299313+0000","last_clean":"2024-03-08T06:03:23.299313+0000","last_became_active":"2024-03-08T06:03:20.065200+0000","last_became_peered":"2024-03-08T06:03:20.065200+0000","last_unstale":"2024-03-08T06:03:23.299313+0000","last_undegraded":"2024-03-08T06:03:23.299313+0000","last_fullsized":"2024-03-08T06:03:23.299313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:17:50.510674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087483+0000","last_change":"2024-03-08T06:03:21.091986+0000","last_active":"2024-03-08T06:03:22.087483+0000","last_peered":"2024-03-08T06:03:22.087483+0000","last_clean":"2024-03-08T06:03:22.087483+0000","last_became_active":"2024-03-08T06:03:21.091675+0000","last_became_peered":"2024-03-08T06:03:21.091675+0000","last_unstale":"2024-03-08T06:03:22.087483+0000","last_undegraded":"2024-03-08T06:03:22.087483+0000","last_fullsized":"2024-03-08T06:03:22.087483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:31.826322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.086969+0000","last_change":"2024-03-08T06:03:20.065327+0000","last_active":"2024-03-08T06:03:22.086969+0000","last_peered":"2024-03-08T06:03:22.086969+0000","last_clean":"2024-03-08T06:03:22.086969+0000","last_became_active":"2024-03-08T06:03:20.064891+0000","last_became_peered":"2024-03-08T06:03:20.064891+0000","last_unstale":"2024-03-08T06:03:22.086969+0000","last_undegraded":"2024-03-08T06:03:22.086969+0000","last_fullsized":"2024-03-08T06:03:22.086969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:26.946077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.299660+0000","last_change":"2024-03-08T06:03:21.097867+0000","last_active":"2024-03-08T06:03:23.299660+0000","last_peered":"2024-03-08T06:03:23.299660+0000","last_clean":"2024-03-08T06:03:23.299660+0000","last_became_active":"2024-03-08T06:03:21.097495+0000","last_became_peered":"2024-03-08T06:03:21.097495+0000","last_unstale":"2024-03-08T06:03:23.299660+0000","last_undegraded":"2024-03-08T06:03:23.299660+0000","last_fullsized":"2024-03-08T06:03:23.299660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:19:57.197522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.090113+0000","last_change":"2024-03-08T06:03:20.069667+0000","last_active":"2024-03-08T06:03:22.090113+0000","last_peered":"2024-03-08T06:03:22.090113+0000","last_clean":"2024-03-08T06:03:22.090113+0000","last_became_active":"2024-03-08T06:03:20.069428+0000","last_became_peered":"2024-03-08T06:03:20.069428+0000","last_unstale":"2024-03-08T06:03:22.090113+0000","last_undegraded":"2024-03-08T06:03:22.090113+0000","last_fullsized":"2024-03-08T06:03:22.090113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:21:04.927163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.086921+0000","last_change":"2024-03-08T06:03:21.084065+0000","last_active":"2024-03-08T06:03:22.086921+0000","last_peered":"2024-03-08T06:03:22.086921+0000","last_clean":"2024-03-08T06:03:22.086921+0000","last_became_active":"2024-03-08T06:03:21.083747+0000","last_became_peered":"2024-03-08T06:03:21.083747+0000","last_unstale":"2024-03-08T06:03:22.086921+0000","last_undegraded":"2024-03-08T06:03:22.086921+0000","last_fullsized":"2024-03-08T06:03:22.086921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:24:30.832300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087595+0000","last_change":"2024-03-08T06:03:20.059341+0000","last_active":"2024-03-08T06:03:22.087595+0000","last_peered":"2024-03-08T06:03:22.087595+0000","last_clean":"2024-03-08T06:03:22.087595+0000","last_became_active":"2024-03-08T06:03:20.059016+0000","last_became_peered":"2024-03-08T06:03:20.059016+0000","last_unstale":"2024-03-08T06:03:22.087595+0000","last_undegraded":"2024-03-08T06:03:22.087595+0000","last_fullsized":"2024-03-08T06:03:22.087595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:22.024440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.924777+0000","last_change":"2024-03-08T06:03:21.088353+0000","last_active":"2024-03-08T06:03:23.924777+0000","last_peered":"2024-03-08T06:03:23.924777+0000","last_clean":"2024-03-08T06:03:23.924777+0000","last_became_active":"2024-03-08T06:03:21.088046+0000","last_became_peered":"2024-03-08T06:03:21.088046+0000","last_unstale":"2024-03-08T06:03:23.924777+0000","last_undegraded":"2024-03-08T06:03:23.924777+0000","last_fullsized":"2024-03-08T06:03:23.924777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:48:37.493932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.343930+0000","last_change":"2024-03-08T06:03:20.071250+0000","last_active":"2024-03-08T06:03:23.343930+0000","last_peered":"2024-03-08T06:03:23.343930+0000","last_clean":"2024-03-08T06:03:23.343930+0000","last_became_active":"2024-03-08T06:03:20.070870+0000","last_became_peered":"2024-03-08T06:03:20.070870+0000","last_unstale":"2024-03-08T06:03:23.343930+0000","last_undegraded":"2024-03-08T06:03:23.343930+0000","last_fullsized":"2024-03-08T06:03:23.343930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:30.813078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.273344+0000","last_change":"2024-03-08T06:03:21.097827+0000","last_active":"2024-03-08T06:03:23.273344+0000","last_peered":"2024-03-08T06:03:23.273344+0000","last_clean":"2024-03-08T06:03:23.273344+0000","last_became_active":"2024-03-08T06:03:21.097542+0000","last_became_peered":"2024-03-08T06:03:21.097542+0000","last_unstale":"2024-03-08T06:03:23.273344+0000","last_undegraded":"2024-03-08T06:03:23.273344+0000","last_fullsized":"2024-03-08T06:03:23.273344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:29:07.055814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087648+0000","last_change":"2024-03-08T06:03:20.064310+0000","last_active":"2024-03-08T06:03:22.087648+0000","last_peered":"2024-03-08T06:03:22.087648+0000","last_clean":"2024-03-08T06:03:22.087648+0000","last_became_active":"2024-03-08T06:03:20.063983+0000","last_became_peered":"2024-03-08T06:03:20.063983+0000","last_unstale":"2024-03-08T06:03:22.087648+0000","last_undegraded":"2024-03-08T06:03:22.087648+0000","last_fullsized":"2024-03-08T06:03:22.087648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:48.579937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087328+0000","last_change":"2024-03-08T06:03:21.085108+0000","last_active":"2024-03-08T06:03:22.087328+0000","last_peered":"2024-03-08T06:03:22.087328+0000","last_clean":"2024-03-08T06:03:22.087328+0000","last_became_active":"2024-03-08T06:03:21.084673+0000","last_became_peered":"2024-03-08T06:03:21.084673+0000","last_unstale":"2024-03-08T06:03:22.087328+0000","last_undegraded":"2024-03-08T06:03:22.087328+0000","last_fullsized":"2024-03-08T06:03:22.087328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:49.593181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088223+0000","last_change":"2024-03-08T06:03:20.054745+0000","last_active":"2024-03-08T06:03:22.088223+0000","last_peered":"2024-03-08T06:03:22.088223+0000","last_clean":"2024-03-08T06:03:22.088223+0000","last_became_active":"2024-03-08T06:03:20.054461+0000","last_became_peered":"2024-03-08T06:03:20.054461+0000","last_unstale":"2024-03-08T06:03:22.088223+0000","last_undegraded":"2024-03-08T06:03:22.088223+0000","last_fullsized":"2024-03-08T06:03:22.088223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:54:47.826647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.924423+0000","last_change":"2024-03-08T06:03:21.079197+0000","last_active":"2024-03-08T06:03:23.924423+0000","last_peered":"2024-03-08T06:03:23.924423+0000","last_clean":"2024-03-08T06:03:23.924423+0000","last_became_active":"2024-03-08T06:03:21.078822+0000","last_became_peered":"2024-03-08T06:03:21.078822+0000","last_unstale":"2024-03-08T06:03:23.924423+0000","last_undegraded":"2024-03-08T06:03:23.924423+0000","last_fullsized":"2024-03-08T06:03:23.924423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:57:16.249537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.087455+0000","last_change":"2024-03-08T06:03:20.071672+0000","last_active":"2024-03-08T06:03:22.087455+0000","last_peered":"2024-03-08T06:03:22.087455+0000","last_clean":"2024-03-08T06:03:22.087455+0000","last_became_active":"2024-03-08T06:03:20.070816+0000","last_became_peered":"2024-03-08T06:03:20.070816+0000","last_unstale":"2024-03-08T06:03:22.087455+0000","last_undegraded":"2024-03-08T06:03:22.087455+0000","last_fullsized":"2024-03-08T06:03:22.087455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:09:48.579937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.925568+0000","last_change":"2024-03-08T06:03:21.089795+0000","last_active":"2024-03-08T06:03:23.925568+0000","last_peered":"2024-03-08T06:03:23.925568+0000","last_clean":"2024-03-08T06:03:23.925568+0000","last_became_active":"2024-03-08T06:03:21.089491+0000","last_became_peered":"2024-03-08T06:03:21.089491+0000","last_unstale":"2024-03-08T06:03:23.925568+0000","last_undegraded":"2024-03-08T06:03:23.925568+0000","last_fullsized":"2024-03-08T06:03:23.925568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:00:39.301215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088562+0000","last_change":"2024-03-08T06:03:20.063251+0000","last_active":"2024-03-08T06:03:22.088562+0000","last_peered":"2024-03-08T06:03:22.088562+0000","last_clean":"2024-03-08T06:03:22.088562+0000","last_became_active":"2024-03-08T06:03:20.061931+0000","last_became_peered":"2024-03-08T06:03:20.061931+0000","last_unstale":"2024-03-08T06:03:22.088562+0000","last_undegraded":"2024-03-08T06:03:22.088562+0000","last_fullsized":"2024-03-08T06:03:22.088562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:49:41.633303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.343248+0000","last_change":"2024-03-08T06:03:21.087608+0000","last_active":"2024-03-08T06:03:23.343248+0000","last_peered":"2024-03-08T06:03:23.343248+0000","last_clean":"2024-03-08T06:03:23.343248+0000","last_became_active":"2024-03-08T06:03:21.086636+0000","last_became_peered":"2024-03-08T06:03:21.086636+0000","last_unstale":"2024-03-08T06:03:23.343248+0000","last_undegraded":"2024-03-08T06:03:23.343248+0000","last_fullsized":"2024-03-08T06:03:23.343248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:23:37.355382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.299458+0000","last_change":"2024-03-08T06:03:21.099738+0000","last_active":"2024-03-08T06:03:23.299458+0000","last_peered":"2024-03-08T06:03:23.299458+0000","last_clean":"2024-03-08T06:03:23.299458+0000","last_became_active":"2024-03-08T06:03:21.098798+0000","last_became_peered":"2024-03-08T06:03:21.098798+0000","last_unstale":"2024-03-08T06:03:23.299458+0000","last_undegraded":"2024-03-08T06:03:23.299458+0000","last_fullsized":"2024-03-08T06:03:23.299458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:17:34.427952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.088884+0000","last_change":"2024-03-08T06:03:20.068500+0000","last_active":"2024-03-08T06:03:22.088884+0000","last_peered":"2024-03-08T06:03:22.088884+0000","last_clean":"2024-03-08T06:03:22.088884+0000","last_became_active":"2024-03-08T06:03:20.068165+0000","last_became_peered":"2024-03-08T06:03:20.068165+0000","last_unstale":"2024-03-08T06:03:22.088884+0000","last_undegraded":"2024-03-08T06:03:22.088884+0000","last_fullsized":"2024-03-08T06:03:22.088884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:04:30.813078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.299229+0000","last_change":"2024-03-08T06:03:21.100116+0000","last_active":"2024-03-08T06:03:23.299229+0000","last_peered":"2024-03-08T06:03:23.299229+0000","last_clean":"2024-03-08T06:03:23.299229+0000","last_became_active":"2024-03-08T06:03:21.099049+0000","last_became_peered":"2024-03-08T06:03:21.099049+0000","last_unstale":"2024-03-08T06:03:23.299229+0000","last_undegraded":"2024-03-08T06:03:23.299229+0000","last_fullsized":"2024-03-08T06:03:23.299229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:36:22.740638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:22.089860+0000","last_change":"2024-03-08T06:03:20.073962+0000","last_active":"2024-03-08T06:03:22.089860+0000","last_peered":"2024-03-08T06:03:22.089860+0000","last_clean":"2024-03-08T06:03:22.089860+0000","last_became_active":"2024-03-08T06:03:20.073658+0000","last_became_peered":"2024-03-08T06:03:20.073658+0000","last_unstale":"2024-03-08T06:03:22.089860+0000","last_undegraded":"2024-03-08T06:03:22.089860+0000","last_fullsized":"2024-03-08T06:03:22.089860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:45:26.946077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.273644+0000","last_change":"2024-03-08T06:03:21.105031+0000","last_active":"2024-03-08T06:03:23.273644+0000","last_peered":"2024-03-08T06:03:23.273644+0000","last_clean":"2024-03-08T06:03:23.273644+0000","last_became_active":"2024-03-08T06:03:21.104736+0000","last_became_peered":"2024-03-08T06:03:21.104736+0000","last_unstale":"2024-03-08T06:03:23.273644+0000","last_undegraded":"2024-03-08T06:03:23.273644+0000","last_fullsized":"2024-03-08T06:03:23.273644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:57:16.249537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.924886+0000","last_change":"2024-03-08T06:03:20.061969+0000","last_active":"2024-03-08T06:03:23.924886+0000","last_peered":"2024-03-08T06:03:23.924886+0000","last_clean":"2024-03-08T06:03:23.924886+0000","last_became_active":"2024-03-08T06:03:20.061568+0000","last_became_peered":"2024-03-08T06:03:20.061568+0000","last_unstale":"2024-03-08T06:03:23.924886+0000","last_undegraded":"2024-03-08T06:03:23.924886+0000","last_fullsized":"2024-03-08T06:03:23.924886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:14:52.512990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.924692+0000","last_change":"2024-03-08T06:03:21.091233+0000","last_active":"2024-03-08T06:03:23.924692+0000","last_peered":"2024-03-08T06:03:23.924692+0000","last_clean":"2024-03-08T06:03:23.924692+0000","last_became_active":"2024-03-08T06:03:21.090260+0000","last_became_peered":"2024-03-08T06:03:21.090260+0000","last_unstale":"2024-03-08T06:03:23.924692+0000","last_undegraded":"2024-03-08T06:03:23.924692+0000","last_fullsized":"2024-03-08T06:03:23.924692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:19.854024+0000","last_clean_scrub_stamp":"2024-03-08T06:03:19.854024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:57:49.623008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-08T06:03:23.274355+0000","last_change":"2024-03-08T06:03:20.066538+0000","last_active":"2024-03-08T06:03:23.274355+0000","last_peered":"2024-03-08T06:03:23.274355+0000","last_clean":"2024-03-08T06:03:23.274355+0000","last_became_active":"2024-03-08T06:03:20.065542+0000","last_became_peered":"2024-03-08T06:03:20.065542+0000","last_unstale":"2024-03-08T06:03:23.274355+0000","last_undegraded":"2024-03-08T06:03:23.274355+0000","last_fullsized":"2024-03-08T06:03:23.274355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:18.840780+0000","last_clean_scrub_stamp":"2024-03-08T06:03:18.840780+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:14:52.512990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":815104,"data_stored":666555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":221184,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":229376,"data_stored":75731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T06:03:29.934 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-08T06:03:29.934 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-08T06:03:29.934 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-08T06:03:29.934 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-08T06:03:30.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.190+0000 7ff302400640 1 Processor -- start 2024-03-08T06:03:30.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.190+0000 7ff302400640 1 -- start start 2024-03-08T06:03:30.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.192+0000 7ff302400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff2fc15e590 0x7ff2fc0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:30.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.192+0000 7ff302400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff2fc0b4620 0x7ff2fc0b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:30.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.192+0000 7ff302400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2fc0b2aa0 con 0x7ff2fc15e970 2024-03-08T06:03:30.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.192+0000 7ff302400640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2fc0af400 con 0x7ff2fc15e590 2024-03-08T06:03:30.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.192+0000 7ff302400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc0b33d0 con 0x7ff2fc0b4620 2024-03-08T06:03:30.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.193+0000 7ff2fb400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff2fc15e590 0x7ff2fc0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:30.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.193+0000 7ff2fb400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff2fc15e590 0x7ff2fc0aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33818/0 (socket says 172.21.15.19:33818) 2024-03-08T06:03:30.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.193+0000 7ff2fb400640 1 -- 172.21.15.19:0/728324076 learned_addr learned my addr 172.21.15.19:0/728324076 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:30.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.193+0000 7ff2faa00640 1 --2- 172.21.15.19:0/728324076 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff2fc0b4620 0x7ff2fc0b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:30.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.193+0000 7ff2fb400640 1 -- 172.21.15.19:0/728324076 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff2fc0b4620 msgr2=0x7ff2fc0b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:30.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.193+0000 7ff2fb400640 1 --2- 172.21.15.19:0/728324076 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff2fc0b4620 0x7ff2fc0b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:30.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.193+0000 7ff2fb400640 1 -- 172.21.15.19:0/728324076 >> v1:172.21.15.42:6789/0 conn(0x7ff2fc15e970 legacy=0x7ff2fc06d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:30.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.193+0000 7ff2fb400640 1 -- 172.21.15.19:0/728324076 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc0b2d80 con 0x7ff2fc15e590 2024-03-08T06:03:30.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.194+0000 7ff2fb400640 1 --2- 172.21.15.19:0/728324076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2fc15e590 0x7ff2fc0aebb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec009870 tx=0x7ff2ec02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32c4fdbf7b0752a server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:30.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.195+0000 7ff2fa000640 1 -- 172.21.15.19:0/728324076 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec035020 con 0x7ff2fc15e590 2024-03-08T06:03:30.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.195+0000 7ff2fa000640 1 -- 172.21.15.19:0/728324076 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec031640 con 0x7ff2fc15e590 2024-03-08T06:03:30.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.195+0000 7ff2fa000640 1 -- 172.21.15.19:0/728324076 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec02d040 con 0x7ff2fc15e590 2024-03-08T06:03:30.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.195+0000 7ff302400640 1 -- 172.21.15.19:0/728324076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2fc15e590 msgr2=0x7ff2fc0aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:30.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.195+0000 7ff302400640 1 --2- 172.21.15.19:0/728324076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2fc15e590 0x7ff2fc0aebb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec009870 tx=0x7ff2ec02b8f0 comp rx=0 tx=0).stop 2024-03-08T06:03:30.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.195+0000 7ff302400640 1 -- 172.21.15.19:0/728324076 shutdown_connections 2024-03-08T06:03:30.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.195+0000 7ff302400640 1 --2- 172.21.15.19:0/728324076 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff2fc0b4620 0x7ff2fc0b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:30.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.195+0000 7ff302400640 1 --2- 172.21.15.19:0/728324076 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2fc15e590 0x7ff2fc0aebb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:30.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.195+0000 7ff302400640 1 -- 172.21.15.19:0/728324076 >> 172.21.15.19:0/728324076 conn(0x7ff2fc0b1670 msgr2=0x7ff2fc0b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:30.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.195+0000 7ff302400640 1 -- 172.21.15.19:0/728324076 shutdown_connections 2024-03-08T06:03:30.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.195+0000 7ff302400640 1 -- 172.21.15.19:0/728324076 wait complete. 2024-03-08T06:03:30.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.197+0000 7ff302400640 1 Processor -- start 2024-03-08T06:03:30.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.197+0000 7ff302400640 1 -- start start 2024-03-08T06:03:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.198+0000 7ff302400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2fc0b4620 0x7ff2fc143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.198+0000 7ff302400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2fc15e590 0x7ff2fc143c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.198+0000 7ff302400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff2fc15e970 0x7ff2fc1e73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.198+0000 7ff302400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc0b3da0 con 0x7ff2fc15e590 2024-03-08T06:03:30.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.198+0000 7ff302400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc0af0f0 con 0x7ff2fc0b4620 2024-03-08T06:03:30.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.198+0000 7ff302400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc15edf0 con 0x7ff2fc15e970 2024-03-08T06:03:30.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.199+0000 7ff2faa00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2fc15e590 0x7ff2fc143c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:30.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.199+0000 7ff2faa00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2fc15e590 0x7ff2fc143c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33828/0 (socket says 172.21.15.19:33828) 2024-03-08T06:03:30.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.199+0000 7ff2faa00640 1 -- 172.21.15.19:0/1186112452 learned_addr learned my addr 172.21.15.19:0/1186112452 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:30.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.199+0000 7ff2fb400640 1 --2- 172.21.15.19:0/1186112452 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2fc0b4620 0x7ff2fc143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:30.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.199+0000 7ff2fbe00640 1 --2- 172.21.15.19:0/1186112452 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff2fc15e970 0x7ff2fc1e73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:30.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.199+0000 7ff2faa00640 1 -- 172.21.15.19:0/1186112452 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff2fc15e970 msgr2=0x7ff2fc1e73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:30.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.199+0000 7ff2faa00640 1 --2- 172.21.15.19:0/1186112452 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff2fc15e970 0x7ff2fc1e73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:30.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.199+0000 7ff2faa00640 1 -- 172.21.15.19:0/1186112452 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2fc0b4620 msgr2=0x7ff2fc143600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:30.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.199+0000 7ff2faa00640 1 --2- 172.21.15.19:0/1186112452 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2fc0b4620 0x7ff2fc143600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:30.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.199+0000 7ff2faa00640 1 -- 172.21.15.19:0/1186112452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc1f3970 con 0x7ff2fc15e590 2024-03-08T06:03:30.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.199+0000 7ff2fbe00640 1 --2- 172.21.15.19:0/1186112452 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff2fc15e970 0x7ff2fc1e73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:30.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.199+0000 7ff2fb400640 1 --2- 172.21.15.19:0/1186112452 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2fc0b4620 0x7ff2fc143600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:30.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.199+0000 7ff2faa00640 1 --2- 172.21.15.19:0/1186112452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2fc15e590 0x7ff2fc143c90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800d7d0 tx=0x7ff2e800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:30.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.200+0000 7ff2f3400640 1 -- 172.21.15.19:0/1186112452 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8004020 con 0x7ff2fc15e590 2024-03-08T06:03:30.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.200+0000 7ff2f3400640 1 -- 172.21.15.19:0/1186112452 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e80041e0 con 0x7ff2fc15e590 2024-03-08T06:03:30.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.200+0000 7ff2f3400640 1 -- 172.21.15.19:0/1186112452 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e80043d0 con 0x7ff2fc15e590 2024-03-08T06:03:30.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.200+0000 7ff302400640 1 -- 172.21.15.19:0/1186112452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2fc1f3c50 con 0x7ff2fc15e590 2024-03-08T06:03:30.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.200+0000 7ff302400640 1 -- 172.21.15.19:0/1186112452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2fc1f4210 con 0x7ff2fc15e590 2024-03-08T06:03:30.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.201+0000 7ff302400640 1 -- 172.21.15.19:0/1186112452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2fc067cb0 con 0x7ff2fc15e590 2024-03-08T06:03:30.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.202+0000 7ff2f3400640 1 -- 172.21.15.19:0/1186112452 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff2e801b020 con 0x7ff2fc15e590 2024-03-08T06:03:30.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.203+0000 7ff2f3400640 1 --2- 172.21.15.19:0/1186112452 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff2dc06b4d0 0x7ff2dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:30.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.203+0000 7ff2f3400640 1 -- 172.21.15.19:0/1186112452 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2e8089fe0 con 0x7ff2fc15e590 2024-03-08T06:03:30.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.203+0000 7ff2fb400640 1 --2- 172.21.15.19:0/1186112452 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff2dc06b4d0 0x7ff2dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:30.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.204+0000 7ff2fb400640 1 --2- 172.21.15.19:0/1186112452 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff2dc06b4d0 0x7ff2dc06d990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec036000 tx=0x7ff2ec008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:30.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.208+0000 7ff2f3400640 1 -- 172.21.15.19:0/1186112452 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff2e8058e90 con 0x7ff2fc15e590 2024-03-08T06:03:30.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.446+0000 7ff302400640 1 -- 172.21.15.19:0/1186112452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff2fc0b40c0 con 0x7ff2fc15e590 2024-03-08T06:03:30.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.447+0000 7ff2f3400640 1 -- 172.21.15.19:0/1186112452 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff2e8058790 con 0x7ff2fc15e590 2024-03-08T06:03:30.448 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:30.448 INFO:teuthology.orchestra.run.smithi019.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-08T06:03:30.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.450+0000 7ff302400640 1 -- 172.21.15.19:0/1186112452 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff2dc06b4d0 msgr2=0x7ff2dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:30.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.450+0000 7ff302400640 1 --2- 172.21.15.19:0/1186112452 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff2dc06b4d0 0x7ff2dc06d990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec036000 tx=0x7ff2ec008030 comp rx=0 tx=0).stop 2024-03-08T06:03:30.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.450+0000 7ff302400640 1 -- 172.21.15.19:0/1186112452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2fc15e590 msgr2=0x7ff2fc143c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:30.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.450+0000 7ff302400640 1 --2- 172.21.15.19:0/1186112452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2fc15e590 0x7ff2fc143c90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800d7d0 tx=0x7ff2e800dc90 comp rx=0 tx=0).stop 2024-03-08T06:03:30.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.450+0000 7ff302400640 1 -- 172.21.15.19:0/1186112452 shutdown_connections 2024-03-08T06:03:30.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.450+0000 7ff302400640 1 --2- 172.21.15.19:0/1186112452 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff2dc06b4d0 0x7ff2dc06d990 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:30.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.450+0000 7ff302400640 1 --2- 172.21.15.19:0/1186112452 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff2fc15e970 0x7ff2fc1e73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:30.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.450+0000 7ff302400640 1 --2- 172.21.15.19:0/1186112452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2fc15e590 0x7ff2fc143c90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:30.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.450+0000 7ff302400640 1 --2- 172.21.15.19:0/1186112452 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff2fc0b4620 0x7ff2fc143600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:30.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.450+0000 7ff302400640 1 -- 172.21.15.19:0/1186112452 >> 172.21.15.19:0/1186112452 conn(0x7ff2fc0b1670 msgr2=0x7ff2fc071600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:30.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.450+0000 7ff302400640 1 -- 172.21.15.19:0/1186112452 shutdown_connections 2024-03-08T06:03:30.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.450+0000 7ff302400640 1 -- 172.21.15.19:0/1186112452 wait complete. 2024-03-08T06:03:30.471 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-08T06:03:30.471 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:03:30.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.689+0000 7f863b200640 1 Processor -- start 2024-03-08T06:03:30.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.689+0000 7f863b200640 1 -- start start 2024-03-08T06:03:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.691+0000 7f863b200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f863415b6c0 0x7f8634161740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.691+0000 7f863b200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f86340b49e0 0x7f86340adec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.691+0000 7f863b200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8634161d20 con 0x7f86340ae400 2024-03-08T06:03:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.691+0000 7f863b200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86340b4e40 con 0x7f86340b49e0 2024-03-08T06:03:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.691+0000 7f863b200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863415e280 con 0x7f863415b6c0 2024-03-08T06:03:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.691+0000 7f8639400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f86340b49e0 0x7f86340adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.691+0000 7f8639400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f86340b49e0 0x7f86340adec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33838/0 (socket says 172.21.15.19:33838) 2024-03-08T06:03:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.691+0000 7f8639400640 1 -- 172.21.15.19:0/3236986177 learned_addr learned my addr 172.21.15.19:0/3236986177 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.692+0000 7f8639e00640 1 --2- 172.21.15.19:0/3236986177 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f863415b6c0 0x7f8634161740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.692+0000 7f8639400640 1 -- 172.21.15.19:0/3236986177 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f863415b6c0 msgr2=0x7f8634161740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:30.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.692+0000 7f8639400640 1 --2- 172.21.15.19:0/3236986177 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f863415b6c0 0x7f8634161740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:30.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.692+0000 7f8639400640 1 -- 172.21.15.19:0/3236986177 >> v1:172.21.15.42:6789/0 conn(0x7f86340ae400 legacy=0x7f86340716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:30.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.692+0000 7f8639400640 1 -- 172.21.15.19:0/3236986177 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8634162000 con 0x7f86340b49e0 2024-03-08T06:03:30.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.693+0000 7f8639400640 1 --2- 172.21.15.19:0/3236986177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86340b49e0 0x7f86340adec0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8624009870 tx=0x7f862402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1c8f2cc7873296 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:30.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.693+0000 7f8638a00640 1 -- 172.21.15.19:0/3236986177 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8624034070 con 0x7f86340b49e0 2024-03-08T06:03:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.694+0000 7f8638a00640 1 -- 172.21.15.19:0/3236986177 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8624030840 con 0x7f86340b49e0 2024-03-08T06:03:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.694+0000 7f8638a00640 1 -- 172.21.15.19:0/3236986177 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8624030c10 con 0x7f86340b49e0 2024-03-08T06:03:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.694+0000 7f863b200640 1 -- 172.21.15.19:0/3236986177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86340b49e0 msgr2=0x7f86340adec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.694+0000 7f863b200640 1 --2- 172.21.15.19:0/3236986177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86340b49e0 0x7f86340adec0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8624009870 tx=0x7f862402b980 comp rx=0 tx=0).stop 2024-03-08T06:03:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.694+0000 7f863b200640 1 -- 172.21.15.19:0/3236986177 shutdown_connections 2024-03-08T06:03:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.694+0000 7f863b200640 1 --2- 172.21.15.19:0/3236986177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86340b49e0 0x7f86340adec0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.694+0000 7f863b200640 1 --2- 172.21.15.19:0/3236986177 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f863415b6c0 0x7f8634161740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.694+0000 7f863b200640 1 -- 172.21.15.19:0/3236986177 >> 172.21.15.19:0/3236986177 conn(0x7f86340b1850 msgr2=0x7f86340b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.694+0000 7f863b200640 1 -- 172.21.15.19:0/3236986177 shutdown_connections 2024-03-08T06:03:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.694+0000 7f863b200640 1 -- 172.21.15.19:0/3236986177 wait complete. 2024-03-08T06:03:30.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.696+0000 7f863b200640 1 Processor -- start 2024-03-08T06:03:30.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.696+0000 7f863b200640 1 -- start start 2024-03-08T06:03:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.697+0000 7f863b200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f86340ae400 0x7f863413d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.697+0000 7f863b200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86340b49e0 0x7f8634142190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.697+0000 7f863b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f863415b6c0 0x7f86340afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.697+0000 7f863b200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86341625c0 con 0x7f86340b49e0 2024-03-08T06:03:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.697+0000 7f863b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86340b4740 con 0x7f863415b6c0 2024-03-08T06:03:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.697+0000 7f863b200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863415baa0 con 0x7f86340ae400 2024-03-08T06:03:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.697+0000 7f8639400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86340b49e0 0x7f8634142190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.698+0000 7f8639400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86340b49e0 0x7f8634142190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33840/0 (socket says 172.21.15.19:33840) 2024-03-08T06:03:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.698+0000 7f8639400640 1 -- 172.21.15.19:0/2412201177 learned_addr learned my addr 172.21.15.19:0/2412201177 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.698+0000 7f8639e00640 1 --2- 172.21.15.19:0/2412201177 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f86340ae400 0x7f863413d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.698+0000 7f863a800640 1 --2- 172.21.15.19:0/2412201177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f863415b6c0 0x7f86340afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.698+0000 7f8639400640 1 -- 172.21.15.19:0/2412201177 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f86340ae400 msgr2=0x7f863413d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.698+0000 7f8639400640 1 --2- 172.21.15.19:0/2412201177 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f86340ae400 0x7f863413d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.698+0000 7f8639400640 1 -- 172.21.15.19:0/2412201177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f863415b6c0 msgr2=0x7f86340afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.698+0000 7f8639400640 1 --2- 172.21.15.19:0/2412201177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f863415b6c0 0x7f86340afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.698+0000 7f8639400640 1 -- 172.21.15.19:0/2412201177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86341426d0 con 0x7f86340b49e0 2024-03-08T06:03:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.698+0000 7f863a800640 1 --2- 172.21.15.19:0/2412201177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f863415b6c0 0x7f86340afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:30.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.698+0000 7f8639400640 1 --2- 172.21.15.19:0/2412201177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86340b49e0 0x7f8634142190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8624000c00 tx=0x7f8624004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:30.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.699+0000 7f862e000640 1 -- 172.21.15.19:0/2412201177 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8624048070 con 0x7f86340b49e0 2024-03-08T06:03:30.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.699+0000 7f862e000640 1 -- 172.21.15.19:0/2412201177 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8624030640 con 0x7f86340b49e0 2024-03-08T06:03:30.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.699+0000 7f862e000640 1 -- 172.21.15.19:0/2412201177 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8624034040 con 0x7f86340b49e0 2024-03-08T06:03:30.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.699+0000 7f863b200640 1 -- 172.21.15.19:0/2412201177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8634142970 con 0x7f86340b49e0 2024-03-08T06:03:30.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.699+0000 7f863b200640 1 -- 172.21.15.19:0/2412201177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86340cc880 con 0x7f86340b49e0 2024-03-08T06:03:30.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.700+0000 7f863b200640 1 -- 172.21.15.19:0/2412201177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8634075100 con 0x7f86340b49e0 2024-03-08T06:03:30.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.701+0000 7f862e000640 1 -- 172.21.15.19:0/2412201177 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8624037070 con 0x7f86340b49e0 2024-03-08T06:03:30.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.702+0000 7f862e000640 1 --2- 172.21.15.19:0/2412201177 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f861806b4d0 0x7f861806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:30.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.702+0000 7f862e000640 1 -- 172.21.15.19:0/2412201177 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86240ac1b0 con 0x7f86340b49e0 2024-03-08T06:03:30.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.702+0000 7f8639e00640 1 --2- 172.21.15.19:0/2412201177 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f861806b4d0 0x7f861806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:30.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.703+0000 7f8639e00640 1 --2- 172.21.15.19:0/2412201177 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f861806b4d0 0x7f861806d990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8628006fd0 tx=0x7f8628008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:30.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.706+0000 7f862e000640 1 -- 172.21.15.19:0/2412201177 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f862407b020 con 0x7f86340b49e0 2024-03-08T06:03:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.906+0000 7f863b200640 1 -- 172.21.15.19:0/2412201177 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86340cef40 con 0x7f86340b49e0 2024-03-08T06:03:30.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.907+0000 7f862e000640 1 -- 172.21.15.19:0/2412201177 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f862407a920 con 0x7f86340b49e0 2024-03-08T06:03:30.909 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:30.909 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:03:22.069498+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:03:18.392703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T06:03:19.537912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:03:30.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.910+0000 7f863b200640 1 -- 172.21.15.19:0/2412201177 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f861806b4d0 msgr2=0x7f861806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:30.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.910+0000 7f863b200640 1 --2- 172.21.15.19:0/2412201177 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f861806b4d0 0x7f861806d990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8628006fd0 tx=0x7f8628008040 comp rx=0 tx=0).stop 2024-03-08T06:03:30.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.910+0000 7f863b200640 1 -- 172.21.15.19:0/2412201177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86340b49e0 msgr2=0x7f8634142190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:30.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.910+0000 7f863b200640 1 --2- 172.21.15.19:0/2412201177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86340b49e0 0x7f8634142190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8624000c00 tx=0x7f8624004730 comp rx=0 tx=0).stop 2024-03-08T06:03:30.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.911+0000 7f863b200640 1 -- 172.21.15.19:0/2412201177 shutdown_connections 2024-03-08T06:03:30.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.911+0000 7f863b200640 1 --2- 172.21.15.19:0/2412201177 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f861806b4d0 0x7f861806d990 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:30.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.911+0000 7f863b200640 1 --2- 172.21.15.19:0/2412201177 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f863415b6c0 0x7f86340afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:30.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.911+0000 7f863b200640 1 --2- 172.21.15.19:0/2412201177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86340b49e0 0x7f8634142190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:30.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.911+0000 7f863b200640 1 --2- 172.21.15.19:0/2412201177 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f86340ae400 0x7f863413d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:30.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.911+0000 7f863b200640 1 -- 172.21.15.19:0/2412201177 >> 172.21.15.19:0/2412201177 conn(0x7f86340b1850 msgr2=0x7f863415bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:30.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.911+0000 7f863b200640 1 -- 172.21.15.19:0/2412201177 shutdown_connections 2024-03-08T06:03:30.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:30.911+0000 7f863b200640 1 -- 172.21.15.19:0/2412201177 wait complete. 2024-03-08T06:03:30.932 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T06:03:14.149736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T06:03:18.392703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T06:03:19.537912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T06:03:30.933 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T06:03:31.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.148+0000 7f0ff3400640 1 Processor -- start 2024-03-08T06:03:31.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.149+0000 7f0ff3400640 1 -- start start 2024-03-08T06:03:31.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.150+0000 7f0ff3400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0fec071bc0 0x7f0fec0cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:31.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.150+0000 7f0ff3400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f0fec15e760 0x7f0fec144000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:31.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.150+0000 7f0ff3400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fec15ebf0 con 0x7f0fec071fa0 2024-03-08T06:03:31.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.150+0000 7f0ff3400640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fec15ee70 con 0x7f0fec071bc0 2024-03-08T06:03:31.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.150+0000 7f0ff3400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec15f150 con 0x7f0fec15e760 2024-03-08T06:03:31.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.151+0000 7f0ff0a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0fec071bc0 0x7f0fec0cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:31.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.151+0000 7f0ff0a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0fec071bc0 0x7f0fec0cf5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.19:40190/0 (socket says 172.21.15.19:40190) 2024-03-08T06:03:31.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.151+0000 7f0ff0a00640 1 -- 172.21.15.19:0/59868780 learned_addr learned my addr 172.21.15.19:0/59868780 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:31.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.151+0000 7f0ff1400640 1 --2- 172.21.15.19:0/59868780 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f0fec15e760 0x7f0fec144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:31.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.152+0000 7f0ff0a00640 1 -- 172.21.15.19:0/59868780 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f0fec15e760 msgr2=0x7f0fec144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:31.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.152+0000 7f0ff0a00640 1 --2- 172.21.15.19:0/59868780 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f0fec15e760 0x7f0fec144000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:31.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.152+0000 7f0ff0a00640 1 -- 172.21.15.19:0/59868780 >> v1:172.21.15.42:6789/0 conn(0x7f0fec071fa0 legacy=0x7f0fec15b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:31.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.152+0000 7f0ff0a00640 1 -- 172.21.15.19:0/59868780 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec15f430 con 0x7f0fec071bc0 2024-03-08T06:03:31.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.153+0000 7f0ff0a00640 1 --2- 172.21.15.19:0/59868780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fec071bc0 0x7f0fec0cf5b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0009870 tx=0x7f0fe002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86f481fea135250a server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:31.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.154+0000 7f0feb400640 1 -- 172.21.15.19:0/59868780 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe0035020 con 0x7f0fec071bc0 2024-03-08T06:03:31.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.155+0000 7f0feb400640 1 -- 172.21.15.19:0/59868780 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe0031640 con 0x7f0fec071bc0 2024-03-08T06:03:31.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.155+0000 7f0feb400640 1 -- 172.21.15.19:0/59868780 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe002d040 con 0x7f0fec071bc0 2024-03-08T06:03:31.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.155+0000 7f0ff3400640 1 -- 172.21.15.19:0/59868780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fec071bc0 msgr2=0x7f0fec0cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:31.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.155+0000 7f0ff3400640 1 --2- 172.21.15.19:0/59868780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fec071bc0 0x7f0fec0cf5b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0009870 tx=0x7f0fe002b8f0 comp rx=0 tx=0).stop 2024-03-08T06:03:31.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.155+0000 7f0ff3400640 1 -- 172.21.15.19:0/59868780 shutdown_connections 2024-03-08T06:03:31.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.155+0000 7f0ff3400640 1 --2- 172.21.15.19:0/59868780 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f0fec15e760 0x7f0fec144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:31.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.155+0000 7f0ff3400640 1 --2- 172.21.15.19:0/59868780 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fec071bc0 0x7f0fec0cf5b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:31.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.155+0000 7f0ff3400640 1 -- 172.21.15.19:0/59868780 >> 172.21.15.19:0/59868780 conn(0x7f0fec06ae30 msgr2=0x7f0fec06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:31.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.156+0000 7f0ff3400640 1 -- 172.21.15.19:0/59868780 shutdown_connections 2024-03-08T06:03:31.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.156+0000 7f0ff3400640 1 -- 172.21.15.19:0/59868780 wait complete. 2024-03-08T06:03:31.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.157+0000 7f0ff3400640 1 Processor -- start 2024-03-08T06:03:31.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.157+0000 7f0ff3400640 1 -- start start 2024-03-08T06:03:31.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.158+0000 7f0ff3400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fec071bc0 0x7f0fec14e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:31.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.158+0000 7f0ff3400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f0fec071fa0 0x7f0fec0cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:31.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.158+0000 7f0ff3400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fec15e760 0x7f0fec0aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:31.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.158+0000 7f0ff3400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec1448d0 con 0x7f0fec15e760 2024-03-08T06:03:31.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.158+0000 7f0ff3400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec144750 con 0x7f0fec071bc0 2024-03-08T06:03:31.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.159+0000 7f0ff3400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec0b3fd0 con 0x7f0fec071fa0 2024-03-08T06:03:31.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.159+0000 7f0ff1400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fec15e760 0x7f0fec0aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:31.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.159+0000 7f0ff1400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fec15e760 0x7f0fec0aa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33856/0 (socket says 172.21.15.19:33856) 2024-03-08T06:03:31.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.159+0000 7f0ff1400640 1 -- 172.21.15.19:0/2722347043 learned_addr learned my addr 172.21.15.19:0/2722347043 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:31.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.159+0000 7f0ff0a00640 1 --2- 172.21.15.19:0/2722347043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fec071bc0 0x7f0fec14e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:31.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.159+0000 7f0febe00640 1 --2- 172.21.15.19:0/2722347043 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f0fec071fa0 0x7f0fec0cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:31.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.159+0000 7f0ff1400640 1 -- 172.21.15.19:0/2722347043 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f0fec071fa0 msgr2=0x7f0fec0cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:31.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.159+0000 7f0ff1400640 1 --2- 172.21.15.19:0/2722347043 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f0fec071fa0 0x7f0fec0cb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:31.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.159+0000 7f0ff1400640 1 -- 172.21.15.19:0/2722347043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fec071bc0 msgr2=0x7f0fec14e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:31.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.159+0000 7f0ff1400640 1 --2- 172.21.15.19:0/2722347043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fec071bc0 0x7f0fec14e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:31.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.159+0000 7f0ff1400640 1 -- 172.21.15.19:0/2722347043 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec0aac50 con 0x7f0fec15e760 2024-03-08T06:03:31.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.160+0000 7f0ff1400640 1 --2- 172.21.15.19:0/2722347043 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fec15e760 0x7f0fec0aa150 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400efc0 tx=0x7f0fe400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:31.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.160+0000 7f0fe8c00640 1 -- 172.21.15.19:0/2722347043 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4018020 con 0x7f0fec15e760 2024-03-08T06:03:31.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.160+0000 7f0fe8c00640 1 -- 172.21.15.19:0/2722347043 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe4014480 con 0x7f0fec15e760 2024-03-08T06:03:31.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.160+0000 7f0fe8c00640 1 -- 172.21.15.19:0/2722347043 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4014870 con 0x7f0fec15e760 2024-03-08T06:03:31.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.160+0000 7f0ff3400640 1 -- 172.21.15.19:0/2722347043 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fec0aaf30 con 0x7f0fec15e760 2024-03-08T06:03:31.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.160+0000 7f0ff3400640 1 -- 172.21.15.19:0/2722347043 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fec0ab4f0 con 0x7f0fec15e760 2024-03-08T06:03:31.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.161+0000 7f0ff3400640 1 -- 172.21.15.19:0/2722347043 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fec0ce0b0 con 0x7f0fec15e760 2024-03-08T06:03:31.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.162+0000 7f0fe8c00640 1 -- 172.21.15.19:0/2722347043 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0fe4005d10 con 0x7f0fec15e760 2024-03-08T06:03:31.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.164+0000 7f0fe8c00640 1 --2- 172.21.15.19:0/2722347043 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f0fcc06b4d0 0x7f0fcc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:31.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.164+0000 7f0fe8c00640 1 -- 172.21.15.19:0/2722347043 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fe408b0b0 con 0x7f0fec15e760 2024-03-08T06:03:31.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.164+0000 7f0ff0a00640 1 --2- 172.21.15.19:0/2722347043 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f0fcc06b4d0 0x7f0fcc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:31.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.165+0000 7f0ff0a00640 1 --2- 172.21.15.19:0/2722347043 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f0fcc06b4d0 0x7f0fcc06d990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0036000 tx=0x7f0fe003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:31.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.169+0000 7f0fe8c00640 1 -- 172.21.15.19:0/2722347043 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0fec0ce0b0 con 0x7f0fec15e760 2024-03-08T06:03:31.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.365+0000 7f0ff3400640 1 -- 172.21.15.19:0/2722347043 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0fec067cb0 con 0x7f0fec15e760 2024-03-08T06:03:31.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.366+0000 7f0fe8c00640 1 -- 172.21.15.19:0/2722347043 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0fe4022030 con 0x7f0fec15e760 2024-03-08T06:03:31.367 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-08T06:03:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.369+0000 7f0ff3400640 1 -- 172.21.15.19:0/2722347043 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f0fcc06b4d0 msgr2=0x7f0fcc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.369+0000 7f0ff3400640 1 --2- 172.21.15.19:0/2722347043 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f0fcc06b4d0 0x7f0fcc06d990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0036000 tx=0x7f0fe003c040 comp rx=0 tx=0).stop 2024-03-08T06:03:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.369+0000 7f0ff3400640 1 -- 172.21.15.19:0/2722347043 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fec15e760 msgr2=0x7f0fec0aa150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.369+0000 7f0ff3400640 1 --2- 172.21.15.19:0/2722347043 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fec15e760 0x7f0fec0aa150 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0fe400efc0 tx=0x7f0fe400c490 comp rx=0 tx=0).stop 2024-03-08T06:03:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.369+0000 7f0ff3400640 1 -- 172.21.15.19:0/2722347043 shutdown_connections 2024-03-08T06:03:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.369+0000 7f0ff3400640 1 --2- 172.21.15.19:0/2722347043 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f0fcc06b4d0 0x7f0fcc06d990 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.369+0000 7f0ff3400640 1 --2- 172.21.15.19:0/2722347043 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fec15e760 0x7f0fec0aa150 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.369+0000 7f0ff3400640 1 --2- 172.21.15.19:0/2722347043 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f0fec071fa0 0x7f0fec0cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.369+0000 7f0ff3400640 1 --2- 172.21.15.19:0/2722347043 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0fec071bc0 0x7f0fec14e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.369+0000 7f0ff3400640 1 -- 172.21.15.19:0/2722347043 >> 172.21.15.19:0/2722347043 conn(0x7f0fec06ae30 msgr2=0x7f0fec0a84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.369+0000 7f0ff3400640 1 -- 172.21.15.19:0/2722347043 shutdown_connections 2024-03-08T06:03:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.369+0000 7f0ff3400640 1 -- 172.21.15.19:0/2722347043 wait complete. 2024-03-08T06:03:31.387 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T06:03:31.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.610+0000 7effc3200640 1 Processor -- start 2024-03-08T06:03:31.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.611+0000 7effc3200640 1 -- start start 2024-03-08T06:03:31.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.612+0000 7effc3200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7effc4145500 0x7effc406ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:31.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.612+0000 7effc3200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7effc4071df0 0x7effc40cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:31.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.612+0000 7effc3200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc415c460 con 0x7effc415bfb0 2024-03-08T06:03:31.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.612+0000 7effc3200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc415c740 con 0x7effc4145500 2024-03-08T06:03:31.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.612+0000 7effc3200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc415ca20 con 0x7effc4071df0 2024-03-08T06:03:31.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.613+0000 7effc1e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7effc4145500 0x7effc406ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:31.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.613+0000 7effc1e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7effc4145500 0x7effc406ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33872/0 (socket says 172.21.15.19:33872) 2024-03-08T06:03:31.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.613+0000 7effc1e00640 1 -- 172.21.15.19:0/3780991564 learned_addr learned my addr 172.21.15.19:0/3780991564 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:31.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.613+0000 7effc2800640 1 --2- 172.21.15.19:0/3780991564 >> v2:172.21.15.42:3300/0 conn(0x7effc4071df0 0x7effc40cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:31.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.613+0000 7effc1e00640 1 -- 172.21.15.19:0/3780991564 >> v2:172.21.15.42:3300/0 conn(0x7effc4071df0 msgr2=0x7effc40cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:31.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.613+0000 7effc1e00640 1 --2- 172.21.15.19:0/3780991564 >> v2:172.21.15.42:3300/0 conn(0x7effc4071df0 0x7effc40cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:31.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.613+0000 7effc1e00640 1 -- 172.21.15.19:0/3780991564 >> v1:172.21.15.42:6789/0 conn(0x7effc415bfb0 legacy=0x7effc40716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:31.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.613+0000 7effc1e00640 1 -- 172.21.15.19:0/3780991564 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc415cd00 con 0x7effc4145500 2024-03-08T06:03:31.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.614+0000 7effc1e00640 1 --2- 172.21.15.19:0/3780991564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc4145500 0x7effc406ecb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7effc40cbb30 tx=0x7effb402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdaaf5546ef88b61 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:31.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.615+0000 7effc1400640 1 -- 172.21.15.19:0/3780991564 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb402e070 con 0x7effc4145500 2024-03-08T06:03:31.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.615+0000 7effc1400640 1 -- 172.21.15.19:0/3780991564 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb4037070 con 0x7effc4145500 2024-03-08T06:03:31.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.615+0000 7effc1400640 1 -- 172.21.15.19:0/3780991564 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb4031a00 con 0x7effc4145500 2024-03-08T06:03:31.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.615+0000 7effc3200640 1 -- 172.21.15.19:0/3780991564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc4145500 msgr2=0x7effc406ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:31.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.615+0000 7effc3200640 1 --2- 172.21.15.19:0/3780991564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc4145500 0x7effc406ecb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7effc40cbb30 tx=0x7effb402b880 comp rx=0 tx=0).stop 2024-03-08T06:03:31.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.616+0000 7effc3200640 1 -- 172.21.15.19:0/3780991564 shutdown_connections 2024-03-08T06:03:31.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.616+0000 7effc3200640 1 --2- 172.21.15.19:0/3780991564 >> v2:172.21.15.42:3300/0 conn(0x7effc4071df0 0x7effc40cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:31.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.616+0000 7effc3200640 1 --2- 172.21.15.19:0/3780991564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc4145500 0x7effc406ecb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:31.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.616+0000 7effc3200640 1 -- 172.21.15.19:0/3780991564 >> 172.21.15.19:0/3780991564 conn(0x7effc40b1850 msgr2=0x7effc40b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:31.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.616+0000 7effc3200640 1 -- 172.21.15.19:0/3780991564 shutdown_connections 2024-03-08T06:03:31.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.616+0000 7effc3200640 1 -- 172.21.15.19:0/3780991564 wait complete. 2024-03-08T06:03:31.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.618+0000 7effc3200640 1 Processor -- start 2024-03-08T06:03:31.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.618+0000 7effc3200640 1 -- start start 2024-03-08T06:03:31.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.619+0000 7effc3200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effc4071df0 0x7effc41f0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:31.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.619+0000 7effc3200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc4145500 0x7effc40c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:31.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.620+0000 7effc3200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7effc415bfb0 0x7effc40adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:31.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.620+0000 7effc3200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc40ccbc0 con 0x7effc4145500 2024-03-08T06:03:31.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.620+0000 7effc3200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc40cca40 con 0x7effc4071df0 2024-03-08T06:03:31.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.620+0000 7effc3200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc40ccd40 con 0x7effc415bfb0 2024-03-08T06:03:31.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.620+0000 7effbbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc4145500 0x7effc40c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:31.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.620+0000 7effbbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc4145500 0x7effc40c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33888/0 (socket says 172.21.15.19:33888) 2024-03-08T06:03:31.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.620+0000 7effbbe00640 1 -- 172.21.15.19:0/4228092767 learned_addr learned my addr 172.21.15.19:0/4228092767 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:31.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.620+0000 7effc2800640 1 --2- 172.21.15.19:0/4228092767 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7effc415bfb0 0x7effc40adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:31.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.620+0000 7effc1e00640 1 --2- 172.21.15.19:0/4228092767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effc4071df0 0x7effc41f0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:31.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.620+0000 7effbbe00640 1 -- 172.21.15.19:0/4228092767 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7effc415bfb0 msgr2=0x7effc40adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:31.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.620+0000 7effbbe00640 1 --2- 172.21.15.19:0/4228092767 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7effc415bfb0 0x7effc40adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:31.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.620+0000 7effbbe00640 1 -- 172.21.15.19:0/4228092767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effc4071df0 msgr2=0x7effc41f0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:31.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.620+0000 7effbbe00640 1 --2- 172.21.15.19:0/4228092767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effc4071df0 0x7effc41f0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:31.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.620+0000 7effbbe00640 1 -- 172.21.15.19:0/4228092767 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc41f1050 con 0x7effc4145500 2024-03-08T06:03:31.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.621+0000 7effbbe00640 1 --2- 172.21.15.19:0/4228092767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc4145500 0x7effc40c4d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7effac00b3f0 tx=0x7effac00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:31.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.621+0000 7effba000640 1 -- 172.21.15.19:0/4228092767 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac015020 con 0x7effc4145500 2024-03-08T06:03:31.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.621+0000 7effba000640 1 -- 172.21.15.19:0/4228092767 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac011830 con 0x7effc4145500 2024-03-08T06:03:31.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.621+0000 7effba000640 1 -- 172.21.15.19:0/4228092767 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac011c20 con 0x7effc4145500 2024-03-08T06:03:31.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.621+0000 7effc3200640 1 -- 172.21.15.19:0/4228092767 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc40b2b10 con 0x7effc4145500 2024-03-08T06:03:31.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.621+0000 7effc3200640 1 -- 172.21.15.19:0/4228092767 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc40b30d0 con 0x7effc4145500 2024-03-08T06:03:31.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.623+0000 7effc3200640 1 -- 172.21.15.19:0/4228092767 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc4075090 con 0x7effc4145500 2024-03-08T06:03:31.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.623+0000 7effba000640 1 -- 172.21.15.19:0/4228092767 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7effac018020 con 0x7effc4145500 2024-03-08T06:03:31.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.625+0000 7effba000640 1 --2- 172.21.15.19:0/4228092767 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7effa006b4d0 0x7effa006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:31.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.625+0000 7effba000640 1 -- 172.21.15.19:0/4228092767 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effac089e30 con 0x7effc4145500 2024-03-08T06:03:31.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.625+0000 7effc1e00640 1 --2- 172.21.15.19:0/4228092767 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7effa006b4d0 0x7effa006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:31.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.626+0000 7effc1e00640 1 --2- 172.21.15.19:0/4228092767 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7effa006b4d0 0x7effa006d990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7effb4036000 tx=0x7effb403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:31.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.629+0000 7effba000640 1 -- 172.21.15.19:0/4228092767 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7effac01f030 con 0x7effc4145500 2024-03-08T06:03:31.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.826+0000 7effc3200640 1 -- 172.21.15.19:0/4228092767 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7effc414cc00 con 0x7effc4145500 2024-03-08T06:03:31.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.827+0000 7effba000640 1 -- 172.21.15.19:0/4228092767 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7effac0172c0 con 0x7effc4145500 2024-03-08T06:03:31.828 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-08T06:03:31.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.829+0000 7effc3200640 1 -- 172.21.15.19:0/4228092767 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7effa006b4d0 msgr2=0x7effa006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:31.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.829+0000 7effc3200640 1 --2- 172.21.15.19:0/4228092767 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7effa006b4d0 0x7effa006d990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7effb4036000 tx=0x7effb403d040 comp rx=0 tx=0).stop 2024-03-08T06:03:31.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.830+0000 7effc3200640 1 -- 172.21.15.19:0/4228092767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc4145500 msgr2=0x7effc40c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:31.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.830+0000 7effc3200640 1 --2- 172.21.15.19:0/4228092767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc4145500 0x7effc40c4d90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7effac00b3f0 tx=0x7effac00b8b0 comp rx=0 tx=0).stop 2024-03-08T06:03:31.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.830+0000 7effc3200640 1 -- 172.21.15.19:0/4228092767 shutdown_connections 2024-03-08T06:03:31.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.830+0000 7effc3200640 1 --2- 172.21.15.19:0/4228092767 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7effa006b4d0 0x7effa006d990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:31.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.830+0000 7effc3200640 1 --2- 172.21.15.19:0/4228092767 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7effc415bfb0 0x7effc40adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:31.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.830+0000 7effc3200640 1 --2- 172.21.15.19:0/4228092767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effc4145500 0x7effc40c4d90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:31.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.830+0000 7effc3200640 1 --2- 172.21.15.19:0/4228092767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effc4071df0 0x7effc41f0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:31.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.830+0000 7effc3200640 1 -- 172.21.15.19:0/4228092767 >> 172.21.15.19:0/4228092767 conn(0x7effc40b1850 msgr2=0x7effc406d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:31.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.830+0000 7effc3200640 1 -- 172.21.15.19:0/4228092767 shutdown_connections 2024-03-08T06:03:31.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:31.830+0000 7effc3200640 1 -- 172.21.15.19:0/4228092767 wait complete. 2024-03-08T06:03:31.851 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T06:03:32.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.077+0000 7f9673c00640 1 Processor -- start 2024-03-08T06:03:32.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.077+0000 7f9673c00640 1 -- start start 2024-03-08T06:03:32.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.078+0000 7f9673c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f966c1604f0 0x7f966c0cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:32.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.078+0000 7f9673c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f966c071950 0x7f966c071d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:32.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.078+0000 7f9673c00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f966c0cd5a0 con 0x7f966c1455b0 2024-03-08T06:03:32.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.078+0000 7f9673c00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966c0cdc20 con 0x7f966c1604f0 2024-03-08T06:03:32.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.078+0000 7f9673c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0722d0 con 0x7f966c071950 2024-03-08T06:03:32.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.079+0000 7f966be00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f966c1604f0 0x7f966c0cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:32.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.079+0000 7f966be00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f966c1604f0 0x7f966c0cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.19:40266/0 (socket says 172.21.15.19:40266) 2024-03-08T06:03:32.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.079+0000 7f966be00640 1 -- 172.21.15.19:0/2115853114 learned_addr learned my addr 172.21.15.19:0/2115853114 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:32.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.079+0000 7f9671c00640 1 --2- 172.21.15.19:0/2115853114 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f966c071950 0x7f966c071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:32.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.080+0000 7f966be00640 1 -- 172.21.15.19:0/2115853114 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f966c071950 msgr2=0x7f966c071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:32.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.080+0000 7f966be00640 1 --2- 172.21.15.19:0/2115853114 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f966c071950 0x7f966c071d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:32.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.080+0000 7f966be00640 1 -- 172.21.15.19:0/2115853114 >> v1:172.21.15.42:6789/0 conn(0x7f966c1455b0 legacy=0x7f966c15c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:32.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.080+0000 7f966be00640 1 -- 172.21.15.19:0/2115853114 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c0ccfe0 con 0x7f966c1604f0 2024-03-08T06:03:32.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.081+0000 7f966be00640 1 --2- 172.21.15.19:0/2115853114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f966c1604f0 0x7f966c0cc690 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9658009870 tx=0x7f965802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bd9571c84688b05 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:32.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.082+0000 7f966b400640 1 -- 172.21.15.19:0/2115853114 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9658034070 con 0x7f966c1604f0 2024-03-08T06:03:32.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.082+0000 7f966b400640 1 -- 172.21.15.19:0/2115853114 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9658030840 con 0x7f966c1604f0 2024-03-08T06:03:32.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.082+0000 7f966b400640 1 -- 172.21.15.19:0/2115853114 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9658030c10 con 0x7f966c1604f0 2024-03-08T06:03:32.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.083+0000 7f9673c00640 1 -- 172.21.15.19:0/2115853114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f966c1604f0 msgr2=0x7f966c0cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:32.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.083+0000 7f9673c00640 1 --2- 172.21.15.19:0/2115853114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f966c1604f0 0x7f966c0cc690 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9658009870 tx=0x7f965802b980 comp rx=0 tx=0).stop 2024-03-08T06:03:32.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.083+0000 7f9673c00640 1 -- 172.21.15.19:0/2115853114 shutdown_connections 2024-03-08T06:03:32.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.083+0000 7f9673c00640 1 --2- 172.21.15.19:0/2115853114 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f966c071950 0x7f966c071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:32.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.083+0000 7f9673c00640 1 --2- 172.21.15.19:0/2115853114 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f966c1604f0 0x7f966c0cc690 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:32.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.083+0000 7f9673c00640 1 -- 172.21.15.19:0/2115853114 >> 172.21.15.19:0/2115853114 conn(0x7f966c06ae30 msgr2=0x7f966c06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:32.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.083+0000 7f9673c00640 1 -- 172.21.15.19:0/2115853114 shutdown_connections 2024-03-08T06:03:32.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.083+0000 7f9673c00640 1 -- 172.21.15.19:0/2115853114 wait complete. 2024-03-08T06:03:32.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.085+0000 7f9673c00640 1 Processor -- start 2024-03-08T06:03:32.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.085+0000 7f9673c00640 1 -- start start 2024-03-08T06:03:32.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.086+0000 7f9673c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f966c071950 0x7f966c1f39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:32.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.086+0000 7f9673c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f966c1455b0 0x7f966c13a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:32.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.086+0000 7f9673c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f966c1604f0 0x7f966c0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:32.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.086+0000 7f9673c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c145990 con 0x7f966c071950 2024-03-08T06:03:32.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.086+0000 7f9673c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0cd8b0 con 0x7f966c1455b0 2024-03-08T06:03:32.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.086+0000 7f9673c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0ccbd0 con 0x7f966c1604f0 2024-03-08T06:03:32.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.086+0000 7f9671200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f966c071950 0x7f966c1f39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:32.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.086+0000 7f9671200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f966c071950 0x7f966c1f39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41792/0 (socket says 172.21.15.19:41792) 2024-03-08T06:03:32.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.086+0000 7f9671200640 1 -- 172.21.15.19:0/1357418230 learned_addr learned my addr 172.21.15.19:0/1357418230 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:32.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.086+0000 7f966be00640 1 --2- 172.21.15.19:0/1357418230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f966c1455b0 0x7f966c13a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:32.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.086+0000 7f9671c00640 1 --2- 172.21.15.19:0/1357418230 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f966c1604f0 0x7f966c0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:32.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.086+0000 7f9671200640 1 -- 172.21.15.19:0/1357418230 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f966c1604f0 msgr2=0x7f966c0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:32.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.087+0000 7f9671200640 1 --2- 172.21.15.19:0/1357418230 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f966c1604f0 0x7f966c0ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:32.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.087+0000 7f9671200640 1 -- 172.21.15.19:0/1357418230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f966c1455b0 msgr2=0x7f966c13a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:32.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.087+0000 7f9671200640 1 --2- 172.21.15.19:0/1357418230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f966c1455b0 0x7f966c13a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:32.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.087+0000 7f9671200640 1 -- 172.21.15.19:0/1357418230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c1539d0 con 0x7f966c071950 2024-03-08T06:03:32.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.087+0000 7f9671c00640 1 --2- 172.21.15.19:0/1357418230 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f966c1604f0 0x7f966c0ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:32.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.087+0000 7f9671200640 1 --2- 172.21.15.19:0/1357418230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f966c071950 0x7f966c1f39a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f966000c450 tx=0x7f966000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:32.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.087+0000 7f9668c00640 1 -- 172.21.15.19:0/1357418230 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9660017070 con 0x7f966c071950 2024-03-08T06:03:32.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.087+0000 7f9668c00640 1 -- 172.21.15.19:0/1357418230 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96600052d0 con 0x7f966c071950 2024-03-08T06:03:32.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.087+0000 7f9673c00640 1 -- 172.21.15.19:0/1357418230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f966c13c9b0 con 0x7f966c071950 2024-03-08T06:03:32.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.087+0000 7f9668c00640 1 -- 172.21.15.19:0/1357418230 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9660003830 con 0x7f966c071950 2024-03-08T06:03:32.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.087+0000 7f9673c00640 1 -- 172.21.15.19:0/1357418230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966c13cf70 con 0x7f966c071950 2024-03-08T06:03:32.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.089+0000 7f9673c00640 1 -- 172.21.15.19:0/1357418230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966c067cb0 con 0x7f966c071950 2024-03-08T06:03:32.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.089+0000 7f9668c00640 1 -- 172.21.15.19:0/1357418230 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f966001a070 con 0x7f966c071950 2024-03-08T06:03:32.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.090+0000 7f9668c00640 1 --2- 172.21.15.19:0/1357418230 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f964c06b4d0 0x7f964c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:32.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.091+0000 7f9668c00640 1 -- 172.21.15.19:0/1357418230 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96600895e0 con 0x7f966c071950 2024-03-08T06:03:32.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.091+0000 7f966be00640 1 --2- 172.21.15.19:0/1357418230 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f964c06b4d0 0x7f964c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:32.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.091+0000 7f966be00640 1 --2- 172.21.15.19:0/1357418230 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f964c06b4d0 0x7f964c06d990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9658036000 tx=0x7f965803b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:32.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.095+0000 7f9668c00640 1 -- 172.21.15.19:0/1357418230 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9660058450 con 0x7f966c071950 2024-03-08T06:03:32.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.295+0000 7f9673c00640 1 -- 172.21.15.19:0/1357418230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f966c0afcb0 con 0x7f966c071950 2024-03-08T06:03:32.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.296+0000 7f9668c00640 1 -- 172.21.15.19:0/1357418230 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9660057d50 con 0x7f966c071950 2024-03-08T06:03:32.297 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-08T06:03:32.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.299+0000 7f9673c00640 1 -- 172.21.15.19:0/1357418230 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f964c06b4d0 msgr2=0x7f964c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:32.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.299+0000 7f9673c00640 1 --2- 172.21.15.19:0/1357418230 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f964c06b4d0 0x7f964c06d990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9658036000 tx=0x7f965803b040 comp rx=0 tx=0).stop 2024-03-08T06:03:32.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.299+0000 7f9673c00640 1 -- 172.21.15.19:0/1357418230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f966c071950 msgr2=0x7f966c1f39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:32.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.299+0000 7f9673c00640 1 --2- 172.21.15.19:0/1357418230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f966c071950 0x7f966c1f39a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f966000c450 tx=0x7f966000c910 comp rx=0 tx=0).stop 2024-03-08T06:03:32.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.299+0000 7f9673c00640 1 -- 172.21.15.19:0/1357418230 shutdown_connections 2024-03-08T06:03:32.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.299+0000 7f9673c00640 1 --2- 172.21.15.19:0/1357418230 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f964c06b4d0 0x7f964c06d990 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:32.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.299+0000 7f9673c00640 1 --2- 172.21.15.19:0/1357418230 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f966c1604f0 0x7f966c0ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:32.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.299+0000 7f9673c00640 1 --2- 172.21.15.19:0/1357418230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f966c1455b0 0x7f966c13a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:32.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.299+0000 7f9673c00640 1 --2- 172.21.15.19:0/1357418230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f966c071950 0x7f966c1f39a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:32.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.299+0000 7f9673c00640 1 -- 172.21.15.19:0/1357418230 >> 172.21.15.19:0/1357418230 conn(0x7f966c06ae30 msgr2=0x7f966c143970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:32.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.299+0000 7f9673c00640 1 -- 172.21.15.19:0/1357418230 shutdown_connections 2024-03-08T06:03:32.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.299+0000 7f9673c00640 1 -- 172.21.15.19:0/1357418230 wait complete. 2024-03-08T06:03:32.318 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T06:03:32.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.533+0000 7f7eb3200640 1 Processor -- start 2024-03-08T06:03:32.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.533+0000 7f7eb3200640 1 -- start start 2024-03-08T06:03:32.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.535+0000 7f7eb3200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7eb415df20 0x7f7eb40ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:32.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.535+0000 7f7eb3200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7eb40d11b0 0x7f7eb4162400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:32.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.535+0000 7f7eb3200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb415e300 con 0x7f7eb40b6bd0 2024-03-08T06:03:32.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.535+0000 7f7eb3200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb40d3990 con 0x7f7eb415df20 2024-03-08T06:03:32.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.535+0000 7f7eb3200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb4162940 con 0x7f7eb40d11b0 2024-03-08T06:03:32.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.535+0000 7f7eb1e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7eb415df20 0x7f7eb40ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:32.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.535+0000 7f7eb1e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7eb415df20 0x7f7eb40ce9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41796/0 (socket says 172.21.15.19:41796) 2024-03-08T06:03:32.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.535+0000 7f7eb1e00640 1 -- 172.21.15.19:0/3356270579 learned_addr learned my addr 172.21.15.19:0/3356270579 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:32.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.536+0000 7f7eb2800640 1 --2- 172.21.15.19:0/3356270579 >> v2:172.21.15.42:3300/0 conn(0x7f7eb40d11b0 0x7f7eb4162400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:32.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.536+0000 7f7eb1e00640 1 -- 172.21.15.19:0/3356270579 >> v2:172.21.15.42:3300/0 conn(0x7f7eb40d11b0 msgr2=0x7f7eb4162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:32.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.536+0000 7f7eb1e00640 1 --2- 172.21.15.19:0/3356270579 >> v2:172.21.15.42:3300/0 conn(0x7f7eb40d11b0 0x7f7eb4162400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:32.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.536+0000 7f7eb1e00640 1 -- 172.21.15.19:0/3356270579 >> v1:172.21.15.42:6789/0 conn(0x7f7eb40b6bd0 legacy=0x7f7eb40d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:32.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.536+0000 7f7eb1e00640 1 -- 172.21.15.19:0/3356270579 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb40cf030 con 0x7f7eb415df20 2024-03-08T06:03:32.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.537+0000 7f7eb1e00640 1 --2- 172.21.15.19:0/3356270579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eb415df20 0x7f7eb40ce9e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40d0520 tx=0x7f7ea402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc23cbc333a0bf30 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:32.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.538+0000 7f7eb0a00640 1 -- 172.21.15.19:0/3356270579 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4034070 con 0x7f7eb415df20 2024-03-08T06:03:32.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.538+0000 7f7eb0a00640 1 -- 172.21.15.19:0/3356270579 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea4030860 con 0x7f7eb415df20 2024-03-08T06:03:32.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.538+0000 7f7eb0a00640 1 -- 172.21.15.19:0/3356270579 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4030c30 con 0x7f7eb415df20 2024-03-08T06:03:32.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.539+0000 7f7eb3200640 1 -- 172.21.15.19:0/3356270579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eb415df20 msgr2=0x7f7eb40ce9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:32.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.539+0000 7f7eb3200640 1 --2- 172.21.15.19:0/3356270579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eb415df20 0x7f7eb40ce9e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40d0520 tx=0x7f7ea402b9a0 comp rx=0 tx=0).stop 2024-03-08T06:03:32.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.539+0000 7f7eb3200640 1 -- 172.21.15.19:0/3356270579 shutdown_connections 2024-03-08T06:03:32.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.539+0000 7f7eb3200640 1 --2- 172.21.15.19:0/3356270579 >> v2:172.21.15.42:3300/0 conn(0x7f7eb40d11b0 0x7f7eb4162400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:32.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.539+0000 7f7eb3200640 1 --2- 172.21.15.19:0/3356270579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eb415df20 0x7f7eb40ce9e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:32.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.539+0000 7f7eb3200640 1 -- 172.21.15.19:0/3356270579 >> 172.21.15.19:0/3356270579 conn(0x7f7eb406c740 msgr2=0x7f7eb406cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:32.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.539+0000 7f7eb3200640 1 -- 172.21.15.19:0/3356270579 shutdown_connections 2024-03-08T06:03:32.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.539+0000 7f7eb3200640 1 -- 172.21.15.19:0/3356270579 wait complete. 2024-03-08T06:03:32.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.541+0000 7f7eb3200640 1 Processor -- start 2024-03-08T06:03:32.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.541+0000 7f7eb3200640 1 -- start start 2024-03-08T06:03:32.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.542+0000 7f7eb3200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eb40b6bd0 0x7f7eb40c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:32.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.542+0000 7f7eb3200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7eb40d11b0 0x7f7eb415a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:32.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.542+0000 7f7eb3200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7eb415df20 0x7f7eb415ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:32.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.542+0000 7f7eb3200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40d2180 con 0x7f7eb40b6bd0 2024-03-08T06:03:32.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.542+0000 7f7eb3200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40d1ea0 con 0x7f7eb415df20 2024-03-08T06:03:32.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.542+0000 7f7eb3200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40d2460 con 0x7f7eb40d11b0 2024-03-08T06:03:32.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.542+0000 7f7eb1e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eb40b6bd0 0x7f7eb40c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:32.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.542+0000 7f7eb1e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eb40b6bd0 0x7f7eb40c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41808/0 (socket says 172.21.15.19:41808) 2024-03-08T06:03:32.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.542+0000 7f7eb1e00640 1 -- 172.21.15.19:0/2044811927 learned_addr learned my addr 172.21.15.19:0/2044811927 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:32.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.543+0000 7f7eb1e00640 1 -- 172.21.15.19:0/2044811927 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7eb40d11b0 msgr2=0x7f7eb415a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:32.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.543+0000 7f7eb1400640 1 --2- 172.21.15.19:0/2044811927 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7eb40d11b0 0x7f7eb415a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:32.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.543+0000 7f7eb2800640 1 --2- 172.21.15.19:0/2044811927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7eb415df20 0x7f7eb415ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:32.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.543+0000 7f7eb1e00640 1 --2- 172.21.15.19:0/2044811927 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7eb40d11b0 0x7f7eb415a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:32.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.543+0000 7f7eb1e00640 1 -- 172.21.15.19:0/2044811927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7eb415df20 msgr2=0x7f7eb415ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:32.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.543+0000 7f7eb1e00640 1 --2- 172.21.15.19:0/2044811927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7eb415df20 0x7f7eb415ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:32.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.543+0000 7f7eb1e00640 1 -- 172.21.15.19:0/2044811927 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb4160490 con 0x7f7eb40b6bd0 2024-03-08T06:03:32.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.543+0000 7f7eb1400640 1 --2- 172.21.15.19:0/2044811927 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7eb40d11b0 0x7f7eb415a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:32.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.543+0000 7f7eb1e00640 1 --2- 172.21.15.19:0/2044811927 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eb40b6bd0 0x7f7eb40c8230 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4000c00 tx=0x7f7ea40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:32.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.543+0000 7f7eaa000640 1 -- 172.21.15.19:0/2044811927 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4034040 con 0x7f7eb40b6bd0 2024-03-08T06:03:32.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.543+0000 7f7eaa000640 1 -- 172.21.15.19:0/2044811927 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea4039d90 con 0x7f7eb40b6bd0 2024-03-08T06:03:32.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.543+0000 7f7eb3200640 1 -- 172.21.15.19:0/2044811927 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb4160730 con 0x7f7eb40b6bd0 2024-03-08T06:03:32.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.543+0000 7f7eaa000640 1 -- 172.21.15.19:0/2044811927 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4043610 con 0x7f7eb40b6bd0 2024-03-08T06:03:32.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.544+0000 7f7eb3200640 1 -- 172.21.15.19:0/2044811927 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb4160cf0 con 0x7f7eb40b6bd0 2024-03-08T06:03:32.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.545+0000 7f7eb3200640 1 -- 172.21.15.19:0/2044811927 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb40cb800 con 0x7f7eb40b6bd0 2024-03-08T06:03:32.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.546+0000 7f7eaa000640 1 -- 172.21.15.19:0/2044811927 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7ea404a060 con 0x7f7eb40b6bd0 2024-03-08T06:03:32.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.547+0000 7f7eaa000640 1 --2- 172.21.15.19:0/2044811927 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7e9406b4d0 0x7f7e9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:32.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.547+0000 7f7eaa000640 1 -- 172.21.15.19:0/2044811927 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ea40ac340 con 0x7f7eb40b6bd0 2024-03-08T06:03:32.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.547+0000 7f7eb1400640 1 --2- 172.21.15.19:0/2044811927 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7e9406b4d0 0x7f7e9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:32.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.548+0000 7f7eb1400640 1 --2- 172.21.15.19:0/2044811927 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7e9406b4d0 0x7f7e9406d990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40b9810 tx=0x7f7ea0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:32.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.552+0000 7f7eaa000640 1 -- 172.21.15.19:0/2044811927 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7ea403e070 con 0x7f7eb40b6bd0 2024-03-08T06:03:32.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.788+0000 7f7eb3200640 1 -- 172.21.15.19:0/2044811927 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7eb4075100 con 0x7f7eb40b6bd0 2024-03-08T06:03:32.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.790+0000 7f7eaa000640 1 -- 172.21.15.19:0/2044811927 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7f7ea4037360 con 0x7f7eb40b6bd0 2024-03-08T06:03:32.791 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:32.791 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1494509643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6835","nonce":1494509643},{"type":"v1","addr":"172.21.15.19:6837","nonce":1494509643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/2031610239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2031610239},{"type":"v1","addr":"172.21.15.42:6834","nonce":2031610239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6836/1964979810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1964979810},{"type":"v1","addr":"172.21.15.19:6836","nonce":1964979810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T06:03:20.532032+0000","modified":"2024-03-08T06:03:23.604391+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1462224228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1462224228},{"type":"v1","addr":"172.21.15.42:6835","nonce":1462224228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T06:03:32.791 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2024-03-08T06:03:32.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.792+0000 7f7eb3200640 1 -- 172.21.15.19:0/2044811927 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7e9406b4d0 msgr2=0x7f7e9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:32.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.792+0000 7f7eb3200640 1 --2- 172.21.15.19:0/2044811927 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7e9406b4d0 0x7f7e9406d990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7eb40b9810 tx=0x7f7ea0009040 comp rx=0 tx=0).stop 2024-03-08T06:03:32.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.792+0000 7f7eb3200640 1 -- 172.21.15.19:0/2044811927 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eb40b6bd0 msgr2=0x7f7eb40c8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:32.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.792+0000 7f7eb3200640 1 --2- 172.21.15.19:0/2044811927 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eb40b6bd0 0x7f7eb40c8230 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4000c00 tx=0x7f7ea40046c0 comp rx=0 tx=0).stop 2024-03-08T06:03:32.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.793+0000 7f7eb3200640 1 -- 172.21.15.19:0/2044811927 shutdown_connections 2024-03-08T06:03:32.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.793+0000 7f7eb3200640 1 --2- 172.21.15.19:0/2044811927 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7e9406b4d0 0x7f7e9406d990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:32.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.793+0000 7f7eb3200640 1 --2- 172.21.15.19:0/2044811927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7eb415df20 0x7f7eb415ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:32.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.793+0000 7f7eb3200640 1 --2- 172.21.15.19:0/2044811927 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7eb40d11b0 0x7f7eb415a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:32.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.793+0000 7f7eb3200640 1 --2- 172.21.15.19:0/2044811927 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7eb40b6bd0 0x7f7eb40c8230 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:32.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.793+0000 7f7eb3200640 1 -- 172.21.15.19:0/2044811927 >> 172.21.15.19:0/2044811927 conn(0x7f7eb406c740 msgr2=0x7f7eb40b5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:32.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.793+0000 7f7eb3200640 1 -- 172.21.15.19:0/2044811927 shutdown_connections 2024-03-08T06:03:32.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:32.793+0000 7f7eb3200640 1 -- 172.21.15.19:0/2044811927 wait complete. 2024-03-08T06:03:32.811 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:03:33.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.031+0000 7f6c1cc00640 1 Processor -- start 2024-03-08T06:03:33.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.031+0000 7f6c1cc00640 1 -- start start 2024-03-08T06:03:33.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.033+0000 7f6c1cc00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6c180d3500 0x7f6c180b2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:33.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.033+0000 7f6c1cc00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6c180b6c90 0x7f6c180d20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:33.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.033+0000 7f6c1cc00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c181617f0 con 0x7f6c18161410 2024-03-08T06:03:33.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.033+0000 7f6c1cc00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c180d1060 con 0x7f6c180d3500 2024-03-08T06:03:33.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.033+0000 7f6c1cc00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c180d12b0 con 0x7f6c180b6c90 2024-03-08T06:03:33.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.033+0000 7f6c16a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6c180d3500 0x7f6c180b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:33.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.034+0000 7f6c16a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6c180d3500 0x7f6c180b2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.19:40310/0 (socket says 172.21.15.19:40310) 2024-03-08T06:03:33.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.034+0000 7f6c16a00640 1 -- 172.21.15.19:0/3568774920 learned_addr learned my addr 172.21.15.19:0/3568774920 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:33.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.034+0000 7f6c17e00640 1 --2- 172.21.15.19:0/3568774920 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6c180b6c90 0x7f6c180d20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:33.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.034+0000 7f6c16a00640 1 -- 172.21.15.19:0/3568774920 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6c180b6c90 msgr2=0x7f6c180d20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:33.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.034+0000 7f6c16a00640 1 --2- 172.21.15.19:0/3568774920 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6c180b6c90 0x7f6c180d20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.034+0000 7f6c16a00640 1 -- 172.21.15.19:0/3568774920 >> v1:172.21.15.42:6789/0 conn(0x7f6c18161410 legacy=0x7f6c180b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:33.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.034+0000 7f6c16a00640 1 -- 172.21.15.19:0/3568774920 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c180cebd0 con 0x7f6c180d3500 2024-03-08T06:03:33.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.035+0000 7f6c16a00640 1 --2- 172.21.15.19:0/3568774920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c180d3500 0x7f6c180b2830 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6c04009870 tx=0x7f6c0402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7517cedb07bd9ca8 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:33.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.036+0000 7f6c16000640 1 -- 172.21.15.19:0/3568774920 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04034070 con 0x7f6c180d3500 2024-03-08T06:03:33.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.036+0000 7f6c16000640 1 -- 172.21.15.19:0/3568774920 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c04030840 con 0x7f6c180d3500 2024-03-08T06:03:33.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.036+0000 7f6c16000640 1 -- 172.21.15.19:0/3568774920 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04030c10 con 0x7f6c180d3500 2024-03-08T06:03:33.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.036+0000 7f6c1cc00640 1 -- 172.21.15.19:0/3568774920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c180d3500 msgr2=0x7f6c180b2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:33.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.036+0000 7f6c1cc00640 1 --2- 172.21.15.19:0/3568774920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c180d3500 0x7f6c180b2830 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6c04009870 tx=0x7f6c0402b980 comp rx=0 tx=0).stop 2024-03-08T06:03:33.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.037+0000 7f6c1cc00640 1 -- 172.21.15.19:0/3568774920 shutdown_connections 2024-03-08T06:03:33.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.037+0000 7f6c1cc00640 1 --2- 172.21.15.19:0/3568774920 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6c180b6c90 0x7f6c180d20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.037+0000 7f6c1cc00640 1 --2- 172.21.15.19:0/3568774920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c180d3500 0x7f6c180b2830 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.037+0000 7f6c1cc00640 1 -- 172.21.15.19:0/3568774920 >> 172.21.15.19:0/3568774920 conn(0x7f6c1806c740 msgr2=0x7f6c1806cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:33.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.037+0000 7f6c1cc00640 1 -- 172.21.15.19:0/3568774920 shutdown_connections 2024-03-08T06:03:33.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.037+0000 7f6c1cc00640 1 -- 172.21.15.19:0/3568774920 wait complete. 2024-03-08T06:03:33.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.039+0000 7f6c1cc00640 1 Processor -- start 2024-03-08T06:03:33.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.039+0000 7f6c1cc00640 1 -- start start 2024-03-08T06:03:33.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.040+0000 7f6c1cc00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6c180b6c90 0x7f6c180cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:33.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.040+0000 7f6c1cc00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c18161410 0x7f6c1815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:33.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.040+0000 7f6c1cc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c18151760 0x7f6c1815ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:33.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.040+0000 7f6c1cc00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c180b5e00 con 0x7f6c18161410 2024-03-08T06:03:33.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.040+0000 7f6c1cc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c180b5c80 con 0x7f6c18151760 2024-03-08T06:03:33.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.040+0000 7f6c1cc00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c180b2de0 con 0x7f6c180b6c90 2024-03-08T06:03:33.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.040+0000 7f6c16a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c18161410 0x7f6c1815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:33.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.040+0000 7f6c16a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c18161410 0x7f6c1815a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41816/0 (socket says 172.21.15.19:41816) 2024-03-08T06:03:33.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.040+0000 7f6c16a00640 1 -- 172.21.15.19:0/4153392499 learned_addr learned my addr 172.21.15.19:0/4153392499 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:33.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.041+0000 7f6c17400640 1 --2- 172.21.15.19:0/4153392499 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6c180b6c90 0x7f6c180cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:33.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.041+0000 7f6c17e00640 1 --2- 172.21.15.19:0/4153392499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c18151760 0x7f6c1815ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:33.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.041+0000 7f6c16a00640 1 -- 172.21.15.19:0/4153392499 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6c180b6c90 msgr2=0x7f6c180cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:33.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.041+0000 7f6c16a00640 1 --2- 172.21.15.19:0/4153392499 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6c180b6c90 0x7f6c180cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.041+0000 7f6c16a00640 1 -- 172.21.15.19:0/4153392499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c18151760 msgr2=0x7f6c1815ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.041+0000 7f6c16a00640 1 --2- 172.21.15.19:0/4153392499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c18151760 0x7f6c1815ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.041+0000 7f6c16a00640 1 -- 172.21.15.19:0/4153392499 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c180cbc40 con 0x7f6c18161410 2024-03-08T06:03:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.041+0000 7f6c17e00640 1 --2- 172.21.15.19:0/4153392499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c18151760 0x7f6c1815ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.041+0000 7f6c16a00640 1 --2- 172.21.15.19:0/4153392499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c18161410 0x7f6c1815a5c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6c04000c00 tx=0x7f6c04004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.041+0000 7f6c0f400640 1 -- 172.21.15.19:0/4153392499 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04048070 con 0x7f6c18161410 2024-03-08T06:03:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.041+0000 7f6c0f400640 1 -- 172.21.15.19:0/4153392499 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c04030640 con 0x7f6c18161410 2024-03-08T06:03:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.041+0000 7f6c0f400640 1 -- 172.21.15.19:0/4153392499 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04034040 con 0x7f6c18161410 2024-03-08T06:03:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.042+0000 7f6c1cc00640 1 -- 172.21.15.19:0/4153392499 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c180cbf20 con 0x7f6c18161410 2024-03-08T06:03:33.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.042+0000 7f6c1cc00640 1 -- 172.21.15.19:0/4153392499 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c180cc4e0 con 0x7f6c18161410 2024-03-08T06:03:33.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.043+0000 7f6c1cc00640 1 -- 172.21.15.19:0/4153392499 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1806dc30 con 0x7f6c18161410 2024-03-08T06:03:33.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.043+0000 7f6c0f400640 1 -- 172.21.15.19:0/4153392499 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6c04037070 con 0x7f6c18161410 2024-03-08T06:03:33.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.044+0000 7f6c0f400640 1 --2- 172.21.15.19:0/4153392499 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6bf806b4d0 0x7f6bf806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:33.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.044+0000 7f6c0f400640 1 -- 172.21.15.19:0/4153392499 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c040ac100 con 0x7f6c18161410 2024-03-08T06:03:33.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.045+0000 7f6c17400640 1 --2- 172.21.15.19:0/4153392499 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6bf806b4d0 0x7f6bf806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:33.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.045+0000 7f6c17400640 1 --2- 172.21.15.19:0/4153392499 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6bf806b4d0 0x7f6bf806d990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6c181f72d0 tx=0x7f6c08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:33.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.050+0000 7f6c0f400640 1 -- 172.21.15.19:0/4153392499 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6c1806dc30 con 0x7f6c18161410 2024-03-08T06:03:33.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.251+0000 7f6c1cc00640 1 -- 172.21.15.19:0/4153392499 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c18075100 con 0x7f6c18161410 2024-03-08T06:03:33.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.254+0000 7f6c0f400640 1 -- 172.21.15.19:0/4153392499 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f6c0407b130 con 0x7f6c18161410 2024-03-08T06:03:33.255 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:33.255 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:03:22.069498+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:03:18.392703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T06:03:19.537912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:03:33.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.256+0000 7f6c1cc00640 1 -- 172.21.15.19:0/4153392499 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6bf806b4d0 msgr2=0x7f6bf806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.256+0000 7f6c1cc00640 1 --2- 172.21.15.19:0/4153392499 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6bf806b4d0 0x7f6bf806d990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6c181f72d0 tx=0x7f6c08009040 comp rx=0 tx=0).stop 2024-03-08T06:03:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.256+0000 7f6c1cc00640 1 -- 172.21.15.19:0/4153392499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c18161410 msgr2=0x7f6c1815a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.256+0000 7f6c1cc00640 1 --2- 172.21.15.19:0/4153392499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c18161410 0x7f6c1815a5c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6c04000c00 tx=0x7f6c04004730 comp rx=0 tx=0).stop 2024-03-08T06:03:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.256+0000 7f6c1cc00640 1 -- 172.21.15.19:0/4153392499 shutdown_connections 2024-03-08T06:03:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.256+0000 7f6c1cc00640 1 --2- 172.21.15.19:0/4153392499 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6bf806b4d0 0x7f6bf806d990 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.256+0000 7f6c1cc00640 1 --2- 172.21.15.19:0/4153392499 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c18151760 0x7f6c1815ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.256+0000 7f6c1cc00640 1 --2- 172.21.15.19:0/4153392499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c18161410 0x7f6c1815a5c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.256+0000 7f6c1cc00640 1 --2- 172.21.15.19:0/4153392499 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6c180b6c90 0x7f6c180cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.257+0000 7f6c1cc00640 1 -- 172.21.15.19:0/4153392499 >> 172.21.15.19:0/4153392499 conn(0x7f6c1806c740 msgr2=0x7f6c18160460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.257+0000 7f6c1cc00640 1 -- 172.21.15.19:0/4153392499 shutdown_connections 2024-03-08T06:03:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.257+0000 7f6c1cc00640 1 -- 172.21.15.19:0/4153392499 wait complete. 2024-03-08T06:03:33.277 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T06:03:14.149736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T06:03:18.392703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T06:03:19.537912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T06:03:33.278 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T06:03:33.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.508+0000 7fc2aae00640 1 Processor -- start 2024-03-08T06:03:33.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.508+0000 7fc2aae00640 1 -- start start 2024-03-08T06:03:33.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.510+0000 7fc2aae00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc2a40b2970 0x7fc2a415e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:33.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.510+0000 7fc2aae00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc2a40716e0 0x7fc2a4071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:33.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.510+0000 7fc2aae00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a415e840 con 0x7fc2a4147040 2024-03-08T06:03:33.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.510+0000 7fc2aae00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a415eb20 con 0x7fc2a40b2970 2024-03-08T06:03:33.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.510+0000 7fc2aae00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a415ee00 con 0x7fc2a40716e0 2024-03-08T06:03:33.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.510+0000 7fc2a9000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc2a40b2970 0x7fc2a415e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:33.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.510+0000 7fc2a9000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc2a40b2970 0x7fc2a415e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41818/0 (socket says 172.21.15.19:41818) 2024-03-08T06:03:33.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.510+0000 7fc2a9000640 1 -- 172.21.15.19:0/4043587547 learned_addr learned my addr 172.21.15.19:0/4043587547 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:33.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.511+0000 7fc2a9000640 1 -- 172.21.15.19:0/4043587547 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc2a40716e0 msgr2=0x7fc2a4071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:33.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.511+0000 7fc2a9000640 1 --2- 172.21.15.19:0/4043587547 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc2a40716e0 0x7fc2a4071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.511+0000 7fc2a9000640 1 -- 172.21.15.19:0/4043587547 >> v1:172.21.15.19:6789/0 conn(0x7fc2a4147040 legacy=0x7fc2a406e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:33.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.511+0000 7fc2a9000640 1 -- 172.21.15.19:0/4043587547 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a40ae0d0 con 0x7fc2a40b2970 2024-03-08T06:03:33.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.512+0000 7fc2a9000640 1 --2- 172.21.15.19:0/4043587547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a40b2970 0x7fc2a415e1a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc2900098a0 tx=0x7fc29002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f826dc839e16d930 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:33.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.512+0000 7fc2a3e00640 1 -- 172.21.15.19:0/4043587547 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290034070 con 0x7fc2a40b2970 2024-03-08T06:03:33.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.512+0000 7fc2a3e00640 1 -- 172.21.15.19:0/4043587547 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc290030840 con 0x7fc2a40b2970 2024-03-08T06:03:33.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.512+0000 7fc2a3e00640 1 -- 172.21.15.19:0/4043587547 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290030c10 con 0x7fc2a40b2970 2024-03-08T06:03:33.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.513+0000 7fc2aae00640 1 -- 172.21.15.19:0/4043587547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a40b2970 msgr2=0x7fc2a415e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:33.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.513+0000 7fc2aae00640 1 --2- 172.21.15.19:0/4043587547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a40b2970 0x7fc2a415e1a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc2900098a0 tx=0x7fc29002b980 comp rx=0 tx=0).stop 2024-03-08T06:03:33.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.513+0000 7fc2aae00640 1 -- 172.21.15.19:0/4043587547 shutdown_connections 2024-03-08T06:03:33.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.513+0000 7fc2aae00640 1 --2- 172.21.15.19:0/4043587547 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc2a40716e0 0x7fc2a4071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.513+0000 7fc2aae00640 1 --2- 172.21.15.19:0/4043587547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a40b2970 0x7fc2a415e1a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.513+0000 7fc2aae00640 1 -- 172.21.15.19:0/4043587547 >> 172.21.15.19:0/4043587547 conn(0x7fc2a40b1850 msgr2=0x7fc2a40b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:33.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.513+0000 7fc2aae00640 1 -- 172.21.15.19:0/4043587547 shutdown_connections 2024-03-08T06:03:33.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.513+0000 7fc2aae00640 1 -- 172.21.15.19:0/4043587547 wait complete. 2024-03-08T06:03:33.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.515+0000 7fc2aae00640 1 Processor -- start 2024-03-08T06:03:33.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.515+0000 7fc2aae00640 1 -- start start 2024-03-08T06:03:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.516+0000 7fc2aae00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a40716e0 0x7fc2a413fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.516+0000 7fc2aae00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc2a40b2970 0x7fc2a4141440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.516+0000 7fc2aae00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2a4147040 0x7fc2a4143690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.516+0000 7fc2aae00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a40ae770 con 0x7fc2a40716e0 2024-03-08T06:03:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.516+0000 7fc2aae00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a40ae5f0 con 0x7fc2a4147040 2024-03-08T06:03:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.516+0000 7fc2aae00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a40ae8f0 con 0x7fc2a40b2970 2024-03-08T06:03:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.516+0000 7fc2a9a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a40716e0 0x7fc2a413fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.516+0000 7fc2a9a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a40716e0 0x7fc2a413fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41824/0 (socket says 172.21.15.19:41824) 2024-03-08T06:03:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.516+0000 7fc2a9a00640 1 -- 172.21.15.19:0/397443191 learned_addr learned my addr 172.21.15.19:0/397443191 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:33.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.516+0000 7fc2aa400640 1 --2- 172.21.15.19:0/397443191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2a4147040 0x7fc2a4143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.517+0000 7fc2a9000640 1 --2- 172.21.15.19:0/397443191 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc2a40b2970 0x7fc2a4141440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.517+0000 7fc2a9a00640 1 -- 172.21.15.19:0/397443191 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc2a40b2970 msgr2=0x7fc2a4141440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.517+0000 7fc2a9a00640 1 --2- 172.21.15.19:0/397443191 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc2a40b2970 0x7fc2a4141440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.517+0000 7fc2a9a00640 1 -- 172.21.15.19:0/397443191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2a4147040 msgr2=0x7fc2a4143690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.517+0000 7fc2a9a00640 1 --2- 172.21.15.19:0/397443191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2a4147040 0x7fc2a4143690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.517+0000 7fc2a9a00640 1 -- 172.21.15.19:0/397443191 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a41425f0 con 0x7fc2a40716e0 2024-03-08T06:03:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.517+0000 7fc2a9a00640 1 --2- 172.21.15.19:0/397443191 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a40716e0 0x7fc2a413fff0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc29800c3f0 tx=0x7fc29800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:33.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.517+0000 7fc2a1600640 1 -- 172.21.15.19:0/397443191 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2980052d0 con 0x7fc2a40716e0 2024-03-08T06:03:33.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.517+0000 7fc2a1600640 1 -- 172.21.15.19:0/397443191 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc298005490 con 0x7fc2a40716e0 2024-03-08T06:03:33.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.517+0000 7fc2aae00640 1 -- 172.21.15.19:0/397443191 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a41428d0 con 0x7fc2a40716e0 2024-03-08T06:03:33.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.517+0000 7fc2a1600640 1 -- 172.21.15.19:0/397443191 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298007260 con 0x7fc2a40716e0 2024-03-08T06:03:33.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.517+0000 7fc2aae00640 1 -- 172.21.15.19:0/397443191 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a4142e90 con 0x7fc2a40716e0 2024-03-08T06:03:33.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.519+0000 7fc2aae00640 1 -- 172.21.15.19:0/397443191 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a40adb10 con 0x7fc2a40716e0 2024-03-08T06:03:33.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.520+0000 7fc2a1600640 1 -- 172.21.15.19:0/397443191 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc298007400 con 0x7fc2a40716e0 2024-03-08T06:03:33.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.522+0000 7fc2a1600640 1 --2- 172.21.15.19:0/397443191 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc28406b4d0 0x7fc28406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:33.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.522+0000 7fc2a1600640 1 -- 172.21.15.19:0/397443191 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2980896f0 con 0x7fc2a40716e0 2024-03-08T06:03:33.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.522+0000 7fc2a9000640 1 --2- 172.21.15.19:0/397443191 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc28406b4d0 0x7fc28406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:33.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.523+0000 7fc2a9000640 1 --2- 172.21.15.19:0/397443191 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc28406b4d0 0x7fc28406d990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc290036000 tx=0x7fc29003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:33.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.526+0000 7fc2a1600640 1 -- 172.21.15.19:0/397443191 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc2a40adb10 con 0x7fc2a40716e0 2024-03-08T06:03:33.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.723+0000 7fc2aae00640 1 -- 172.21.15.19:0/397443191 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc2a4075090 con 0x7fc2a40716e0 2024-03-08T06:03:33.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.724+0000 7fc2a1600640 1 -- 172.21.15.19:0/397443191 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc298058560 con 0x7fc2a40716e0 2024-03-08T06:03:33.724 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-08T06:03:33.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.726+0000 7fc2aae00640 1 -- 172.21.15.19:0/397443191 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc28406b4d0 msgr2=0x7fc28406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:33.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.726+0000 7fc2aae00640 1 --2- 172.21.15.19:0/397443191 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc28406b4d0 0x7fc28406d990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc290036000 tx=0x7fc29003b040 comp rx=0 tx=0).stop 2024-03-08T06:03:33.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.726+0000 7fc2aae00640 1 -- 172.21.15.19:0/397443191 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a40716e0 msgr2=0x7fc2a413fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:33.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.726+0000 7fc2aae00640 1 --2- 172.21.15.19:0/397443191 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a40716e0 0x7fc2a413fff0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc29800c3f0 tx=0x7fc29800c8b0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.726+0000 7fc2aae00640 1 -- 172.21.15.19:0/397443191 shutdown_connections 2024-03-08T06:03:33.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.726+0000 7fc2aae00640 1 --2- 172.21.15.19:0/397443191 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc28406b4d0 0x7fc28406d990 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.726+0000 7fc2aae00640 1 --2- 172.21.15.19:0/397443191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc2a4147040 0x7fc2a4143690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.726+0000 7fc2aae00640 1 --2- 172.21.15.19:0/397443191 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc2a40b2970 0x7fc2a4141440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.726+0000 7fc2aae00640 1 --2- 172.21.15.19:0/397443191 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a40716e0 0x7fc2a413fff0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.726+0000 7fc2aae00640 1 -- 172.21.15.19:0/397443191 >> 172.21.15.19:0/397443191 conn(0x7fc2a40b1850 msgr2=0x7fc2a40b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:33.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.727+0000 7fc2aae00640 1 -- 172.21.15.19:0/397443191 shutdown_connections 2024-03-08T06:03:33.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.727+0000 7fc2aae00640 1 -- 172.21.15.19:0/397443191 wait complete. 2024-03-08T06:03:33.747 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T06:03:33.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.970+0000 7f7082200640 1 Processor -- start 2024-03-08T06:03:33.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.971+0000 7f7082200640 1 -- start start 2024-03-08T06:03:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.972+0000 7f7082200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f707c0b97d0 0x7f707c0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.972+0000 7f7082200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f707c15e230 0x7f707c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.972+0000 7f7082200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f707c162520 con 0x7f707c15de50 2024-03-08T06:03:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.972+0000 7f7082200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f707c1622e0 con 0x7f707c0b97d0 2024-03-08T06:03:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.972+0000 7f7082200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707c162ae0 con 0x7f707c15e230 2024-03-08T06:03:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.973+0000 7f707aa00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f707c0b97d0 0x7f707c0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.973+0000 7f707aa00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f707c0b97d0 0x7f707c0ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41836/0 (socket says 172.21.15.19:41836) 2024-03-08T06:03:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.973+0000 7f707aa00640 1 -- 172.21.15.19:0/42547904 learned_addr learned my addr 172.21.15.19:0/42547904 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.973+0000 7f707be00640 1 --2- 172.21.15.19:0/42547904 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f707c15e230 0x7f707c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:33.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.973+0000 7f707aa00640 1 -- 172.21.15.19:0/42547904 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f707c15e230 msgr2=0x7f707c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:33.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.973+0000 7f707aa00640 1 --2- 172.21.15.19:0/42547904 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f707c15e230 0x7f707c0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.973+0000 7f707aa00640 1 -- 172.21.15.19:0/42547904 >> v1:172.21.15.42:6789/0 conn(0x7f707c15de50 legacy=0x7f707c161bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:33.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.973+0000 7f707aa00640 1 -- 172.21.15.19:0/42547904 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c162800 con 0x7f707c0b97d0 2024-03-08T06:03:33.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.975+0000 7f707aa00640 1 --2- 172.21.15.19:0/42547904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f707c0b97d0 0x7f707c0ceb30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7068009870 tx=0x7f706802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22e4eb813ad9cbc server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:33.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.975+0000 7f707a000640 1 -- 172.21.15.19:0/42547904 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7068035020 con 0x7f707c0b97d0 2024-03-08T06:03:33.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.975+0000 7f707a000640 1 -- 172.21.15.19:0/42547904 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7068031640 con 0x7f707c0b97d0 2024-03-08T06:03:33.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.975+0000 7f707a000640 1 -- 172.21.15.19:0/42547904 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706802d040 con 0x7f707c0b97d0 2024-03-08T06:03:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.975+0000 7f7082200640 1 -- 172.21.15.19:0/42547904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f707c0b97d0 msgr2=0x7f707c0ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.975+0000 7f7082200640 1 --2- 172.21.15.19:0/42547904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f707c0b97d0 0x7f707c0ceb30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7068009870 tx=0x7f706802b8f0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.976+0000 7f7082200640 1 -- 172.21.15.19:0/42547904 shutdown_connections 2024-03-08T06:03:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.976+0000 7f7082200640 1 --2- 172.21.15.19:0/42547904 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f707c15e230 0x7f707c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.976+0000 7f7082200640 1 --2- 172.21.15.19:0/42547904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f707c0b97d0 0x7f707c0ceb30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.976+0000 7f7082200640 1 -- 172.21.15.19:0/42547904 >> 172.21.15.19:0/42547904 conn(0x7f707c06c490 msgr2=0x7f707c06c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.976+0000 7f7082200640 1 -- 172.21.15.19:0/42547904 shutdown_connections 2024-03-08T06:03:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.976+0000 7f7082200640 1 -- 172.21.15.19:0/42547904 wait complete. 2024-03-08T06:03:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.977+0000 7f7082200640 1 Processor -- start 2024-03-08T06:03:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.978+0000 7f7082200640 1 -- start start 2024-03-08T06:03:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.979+0000 7f7082200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f707c0b97d0 0x7f707c155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.979+0000 7f7082200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f707c15de50 0x7f707c0b5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.979+0000 7f7082200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f707c15e230 0x7f707c0cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.979+0000 7f7082200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0d27f0 con 0x7f707c15e230 2024-03-08T06:03:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.979+0000 7f7082200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0d2360 con 0x7f707c0b97d0 2024-03-08T06:03:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.979+0000 7f7082200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0d2970 con 0x7f707c15de50 2024-03-08T06:03:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.979+0000 7f707be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f707c15e230 0x7f707c0cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.979+0000 7f707be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f707c15e230 0x7f707c0cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41846/0 (socket says 172.21.15.19:41846) 2024-03-08T06:03:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.979+0000 7f707be00640 1 -- 172.21.15.19:0/1954629837 learned_addr learned my addr 172.21.15.19:0/1954629837 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.979+0000 7f707b400640 1 --2- 172.21.15.19:0/1954629837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f707c0b97d0 0x7f707c155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:33.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.979+0000 7f707be00640 1 -- 172.21.15.19:0/1954629837 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f707c15de50 msgr2=0x7f707c0b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:33.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.979+0000 7f707be00640 1 --2- 172.21.15.19:0/1954629837 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f707c15de50 0x7f707c0b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.979+0000 7f707be00640 1 -- 172.21.15.19:0/1954629837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f707c0b97d0 msgr2=0x7f707c155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:33.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.979+0000 7f707be00640 1 --2- 172.21.15.19:0/1954629837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f707c0b97d0 0x7f707c155ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:33.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.979+0000 7f707be00640 1 -- 172.21.15.19:0/1954629837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c0cbd40 con 0x7f707c15e230 2024-03-08T06:03:33.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.980+0000 7f707be00640 1 --2- 172.21.15.19:0/1954629837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f707c15e230 0x7f707c0cd160 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7074009fd0 tx=0x7f707400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:33.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.980+0000 7f7073400640 1 -- 172.21.15.19:0/1954629837 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7074014420 con 0x7f707c15e230 2024-03-08T06:03:33.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.980+0000 7f7073400640 1 -- 172.21.15.19:0/1954629837 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7074019070 con 0x7f707c15e230 2024-03-08T06:03:33.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.980+0000 7f7082200640 1 -- 172.21.15.19:0/1954629837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707c0cc020 con 0x7f707c15e230 2024-03-08T06:03:33.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.980+0000 7f7073400640 1 -- 172.21.15.19:0/1954629837 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7074014800 con 0x7f707c15e230 2024-03-08T06:03:33.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.980+0000 7f7082200640 1 -- 172.21.15.19:0/1954629837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707c0cc5e0 con 0x7f707c15e230 2024-03-08T06:03:33.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.981+0000 7f7082200640 1 -- 172.21.15.19:0/1954629837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707c0cc7b0 con 0x7f707c15e230 2024-03-08T06:03:33.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.982+0000 7f7073400640 1 -- 172.21.15.19:0/1954629837 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f70740149a0 con 0x7f707c15e230 2024-03-08T06:03:33.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.983+0000 7f7073400640 1 --2- 172.21.15.19:0/1954629837 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f705c06b4d0 0x7f705c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:33.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.983+0000 7f7073400640 1 -- 172.21.15.19:0/1954629837 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f707408ab40 con 0x7f707c15e230 2024-03-08T06:03:33.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.983+0000 7f707b400640 1 --2- 172.21.15.19:0/1954629837 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f705c06b4d0 0x7f705c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:33.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.984+0000 7f707b400640 1 --2- 172.21.15.19:0/1954629837 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f705c06b4d0 0x7f705c06d990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f706c003d90 tx=0x7f706c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:33.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:33.987+0000 7f7073400640 1 -- 172.21.15.19:0/1954629837 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7074059920 con 0x7f707c15e230 2024-03-08T06:03:34.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.188+0000 7f7082200640 1 -- 172.21.15.19:0/1954629837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f707c067cb0 con 0x7f707c15e230 2024-03-08T06:03:34.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.189+0000 7f7073400640 1 -- 172.21.15.19:0/1954629837 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7074059220 con 0x7f707c15e230 2024-03-08T06:03:34.190 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-08T06:03:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.192+0000 7f7082200640 1 -- 172.21.15.19:0/1954629837 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f705c06b4d0 msgr2=0x7f705c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.192+0000 7f7082200640 1 --2- 172.21.15.19:0/1954629837 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f705c06b4d0 0x7f705c06d990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f706c003d90 tx=0x7f706c009040 comp rx=0 tx=0).stop 2024-03-08T06:03:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.192+0000 7f7082200640 1 -- 172.21.15.19:0/1954629837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f707c15e230 msgr2=0x7f707c0cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.192+0000 7f7082200640 1 --2- 172.21.15.19:0/1954629837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f707c15e230 0x7f707c0cd160 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7074009fd0 tx=0x7f707400e4b0 comp rx=0 tx=0).stop 2024-03-08T06:03:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.192+0000 7f7082200640 1 -- 172.21.15.19:0/1954629837 shutdown_connections 2024-03-08T06:03:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.192+0000 7f7082200640 1 --2- 172.21.15.19:0/1954629837 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f705c06b4d0 0x7f705c06d990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.192+0000 7f7082200640 1 --2- 172.21.15.19:0/1954629837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f707c15e230 0x7f707c0cd160 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.192+0000 7f7082200640 1 --2- 172.21.15.19:0/1954629837 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f707c15de50 0x7f707c0b5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.192+0000 7f7082200640 1 --2- 172.21.15.19:0/1954629837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f707c0b97d0 0x7f707c155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.192+0000 7f7082200640 1 -- 172.21.15.19:0/1954629837 >> 172.21.15.19:0/1954629837 conn(0x7f707c06c490 msgr2=0x7f707c0d3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.192+0000 7f7082200640 1 -- 172.21.15.19:0/1954629837 shutdown_connections 2024-03-08T06:03:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.193+0000 7f7082200640 1 -- 172.21.15.19:0/1954629837 wait complete. 2024-03-08T06:03:34.214 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T06:03:34.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.429+0000 7fcef3000640 1 Processor -- start 2024-03-08T06:03:34.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.429+0000 7fcef3000640 1 -- start start 2024-03-08T06:03:34.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.431+0000 7fcef3000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fceec1604f0 0x7fceec0cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:34.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.431+0000 7fcef3000640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceec0cd5a0 con 0x7fceec071950 2024-03-08T06:03:34.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.431+0000 7fcef3000640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceec0ccfe0 con 0x7fceec1455b0 2024-03-08T06:03:34.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.431+0000 7fcef3000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0cdc20 con 0x7fceec1604f0 2024-03-08T06:03:34.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.432+0000 7fcef1000640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fceec071950 0x7fceec0ce0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42308/0 (socket says 172.21.15.19:42308) 2024-03-08T06:03:34.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.432+0000 7fcef1000640 1 -- 172.21.15.19:0/3301089523 learned_addr learned my addr 172.21.15.19:0/3301089523 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:34.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.432+0000 7fcee3e00640 1 --2- 172.21.15.19:0/3301089523 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fceec1604f0 0x7fceec0cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:34.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.432+0000 7fceeb400640 1 -- 172.21.15.19:0/3301089523 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960997578 0 0) 0x7fceec0cd5a0 con 0x7fceec071950 2024-03-08T06:03:34.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.432+0000 7fceeb400640 1 -- 172.21.15.19:0/3301089523 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fced0003520 con 0x7fceec071950 2024-03-08T06:03:34.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.432+0000 7fceeb400640 1 -- 172.21.15.19:0/3301089523 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3955017633 0 0) 0x7fced0003520 con 0x7fceec071950 2024-03-08T06:03:34.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.432+0000 7fceeb400640 1 -- 172.21.15.19:0/3301089523 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fceec1604f0 msgr2=0x7fceec0cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:34.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.432+0000 7fceeb400640 1 --2- 172.21.15.19:0/3301089523 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fceec1604f0 0x7fceec0cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:34.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.433+0000 7fceeb400640 1 -- 172.21.15.19:0/3301089523 >> v1:172.21.15.42:6789/0 conn(0x7fceec1455b0 legacy=0x7fceec15c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:34.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.433+0000 7fceeb400640 1 -- 172.21.15.19:0/3301089523 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec0cd2c0 con 0x7fceec071950 2024-03-08T06:03:34.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.433+0000 7fceeb400640 1 -- 172.21.15.19:0/3301089523 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7fcee40019f0 con 0x7fceec071950 2024-03-08T06:03:34.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.433+0000 7fceeb400640 1 -- 172.21.15.19:0/3301089523 >> v1:172.21.15.19:6789/0 conn(0x7fceec071950 legacy=0x7fceec0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:34.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.433+0000 7fceeb400640 1 --2- 172.21.15.19:0/3301089523 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fceec1604f0 0x7fced00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:34.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.433+0000 7fceeb400640 1 --2- 172.21.15.19:0/3301089523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced0003f60 0x7fced0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:34.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.433+0000 7fceeb400640 1 --2- 172.21.15.19:0/3301089523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced0004d40 0x7fced00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:34.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.433+0000 7fceeb400640 1 -- 172.21.15.19:0/3301089523 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0cdc20 con 0x7fced0004d40 2024-03-08T06:03:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.433+0000 7fceeb400640 1 -- 172.21.15.19:0/3301089523 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced000baa0 con 0x7fced0003f60 2024-03-08T06:03:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.433+0000 7fceeb400640 1 -- 172.21.15.19:0/3301089523 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced000bca0 con 0x7fceec1604f0 2024-03-08T06:03:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.433+0000 7fcef1000640 1 --2- 172.21.15.19:0/3301089523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced0004d40 0x7fced00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.433+0000 7fcee3e00640 1 --2- 172.21.15.19:0/3301089523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced0003f60 0x7fced0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.433+0000 7fcef1000640 1 -- 172.21.15.19:0/3301089523 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fceec1604f0 msgr2=0x7fced00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.433+0000 7fcef1000640 1 --2- 172.21.15.19:0/3301089523 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fceec1604f0 0x7fced00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.433+0000 7fcef1000640 1 -- 172.21.15.19:0/3301089523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced0003f60 msgr2=0x7fced0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.433+0000 7fcef1000640 1 --2- 172.21.15.19:0/3301089523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced0003f60 0x7fced0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.433+0000 7fcef1000640 1 -- 172.21.15.19:0/3301089523 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced0003520 con 0x7fced0004d40 2024-03-08T06:03:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.433+0000 7fcee3e00640 1 --2- 172.21.15.19:0/3301089523 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fced0003f60 0x7fced0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.435+0000 7fcef1000640 1 --2- 172.21.15.19:0/3301089523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced0004d40 0x7fced00051c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcee400a840 tx=0x7fced0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6889a24ea60ea3e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.435+0000 7fceeb400640 1 -- 172.21.15.19:0/3301089523 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee400a460 con 0x7fced0004d40 2024-03-08T06:03:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.435+0000 7fceeb400640 1 -- 172.21.15.19:0/3301089523 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee4034650 con 0x7fced0004d40 2024-03-08T06:03:34.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.435+0000 7fceeb400640 1 -- 172.21.15.19:0/3301089523 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4034a80 con 0x7fced0004d40 2024-03-08T06:03:34.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.436+0000 7fcef3000640 1 -- 172.21.15.19:0/3301089523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced0004d40 msgr2=0x7fced00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:34.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.436+0000 7fcef3000640 1 --2- 172.21.15.19:0/3301089523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced0004d40 0x7fced00051c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcee400a840 tx=0x7fced0005830 comp rx=0 tx=0).stop 2024-03-08T06:03:34.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.436+0000 7fcef1000640 1 -- 172.21.15.19:0/3301089523 reap_dead start 2024-03-08T06:03:34.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.436+0000 7fcef3000640 1 -- 172.21.15.19:0/3301089523 shutdown_connections 2024-03-08T06:03:34.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.436+0000 7fcef3000640 1 -- 172.21.15.19:0/3301089523 >> 172.21.15.19:0/3301089523 conn(0x7fceec06ae30 msgr2=0x7fceec06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:34.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.436+0000 7fcef3000640 1 -- 172.21.15.19:0/3301089523 shutdown_connections 2024-03-08T06:03:34.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.436+0000 7fcef3000640 1 -- 172.21.15.19:0/3301089523 wait complete. 2024-03-08T06:03:34.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.438+0000 7fcef3000640 1 Processor -- start 2024-03-08T06:03:34.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.438+0000 7fcef3000640 1 -- start start 2024-03-08T06:03:34.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.439+0000 7fcef3000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced0004d40 0x7fceec13bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:34.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.440+0000 7fcef3000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fceec141e30 0x7fceec1422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:34.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.440+0000 7fcef3000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fceec15aac0 0x7fceec15af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:34.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.440+0000 7fcef3000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec071d80 con 0x7fced0004d40 2024-03-08T06:03:34.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.440+0000 7fcef3000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec145990 con 0x7fceec15aac0 2024-03-08T06:03:34.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.440+0000 7fcef3000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec071f00 con 0x7fceec141e30 2024-03-08T06:03:34.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.440+0000 7fceebe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced0004d40 0x7fceec13bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:34.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.440+0000 7fceebe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced0004d40 0x7fceec13bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41868/0 (socket says 172.21.15.19:41868) 2024-03-08T06:03:34.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.440+0000 7fceebe00640 1 -- 172.21.15.19:0/235907317 learned_addr learned my addr 172.21.15.19:0/235907317 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:34.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.440+0000 7fcef1000640 1 --2- 172.21.15.19:0/235907317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fceec15aac0 0x7fceec15af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:34.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.440+0000 7fceebe00640 1 -- 172.21.15.19:0/235907317 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fceec141e30 msgr2=0x7fceec1422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:34.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.440+0000 7fcee3e00640 1 --2- 172.21.15.19:0/235907317 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fceec141e30 0x7fceec1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:34.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.440+0000 7fceebe00640 1 --2- 172.21.15.19:0/235907317 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fceec141e30 0x7fceec1422b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:34.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.440+0000 7fceebe00640 1 -- 172.21.15.19:0/235907317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fceec15aac0 msgr2=0x7fceec15af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:34.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.440+0000 7fceebe00640 1 --2- 172.21.15.19:0/235907317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fceec15aac0 0x7fceec15af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:34.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.440+0000 7fceebe00640 1 -- 172.21.15.19:0/235907317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec0b0c00 con 0x7fced0004d40 2024-03-08T06:03:34.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.440+0000 7fcef1000640 1 --2- 172.21.15.19:0/235907317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fceec15aac0 0x7fceec15af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:34.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.441+0000 7fceebe00640 1 --2- 172.21.15.19:0/235907317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced0004d40 0x7fceec13bc10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcedc00c4b0 tx=0x7fcedc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:34.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.441+0000 7fcee8c00640 1 -- 172.21.15.19:0/235907317 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0052d0 con 0x7fced0004d40 2024-03-08T06:03:34.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.441+0000 7fcee8c00640 1 -- 172.21.15.19:0/235907317 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc005470 con 0x7fced0004d40 2024-03-08T06:03:34.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.441+0000 7fcee8c00640 1 -- 172.21.15.19:0/235907317 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc012870 con 0x7fced0004d40 2024-03-08T06:03:34.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.441+0000 7fcef3000640 1 -- 172.21.15.19:0/235907317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceec15b7f0 con 0x7fced0004d40 2024-03-08T06:03:34.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.441+0000 7fcef3000640 1 -- 172.21.15.19:0/235907317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceec0b0ec0 con 0x7fced0004d40 2024-03-08T06:03:34.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.442+0000 7fcef3000640 1 -- 172.21.15.19:0/235907317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceec067cb0 con 0x7fced0004d40 2024-03-08T06:03:34.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.443+0000 7fcee8c00640 1 -- 172.21.15.19:0/235907317 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcedc012a10 con 0x7fced0004d40 2024-03-08T06:03:34.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.445+0000 7fcee8c00640 1 --2- 172.21.15.19:0/235907317 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fcec806b500 0x7fcec806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:34.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.445+0000 7fcee8c00640 1 -- 172.21.15.19:0/235907317 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcedc089e50 con 0x7fced0004d40 2024-03-08T06:03:34.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.445+0000 7fcee3e00640 1 --2- 172.21.15.19:0/235907317 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fcec806b500 0x7fcec806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:34.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.446+0000 7fcee3e00640 1 --2- 172.21.15.19:0/235907317 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fcec806b500 0x7fcec806d9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fceec13fce0 tx=0x7fced4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:34.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.449+0000 7fcee8c00640 1 -- 172.21.15.19:0/235907317 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcedc058c30 con 0x7fced0004d40 2024-03-08T06:03:34.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.650+0000 7fcef3000640 1 -- 172.21.15.19:0/235907317 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fceec0729c0 con 0x7fced0004d40 2024-03-08T06:03:34.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.651+0000 7fcee8c00640 1 -- 172.21.15.19:0/235907317 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcedc058530 con 0x7fced0004d40 2024-03-08T06:03:34.651 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-08T06:03:34.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.654+0000 7fcef3000640 1 -- 172.21.15.19:0/235907317 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fcec806b500 msgr2=0x7fcec806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:34.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.654+0000 7fcef3000640 1 --2- 172.21.15.19:0/235907317 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fcec806b500 0x7fcec806d9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fceec13fce0 tx=0x7fced4008040 comp rx=0 tx=0).stop 2024-03-08T06:03:34.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.654+0000 7fcef3000640 1 -- 172.21.15.19:0/235907317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced0004d40 msgr2=0x7fceec13bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:34.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.654+0000 7fcef3000640 1 --2- 172.21.15.19:0/235907317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced0004d40 0x7fceec13bc10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcedc00c4b0 tx=0x7fcedc00c970 comp rx=0 tx=0).stop 2024-03-08T06:03:34.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.654+0000 7fcef3000640 1 -- 172.21.15.19:0/235907317 shutdown_connections 2024-03-08T06:03:34.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.654+0000 7fcef3000640 1 --2- 172.21.15.19:0/235907317 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fcec806b500 0x7fcec806d9c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:34.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.654+0000 7fcef3000640 1 --2- 172.21.15.19:0/235907317 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fceec15aac0 0x7fceec15af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:34.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.654+0000 7fcef3000640 1 --2- 172.21.15.19:0/235907317 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fceec141e30 0x7fceec1422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:34.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.654+0000 7fcef3000640 1 --2- 172.21.15.19:0/235907317 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced0004d40 0x7fceec13bc10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:34.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.654+0000 7fcef3000640 1 -- 172.21.15.19:0/235907317 >> 172.21.15.19:0/235907317 conn(0x7fceec06ae30 msgr2=0x7fceec15f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:34.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.654+0000 7fcef3000640 1 -- 172.21.15.19:0/235907317 shutdown_connections 2024-03-08T06:03:34.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.654+0000 7fcef3000640 1 -- 172.21.15.19:0/235907317 wait complete. 2024-03-08T06:03:34.674 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T06:03:34.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.899+0000 7fc406e00640 1 Processor -- start 2024-03-08T06:03:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.899+0000 7fc406e00640 1 -- start start 2024-03-08T06:03:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.901+0000 7fc406e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc40006d600 0x7fc400144d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.901+0000 7fc406e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc400071e90 0x7fc4001452a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.901+0000 7fc406e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc40006da80 con 0x7fc400071ab0 2024-03-08T06:03:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.901+0000 7fc406e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40006ef40 con 0x7fc40006d600 2024-03-08T06:03:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.901+0000 7fc406e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4001457e0 con 0x7fc400071e90 2024-03-08T06:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.901+0000 7fc3ffe00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc400071ab0 0x7fc40015cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42324/0 (socket says 172.21.15.19:42324) 2024-03-08T06:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.901+0000 7fc3ffe00640 1 -- 172.21.15.19:0/3208047064 learned_addr learned my addr 172.21.15.19:0/3208047064 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.901+0000 7fc3f7e00640 1 --2- 172.21.15.19:0/3208047064 >> v2:172.21.15.19:3300/0 conn(0x7fc40006d600 0x7fc400144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.901+0000 7fc404e00640 1 --2- 172.21.15.19:0/3208047064 >> v2:172.21.15.42:3300/0 conn(0x7fc400071e90 0x7fc4001452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.901+0000 7fc3ff400640 1 -- 172.21.15.19:0/3208047064 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597118466 0 0) 0x7fc40006da80 con 0x7fc400071ab0 2024-03-08T06:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.902+0000 7fc3ff400640 1 -- 172.21.15.19:0/3208047064 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3e4003520 con 0x7fc400071ab0 2024-03-08T06:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.902+0000 7fc3f7e00640 1 -- 172.21.15.19:0/3208047064 >> v2:172.21.15.42:3300/0 conn(0x7fc400071e90 msgr2=0x7fc4001452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.902+0000 7fc3f7e00640 1 --2- 172.21.15.19:0/3208047064 >> v2:172.21.15.42:3300/0 conn(0x7fc400071e90 0x7fc4001452a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.902+0000 7fc3f7e00640 1 -- 172.21.15.19:0/3208047064 >> v1:172.21.15.19:6789/0 conn(0x7fc400071ab0 legacy=0x7fc40015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.902+0000 7fc3f7e00640 1 -- 172.21.15.19:0/3208047064 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40006dd60 con 0x7fc40006d600 2024-03-08T06:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.902+0000 7fc404e00640 1 --2- 172.21.15.19:0/3208047064 >> v2:172.21.15.42:3300/0 conn(0x7fc400071e90 0x7fc4001452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.903+0000 7fc3f7e00640 1 --2- 172.21.15.19:0/3208047064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40006d600 0x7fc400144d60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc4000cf2e0 tx=0x7fc3e802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be26cbc0d195940 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.903+0000 7fc3ff400640 1 -- 172.21.15.19:0/3208047064 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8035020 con 0x7fc40006d600 2024-03-08T06:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.903+0000 7fc3ff400640 1 -- 172.21.15.19:0/3208047064 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e8031830 con 0x7fc40006d600 2024-03-08T06:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.903+0000 7fc3ff400640 1 -- 172.21.15.19:0/3208047064 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8031c00 con 0x7fc40006d600 2024-03-08T06:03:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.904+0000 7fc406e00640 1 -- 172.21.15.19:0/3208047064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40006d600 msgr2=0x7fc400144d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.904+0000 7fc406e00640 1 --2- 172.21.15.19:0/3208047064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40006d600 0x7fc400144d60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc4000cf2e0 tx=0x7fc3e802b8d0 comp rx=0 tx=0).stop 2024-03-08T06:03:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.904+0000 7fc406e00640 1 -- 172.21.15.19:0/3208047064 shutdown_connections 2024-03-08T06:03:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.904+0000 7fc406e00640 1 --2- 172.21.15.19:0/3208047064 >> v2:172.21.15.42:3300/0 conn(0x7fc400071e90 0x7fc4001452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.904+0000 7fc406e00640 1 --2- 172.21.15.19:0/3208047064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40006d600 0x7fc400144d60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.904+0000 7fc406e00640 1 -- 172.21.15.19:0/3208047064 >> 172.21.15.19:0/3208047064 conn(0x7fc40006ae30 msgr2=0x7fc40006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.904+0000 7fc406e00640 1 -- 172.21.15.19:0/3208047064 shutdown_connections 2024-03-08T06:03:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.904+0000 7fc406e00640 1 -- 172.21.15.19:0/3208047064 wait complete. 2024-03-08T06:03:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.906+0000 7fc406e00640 1 Processor -- start 2024-03-08T06:03:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.906+0000 7fc406e00640 1 -- start start 2024-03-08T06:03:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.907+0000 7fc406e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40006d600 0x7fc4000cd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.907+0000 7fc406e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc400071ab0 0x7fc40013c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.907+0000 7fc406e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc400071e90 0x7fc400142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.907+0000 7fc406e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40006e600 con 0x7fc40006d600 2024-03-08T06:03:34.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.907+0000 7fc406e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40006e100 con 0x7fc400071e90 2024-03-08T06:03:34.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.907+0000 7fc406e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40015d3a0 con 0x7fc400071ab0 2024-03-08T06:03:34.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.907+0000 7fc3ffe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40006d600 0x7fc4000cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:34.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.907+0000 7fc3ffe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40006d600 0x7fc4000cd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41886/0 (socket says 172.21.15.19:41886) 2024-03-08T06:03:34.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.907+0000 7fc3ffe00640 1 -- 172.21.15.19:0/4030651682 learned_addr learned my addr 172.21.15.19:0/4030651682 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:34.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.907+0000 7fc404e00640 1 --2- 172.21.15.19:0/4030651682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc400071e90 0x7fc400142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:34.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.907+0000 7fc3ffe00640 1 -- 172.21.15.19:0/4030651682 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc400071ab0 msgr2=0x7fc40013c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:34.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.907+0000 7fc3ffe00640 1 --2- 172.21.15.19:0/4030651682 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc400071ab0 0x7fc40013c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:34.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.907+0000 7fc3ffe00640 1 -- 172.21.15.19:0/4030651682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc400071e90 msgr2=0x7fc400142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:34.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.907+0000 7fc3ffe00640 1 --2- 172.21.15.19:0/4030651682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc400071e90 0x7fc400142130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:34.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.907+0000 7fc3ffe00640 1 -- 172.21.15.19:0/4030651682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40013d000 con 0x7fc40006d600 2024-03-08T06:03:34.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.908+0000 7fc3ffe00640 1 --2- 172.21.15.19:0/4030651682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40006d600 0x7fc4000cd970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000c430 tx=0x7fc3f000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:34.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.908+0000 7fc3fcc00640 1 -- 172.21.15.19:0/4030651682 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f0017070 con 0x7fc40006d600 2024-03-08T06:03:34.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.908+0000 7fc3fcc00640 1 -- 172.21.15.19:0/4030651682 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f0005ce0 con 0x7fc40006d600 2024-03-08T06:03:34.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.908+0000 7fc3fcc00640 1 -- 172.21.15.19:0/4030651682 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f00072f0 con 0x7fc40006d600 2024-03-08T06:03:34.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.908+0000 7fc406e00640 1 -- 172.21.15.19:0/4030651682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40013d2e0 con 0x7fc40006d600 2024-03-08T06:03:34.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.908+0000 7fc406e00640 1 -- 172.21.15.19:0/4030651682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40013d8a0 con 0x7fc40006d600 2024-03-08T06:03:34.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.909+0000 7fc406e00640 1 -- 172.21.15.19:0/4030651682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc400067cb0 con 0x7fc40006d600 2024-03-08T06:03:34.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.910+0000 7fc3fcc00640 1 -- 172.21.15.19:0/4030651682 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc3f001a070 con 0x7fc40006d600 2024-03-08T06:03:34.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.911+0000 7fc3fcc00640 1 --2- 172.21.15.19:0/4030651682 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc3dc06b4d0 0x7fc3dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:34.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.911+0000 7fc3fcc00640 1 -- 172.21.15.19:0/4030651682 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3f0089780 con 0x7fc40006d600 2024-03-08T06:03:34.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.911+0000 7fc3f7e00640 1 --2- 172.21.15.19:0/4030651682 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc3dc06b4d0 0x7fc3dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:34.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.912+0000 7fc3f7e00640 1 --2- 172.21.15.19:0/4030651682 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc3dc06b4d0 0x7fc3dc06d990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8036000 tx=0x7fc3e8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:34.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:34.915+0000 7fc3fcc00640 1 -- 172.21.15.19:0/4030651682 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc3f0058560 con 0x7fc40006d600 2024-03-08T06:03:35.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.155+0000 7fc406e00640 1 -- 172.21.15.19:0/4030651682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc40015d040 con 0x7fc40006d600 2024-03-08T06:03:35.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.155+0000 7fc3fcc00640 1 -- 172.21.15.19:0/4030651682 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7fc3f0057e60 con 0x7fc40006d600 2024-03-08T06:03:35.156 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:35.157 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1494509643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6835","nonce":1494509643},{"type":"v1","addr":"172.21.15.19:6837","nonce":1494509643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/2031610239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2031610239},{"type":"v1","addr":"172.21.15.42:6834","nonce":2031610239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6836/1964979810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1964979810},{"type":"v1","addr":"172.21.15.19:6836","nonce":1964979810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T06:03:20.532032+0000","modified":"2024-03-08T06:03:23.604391+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1462224228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1462224228},{"type":"v1","addr":"172.21.15.42:6835","nonce":1462224228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T06:03:35.157 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2024-03-08T06:03:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.158+0000 7fc406e00640 1 -- 172.21.15.19:0/4030651682 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc3dc06b4d0 msgr2=0x7fc3dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.158+0000 7fc406e00640 1 --2- 172.21.15.19:0/4030651682 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc3dc06b4d0 0x7fc3dc06d990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8036000 tx=0x7fc3e8030000 comp rx=0 tx=0).stop 2024-03-08T06:03:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.158+0000 7fc406e00640 1 -- 172.21.15.19:0/4030651682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40006d600 msgr2=0x7fc4000cd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.158+0000 7fc406e00640 1 --2- 172.21.15.19:0/4030651682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40006d600 0x7fc4000cd970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000c430 tx=0x7fc3f000c8f0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.158+0000 7fc406e00640 1 -- 172.21.15.19:0/4030651682 shutdown_connections 2024-03-08T06:03:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.158+0000 7fc406e00640 1 --2- 172.21.15.19:0/4030651682 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc3dc06b4d0 0x7fc3dc06d990 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.158+0000 7fc406e00640 1 --2- 172.21.15.19:0/4030651682 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc400071e90 0x7fc400142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.158+0000 7fc406e00640 1 --2- 172.21.15.19:0/4030651682 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc400071ab0 0x7fc40013c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.158+0000 7fc406e00640 1 --2- 172.21.15.19:0/4030651682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40006d600 0x7fc4000cd970 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.158+0000 7fc406e00640 1 -- 172.21.15.19:0/4030651682 >> 172.21.15.19:0/4030651682 conn(0x7fc40006ae30 msgr2=0x7fc4001429f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:35.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.158+0000 7fc406e00640 1 -- 172.21.15.19:0/4030651682 shutdown_connections 2024-03-08T06:03:35.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.158+0000 7fc406e00640 1 -- 172.21.15.19:0/4030651682 wait complete. 2024-03-08T06:03:35.176 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:03:35.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.387+0000 7f224f200640 1 Processor -- start 2024-03-08T06:03:35.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.387+0000 7f224f200640 1 -- start start 2024-03-08T06:03:35.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.389+0000 7f224f200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2250145520 0x7f225015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:35.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.389+0000 7f224f200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f225015bea0 0x7f22500716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:35.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.389+0000 7f224f200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f22500af040 0x7f2250071c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:35.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.389+0000 7f224f200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225015ceb0 con 0x7f225015bea0 2024-03-08T06:03:35.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.389+0000 7f224f200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225015c330 con 0x7f22500af040 2024-03-08T06:03:35.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.389+0000 7f224f200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225015c610 con 0x7f2250145520 2024-03-08T06:03:35.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.390+0000 7f2245400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f225015bea0 0x7f22500716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:35.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.390+0000 7f2245400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f225015bea0 0x7f22500716e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41894/0 (socket says 172.21.15.19:41894) 2024-03-08T06:03:35.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.390+0000 7f2245400640 1 -- 172.21.15.19:0/1401778253 learned_addr learned my addr 172.21.15.19:0/1401778253 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:35.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.390+0000 7f224e800640 1 --2- 172.21.15.19:0/1401778253 >> v2:172.21.15.42:3300/0 conn(0x7f22500af040 0x7f2250071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:35.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.390+0000 7f224de00640 1 --2- 172.21.15.19:0/1401778253 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2250145520 0x7f225015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:35.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.390+0000 7f2245400640 1 -- 172.21.15.19:0/1401778253 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2250145520 msgr2=0x7f225015d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:35.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.390+0000 7f2245400640 1 --2- 172.21.15.19:0/1401778253 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2250145520 0x7f225015d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.390+0000 7f2245400640 1 -- 172.21.15.19:0/1401778253 >> v2:172.21.15.42:3300/0 conn(0x7f22500af040 msgr2=0x7f2250071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:35.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.390+0000 7f2245400640 1 --2- 172.21.15.19:0/1401778253 >> v2:172.21.15.42:3300/0 conn(0x7f22500af040 0x7f2250071c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.390+0000 7f2245400640 1 -- 172.21.15.19:0/1401778253 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225015c8f0 con 0x7f225015bea0 2024-03-08T06:03:35.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.391+0000 7f2245400640 1 --2- 172.21.15.19:0/1401778253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f225015bea0 0x7f22500716e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f22500b2a00 tx=0x7f223802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd4dc28a03414f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:35.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.391+0000 7f224d400640 1 -- 172.21.15.19:0/1401778253 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2238035020 con 0x7f225015bea0 2024-03-08T06:03:35.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.392+0000 7f224d400640 1 -- 172.21.15.19:0/1401778253 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2238031870 con 0x7f225015bea0 2024-03-08T06:03:35.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.392+0000 7f224d400640 1 -- 172.21.15.19:0/1401778253 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2238031c40 con 0x7f225015bea0 2024-03-08T06:03:35.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.392+0000 7f224f200640 1 -- 172.21.15.19:0/1401778253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f225015bea0 msgr2=0x7f22500716e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:35.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.392+0000 7f224f200640 1 --2- 172.21.15.19:0/1401778253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f225015bea0 0x7f22500716e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f22500b2a00 tx=0x7f223802b910 comp rx=0 tx=0).stop 2024-03-08T06:03:35.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.392+0000 7f224f200640 1 -- 172.21.15.19:0/1401778253 shutdown_connections 2024-03-08T06:03:35.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.392+0000 7f224f200640 1 --2- 172.21.15.19:0/1401778253 >> v2:172.21.15.42:3300/0 conn(0x7f22500af040 0x7f2250071c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.392+0000 7f224f200640 1 --2- 172.21.15.19:0/1401778253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f225015bea0 0x7f22500716e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.392+0000 7f224f200640 1 --2- 172.21.15.19:0/1401778253 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2250145520 0x7f225015d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.392+0000 7f224f200640 1 -- 172.21.15.19:0/1401778253 >> 172.21.15.19:0/1401778253 conn(0x7f22500b1850 msgr2=0x7f22500b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:35.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.392+0000 7f224f200640 1 -- 172.21.15.19:0/1401778253 shutdown_connections 2024-03-08T06:03:35.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.392+0000 7f224f200640 1 -- 172.21.15.19:0/1401778253 wait complete. 2024-03-08T06:03:35.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.394+0000 7f224f200640 1 Processor -- start 2024-03-08T06:03:35.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.394+0000 7f224f200640 1 -- start start 2024-03-08T06:03:35.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.395+0000 7f224f200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22500af040 0x7f2250144560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:35.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.395+0000 7f224f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2250145520 0x7f225013f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:35.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.395+0000 7f224f200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f225013d5a0 0x7f2250142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:35.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.395+0000 7f224f200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225006e590 con 0x7f22500af040 2024-03-08T06:03:35.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.395+0000 7f224f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225006e410 con 0x7f2250145520 2024-03-08T06:03:35.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.395+0000 7f224f200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225006e710 con 0x7f225013d5a0 2024-03-08T06:03:35.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.395+0000 7f224de00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22500af040 0x7f2250144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:35.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.396+0000 7f224de00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22500af040 0x7f2250144560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41908/0 (socket says 172.21.15.19:41908) 2024-03-08T06:03:35.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.396+0000 7f224de00640 1 -- 172.21.15.19:0/4135154350 learned_addr learned my addr 172.21.15.19:0/4135154350 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:35.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.396+0000 7f2245400640 1 --2- 172.21.15.19:0/4135154350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2250145520 0x7f225013f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:35.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.396+0000 7f224de00640 1 -- 172.21.15.19:0/4135154350 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f225013d5a0 msgr2=0x7f2250142a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:35.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.396+0000 7f224de00640 1 --2- 172.21.15.19:0/4135154350 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f225013d5a0 0x7f2250142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.396+0000 7f224de00640 1 -- 172.21.15.19:0/4135154350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2250145520 msgr2=0x7f225013f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:35.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.396+0000 7f224de00640 1 --2- 172.21.15.19:0/4135154350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2250145520 0x7f225013f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.396+0000 7f224de00640 1 -- 172.21.15.19:0/4135154350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225013da50 con 0x7f22500af040 2024-03-08T06:03:35.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.396+0000 7f2245400640 1 --2- 172.21.15.19:0/4135154350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2250145520 0x7f225013f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:35.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.396+0000 7f224de00640 1 --2- 172.21.15.19:0/4135154350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22500af040 0x7f2250144560 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2240007f20 tx=0x7f224000e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:35.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.397+0000 7f2246a00640 1 -- 172.21.15.19:0/4135154350 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240014620 con 0x7f22500af040 2024-03-08T06:03:35.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.397+0000 7f2246a00640 1 -- 172.21.15.19:0/4135154350 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2240019070 con 0x7f22500af040 2024-03-08T06:03:35.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.397+0000 7f2246a00640 1 -- 172.21.15.19:0/4135154350 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240014a00 con 0x7f22500af040 2024-03-08T06:03:35.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.397+0000 7f224f200640 1 -- 172.21.15.19:0/4135154350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225013e8f0 con 0x7f22500af040 2024-03-08T06:03:35.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.397+0000 7f224f200640 1 -- 172.21.15.19:0/4135154350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225013eeb0 con 0x7f22500af040 2024-03-08T06:03:35.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.398+0000 7f224f200640 1 -- 172.21.15.19:0/4135154350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2250075100 con 0x7f22500af040 2024-03-08T06:03:35.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.399+0000 7f2246a00640 1 -- 172.21.15.19:0/4135154350 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2240014ba0 con 0x7f22500af040 2024-03-08T06:03:35.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.400+0000 7f2246a00640 1 --2- 172.21.15.19:0/4135154350 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f222c06b4d0 0x7f222c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:35.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.400+0000 7f2246a00640 1 -- 172.21.15.19:0/4135154350 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f224008aae0 con 0x7f22500af040 2024-03-08T06:03:35.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.400+0000 7f2245400640 1 --2- 172.21.15.19:0/4135154350 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f222c06b4d0 0x7f222c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:35.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.401+0000 7f2245400640 1 --2- 172.21.15.19:0/4135154350 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f222c06b4d0 0x7f222c06d990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2238036000 tx=0x7f2238008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:35.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.404+0000 7f2246a00640 1 -- 172.21.15.19:0/4135154350 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f225013da50 con 0x7f22500af040 2024-03-08T06:03:35.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.604+0000 7f224f200640 1 -- 172.21.15.19:0/4135154350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2250074740 con 0x7f22500af040 2024-03-08T06:03:35.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.606+0000 7f2246a00640 1 -- 172.21.15.19:0/4135154350 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f2240059950 con 0x7f22500af040 2024-03-08T06:03:35.608 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:35.608 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:03:22.069498+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:03:18.392703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T06:03:19.537912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:03:35.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.609+0000 7f224f200640 1 -- 172.21.15.19:0/4135154350 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f222c06b4d0 msgr2=0x7f222c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:35.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.609+0000 7f224f200640 1 --2- 172.21.15.19:0/4135154350 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f222c06b4d0 0x7f222c06d990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2238036000 tx=0x7f2238008030 comp rx=0 tx=0).stop 2024-03-08T06:03:35.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.609+0000 7f224f200640 1 -- 172.21.15.19:0/4135154350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22500af040 msgr2=0x7f2250144560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:35.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.609+0000 7f224f200640 1 --2- 172.21.15.19:0/4135154350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22500af040 0x7f2250144560 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2240007f20 tx=0x7f224000e570 comp rx=0 tx=0).stop 2024-03-08T06:03:35.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.609+0000 7f224f200640 1 -- 172.21.15.19:0/4135154350 shutdown_connections 2024-03-08T06:03:35.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.609+0000 7f224f200640 1 --2- 172.21.15.19:0/4135154350 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f222c06b4d0 0x7f222c06d990 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.609+0000 7f224f200640 1 --2- 172.21.15.19:0/4135154350 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f225013d5a0 0x7f2250142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.609+0000 7f224f200640 1 --2- 172.21.15.19:0/4135154350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2250145520 0x7f225013f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.609+0000 7f224f200640 1 --2- 172.21.15.19:0/4135154350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22500af040 0x7f2250144560 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.609+0000 7f224f200640 1 -- 172.21.15.19:0/4135154350 >> 172.21.15.19:0/4135154350 conn(0x7f22500b1850 msgr2=0x7f225006ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:35.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.610+0000 7f224f200640 1 -- 172.21.15.19:0/4135154350 shutdown_connections 2024-03-08T06:03:35.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.610+0000 7f224f200640 1 -- 172.21.15.19:0/4135154350 wait complete. 2024-03-08T06:03:35.631 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T06:03:35.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.837+0000 7f54a6400640 1 Processor -- start 2024-03-08T06:03:35.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.837+0000 7f54a6400640 1 -- start start 2024-03-08T06:03:35.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.839+0000 7f54a6400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54a006ea40 0x7f54a0165770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:35.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.839+0000 7f54a6400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a00cd020 con 0x7f54a015ed80 2024-03-08T06:03:35.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.839+0000 7f54a6400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a00cd300 con 0x7f54a015a770 2024-03-08T06:03:35.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.839+0000 7f54a6400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00ccdd0 con 0x7f54a006ea40 2024-03-08T06:03:35.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.839+0000 7f549fe00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f54a015ed80 0x7f54a006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42340/0 (socket says 172.21.15.19:42340) 2024-03-08T06:03:35.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.839+0000 7f549fe00640 1 -- 172.21.15.19:0/3157763049 learned_addr learned my addr 172.21.15.19:0/3157763049 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:35.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.839+0000 7f54a5a00640 1 --2- 172.21.15.19:0/3157763049 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54a006ea40 0x7f54a0165770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:35.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.839+0000 7f549f400640 1 -- 172.21.15.19:0/3157763049 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553197238 0 0) 0x7f54a00cd020 con 0x7f54a015ed80 2024-03-08T06:03:35.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.840+0000 7f549f400640 1 -- 172.21.15.19:0/3157763049 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5488003520 con 0x7f54a015ed80 2024-03-08T06:03:35.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.840+0000 7f549f400640 1 -- 172.21.15.19:0/3157763049 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1016292314 0 0) 0x7f5488003520 con 0x7f54a015ed80 2024-03-08T06:03:35.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.840+0000 7f549f400640 1 -- 172.21.15.19:0/3157763049 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54a006ea40 msgr2=0x7f54a0165770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:35.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.840+0000 7f549f400640 1 --2- 172.21.15.19:0/3157763049 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54a006ea40 0x7f54a0165770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.840+0000 7f549f400640 1 -- 172.21.15.19:0/3157763049 >> v1:172.21.15.42:6789/0 conn(0x7f54a015a770 legacy=0x7f54a00cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:35.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.840+0000 7f549f400640 1 -- 172.21.15.19:0/3157763049 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a015e580 con 0x7f54a015ed80 2024-03-08T06:03:35.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.840+0000 7f549f400640 1 -- 172.21.15.19:0/3157763049 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f548c001670 con 0x7f54a015ed80 2024-03-08T06:03:35.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.840+0000 7f54a5a00640 1 --2- 172.21.15.19:0/3157763049 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54a006ea40 0x7f54a0165770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:03:35.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.840+0000 7f549f400640 1 -- 172.21.15.19:0/3157763049 >> v1:172.21.15.19:6789/0 conn(0x7f54a015ed80 legacy=0x7f54a006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:35.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.840+0000 7f549f400640 1 --2- 172.21.15.19:0/3157763049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54880039e0 0x7f5488003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:35.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.840+0000 7f549f400640 1 --2- 172.21.15.19:0/3157763049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5488004800 0x7f5488004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:35.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.840+0000 7f549f400640 1 --2- 172.21.15.19:0/3157763049 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54a006ea40 0x7f5488005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:35.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.840+0000 7f549f400640 1 -- 172.21.15.19:0/3157763049 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00ccdd0 con 0x7f54880039e0 2024-03-08T06:03:35.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.840+0000 7f549f400640 1 -- 172.21.15.19:0/3157763049 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548800dd60 con 0x7f5488004800 2024-03-08T06:03:35.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.840+0000 7f549f400640 1 -- 172.21.15.19:0/3157763049 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548800df60 con 0x7f54a006ea40 2024-03-08T06:03:35.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.840+0000 7f54a5000640 1 --2- 172.21.15.19:0/3157763049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54880039e0 0x7f5488003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:35.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.841+0000 7f549fe00640 1 --2- 172.21.15.19:0/3157763049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5488004800 0x7f5488004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:35.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.841+0000 7f54a5a00640 1 --2- 172.21.15.19:0/3157763049 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54a006ea40 0x7f5488005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:35.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.841+0000 7f54a5000640 1 -- 172.21.15.19:0/3157763049 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54a006ea40 msgr2=0x7f5488005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:35.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.841+0000 7f54a5000640 1 --2- 172.21.15.19:0/3157763049 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54a006ea40 0x7f5488005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.841+0000 7f54a5000640 1 -- 172.21.15.19:0/3157763049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5488004800 msgr2=0x7f5488004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:35.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.841+0000 7f54a5000640 1 --2- 172.21.15.19:0/3157763049 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5488004800 0x7f5488004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.841+0000 7f54a5000640 1 -- 172.21.15.19:0/3157763049 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5488003520 con 0x7f54880039e0 2024-03-08T06:03:35.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.842+0000 7f54a5000640 1 --2- 172.21.15.19:0/3157763049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54880039e0 0x7f5488003e00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5494001750 tx=0x7f5488005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d30d3976c8a873 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:35.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.842+0000 7f549f400640 1 -- 172.21.15.19:0/3157763049 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5494001370 con 0x7f54880039e0 2024-03-08T06:03:35.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.842+0000 7f549f400640 1 -- 172.21.15.19:0/3157763049 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54940052d0 con 0x7f54880039e0 2024-03-08T06:03:35.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.842+0000 7f549f400640 1 -- 172.21.15.19:0/3157763049 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5494003830 con 0x7f54880039e0 2024-03-08T06:03:35.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.843+0000 7f54a6400640 1 -- 172.21.15.19:0/3157763049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54880039e0 msgr2=0x7f5488003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:35.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.843+0000 7f54a6400640 1 --2- 172.21.15.19:0/3157763049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54880039e0 0x7f5488003e00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5494001750 tx=0x7f5488005830 comp rx=0 tx=0).stop 2024-03-08T06:03:35.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.843+0000 7f54a5a00640 1 -- 172.21.15.19:0/3157763049 reap_dead start 2024-03-08T06:03:35.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.843+0000 7f54a6400640 1 -- 172.21.15.19:0/3157763049 shutdown_connections 2024-03-08T06:03:35.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.843+0000 7f54a6400640 1 -- 172.21.15.19:0/3157763049 >> 172.21.15.19:0/3157763049 conn(0x7f54a00b1850 msgr2=0x7f54a00b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:35.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.843+0000 7f54a6400640 1 -- 172.21.15.19:0/3157763049 shutdown_connections 2024-03-08T06:03:35.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.843+0000 7f54a6400640 1 -- 172.21.15.19:0/3157763049 wait complete. 2024-03-08T06:03:35.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.845+0000 7f54a6400640 1 Processor -- start 2024-03-08T06:03:35.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.845+0000 7f54a6400640 1 -- start start 2024-03-08T06:03:35.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.846+0000 7f54a6400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54880039e0 0x7f54a0143370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:35.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.846+0000 7f54a6400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54a01575d0 0x7f54a0157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:35.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.846+0000 7f54a6400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54a01e6460 0x7f54a01e68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:35.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.846+0000 7f54a6400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00b4e00 con 0x7f54a01575d0 2024-03-08T06:03:35.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.846+0000 7f54a6400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a015e8f0 con 0x7f54880039e0 2024-03-08T06:03:35.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.846+0000 7f54a6400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a006d220 con 0x7f54a01e6460 2024-03-08T06:03:35.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.846+0000 7f549fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54a01575d0 0x7f54a0157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:35.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.846+0000 7f549fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54a01575d0 0x7f54a0157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41936/0 (socket says 172.21.15.19:41936) 2024-03-08T06:03:35.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.846+0000 7f549fe00640 1 -- 172.21.15.19:0/1644925748 learned_addr learned my addr 172.21.15.19:0/1644925748 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:35.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.846+0000 7f54a5000640 1 --2- 172.21.15.19:0/1644925748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54880039e0 0x7f54a0143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:35.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.846+0000 7f549fe00640 1 -- 172.21.15.19:0/1644925748 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54a01e6460 msgr2=0x7f54a01e68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:35.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.846+0000 7f549fe00640 1 --2- 172.21.15.19:0/1644925748 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54a01e6460 0x7f54a01e68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.846+0000 7f549fe00640 1 -- 172.21.15.19:0/1644925748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54880039e0 msgr2=0x7f54a0143370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:35.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.846+0000 7f549fe00640 1 --2- 172.21.15.19:0/1644925748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54880039e0 0x7f54a0143370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:35.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.846+0000 7f549fe00640 1 -- 172.21.15.19:0/1644925748 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a0158140 con 0x7f54a01575d0 2024-03-08T06:03:35.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.847+0000 7f549fe00640 1 --2- 172.21.15.19:0/1644925748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54a01575d0 0x7f54a0157a50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f548c00e780 tx=0x7f548c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:35.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.847+0000 7f549cc00640 1 -- 172.21.15.19:0/1644925748 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c00ee90 con 0x7f54a01575d0 2024-03-08T06:03:35.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.847+0000 7f549cc00640 1 -- 172.21.15.19:0/1644925748 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c018070 con 0x7f54a01575d0 2024-03-08T06:03:35.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.847+0000 7f54a6400640 1 -- 172.21.15.19:0/1644925748 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a0158420 con 0x7f54a01575d0 2024-03-08T06:03:35.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.847+0000 7f549cc00640 1 -- 172.21.15.19:0/1644925748 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c00ca90 con 0x7f54a01575d0 2024-03-08T06:03:35.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.847+0000 7f54a6400640 1 -- 172.21.15.19:0/1644925748 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a0143ce0 con 0x7f54a01575d0 2024-03-08T06:03:35.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.848+0000 7f54a6400640 1 -- 172.21.15.19:0/1644925748 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a0075100 con 0x7f54a01575d0 2024-03-08T06:03:35.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.849+0000 7f549cc00640 1 -- 172.21.15.19:0/1644925748 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f548c00cc30 con 0x7f54a01575d0 2024-03-08T06:03:35.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.850+0000 7f549cc00640 1 --2- 172.21.15.19:0/1644925748 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f548006b670 0x7f548006db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:35.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.850+0000 7f549cc00640 1 -- 172.21.15.19:0/1644925748 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f548c08a1e0 con 0x7f54a01575d0 2024-03-08T06:03:35.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.850+0000 7f54a5000640 1 --2- 172.21.15.19:0/1644925748 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f548006b670 0x7f548006db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:35.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.851+0000 7f54a5000640 1 --2- 172.21.15.19:0/1644925748 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f548006b670 0x7f548006db30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5494033000 tx=0x7f5494009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:35.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:35.855+0000 7f549cc00640 1 -- 172.21.15.19:0/1644925748 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f548c058fc0 con 0x7f54a01575d0 2024-03-08T06:03:36.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.098+0000 7f54a6400640 1 -- 172.21.15.19:0/1644925748 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54a01e6240 con 0x7f54a01575d0 2024-03-08T06:03:36.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.099+0000 7f549cc00640 1 -- 172.21.15.19:0/1644925748 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7f548c0588c0 con 0x7f54a01575d0 2024-03-08T06:03:36.100 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:36.100 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1494509643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6835","nonce":1494509643},{"type":"v1","addr":"172.21.15.19:6837","nonce":1494509643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/2031610239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2031610239},{"type":"v1","addr":"172.21.15.42:6834","nonce":2031610239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6836/1964979810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1964979810},{"type":"v1","addr":"172.21.15.19:6836","nonce":1964979810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T06:03:20.532032+0000","modified":"2024-03-08T06:03:23.604391+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1462224228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1462224228},{"type":"v1","addr":"172.21.15.42:6835","nonce":1462224228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T06:03:36.100 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2024-03-08T06:03:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.102+0000 7f54a6400640 1 -- 172.21.15.19:0/1644925748 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f548006b670 msgr2=0x7f548006db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.102+0000 7f54a6400640 1 --2- 172.21.15.19:0/1644925748 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f548006b670 0x7f548006db30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5494033000 tx=0x7f5494009030 comp rx=0 tx=0).stop 2024-03-08T06:03:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.102+0000 7f54a6400640 1 -- 172.21.15.19:0/1644925748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54a01575d0 msgr2=0x7f54a0157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.102+0000 7f54a6400640 1 --2- 172.21.15.19:0/1644925748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54a01575d0 0x7f54a0157a50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f548c00e780 tx=0x7f548c00ec40 comp rx=0 tx=0).stop 2024-03-08T06:03:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.102+0000 7f54a6400640 1 -- 172.21.15.19:0/1644925748 shutdown_connections 2024-03-08T06:03:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.102+0000 7f54a6400640 1 --2- 172.21.15.19:0/1644925748 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f548006b670 0x7f548006db30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.102+0000 7f54a6400640 1 --2- 172.21.15.19:0/1644925748 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54a01e6460 0x7f54a01e68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.102+0000 7f54a6400640 1 --2- 172.21.15.19:0/1644925748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54a01575d0 0x7f54a0157a50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.102+0000 7f54a6400640 1 --2- 172.21.15.19:0/1644925748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54880039e0 0x7f54a0143370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.102+0000 7f54a6400640 1 -- 172.21.15.19:0/1644925748 >> 172.21.15.19:0/1644925748 conn(0x7f54a00b1850 msgr2=0x7f54a006d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.102+0000 7f54a6400640 1 -- 172.21.15.19:0/1644925748 shutdown_connections 2024-03-08T06:03:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.102+0000 7f54a6400640 1 -- 172.21.15.19:0/1644925748 wait complete. 2024-03-08T06:03:36.523 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-08T06:03:20.532032+0000', 'modified': '2024-03-08T06:03:23.604391+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.42:6835/1462224228', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6833', 'nonce': 1462224228}, {'type': 'v1', 'addr': '172.21.15.42:6835', 'nonce': 1462224228}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-08T06:03:36.523 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-08T06:03:36.523 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-03-08T06:03:36.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.752+0000 7f3917e00640 1 Processor -- start 2024-03-08T06:03:36.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.753+0000 7f3917e00640 1 -- start start 2024-03-08T06:03:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.754+0000 7f3917e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3918161240 0x7f39180b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.754+0000 7f3917e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f39180b5bd0 0x7f39180d1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.754+0000 7f3917e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39180b2ee0 con 0x7f39180d0fd0 2024-03-08T06:03:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.754+0000 7f3917e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39180ceaa0 con 0x7f3918161240 2024-03-08T06:03:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.754+0000 7f3917e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39180d33a0 con 0x7f39180b5bd0 2024-03-08T06:03:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.754+0000 7f3916a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3918161240 0x7f39180b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.755+0000 7f3916a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3918161240 0x7f39180b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41942/0 (socket says 172.21.15.19:41942) 2024-03-08T06:03:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.755+0000 7f3916a00640 1 -- 172.21.15.19:0/1019651359 learned_addr learned my addr 172.21.15.19:0/1019651359 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.755+0000 7f3917400640 1 --2- 172.21.15.19:0/1019651359 >> v2:172.21.15.42:3300/0 conn(0x7f39180b5bd0 0x7f39180d1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:36.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.755+0000 7f3916a00640 1 -- 172.21.15.19:0/1019651359 >> v2:172.21.15.42:3300/0 conn(0x7f39180b5bd0 msgr2=0x7f39180d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:36.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.755+0000 7f3916a00640 1 --2- 172.21.15.19:0/1019651359 >> v2:172.21.15.42:3300/0 conn(0x7f39180b5bd0 0x7f39180d1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.755+0000 7f3916a00640 1 -- 172.21.15.19:0/1019651359 >> v1:172.21.15.42:6789/0 conn(0x7f39180d0fd0 legacy=0x7f39180b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:36.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.755+0000 7f3916a00640 1 -- 172.21.15.19:0/1019651359 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39180d3680 con 0x7f3918161240 2024-03-08T06:03:36.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.756+0000 7f3916a00640 1 --2- 172.21.15.19:0/1019651359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3918161240 0x7f39180b2780 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f39180ce020 tx=0x7f390802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51db349ad57ca6d server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:36.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.756+0000 7f3915600640 1 -- 172.21.15.19:0/1019651359 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390802e070 con 0x7f3918161240 2024-03-08T06:03:36.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.757+0000 7f3915600640 1 -- 172.21.15.19:0/1019651359 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3908037070 con 0x7f3918161240 2024-03-08T06:03:36.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.757+0000 7f3915600640 1 -- 172.21.15.19:0/1019651359 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908031a00 con 0x7f3918161240 2024-03-08T06:03:36.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.757+0000 7f3917e00640 1 -- 172.21.15.19:0/1019651359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3918161240 msgr2=0x7f39180b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:36.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.757+0000 7f3917e00640 1 --2- 172.21.15.19:0/1019651359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3918161240 0x7f39180b2780 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f39180ce020 tx=0x7f390802b880 comp rx=0 tx=0).stop 2024-03-08T06:03:36.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.757+0000 7f3917e00640 1 -- 172.21.15.19:0/1019651359 shutdown_connections 2024-03-08T06:03:36.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.757+0000 7f3917e00640 1 --2- 172.21.15.19:0/1019651359 >> v2:172.21.15.42:3300/0 conn(0x7f39180b5bd0 0x7f39180d1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.757+0000 7f3917e00640 1 --2- 172.21.15.19:0/1019651359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3918161240 0x7f39180b2780 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.757+0000 7f3917e00640 1 -- 172.21.15.19:0/1019651359 >> 172.21.15.19:0/1019651359 conn(0x7f391806c700 msgr2=0x7f391806cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:36.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.757+0000 7f3917e00640 1 -- 172.21.15.19:0/1019651359 shutdown_connections 2024-03-08T06:03:36.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.757+0000 7f3917e00640 1 -- 172.21.15.19:0/1019651359 wait complete. 2024-03-08T06:03:36.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.759+0000 7f3917e00640 1 Processor -- start 2024-03-08T06:03:36.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.759+0000 7f3917e00640 1 -- start start 2024-03-08T06:03:36.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.760+0000 7f3917e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39180b5bd0 0x7f3918154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:36.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.760+0000 7f3917e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f39180d0fd0 0x7f3918155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:36.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.760+0000 7f3917e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3918161240 0x7f39181556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:36.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.760+0000 7f3917e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3918161620 con 0x7f3918161240 2024-03-08T06:03:36.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.760+0000 7f3917e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39180cefd0 con 0x7f39180b5bd0 2024-03-08T06:03:36.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.760+0000 7f3917e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39181617a0 con 0x7f39180d0fd0 2024-03-08T06:03:36.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.760+0000 7f3917400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3918161240 0x7f39181556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:36.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.760+0000 7f3917400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3918161240 0x7f39181556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41956/0 (socket says 172.21.15.19:41956) 2024-03-08T06:03:36.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.760+0000 7f3917400640 1 -- 172.21.15.19:0/268922414 learned_addr learned my addr 172.21.15.19:0/268922414 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:36.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.760+0000 7f3917400640 1 -- 172.21.15.19:0/268922414 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f39180d0fd0 msgr2=0x7f3918155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:36.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.761+0000 7f3917400640 1 --2- 172.21.15.19:0/268922414 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f39180d0fd0 0x7f3918155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.761+0000 7f3917400640 1 -- 172.21.15.19:0/268922414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39180b5bd0 msgr2=0x7f3918154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:36.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.761+0000 7f3917400640 1 --2- 172.21.15.19:0/268922414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39180b5bd0 0x7f3918154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.761+0000 7f3917400640 1 -- 172.21.15.19:0/268922414 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39180cd720 con 0x7f3918161240 2024-03-08T06:03:36.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.761+0000 7f3917400640 1 --2- 172.21.15.19:0/268922414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3918161240 0x7f39181556b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f391000cd60 tx=0x7f391000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:36.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.761+0000 7f390ea00640 1 -- 172.21.15.19:0/268922414 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3910003b90 con 0x7f3918161240 2024-03-08T06:03:36.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.761+0000 7f390ea00640 1 -- 172.21.15.19:0/268922414 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3910003d50 con 0x7f3918161240 2024-03-08T06:03:36.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.761+0000 7f3917e00640 1 -- 172.21.15.19:0/268922414 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3918153e70 con 0x7f3918161240 2024-03-08T06:03:36.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.761+0000 7f390ea00640 1 -- 172.21.15.19:0/268922414 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3910004260 con 0x7f3918161240 2024-03-08T06:03:36.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.761+0000 7f3917e00640 1 -- 172.21.15.19:0/268922414 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3918154430 con 0x7f3918161240 2024-03-08T06:03:36.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.763+0000 7f390ea00640 1 -- 172.21.15.19:0/268922414 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3910004400 con 0x7f3918161240 2024-03-08T06:03:36.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.764+0000 7f390ea00640 1 --2- 172.21.15.19:0/268922414 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f38f406b500 0x7f38f406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:36.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.764+0000 7f390ea00640 1 -- 172.21.15.19:0/268922414 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f391008ace0 con 0x7f3918161240 2024-03-08T06:03:36.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.765+0000 7f3916a00640 1 --2- 172.21.15.19:0/268922414 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f38f406b500 0x7f38f406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:36.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.765+0000 7f3920465740 1 Processor -- start 2024-03-08T06:03:36.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.765+0000 7f3916a00640 1 --2- 172.21.15.19:0/268922414 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f38f406b500 0x7f38f406d9c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3908036000 tx=0x7f3908030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:36.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.765+0000 7f3920465740 1 -- start start 2024-03-08T06:03:36.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.766+0000 7f3920465740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 0x55d60d00b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:36.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.766+0000 7f3920465740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d60d038d70 0x55d60d03b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:36.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.766+0000 7f3920465740 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d60d00be70 0x55d60d03bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:36.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.766+0000 7f3920465740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60cf75600 con 0x55d60d038990 2024-03-08T06:03:36.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.766+0000 7f3920465740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60cf1e930 con 0x55d60d038d70 2024-03-08T06:03:36.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.766+0000 7f3920465740 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d60cf716a0 con 0x55d60d00be70 2024-03-08T06:03:36.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.766+0000 7f3916a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 0x55d60d00b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:36.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.767+0000 7f3916a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 0x55d60d00b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41972/0 (socket says 172.21.15.19:41972) 2024-03-08T06:03:36.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.767+0000 7f3916a00640 1 -- 172.21.15.19:0/372765533 learned_addr learned my addr 172.21.15.19:0/372765533 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:36.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.767+0000 7f3916a00640 1 -- 172.21.15.19:0/372765533 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d60d00be70 msgr2=0x55d60d03bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:36.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.767+0000 7f3916a00640 1 --2- 172.21.15.19:0/372765533 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d60d00be70 0x55d60d03bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.767+0000 7f3916000640 1 --2- 172.21.15.19:0/372765533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d60d038d70 0x55d60d03b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:36.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.767+0000 7f3916a00640 1 -- 172.21.15.19:0/372765533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d60d038d70 msgr2=0x55d60d03b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:36.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.767+0000 7f3916a00640 1 --2- 172.21.15.19:0/372765533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d60d038d70 0x55d60d03b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.767+0000 7f3916a00640 1 -- 172.21.15.19:0/372765533 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d60cc8a2d0 con 0x55d60d038990 2024-03-08T06:03:36.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.767+0000 7f3916a00640 1 --2- 172.21.15.19:0/372765533 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 0x55d60d00b930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f390802b8c0 tx=0x7f3908031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee4fbd4db12a22a server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:36.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.767+0000 7f3907400640 1 -- 172.21.15.19:0/372765533 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908041070 con 0x55d60d038990 2024-03-08T06:03:36.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.768+0000 7f3907400640 1 -- 172.21.15.19:0/372765533 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3908037040 con 0x55d60d038990 2024-03-08T06:03:36.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.768+0000 7f3907400640 1 -- 172.21.15.19:0/372765533 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39080329d0 con 0x55d60d038990 2024-03-08T06:03:36.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.768+0000 7f3920465740 1 -- 172.21.15.19:0/372765533 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 msgr2=0x55d60d00b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:36.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.768+0000 7f3920465740 1 --2- 172.21.15.19:0/372765533 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 0x55d60d00b930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f390802b8c0 tx=0x7f3908031000 comp rx=0 tx=0).stop 2024-03-08T06:03:36.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.768+0000 7f3920465740 1 -- 172.21.15.19:0/372765533 shutdown_connections 2024-03-08T06:03:36.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.768+0000 7f3920465740 1 --2- 172.21.15.19:0/372765533 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d60d00be70 0x55d60d03bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.768+0000 7f3920465740 1 --2- 172.21.15.19:0/372765533 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d60d038d70 0x55d60d03b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.768+0000 7f3920465740 1 --2- 172.21.15.19:0/372765533 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 0x55d60d00b930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.768+0000 7f3920465740 1 -- 172.21.15.19:0/372765533 >> 172.21.15.19:0/372765533 conn(0x55d60d00dba0 msgr2=0x55d60d056720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:36.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.768+0000 7f3920465740 1 -- 172.21.15.19:0/372765533 shutdown_connections 2024-03-08T06:03:36.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.768+0000 7f3920465740 1 -- 172.21.15.19:0/372765533 wait complete. 2024-03-08T06:03:36.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.769+0000 7f3920465740 1 -- start start 2024-03-08T06:03:36.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.769+0000 7f3920465740 1 Processor -- start 2024-03-08T06:03:36.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.770+0000 7f3920465740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 0x55d60d050f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:36.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.770+0000 7f3920465740 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d60d038d70 0x55d60d04ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:36.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.770+0000 7f3920465740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d60d037e40 0x55d60d0665f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:36.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.770+0000 7f3920465740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60d010140 con 0x55d60d038990 2024-03-08T06:03:36.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.770+0000 7f3920465740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60cf31d90 con 0x55d60d037e40 2024-03-08T06:03:36.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.770+0000 7f3920465740 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d60d00f530 con 0x55d60d038d70 2024-03-08T06:03:36.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.770+0000 7f3920465740 10 client.0 _ll_register_callbacks cb 0x55d60cf6d350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-08T06:03:36.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.770+0000 7f3916a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 0x55d60d050f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:36.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.770+0000 7f3916a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 0x55d60d050f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41978/0 (socket says 172.21.15.19:41978) 2024-03-08T06:03:36.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.770+0000 7f3916a00640 1 -- 172.21.15.19:0/331695275 learned_addr learned my addr 172.21.15.19:0/331695275 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:36.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.771+0000 7f3916a00640 1 -- 172.21.15.19:0/331695275 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d60d038d70 msgr2=0x55d60d04ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:36.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.771+0000 7f3916a00640 1 --2- 172.21.15.19:0/331695275 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d60d038d70 0x55d60d04ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.771+0000 7f3916a00640 1 -- 172.21.15.19:0/331695275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d60d037e40 msgr2=0x55d60d0665f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:36.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.771+0000 7f3916a00640 1 --2- 172.21.15.19:0/331695275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d60d037e40 0x55d60d0665f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.771+0000 7f3916a00640 1 -- 172.21.15.19:0/331695275 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d60cd546b0 con 0x55d60d038990 2024-03-08T06:03:36.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.771+0000 7f3916a00640 1 --2- 172.21.15.19:0/331695275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 0x55d60d050f80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f390802b8c0 tx=0x7f3908004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64b912d3d25bc5e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:36.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.771+0000 7f38fbe00640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-03-08T06:03:36.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.771+0000 7f38fbe00640 1 -- 172.21.15.19:0/331695275 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908041040 con 0x55d60d038990 2024-03-08T06:03:36.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.771+0000 7f38fbe00640 1 -- 172.21.15.19:0/331695275 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3908051680 con 0x55d60d038990 2024-03-08T06:03:36.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.771+0000 7f3920465740 1 -- 172.21.15.19:0/331695275 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3908037040 con 0x55d60d038990 2024-03-08T06:03:36.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.772+0000 7f38fbe00640 1 -- 172.21.15.19:0/331695275 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3908063050 con 0x55d60d038990 2024-03-08T06:03:36.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.772+0000 7f3920465740 10 client.4611 fetch_fsmap learned FSMap version 8 2024-03-08T06:03:36.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.772+0000 7f3920465740 1 -- 172.21.15.19:0/331695275 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55d60d04fe60 con 0x55d60d038990 2024-03-08T06:03:36.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.772+0000 7f38fbe00640 1 -- 172.21.15.19:0/331695275 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3908037040 con 0x55d60d038990 2024-03-08T06:03:36.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.772+0000 7f38fbe00640 1 -- 172.21.15.19:0/331695275 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3908066020 con 0x55d60d038990 2024-03-08T06:03:36.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.772+0000 7f3920465740 10 client.4611 fetch_fsmap finished waiting for FSMap version 8 2024-03-08T06:03:36.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.772+0000 7f3920465740 10 client.4611 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-08T06:03:36.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.772+0000 7f3920465740 20 client.4611 populate_metadata read hostname 'smithi019' 2024-03-08T06:03:36.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.772+0000 7f3920465740 1 --2- 172.21.15.19:0/331695275 >> [v2:172.21.15.42:6833/1462224228,v1:172.21.15.42:6835/1462224228] conn(0x55d60d03dd10 0x55d60d074420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:36.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.772+0000 7f3920465740 4 client.4611 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-08T06:03:36.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.772+0000 7f3920465740 1 -- 172.21.15.19:0/331695275 --> [v2:172.21.15.42:6833/1462224228,v1:172.21.15.42:6835/1462224228] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d60cf82b40 con 0x55d60d03dd10 2024-03-08T06:03:36.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.773+0000 7f3916000640 1 --2- 172.21.15.19:0/331695275 >> [v2:172.21.15.42:6833/1462224228,v1:172.21.15.42:6835/1462224228] conn(0x55d60d03dd10 0x55d60d074420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:36.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.774+0000 7f3916000640 1 --2- 172.21.15.19:0/331695275 >> [v2:172.21.15.42:6833/1462224228,v1:172.21.15.42:6835/1462224228] conn(0x55d60d03dd10 0x55d60d074420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef7b7e6b6b67555c server_cookie=22bda7f597c5d466 in_seq=0 out_seq=0 2024-03-08T06:03:36.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.774+0000 7f38fbe00640 10 client.4611 ms_handle_connect on v2:172.21.15.42:6833/1462224228 2024-03-08T06:03:36.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.776+0000 7f38fbe00640 1 -- 172.21.15.19:0/331695275 <== mds.0 v2:172.21.15.42:6833/1462224228 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d60cf82b40 con 0x55d60d03dd10 2024-03-08T06:03:36.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.776+0000 7f38fbe00640 10 client.4611 handle_command_reply: tid=0 2024-03-08T06:03:36.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.776+0000 7f3920465740 1 client.4611 shutdown 2024-03-08T06:03:36.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.776+0000 7f3920465740 1 -- 172.21.15.19:0/331695275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 msgr2=0x55d60d050f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:36.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.776+0000 7f3920465740 1 --2- 172.21.15.19:0/331695275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 0x55d60d050f80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f390802b8c0 tx=0x7f3908004730 comp rx=0 tx=0).stop 2024-03-08T06:03:36.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.776+0000 7f3920465740 1 -- 172.21.15.19:0/331695275 shutdown_connections 2024-03-08T06:03:36.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.776+0000 7f3920465740 1 --2- 172.21.15.19:0/331695275 >> [v2:172.21.15.42:6833/1462224228,v1:172.21.15.42:6835/1462224228] conn(0x55d60d03dd10 0x55d60d074420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.776+0000 7f3920465740 1 --2- 172.21.15.19:0/331695275 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d60d037e40 0x55d60d0665f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.776+0000 7f3920465740 1 --2- 172.21.15.19:0/331695275 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d60d038d70 0x55d60d04ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.776+0000 7f3920465740 1 --2- 172.21.15.19:0/331695275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 0x55d60d050f80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.776+0000 7f38fbe00640 0 client.4611 ms_handle_reset on v2:172.21.15.42:6833/1462224228 2024-03-08T06:03:36.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.776+0000 7f3920465740 1 -- 172.21.15.19:0/331695275 >> 172.21.15.19:0/331695275 conn(0x55d60d00be70 msgr2=0x55d60d03b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:36.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.776+0000 7f3920465740 1 -- 172.21.15.19:0/331695275 shutdown_connections 2024-03-08T06:03:36.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.776+0000 7f3920465740 1 -- 172.21.15.19:0/331695275 wait complete. 2024-03-08T06:03:36.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.777+0000 7f3920465740 20 client.4611 trim_cache size 0 max 16384 2024-03-08T06:03:36.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.794+0000 7f3920465740 1 Processor -- start 2024-03-08T06:03:36.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.794+0000 7f3920465740 1 -- start start 2024-03-08T06:03:36.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.795+0000 7f3920465740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d037e40 0x55d60d037290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:36.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.795+0000 7f3920465740 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d60d038990 0x55d60d0377d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:36.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.795+0000 7f3920465740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d60d038d70 0x55d60d059e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:36.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.795+0000 7f3920465740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39181ff040 con 0x55d60d037e40 2024-03-08T06:03:36.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.795+0000 7f3920465740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3918152550 con 0x55d60d038d70 2024-03-08T06:03:36.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.795+0000 7f3920465740 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39181fea70 con 0x55d60d038990 2024-03-08T06:03:36.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.795+0000 7f3916a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d037e40 0x55d60d037290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:36.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.795+0000 7f3916a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d037e40 0x55d60d037290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41982/0 (socket says 172.21.15.19:41982) 2024-03-08T06:03:36.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.795+0000 7f3916a00640 1 -- 172.21.15.19:0/770771702 learned_addr learned my addr 172.21.15.19:0/770771702 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:36.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.795+0000 7f3916000640 1 --2- 172.21.15.19:0/770771702 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d60d038990 0x55d60d0377d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:36.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.795+0000 7f3917400640 1 --2- 172.21.15.19:0/770771702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d60d038d70 0x55d60d059e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:36.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.795+0000 7f3916a00640 1 -- 172.21.15.19:0/770771702 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d60d038990 msgr2=0x55d60d0377d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:36.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.795+0000 7f3916a00640 1 --2- 172.21.15.19:0/770771702 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d60d038990 0x55d60d0377d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.795+0000 7f3916a00640 1 -- 172.21.15.19:0/770771702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d60d038d70 msgr2=0x55d60d059e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:36.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.795+0000 7f3916a00640 1 --2- 172.21.15.19:0/770771702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d60d038d70 0x55d60d059e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.796+0000 7f3916a00640 1 -- 172.21.15.19:0/770771702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d60d00a440 con 0x55d60d037e40 2024-03-08T06:03:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.796+0000 7f3917400640 1 --2- 172.21.15.19:0/770771702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d60d038d70 0x55d60d059e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.796+0000 7f3916a00640 1 --2- 172.21.15.19:0/770771702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d037e40 0x55d60d037290 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3908032a70 tx=0x7f3908054040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44a4d5b8313eb41 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.796+0000 7f3906a00640 1 -- 172.21.15.19:0/770771702 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908051de0 con 0x55d60d037e40 2024-03-08T06:03:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.796+0000 7f3906a00640 1 -- 172.21.15.19:0/770771702 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3908051480 con 0x55d60d037e40 2024-03-08T06:03:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.796+0000 7f3906a00640 1 -- 172.21.15.19:0/770771702 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908004030 con 0x55d60d037e40 2024-03-08T06:03:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.797+0000 7f3920465740 1 -- 172.21.15.19:0/770771702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d037e40 msgr2=0x55d60d037290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.797+0000 7f3920465740 1 --2- 172.21.15.19:0/770771702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d037e40 0x55d60d037290 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3908032a70 tx=0x7f3908054040 comp rx=0 tx=0).stop 2024-03-08T06:03:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.797+0000 7f3920465740 1 -- 172.21.15.19:0/770771702 shutdown_connections 2024-03-08T06:03:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.797+0000 7f3920465740 1 --2- 172.21.15.19:0/770771702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d60d038d70 0x55d60d059e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.797+0000 7f3920465740 1 --2- 172.21.15.19:0/770771702 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d60d038990 0x55d60d0377d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.797+0000 7f3920465740 1 --2- 172.21.15.19:0/770771702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d037e40 0x55d60d037290 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.797+0000 7f3920465740 1 -- 172.21.15.19:0/770771702 >> 172.21.15.19:0/770771702 conn(0x55d60d00be70 msgr2=0x55d60d00f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.797+0000 7f3920465740 1 -- 172.21.15.19:0/770771702 shutdown_connections 2024-03-08T06:03:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.797+0000 7f3920465740 1 -- 172.21.15.19:0/770771702 wait complete. 2024-03-08T06:03:36.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.797+0000 7f3920465740 1 -- start start 2024-03-08T06:03:36.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.798+0000 7f3920465740 1 Processor -- start 2024-03-08T06:03:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.798+0000 7f3920465740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d60d037e40 0x55d60d054890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.799+0000 7f3920465740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 0x55d60d0c0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.799+0000 7f3920465740 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d60d038d70 0x55d60d078440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.799+0000 7f3920465740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60d03db90 con 0x55d60d038990 2024-03-08T06:03:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.799+0000 7f3920465740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60d03d760 con 0x55d60d037e40 2024-03-08T06:03:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.799+0000 7f3920465740 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d60d03e190 con 0x55d60d038d70 2024-03-08T06:03:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.799+0000 7f3920465740 10 client.0 _ll_register_callbacks cb 0x7f39080096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-08T06:03:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.799+0000 7f3916000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 0x55d60d0c0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.799+0000 7f3916000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 0x55d60d0c0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41988/0 (socket says 172.21.15.19:41988) 2024-03-08T06:03:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.799+0000 7f3916000640 1 -- 172.21.15.19:0/3066770372 learned_addr learned my addr 172.21.15.19:0/3066770372 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.799+0000 7f3916a00640 1 --2- 172.21.15.19:0/3066770372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d60d037e40 0x55d60d054890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.799+0000 7f3917400640 1 --2- 172.21.15.19:0/3066770372 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d60d038d70 0x55d60d078440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.799+0000 7f3916000640 1 -- 172.21.15.19:0/3066770372 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d60d038d70 msgr2=0x55d60d078440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.799+0000 7f3916000640 1 --2- 172.21.15.19:0/3066770372 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d60d038d70 0x55d60d078440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.799+0000 7f3916000640 1 -- 172.21.15.19:0/3066770372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d60d037e40 msgr2=0x55d60d054890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:36.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.799+0000 7f3916000640 1 --2- 172.21.15.19:0/3066770372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d60d037e40 0x55d60d054890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.799+0000 7f3916000640 1 -- 172.21.15.19:0/3066770372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d60d04d5f0 con 0x55d60d038990 2024-03-08T06:03:36.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.799+0000 7f3917400640 1 --2- 172.21.15.19:0/3066770372 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d60d038d70 0x55d60d078440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:36.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.800+0000 7f3916000640 1 --2- 172.21.15.19:0/3066770372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 0x55d60d0c0be0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3900003c10 tx=0x7f3900016850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893cd90b4ea9b67e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:36.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.800+0000 7f38fbe00640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-03-08T06:03:36.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.800+0000 7f38fbe00640 1 -- 172.21.15.19:0/3066770372 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900007220 con 0x55d60d038990 2024-03-08T06:03:36.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.800+0000 7f38fbe00640 1 -- 172.21.15.19:0/3066770372 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39000073c0 con 0x55d60d038990 2024-03-08T06:03:36.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.800+0000 7f3920465740 1 -- 172.21.15.19:0/3066770372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3908051480 con 0x55d60d038990 2024-03-08T06:03:36.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.800+0000 7f38fbe00640 1 -- 172.21.15.19:0/3066770372 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39000075c0 con 0x55d60d038990 2024-03-08T06:03:36.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.800+0000 7f3920465740 10 client.4617 fetch_fsmap learned FSMap version 8 2024-03-08T06:03:36.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.800+0000 7f3920465740 1 -- 172.21.15.19:0/3066770372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55d60d0570f0 con 0x55d60d038990 2024-03-08T06:03:36.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.800+0000 7f38fbe00640 1 -- 172.21.15.19:0/3066770372 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3908051480 con 0x55d60d038990 2024-03-08T06:03:36.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.800+0000 7f38fbe00640 1 -- 172.21.15.19:0/3066770372 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f39000067d0 con 0x55d60d038990 2024-03-08T06:03:36.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.801+0000 7f3920465740 10 client.4617 fetch_fsmap finished waiting for FSMap version 8 2024-03-08T06:03:36.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.801+0000 7f3920465740 10 client.4617 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-08T06:03:36.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.801+0000 7f3920465740 20 client.4617 populate_metadata read hostname 'smithi019' 2024-03-08T06:03:36.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.801+0000 7f3920465740 1 --2- 172.21.15.19:0/3066770372 >> [v2:172.21.15.42:6833/1462224228,v1:172.21.15.42:6835/1462224228] conn(0x55d60d037630 0x55d60d03c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:36.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.801+0000 7f3920465740 4 client.4617 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-08T06:03:36.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.801+0000 7f3920465740 1 -- 172.21.15.19:0/3066770372 --> [v2:172.21.15.42:6833/1462224228,v1:172.21.15.42:6835/1462224228] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d60cf7ce90 con 0x55d60d037630 2024-03-08T06:03:36.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.801+0000 7f3916a00640 1 --2- 172.21.15.19:0/3066770372 >> [v2:172.21.15.42:6833/1462224228,v1:172.21.15.42:6835/1462224228] conn(0x55d60d037630 0x55d60d03c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:36.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.802+0000 7f3916a00640 1 --2- 172.21.15.19:0/3066770372 >> [v2:172.21.15.42:6833/1462224228,v1:172.21.15.42:6835/1462224228] conn(0x55d60d037630 0x55d60d03c4a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bcf13bfe0f95074 server_cookie=3b1295f9961f0829 in_seq=0 out_seq=0 2024-03-08T06:03:36.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.802+0000 7f38fbe00640 10 client.4617 ms_handle_connect on v2:172.21.15.42:6833/1462224228 2024-03-08T06:03:36.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.802+0000 7f38fbe00640 1 -- 172.21.15.19:0/3066770372 <== mds.0 v2:172.21.15.42:6833/1462224228 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55d60cf7ce90 con 0x55d60d037630 2024-03-08T06:03:36.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.802+0000 7f38fbe00640 10 client.4617 handle_command_reply: tid=0 2024-03-08T06:03:36.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.802+0000 7f3920465740 1 client.4617 shutdown 2024-03-08T06:03:36.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.803+0000 7f3920465740 1 -- 172.21.15.19:0/3066770372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 msgr2=0x55d60d0c0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:36.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.803+0000 7f3920465740 1 --2- 172.21.15.19:0/3066770372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 0x55d60d0c0be0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3900003c10 tx=0x7f3900016850 comp rx=0 tx=0).stop 2024-03-08T06:03:36.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.803+0000 7f3920465740 1 -- 172.21.15.19:0/3066770372 shutdown_connections 2024-03-08T06:03:36.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.803+0000 7f3920465740 1 --2- 172.21.15.19:0/3066770372 >> [v2:172.21.15.42:6833/1462224228,v1:172.21.15.42:6835/1462224228] conn(0x55d60d037630 0x55d60d03c4a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.803+0000 7f3920465740 1 --2- 172.21.15.19:0/3066770372 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d60d038d70 0x55d60d078440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.803+0000 7f3920465740 1 --2- 172.21.15.19:0/3066770372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d60d038990 0x55d60d0c0be0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.803+0000 7f3920465740 1 --2- 172.21.15.19:0/3066770372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d60d037e40 0x55d60d054890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.803+0000 7f38fbe00640 0 client.4617 ms_handle_reset on v2:172.21.15.42:6833/1462224228 2024-03-08T06:03:36.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.803+0000 7f3920465740 1 -- 172.21.15.19:0/3066770372 >> 172.21.15.19:0/3066770372 conn(0x55d60d00be70 msgr2=0x55d60d0693e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:36.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.803+0000 7f3920465740 1 -- 172.21.15.19:0/3066770372 shutdown_connections 2024-03-08T06:03:36.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.803+0000 7f3920465740 1 -- 172.21.15.19:0/3066770372 wait complete. 2024-03-08T06:03:36.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.803+0000 7f3920465740 20 client.4617 trim_cache size 0 max 16384 2024-03-08T06:03:36.808 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-08T06:03:36.808 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd", 2024-03-08T06:03:36.808 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-03-08T06:03:36.808 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4272, 2024-03-08T06:03:36.808 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-03-08T06:03:36.808 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-03-08T06:03:36.808 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-03-08T06:03:36.808 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 15.729322628, 2024-03-08T06:03:36.808 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 8, 2024-03-08T06:03:36.808 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 21, 2024-03-08T06:03:36.809 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 21, 2024-03-08T06:03:36.809 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 23.567794537000001 2024-03-08T06:03:36.809 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-08T06:03:36.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.804+0000 7f3917e00640 1 -- 172.21.15.19:0/268922414 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f38f406b500 msgr2=0x7f38f406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:36.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.804+0000 7f3917e00640 1 --2- 172.21.15.19:0/268922414 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f38f406b500 0x7f38f406d9c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3908036000 tx=0x7f3908030000 comp rx=0 tx=0).stop 2024-03-08T06:03:36.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.804+0000 7f3917e00640 1 -- 172.21.15.19:0/268922414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3918161240 msgr2=0x7f39181556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:36.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.804+0000 7f3917e00640 1 --2- 172.21.15.19:0/268922414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3918161240 0x7f39181556b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f391000cd60 tx=0x7f391000a660 comp rx=0 tx=0).stop 2024-03-08T06:03:36.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.804+0000 7f3917e00640 1 -- 172.21.15.19:0/268922414 shutdown_connections 2024-03-08T06:03:36.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.804+0000 7f3917e00640 1 --2- 172.21.15.19:0/268922414 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f38f406b500 0x7f38f406d9c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.804+0000 7f3917e00640 1 --2- 172.21.15.19:0/268922414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3918161240 0x7f39181556b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.804+0000 7f3917e00640 1 --2- 172.21.15.19:0/268922414 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f39180d0fd0 0x7f3918155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.804+0000 7f3917e00640 1 --2- 172.21.15.19:0/268922414 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f39180b5bd0 0x7f3918154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:36.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.804+0000 7f3917e00640 1 -- 172.21.15.19:0/268922414 >> 172.21.15.19:0/268922414 conn(0x7f391806c700 msgr2=0x7f3918161950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:36.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.804+0000 7f3917e00640 1 -- 172.21.15.19:0/268922414 shutdown_connections 2024-03-08T06:03:36.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:36.804+0000 7f3917e00640 1 -- 172.21.15.19:0/268922414 wait complete. 2024-03-08T06:03:36.821 INFO:teuthology.run_tasks:Running task kclient... 2024-03-08T06:03:36.844 INFO:tasks.kclient:Mounting kernel clients... 2024-03-08T06:03:36.844 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-03-08T06:03:36.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:36.844 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-03-08T06:03:36.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:36.900 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-03-08T06:03:37.000 INFO:teuthology.orchestra.run.smithi019.stderr:Cannot find device "ceph-brx" 2024-03-08T06:03:37.005 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T06:03:37.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:37.006 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-03-08T06:03:37.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:37.063 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-03-08T06:03:37.166 INFO:teuthology.orchestra.run.smithi019.stderr:Cannot find device "ceph-brx" 2024-03-08T06:03:37.170 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T06:03:37.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:37.170 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-03-08T06:03:37.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:37.229 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-03-08T06:03:37.334 INFO:teuthology.orchestra.run.smithi042.stderr:Cannot find device "ceph-brx" 2024-03-08T06:03:37.338 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T06:03:37.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:37.339 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-03-08T06:03:37.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:37.395 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-03-08T06:03:37.498 INFO:teuthology.orchestra.run.smithi042.stderr:Cannot find device "ceph-brx" 2024-03-08T06:03:37.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T06:03:37.502 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-03-08T06:03:37.502 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-08T06:03:37.502 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-08T06:03:37.503 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-08T06:03:37.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.735+0000 7fa2e2a00640 1 Processor -- start 2024-03-08T06:03:37.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.735+0000 7fa2e2a00640 1 -- start start 2024-03-08T06:03:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.737+0000 7fa2e2a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa2dc071ab0 0x7fa2dc15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.737+0000 7fa2e2a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa2dc06d600 0x7fa2dc144d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.737+0000 7fa2e2a00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2dc15d0c0 con 0x7fa2dc071e90 2024-03-08T06:03:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.737+0000 7fa2e2a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2dc06ef40 con 0x7fa2dc071ab0 2024-03-08T06:03:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.737+0000 7fa2e2a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc06da80 con 0x7fa2dc06d600 2024-03-08T06:03:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.737+0000 7fa2dbe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa2dc071ab0 0x7fa2dc15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.737+0000 7fa2dbe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa2dc071ab0 0x7fa2dc15cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41994/0 (socket says 172.21.15.19:41994) 2024-03-08T06:03:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.737+0000 7fa2dbe00640 1 -- 172.21.15.19:0/3130039206 learned_addr learned my addr 172.21.15.19:0/3130039206 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.738+0000 7fa2db400640 1 --2- 172.21.15.19:0/3130039206 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa2dc06d600 0x7fa2dc144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.738+0000 7fa2dbe00640 1 -- 172.21.15.19:0/3130039206 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa2dc06d600 msgr2=0x7fa2dc144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.738+0000 7fa2dbe00640 1 --2- 172.21.15.19:0/3130039206 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa2dc06d600 0x7fa2dc144d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.738+0000 7fa2dbe00640 1 -- 172.21.15.19:0/3130039206 >> v1:172.21.15.42:6789/0 conn(0x7fa2dc071e90 legacy=0x7fa2dc15f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.738+0000 7fa2dbe00640 1 -- 172.21.15.19:0/3130039206 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc06dd60 con 0x7fa2dc071ab0 2024-03-08T06:03:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.740+0000 7fa2dbe00640 1 --2- 172.21.15.19:0/3130039206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc071ab0 0x7fa2dc15cb80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009870 tx=0x7fa2cc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ba72343c574d92 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.740+0000 7fa2daa00640 1 -- 172.21.15.19:0/3130039206 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc035020 con 0x7fa2dc071ab0 2024-03-08T06:03:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.740+0000 7fa2daa00640 1 -- 172.21.15.19:0/3130039206 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc031640 con 0x7fa2dc071ab0 2024-03-08T06:03:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.740+0000 7fa2daa00640 1 -- 172.21.15.19:0/3130039206 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc02d040 con 0x7fa2dc071ab0 2024-03-08T06:03:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.741+0000 7fa2e2a00640 1 -- 172.21.15.19:0/3130039206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc071ab0 msgr2=0x7fa2dc15cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.741+0000 7fa2e2a00640 1 --2- 172.21.15.19:0/3130039206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc071ab0 0x7fa2dc15cb80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009870 tx=0x7fa2cc02b8f0 comp rx=0 tx=0).stop 2024-03-08T06:03:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.741+0000 7fa2e2a00640 1 -- 172.21.15.19:0/3130039206 shutdown_connections 2024-03-08T06:03:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.741+0000 7fa2e2a00640 1 --2- 172.21.15.19:0/3130039206 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa2dc06d600 0x7fa2dc144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.741+0000 7fa2e2a00640 1 --2- 172.21.15.19:0/3130039206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc071ab0 0x7fa2dc15cb80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.741+0000 7fa2e2a00640 1 -- 172.21.15.19:0/3130039206 >> 172.21.15.19:0/3130039206 conn(0x7fa2dc06ae30 msgr2=0x7fa2dc06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.741+0000 7fa2e2a00640 1 -- 172.21.15.19:0/3130039206 shutdown_connections 2024-03-08T06:03:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.741+0000 7fa2e2a00640 1 -- 172.21.15.19:0/3130039206 wait complete. 2024-03-08T06:03:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.743+0000 7fa2e2a00640 1 Processor -- start 2024-03-08T06:03:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.743+0000 7fa2e2a00640 1 -- start start 2024-03-08T06:03:37.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.745+0000 7fa2e2a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc06d600 0x7fa2dc15b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:37.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.745+0000 7fa2e2a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa2dc071ab0 0x7fa2dc1f3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:37.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.745+0000 7fa2e2a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2dc071e90 0x7fa2dc0ad820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:37.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.745+0000 7fa2e2a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc06e600 con 0x7fa2dc06d600 2024-03-08T06:03:37.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.745+0000 7fa2e2a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc06e320 con 0x7fa2dc071e90 2024-03-08T06:03:37.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.745+0000 7fa2e2a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc15e3b0 con 0x7fa2dc071ab0 2024-03-08T06:03:37.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.745+0000 7fa2dbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc06d600 0x7fa2dc15b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.745+0000 7fa2dbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc06d600 0x7fa2dc15b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41998/0 (socket says 172.21.15.19:41998) 2024-03-08T06:03:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.745+0000 7fa2dbe00640 1 -- 172.21.15.19:0/427529735 learned_addr learned my addr 172.21.15.19:0/427529735 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.745+0000 7fa2db400640 1 --2- 172.21.15.19:0/427529735 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa2dc071ab0 0x7fa2dc1f3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.745+0000 7fa2e0a00640 1 --2- 172.21.15.19:0/427529735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2dc071e90 0x7fa2dc0ad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.746+0000 7fa2dbe00640 1 -- 172.21.15.19:0/427529735 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa2dc071ab0 msgr2=0x7fa2dc1f3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.746+0000 7fa2dbe00640 1 --2- 172.21.15.19:0/427529735 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa2dc071ab0 0x7fa2dc1f3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.746+0000 7fa2dbe00640 1 -- 172.21.15.19:0/427529735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2dc071e90 msgr2=0x7fa2dc0ad820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.746+0000 7fa2dbe00640 1 --2- 172.21.15.19:0/427529735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2dc071e90 0x7fa2dc0ad820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.746+0000 7fa2dbe00640 1 -- 172.21.15.19:0/427529735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc0b3000 con 0x7fa2dc06d600 2024-03-08T06:03:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.746+0000 7fa2dbe00640 1 --2- 172.21.15.19:0/427529735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc06d600 0x7fa2dc15b610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009870 tx=0x7fa2cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:37.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.746+0000 7fa2d3e00640 1 -- 172.21.15.19:0/427529735 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc040070 con 0x7fa2dc06d600 2024-03-08T06:03:37.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.746+0000 7fa2d3e00640 1 -- 172.21.15.19:0/427529735 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc039c10 con 0x7fa2dc06d600 2024-03-08T06:03:37.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.746+0000 7fa2d3e00640 1 -- 172.21.15.19:0/427529735 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc035040 con 0x7fa2dc06d600 2024-03-08T06:03:37.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.746+0000 7fa2e2a00640 1 -- 172.21.15.19:0/427529735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2dc0b32a0 con 0x7fa2dc06d600 2024-03-08T06:03:37.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.747+0000 7fa2e2a00640 1 -- 172.21.15.19:0/427529735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2dc0b3860 con 0x7fa2dc06d600 2024-03-08T06:03:37.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.748+0000 7fa2e2a00640 1 -- 172.21.15.19:0/427529735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2dc067cb0 con 0x7fa2dc06d600 2024-03-08T06:03:37.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.749+0000 7fa2d3e00640 1 -- 172.21.15.19:0/427529735 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa2cc04b060 con 0x7fa2dc06d600 2024-03-08T06:03:37.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.749+0000 7fa2d3e00640 1 --2- 172.21.15.19:0/427529735 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa2bc06b4d0 0x7fa2bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:37.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.750+0000 7fa2d3e00640 1 -- 172.21.15.19:0/427529735 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2cc0abbd0 con 0x7fa2dc06d600 2024-03-08T06:03:37.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.750+0000 7fa2db400640 1 --2- 172.21.15.19:0/427529735 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa2bc06b4d0 0x7fa2bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:37.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.750+0000 7fa2db400640 1 --2- 172.21.15.19:0/427529735 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa2bc06b4d0 0x7fa2bc06d990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc1603d0 tx=0x7fa2c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:37.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.754+0000 7fa2d3e00640 1 -- 172.21.15.19:0/427529735 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa2dc15d0c0 con 0x7fa2dc06d600 2024-03-08T06:03:37.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.995+0000 7fa2e2a00640 1 -- 172.21.15.19:0/427529735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa2dc160120 con 0x7fa2dc06d600 2024-03-08T06:03:37.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.995+0000 7fa2d3e00640 1 -- 172.21.15.19:0/427529735 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa2cc07a9b0 con 0x7fa2dc06d600 2024-03-08T06:03:37.996 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-08T06:03:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.998+0000 7fa2e2a00640 1 -- 172.21.15.19:0/427529735 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa2bc06b4d0 msgr2=0x7fa2bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.998+0000 7fa2e2a00640 1 --2- 172.21.15.19:0/427529735 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa2bc06b4d0 0x7fa2bc06d990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc1603d0 tx=0x7fa2c8008040 comp rx=0 tx=0).stop 2024-03-08T06:03:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.998+0000 7fa2e2a00640 1 -- 172.21.15.19:0/427529735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc06d600 msgr2=0x7fa2dc15b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.998+0000 7fa2e2a00640 1 --2- 172.21.15.19:0/427529735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc06d600 0x7fa2dc15b610 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009870 tx=0x7fa2cc0046c0 comp rx=0 tx=0).stop 2024-03-08T06:03:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.998+0000 7fa2e2a00640 1 -- 172.21.15.19:0/427529735 shutdown_connections 2024-03-08T06:03:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.998+0000 7fa2e2a00640 1 --2- 172.21.15.19:0/427529735 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa2bc06b4d0 0x7fa2bc06d990 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.998+0000 7fa2e2a00640 1 --2- 172.21.15.19:0/427529735 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2dc071e90 0x7fa2dc0ad820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.998+0000 7fa2e2a00640 1 --2- 172.21.15.19:0/427529735 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa2dc071ab0 0x7fa2dc1f3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.998+0000 7fa2e2a00640 1 --2- 172.21.15.19:0/427529735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2dc06d600 0x7fa2dc15b610 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.998+0000 7fa2e2a00640 1 -- 172.21.15.19:0/427529735 >> 172.21.15.19:0/427529735 conn(0x7fa2dc06ae30 msgr2=0x7fa2dc142e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.998+0000 7fa2e2a00640 1 -- 172.21.15.19:0/427529735 shutdown_connections 2024-03-08T06:03:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:37.998+0000 7fa2e2a00640 1 -- 172.21.15.19:0/427529735 wait complete. 2024-03-08T06:03:38.019 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-08T06:03:38.019 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-08T06:03:38.019 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-03-08T06:03:38.019 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-08T06:03:38.019 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-08T06:03:38.019 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-08T06:03:38.020 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-08T06:03:38.020 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-08T06:03:38.020 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-08T06:03:38.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:38.020 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-03-08T06:03:38.075 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-08T06:03:38.075 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-08T06:03:38.075 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-03-08T06:03:38.076 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:38.076 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-03-08T06:03:38.076 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:38.076 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T06:03:38.076 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-03-08T06:03:38.076 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-03-08T06:03:38.076 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T06:03:38.076 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-03-08T06:03:38.076 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-03-08T06:03:38.076 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-08T06:03:38.076 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-03-08T06:03:38.076 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-03-08T06:03:38.077 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-08T06:03:38.077 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42613sec preferred_lft 42613sec 2024-03-08T06:03:38.077 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link noprefixroute 2024-03-08T06:03:38.077 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:38.077 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T06:03:38.077 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-03-08T06:03:38.077 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-03-08T06:03:38.077 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-08T06:03:38.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:38.078 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-08T06:03:38.078 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-08T06:03:38.078 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add name ceph-brx type bridge 2024-03-08T06:03:38.078 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr flush dev ceph-brx 2024-03-08T06:03:38.078 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set ceph-brx up 2024-03-08T06:03:38.078 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-08T06:03:38.078 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-08T06:03:38.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:38.549 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-08T06:03:38.634 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-03-08T06:03:38.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:38.638 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-03-08T06:03:38.690 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-03-08T06:03:38.690 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-08T06:03:38.691 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-08T06:03:38.691 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-08T06:03:38.691 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-08T06:03:38.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:38.691 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-08T06:03:38.692 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-08T06:03:38.692 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-08T06:03:38.692 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-08T06:03:38.692 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-08T06:03:38.692 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-08T06:03:39.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:39.351 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-03-08T06:03:39.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:39.402 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list-id 2024-03-08T06:03:39.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:39.446 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-08T06:03:39.446 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-08T06:03:39.446 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T06:03:39.446 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-08T06:03:39.446 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-08T06:03:39.619 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-08T06:03:39.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:39.620 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-08T06:03:39.620 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-08T06:03:39.620 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-08T06:03:39.620 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-08T06:03:39.620 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-08T06:03:39.620 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-08T06:03:39.621 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-08T06:03:39.621 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-08T06:03:39.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:39.901 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-08T06:03:39.901 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-08T06:03:39.901 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-03-08T06:03:39.902 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set dev brx.0 master ceph-brx 2024-03-08T06:03:39.902 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-08T06:03:40.054 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T06:03:40.054 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-08T06:03:40.098 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-08T06:03:40.099 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T06:03:40.099 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-08T06:03:40.185 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-03-08T06:03:40.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:40.185 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T06:03:40.357 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T06:03:40.357 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-08T06:03:40.961 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T06:03:40.961 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-08T06:03:40.961 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.42:3300,172.21.15.42:3301" 2024-03-08T06:03:40.961 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with new device syntax: 0@d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd.cephfs=/ 2024-03-08T06:03:40.961 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.19:3300/172.21.15.42:3300/172.21.15.42:3301" will pass to kernel 2024-03-08T06:03:40.965 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-08T06:03:40.965 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-03-08T06:03:40.965 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-08T06:03:40.965 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-03-08T06:03:40.965 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-08T06:03:40.971 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-08T06:03:40.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:40.972 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-08T06:03:41.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:41.072 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-08T06:03:41.150 INFO:teuthology.orchestra.run.smithi019.stdout:client4626 2024-03-08T06:03:41.150 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:03:41.150 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:03:41.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:41.205 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-08T06:03:41.286 INFO:teuthology.orchestra.run.smithi019.stdout:client4626 2024-03-08T06:03:41.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:41.287 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-08T06:03:41.365 INFO:teuthology.orchestra.run.smithi019.stdout:client4626 2024-03-08T06:03:41.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:41.365 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd.client4626/status') 2024-03-08T06:03:41.477 INFO:teuthology.orchestra.run.smithi019.stdout:instance: client.4626 (3)192.168.0.1:0/1600360355 2024-03-08T06:03:41.477 INFO:teuthology.orchestra.run.smithi019.stdout:blocklisted: false 2024-03-08T06:03:41.477 INFO:teuthology.orchestra.run.smithi019.stderr:0+1 records in 2024-03-08T06:03:41.477 INFO:teuthology.orchestra.run.smithi019.stderr:0+1 records out 2024-03-08T06:03:41.477 INFO:teuthology.orchestra.run.smithi019.stderr:69 bytes copied, 8.0503e-05 s, 857 kB/s 2024-03-08T06:03:41.482 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-03-08T06:03:41.482 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-08T06:03:41.482 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-08T06:03:41.482 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-08T06:03:41.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.706+0000 7ff6b5a00640 1 Processor -- start 2024-03-08T06:03:41.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.706+0000 7ff6b5a00640 1 -- start start 2024-03-08T06:03:41.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.708+0000 7ff6b5a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff6b015df20 0x7ff6b00ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:41.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.708+0000 7ff6b5a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff6b00b6bd0 0x7ff6b0162400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:41.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.708+0000 7ff6b5a00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b015e300 con 0x7ff6b00d0aa0 2024-03-08T06:03:41.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.708+0000 7ff6b5a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b00d3990 con 0x7ff6b015df20 2024-03-08T06:03:41.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.708+0000 7ff6b5a00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b0162940 con 0x7ff6b00b6bd0 2024-03-08T06:03:41.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.708+0000 7ff6afe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff6b015df20 0x7ff6b00ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:41.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.708+0000 7ff6afe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff6b015df20 0x7ff6b00ce9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42004/0 (socket says 172.21.15.19:42004) 2024-03-08T06:03:41.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.708+0000 7ff6afe00640 1 -- 172.21.15.19:0/3342491760 learned_addr learned my addr 172.21.15.19:0/3342491760 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:41.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.709+0000 7ff6af400640 1 --2- 172.21.15.19:0/3342491760 >> v2:172.21.15.42:3300/0 conn(0x7ff6b00b6bd0 0x7ff6b0162400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:41.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.709+0000 7ff6afe00640 1 -- 172.21.15.19:0/3342491760 >> v2:172.21.15.42:3300/0 conn(0x7ff6b00b6bd0 msgr2=0x7ff6b0162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:41.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.709+0000 7ff6afe00640 1 --2- 172.21.15.19:0/3342491760 >> v2:172.21.15.42:3300/0 conn(0x7ff6b00b6bd0 0x7ff6b0162400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:41.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.709+0000 7ff6afe00640 1 -- 172.21.15.19:0/3342491760 >> v1:172.21.15.42:6789/0 conn(0x7ff6b00d0aa0 legacy=0x7ff6b00b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:41.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.709+0000 7ff6afe00640 1 -- 172.21.15.19:0/3342491760 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b00cf030 con 0x7ff6b015df20 2024-03-08T06:03:41.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.710+0000 7ff6afe00640 1 --2- 172.21.15.19:0/3342491760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6b015df20 0x7ff6b00ce9e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00d4b20 tx=0x7ff6a002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa3a762e3f77451 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:41.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.711+0000 7ff6aea00640 1 -- 172.21.15.19:0/3342491760 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0034070 con 0x7ff6b015df20 2024-03-08T06:03:41.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.711+0000 7ff6aea00640 1 -- 172.21.15.19:0/3342491760 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a0030860 con 0x7ff6b015df20 2024-03-08T06:03:41.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.711+0000 7ff6aea00640 1 -- 172.21.15.19:0/3342491760 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0030c30 con 0x7ff6b015df20 2024-03-08T06:03:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.712+0000 7ff6b5a00640 1 -- 172.21.15.19:0/3342491760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6b015df20 msgr2=0x7ff6b00ce9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.712+0000 7ff6b5a00640 1 --2- 172.21.15.19:0/3342491760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6b015df20 0x7ff6b00ce9e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00d4b20 tx=0x7ff6a002b9a0 comp rx=0 tx=0).stop 2024-03-08T06:03:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.712+0000 7ff6b5a00640 1 -- 172.21.15.19:0/3342491760 shutdown_connections 2024-03-08T06:03:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.712+0000 7ff6b5a00640 1 --2- 172.21.15.19:0/3342491760 >> v2:172.21.15.42:3300/0 conn(0x7ff6b00b6bd0 0x7ff6b0162400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.712+0000 7ff6b5a00640 1 --2- 172.21.15.19:0/3342491760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6b015df20 0x7ff6b00ce9e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.712+0000 7ff6b5a00640 1 -- 172.21.15.19:0/3342491760 >> 172.21.15.19:0/3342491760 conn(0x7ff6b006c740 msgr2=0x7ff6b006cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.712+0000 7ff6b5a00640 1 -- 172.21.15.19:0/3342491760 shutdown_connections 2024-03-08T06:03:41.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.712+0000 7ff6b5a00640 1 -- 172.21.15.19:0/3342491760 wait complete. 2024-03-08T06:03:41.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.714+0000 7ff6b5a00640 1 Processor -- start 2024-03-08T06:03:41.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.714+0000 7ff6b5a00640 1 -- start start 2024-03-08T06:03:41.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.715+0000 7ff6b5a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6b00b6bd0 0x7ff6b00c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:41.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.715+0000 7ff6b5a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6b00d0aa0 0x7ff6b00cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:41.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.715+0000 7ff6b5a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6b015df20 0x7ff6b0154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:41.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.715+0000 7ff6b5a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b00d2180 con 0x7ff6b00d0aa0 2024-03-08T06:03:41.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.715+0000 7ff6b5a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b00d1ea0 con 0x7ff6b00b6bd0 2024-03-08T06:03:41.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.715+0000 7ff6b5a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b00d2460 con 0x7ff6b015df20 2024-03-08T06:03:41.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.715+0000 7ff6af400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6b00d0aa0 0x7ff6b00cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:41.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.715+0000 7ff6af400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6b00d0aa0 0x7ff6b00cc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42018/0 (socket says 172.21.15.19:42018) 2024-03-08T06:03:41.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.715+0000 7ff6af400640 1 -- 172.21.15.19:0/4112353550 learned_addr learned my addr 172.21.15.19:0/4112353550 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:41.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.715+0000 7ff6afe00640 1 --2- 172.21.15.19:0/4112353550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6b00b6bd0 0x7ff6b00c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:41.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.715+0000 7ff6b5000640 1 --2- 172.21.15.19:0/4112353550 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6b015df20 0x7ff6b0154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:41.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.716+0000 7ff6af400640 1 -- 172.21.15.19:0/4112353550 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6b015df20 msgr2=0x7ff6b0154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:41.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.716+0000 7ff6af400640 1 --2- 172.21.15.19:0/4112353550 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6b015df20 0x7ff6b0154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:41.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.716+0000 7ff6af400640 1 -- 172.21.15.19:0/4112353550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6b00b6bd0 msgr2=0x7ff6b00c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:41.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.716+0000 7ff6af400640 1 --2- 172.21.15.19:0/4112353550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6b00b6bd0 0x7ff6b00c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:41.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.716+0000 7ff6af400640 1 -- 172.21.15.19:0/4112353550 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b00ccb30 con 0x7ff6b00d0aa0 2024-03-08T06:03:41.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.716+0000 7ff6af400640 1 --2- 172.21.15.19:0/4112353550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6b00d0aa0 0x7ff6b00cc5f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00e9b0 tx=0x7ff69c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:41.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.716+0000 7ff6a7e00640 1 -- 172.21.15.19:0/4112353550 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c017070 con 0x7ff6b00d0aa0 2024-03-08T06:03:41.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.716+0000 7ff6a7e00640 1 -- 172.21.15.19:0/4112353550 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c00c9a0 con 0x7ff6b00d0aa0 2024-03-08T06:03:41.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.716+0000 7ff6a7e00640 1 -- 172.21.15.19:0/4112353550 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c00cd90 con 0x7ff6b00d0aa0 2024-03-08T06:03:41.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.716+0000 7ff6b5a00640 1 -- 172.21.15.19:0/4112353550 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b00c7c20 con 0x7ff6b00d0aa0 2024-03-08T06:03:41.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.716+0000 7ff6b5a00640 1 -- 172.21.15.19:0/4112353550 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b00c81e0 con 0x7ff6b00d0aa0 2024-03-08T06:03:41.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.718+0000 7ff6b5a00640 1 -- 172.21.15.19:0/4112353550 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b0075100 con 0x7ff6b00d0aa0 2024-03-08T06:03:41.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.719+0000 7ff6a7e00640 1 -- 172.21.15.19:0/4112353550 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff69c01a070 con 0x7ff6b00d0aa0 2024-03-08T06:03:41.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.719+0000 7ff6a7e00640 1 --2- 172.21.15.19:0/4112353550 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff69006b4d0 0x7ff69006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:41.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.720+0000 7ff6a7e00640 1 -- 172.21.15.19:0/4112353550 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff69c08a2e0 con 0x7ff6b00d0aa0 2024-03-08T06:03:41.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.720+0000 7ff6afe00640 1 --2- 172.21.15.19:0/4112353550 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff69006b4d0 0x7ff69006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:41.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.720+0000 7ff6afe00640 1 --2- 172.21.15.19:0/4112353550 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff69006b4d0 0x7ff69006d990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0036000 tx=0x7ff6a003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:41.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.724+0000 7ff6a7e00640 1 -- 172.21.15.19:0/4112353550 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff69c0590c0 con 0x7ff6b00d0aa0 2024-03-08T06:03:41.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.964+0000 7ff6b5a00640 1 -- 172.21.15.19:0/4112353550 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff6b00d3070 con 0x7ff6b00d0aa0 2024-03-08T06:03:41.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.965+0000 7ff6a7e00640 1 -- 172.21.15.19:0/4112353550 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff69c0589c0 con 0x7ff6b00d0aa0 2024-03-08T06:03:41.966 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-08T06:03:41.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.968+0000 7ff6b5a00640 1 -- 172.21.15.19:0/4112353550 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff69006b4d0 msgr2=0x7ff69006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:41.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.969+0000 7ff6b5a00640 1 --2- 172.21.15.19:0/4112353550 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff69006b4d0 0x7ff69006d990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0036000 tx=0x7ff6a003b040 comp rx=0 tx=0).stop 2024-03-08T06:03:41.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.969+0000 7ff6b5a00640 1 -- 172.21.15.19:0/4112353550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6b00d0aa0 msgr2=0x7ff6b00cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:41.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.969+0000 7ff6b5a00640 1 --2- 172.21.15.19:0/4112353550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6b00d0aa0 0x7ff6b00cc5f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00e9b0 tx=0x7ff69c00ee70 comp rx=0 tx=0).stop 2024-03-08T06:03:41.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.969+0000 7ff6b5a00640 1 -- 172.21.15.19:0/4112353550 shutdown_connections 2024-03-08T06:03:41.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.969+0000 7ff6b5a00640 1 --2- 172.21.15.19:0/4112353550 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff69006b4d0 0x7ff69006d990 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:41.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.969+0000 7ff6b5a00640 1 --2- 172.21.15.19:0/4112353550 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff6b015df20 0x7ff6b0154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:41.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.969+0000 7ff6b5a00640 1 --2- 172.21.15.19:0/4112353550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6b00d0aa0 0x7ff6b00cc5f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:41.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.969+0000 7ff6b5a00640 1 --2- 172.21.15.19:0/4112353550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6b00b6bd0 0x7ff6b00c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:41.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.969+0000 7ff6b5a00640 1 -- 172.21.15.19:0/4112353550 >> 172.21.15.19:0/4112353550 conn(0x7ff6b006c740 msgr2=0x7ff6b00b8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:41.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.969+0000 7ff6b5a00640 1 -- 172.21.15.19:0/4112353550 shutdown_connections 2024-03-08T06:03:41.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:41.969+0000 7ff6b5a00640 1 -- 172.21.15.19:0/4112353550 wait complete. 2024-03-08T06:03:41.988 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-08T06:03:41.988 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-08T06:03:41.989 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-03-08T06:03:41.989 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-03-08T06:03:41.989 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-08T06:03:41.989 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-08T06:03:41.989 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-08T06:03:41.989 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-08T06:03:41.989 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-03-08T06:03:41.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:41.989 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-03-08T06:03:42.043 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-08T06:03:42.043 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-08T06:03:42.044 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-03-08T06:03:42.044 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:42.044 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-03-08T06:03:42.044 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:42.044 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T06:03:42.044 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-03-08T06:03:42.044 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-03-08T06:03:42.044 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T06:03:42.044 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-03-08T06:03:42.044 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-03-08T06:03:42.044 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-08T06:03:42.044 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-03-08T06:03:42.044 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-03-08T06:03:42.044 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-08T06:03:42.044 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42609sec preferred_lft 42609sec 2024-03-08T06:03:42.045 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link noprefixroute 2024-03-08T06:03:42.045 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:42.045 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T06:03:42.045 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-03-08T06:03:42.045 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-03-08T06:03:42.045 INFO:teuthology.orchestra.run.smithi019.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-08T06:03:42.045 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 4e:60:0d:1b:c8:aa brd ff:ff:ff:ff:ff:ff 2024-03-08T06:03:42.045 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-08T06:03:42.045 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:42.045 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::d8f4:f9ff:fe64:b003/64 scope link 2024-03-08T06:03:42.045 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:42.045 INFO:teuthology.orchestra.run.smithi019.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-08T06:03:42.045 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 4e:60:0d:1b:c8:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T06:03:42.045 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::4c60:dff:fe1b:c8aa/64 scope link 2024-03-08T06:03:42.045 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:42.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:42.046 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-08T06:03:42.142 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-03-08T06:03:42.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:42.147 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-03-08T06:03:42.204 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-03-08T06:03:42.204 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-08T06:03:42.205 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-08T06:03:42.205 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-08T06:03:42.205 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-08T06:03:42.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:42.205 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-08T06:03:42.205 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-08T06:03:42.205 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-08T06:03:42.205 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-08T06:03:42.205 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-08T06:03:42.205 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-08T06:03:42.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:42.402 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-03-08T06:03:42.456 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-08T06:03:42.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:42.457 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list-id 2024-03-08T06:03:42.511 INFO:teuthology.orchestra.run.smithi019.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-03-08T06:03:42.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:42.512 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-08T06:03:42.513 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-08T06:03:42.513 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-08T06:03:42.513 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-03-08T06:03:42.513 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-08T06:03:42.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:42.660 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-08T06:03:42.757 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-08T06:03:42.757 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-08T06:03:42.757 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-03-08T06:03:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-03-08T06:03:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:42.758 INFO:teuthology.orchestra.run.smithi019.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-08T06:03:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 26:1b:13:05:11:03 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-08T06:03:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-08T06:03:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::241b:13ff:fe05:1103/64 scope link 2024-03-08T06:03:42.758 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:42.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:42.763 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-08T06:03:42.863 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-08T06:03:42.863 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-08T06:03:42.863 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-03-08T06:03:42.863 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:42.863 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-03-08T06:03:42.864 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:42.864 INFO:teuthology.orchestra.run.smithi019.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-08T06:03:42.864 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 26:1b:13:05:11:03 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-08T06:03:42.864 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-08T06:03:42.864 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:42.864 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::241b:13ff:fe05:1103/64 scope link 2024-03-08T06:03:42.864 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:42.868 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-03-08T06:03:42.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:42.869 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-08T06:03:42.869 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-08T06:03:42.869 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-03-08T06:03:42.869 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-08T06:03:42.869 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-03-08T06:03:42.869 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-03-08T06:03:42.869 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-03-08T06:03:42.869 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-08T06:03:43.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:43.163 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-08T06:03:43.163 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-08T06:03:43.163 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.1 up 2024-03-08T06:03:43.163 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set dev brx.1 master ceph-brx 2024-03-08T06:03:43.163 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-08T06:03:43.341 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T06:03:43.341 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-03-08T06:03:43.393 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-03-08T06:03:43.394 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T06:03:43.394 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-03-08T06:03:43.443 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-03-08T06:03:43.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:43.443 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T06:03:43.588 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T06:03:43.589 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-08T06:03:43.624 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T06:03:43.624 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-08T06:03:43.625 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.42:3300,172.21.15.42:3301" 2024-03-08T06:03:43.625 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with new device syntax: 2@d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd.cephfs=/ 2024-03-08T06:03:43.625 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.19:3300/172.21.15.42:3300/172.21.15.42:3301" will pass to kernel 2024-03-08T06:03:43.627 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-03-08T06:03:43.627 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-03-08T06:03:43.627 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-08T06:03:43.627 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-03-08T06:03:43.627 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-08T06:03:43.631 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-08T06:03:43.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:43.632 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-03-08T06:03:43.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:43.722 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-08T06:03:43.781 INFO:teuthology.orchestra.run.smithi019.stdout:client4477 2024-03-08T06:03:43.782 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:03:43.782 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:03:43.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:43.838 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-08T06:03:43.898 INFO:teuthology.orchestra.run.smithi019.stdout:client4477 2024-03-08T06:03:43.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:43.898 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-08T06:03:43.957 INFO:teuthology.orchestra.run.smithi019.stdout:client4477 2024-03-08T06:03:43.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:43.958 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd.client4477/status') 2024-03-08T06:03:44.054 INFO:teuthology.orchestra.run.smithi019.stdout:instance: client.4477 (3)172.21.15.19:0/954582160 2024-03-08T06:03:44.054 INFO:teuthology.orchestra.run.smithi019.stdout:blocklisted: false 2024-03-08T06:03:44.054 INFO:teuthology.orchestra.run.smithi019.stderr:0+1 records in 2024-03-08T06:03:44.055 INFO:teuthology.orchestra.run.smithi019.stderr:0+1 records out 2024-03-08T06:03:44.055 INFO:teuthology.orchestra.run.smithi019.stderr:69 bytes copied, 0.000112521 s, 613 kB/s 2024-03-08T06:03:44.059 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-03-08T06:03:44.059 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-08T06:03:44.059 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-08T06:03:44.059 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-08T06:03:44.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.282+0000 7f1980200640 1 Processor -- start 2024-03-08T06:03:44.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.282+0000 7f1980200640 1 -- start start 2024-03-08T06:03:44.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.283+0000 7f1980200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1978144840 0x7f197806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:44.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.283+0000 7f1980200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1978071600 0x7f1978071a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:44.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.283+0000 7f1980200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f197806eb30 0x7f197806ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:44.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.283+0000 7f1980200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1978144c20 con 0x7f1978144840 2024-03-08T06:03:44.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.283+0000 7f1980200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f197806f4c0 con 0x7f197806eb30 2024-03-08T06:03:44.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.283+0000 7f1980200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19780720a0 con 0x7f1978071600 2024-03-08T06:03:44.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.284+0000 7f197d800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1978144840 0x7f197806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:44.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.284+0000 7f197d800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1978144840 0x7f197806e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44754/0 (socket says 172.21.15.19:44754) 2024-03-08T06:03:44.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.284+0000 7f197d800640 1 -- 172.21.15.19:0/1918203743 learned_addr learned my addr 172.21.15.19:0/1918203743 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:44.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.284+0000 7f197ce00640 1 --2- 172.21.15.19:0/1918203743 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1978071600 0x7f1978071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:44.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.284+0000 7f197e200640 1 --2- 172.21.15.19:0/1918203743 >> v2:172.21.15.42:3300/0 conn(0x7f197806eb30 0x7f197806ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:44.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.285+0000 7f197d800640 1 -- 172.21.15.19:0/1918203743 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1978071600 msgr2=0x7f1978071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:44.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.285+0000 7f197d800640 1 --2- 172.21.15.19:0/1918203743 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1978071600 0x7f1978071a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:44.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.285+0000 7f197d800640 1 -- 172.21.15.19:0/1918203743 >> v2:172.21.15.42:3300/0 conn(0x7f197806eb30 msgr2=0x7f197806ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:44.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.285+0000 7f197d800640 1 --2- 172.21.15.19:0/1918203743 >> v2:172.21.15.42:3300/0 conn(0x7f197806eb30 0x7f197806ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:44.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.285+0000 7f197d800640 1 -- 172.21.15.19:0/1918203743 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197806d810 con 0x7f1978144840 2024-03-08T06:03:44.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.285+0000 7f197ce00640 1 --2- 172.21.15.19:0/1918203743 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1978071600 0x7f1978071a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:03:44.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.285+0000 7f197e200640 1 --2- 172.21.15.19:0/1918203743 >> v2:172.21.15.42:3300/0 conn(0x7f197806eb30 0x7f197806ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:03:44.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.286+0000 7f197d800640 1 --2- 172.21.15.19:0/1918203743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1978144840 0x7f197806e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1978072a00 tx=0x7f196c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4caf8b960283e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:44.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.287+0000 7f1977e00640 1 -- 172.21.15.19:0/1918203743 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c035020 con 0x7f1978144840 2024-03-08T06:03:44.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.287+0000 7f1977e00640 1 -- 172.21.15.19:0/1918203743 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196c031870 con 0x7f1978144840 2024-03-08T06:03:44.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.287+0000 7f1977e00640 1 -- 172.21.15.19:0/1918203743 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c031c40 con 0x7f1978144840 2024-03-08T06:03:44.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.287+0000 7f1980200640 1 -- 172.21.15.19:0/1918203743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1978144840 msgr2=0x7f197806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:44.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.287+0000 7f1980200640 1 --2- 172.21.15.19:0/1918203743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1978144840 0x7f197806e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1978072a00 tx=0x7f196c02b910 comp rx=0 tx=0).stop 2024-03-08T06:03:44.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.287+0000 7f1980200640 1 -- 172.21.15.19:0/1918203743 shutdown_connections 2024-03-08T06:03:44.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.287+0000 7f1980200640 1 --2- 172.21.15.19:0/1918203743 >> v2:172.21.15.42:3300/0 conn(0x7f197806eb30 0x7f197806ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:44.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.287+0000 7f1980200640 1 --2- 172.21.15.19:0/1918203743 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1978071600 0x7f1978071a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:44.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.287+0000 7f1980200640 1 --2- 172.21.15.19:0/1918203743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1978144840 0x7f197806e2f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:44.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.287+0000 7f1980200640 1 -- 172.21.15.19:0/1918203743 >> 172.21.15.19:0/1918203743 conn(0x7f197806ac50 msgr2=0x7f197806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:44.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.287+0000 7f1980200640 1 -- 172.21.15.19:0/1918203743 shutdown_connections 2024-03-08T06:03:44.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.287+0000 7f1980200640 1 -- 172.21.15.19:0/1918203743 wait complete. 2024-03-08T06:03:44.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.289+0000 7f1980200640 1 Processor -- start 2024-03-08T06:03:44.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.289+0000 7f1980200640 1 -- start start 2024-03-08T06:03:44.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.290+0000 7f1980200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f197806eb30 0x7f19781f4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:44.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.290+0000 7f1980200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1978071600 0x7f19780a9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:44.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.290+0000 7f1980200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1978144840 0x7f1978142f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:44.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.290+0000 7f1980200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1978145010 con 0x7f1978144840 2024-03-08T06:03:44.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.290+0000 7f1980200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197806ddd0 con 0x7f197806eb30 2024-03-08T06:03:44.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.290+0000 7f1980200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19780cc160 con 0x7f1978071600 2024-03-08T06:03:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.291+0000 7f197e200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1978144840 0x7f1978142f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.291+0000 7f197e200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1978144840 0x7f1978142f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44764/0 (socket says 172.21.15.19:44764) 2024-03-08T06:03:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.291+0000 7f197e200640 1 -- 172.21.15.19:0/4147121388 learned_addr learned my addr 172.21.15.19:0/4147121388 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.291+0000 7f197d800640 1 --2- 172.21.15.19:0/4147121388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f197806eb30 0x7f19781f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.291+0000 7f197ce00640 1 --2- 172.21.15.19:0/4147121388 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1978071600 0x7f19780a9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.291+0000 7f197e200640 1 -- 172.21.15.19:0/4147121388 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1978071600 msgr2=0x7f19780a9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.291+0000 7f197e200640 1 --2- 172.21.15.19:0/4147121388 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1978071600 0x7f19780a9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.291+0000 7f197e200640 1 -- 172.21.15.19:0/4147121388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f197806eb30 msgr2=0x7f19781f4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.291+0000 7f197e200640 1 --2- 172.21.15.19:0/4147121388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f197806eb30 0x7f19781f4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.291+0000 7f197e200640 1 -- 172.21.15.19:0/4147121388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197815e620 con 0x7f1978144840 2024-03-08T06:03:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.291+0000 7f197ce00640 1 --2- 172.21.15.19:0/4147121388 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1978071600 0x7f19780a9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:44.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.292+0000 7f197e200640 1 --2- 172.21.15.19:0/4147121388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1978144840 0x7f1978142f10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1970007e10 tx=0x7f197000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:44.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.292+0000 7f1975600640 1 -- 172.21.15.19:0/4147121388 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197001a070 con 0x7f1978144840 2024-03-08T06:03:44.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.292+0000 7f1975600640 1 -- 172.21.15.19:0/4147121388 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1970003b90 con 0x7f1978144840 2024-03-08T06:03:44.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.292+0000 7f1975600640 1 -- 172.21.15.19:0/4147121388 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1970004030 con 0x7f1978144840 2024-03-08T06:03:44.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.292+0000 7f1980200640 1 -- 172.21.15.19:0/4147121388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197815e900 con 0x7f1978144840 2024-03-08T06:03:44.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.292+0000 7f1980200640 1 -- 172.21.15.19:0/4147121388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197815eec0 con 0x7f1978144840 2024-03-08T06:03:44.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.293+0000 7f1980200640 1 -- 172.21.15.19:0/4147121388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f197815f1f0 con 0x7f1978144840 2024-03-08T06:03:44.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.294+0000 7f1975600640 1 -- 172.21.15.19:0/4147121388 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f197001d070 con 0x7f1978144840 2024-03-08T06:03:44.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.295+0000 7f1975600640 1 --2- 172.21.15.19:0/4147121388 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f195806b4d0 0x7f195806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:44.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.295+0000 7f1975600640 1 -- 172.21.15.19:0/4147121388 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f197008a5a0 con 0x7f1978144840 2024-03-08T06:03:44.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.295+0000 7f197d800640 1 --2- 172.21.15.19:0/4147121388 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f195806b4d0 0x7f195806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:44.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.296+0000 7f197d800640 1 --2- 172.21.15.19:0/4147121388 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f195806b4d0 0x7f195806d990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f196c036000 tx=0x7f196c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:44.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.300+0000 7f1975600640 1 -- 172.21.15.19:0/4147121388 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1970010070 con 0x7f1978144840 2024-03-08T06:03:44.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.536+0000 7f1980200640 1 -- 172.21.15.19:0/4147121388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1978067cb0 con 0x7f1978144840 2024-03-08T06:03:44.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.537+0000 7f1975600640 1 -- 172.21.15.19:0/4147121388 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1970059380 con 0x7f1978144840 2024-03-08T06:03:44.538 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-08T06:03:44.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.540+0000 7f1980200640 1 -- 172.21.15.19:0/4147121388 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f195806b4d0 msgr2=0x7f195806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:44.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.540+0000 7f1980200640 1 --2- 172.21.15.19:0/4147121388 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f195806b4d0 0x7f195806d990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f196c036000 tx=0x7f196c03c040 comp rx=0 tx=0).stop 2024-03-08T06:03:44.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.540+0000 7f1980200640 1 -- 172.21.15.19:0/4147121388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1978144840 msgr2=0x7f1978142f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:44.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.540+0000 7f1980200640 1 --2- 172.21.15.19:0/4147121388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1978144840 0x7f1978142f10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1970007e10 tx=0x7f197000d4a0 comp rx=0 tx=0).stop 2024-03-08T06:03:44.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.540+0000 7f1980200640 1 -- 172.21.15.19:0/4147121388 shutdown_connections 2024-03-08T06:03:44.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.540+0000 7f1980200640 1 --2- 172.21.15.19:0/4147121388 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f195806b4d0 0x7f195806d990 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:44.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.540+0000 7f1980200640 1 --2- 172.21.15.19:0/4147121388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1978144840 0x7f1978142f10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:44.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.540+0000 7f1980200640 1 --2- 172.21.15.19:0/4147121388 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1978071600 0x7f19780a9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:44.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.540+0000 7f1980200640 1 --2- 172.21.15.19:0/4147121388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f197806eb30 0x7f19781f4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:44.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.540+0000 7f1980200640 1 -- 172.21.15.19:0/4147121388 >> 172.21.15.19:0/4147121388 conn(0x7f197806ac50 msgr2=0x7f197813f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:44.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.540+0000 7f1980200640 1 -- 172.21.15.19:0/4147121388 shutdown_connections 2024-03-08T06:03:44.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:44.540+0000 7f1980200640 1 -- 172.21.15.19:0/4147121388 wait complete. 2024-03-08T06:03:44.561 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-08T06:03:44.561 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-08T06:03:44.561 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-03-08T06:03:44.561 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-08T06:03:44.561 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-08T06:03:44.561 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-08T06:03:44.561 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-08T06:03:44.561 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-08T06:03:44.561 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-08T06:03:44.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:44.562 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-03-08T06:03:44.621 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-08T06:03:44.621 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-08T06:03:44.622 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-03-08T06:03:44.622 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:44.622 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-03-08T06:03:44.622 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:44.622 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T06:03:44.622 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-03-08T06:03:44.622 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-03-08T06:03:44.622 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T06:03:44.622 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-03-08T06:03:44.622 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-03-08T06:03:44.622 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-08T06:03:44.622 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-03-08T06:03:44.622 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-03-08T06:03:44.623 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-08T06:03:44.623 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42549sec preferred_lft 42549sec 2024-03-08T06:03:44.623 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link noprefixroute 2024-03-08T06:03:44.623 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:44.623 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T06:03:44.623 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-03-08T06:03:44.623 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-03-08T06:03:44.624 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-08T06:03:44.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:44.624 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2024-03-08T06:03:44.624 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-03-08T06:03:44.624 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add name ceph-brx type bridge 2024-03-08T06:03:44.624 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr flush dev ceph-brx 2024-03-08T06:03:44.624 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set ceph-brx up 2024-03-08T06:03:44.624 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-08T06:03:44.624 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-03-08T06:03:45.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:45.088 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-08T06:03:45.175 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-03-08T06:03:45.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:45.179 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-03-08T06:03:45.233 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-03-08T06:03:45.233 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-08T06:03:45.233 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-08T06:03:45.233 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-08T06:03:45.233 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-08T06:03:45.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:45.234 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2024-03-08T06:03:45.234 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-03-08T06:03:45.234 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-08T06:03:45.234 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-08T06:03:45.234 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-08T06:03:45.234 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-03-08T06:03:46.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:46.080 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-03-08T06:03:46.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:46.137 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list-id 2024-03-08T06:03:46.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:46.188 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2024-03-08T06:03:46.188 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-03-08T06:03:46.188 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-08T06:03:46.188 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-08T06:03:46.188 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-03-08T06:03:46.235 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T06:03:46.242 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T06:03:46.325 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-08T06:03:46.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:46.325 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2024-03-08T06:03:46.325 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-03-08T06:03:46.325 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-08T06:03:46.325 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-08T06:03:46.326 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-08T06:03:46.326 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-08T06:03:46.326 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-08T06:03:46.326 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-03-08T06:03:46.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:46.644 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2024-03-08T06:03:46.644 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-03-08T06:03:46.644 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-03-08T06:03:46.644 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set dev brx.0 master ceph-brx 2024-03-08T06:03:46.645 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-03-08T06:03:46.819 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T06:03:46.819 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-08T06:03:46.868 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-08T06:03:46.868 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T06:03:46.869 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-08T06:03:46.917 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-03-08T06:03:46.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:46.917 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T06:03:47.050 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T06:03:47.051 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-08T06:03:47.694 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T06:03:47.694 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-08T06:03:47.694 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.42:3300,172.21.15.42:3301" 2024-03-08T06:03:47.694 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with new device syntax: 1@d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd.cephfs=/ 2024-03-08T06:03:47.695 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.19:3300/172.21.15.42:3300/172.21.15.42:3301" will pass to kernel 2024-03-08T06:03:47.698 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-03-08T06:03:47.698 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-03-08T06:03:47.698 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-08T06:03:47.698 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-03-08T06:03:47.699 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-08T06:03:47.704 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-08T06:03:47.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:47.704 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-08T06:03:47.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:47.803 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-08T06:03:47.861 INFO:teuthology.orchestra.run.smithi042.stdout:client4641 2024-03-08T06:03:47.861 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:03:47.861 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:03:47.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:47.915 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-08T06:03:47.973 INFO:teuthology.orchestra.run.smithi042.stdout:client4641 2024-03-08T06:03:47.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:47.973 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-08T06:03:48.034 INFO:teuthology.orchestra.run.smithi042.stdout:client4641 2024-03-08T06:03:48.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:48.034 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd.client4641/status') 2024-03-08T06:03:48.131 INFO:teuthology.orchestra.run.smithi042.stdout:instance: client.4641 (3)172.21.15.42:0/772050363 2024-03-08T06:03:48.131 INFO:teuthology.orchestra.run.smithi042.stdout:blocklisted: false 2024-03-08T06:03:48.131 INFO:teuthology.orchestra.run.smithi042.stderr:0+1 records in 2024-03-08T06:03:48.131 INFO:teuthology.orchestra.run.smithi042.stderr:0+1 records out 2024-03-08T06:03:48.131 INFO:teuthology.orchestra.run.smithi042.stderr:69 bytes copied, 9.8008e-05 s, 704 kB/s 2024-03-08T06:03:48.135 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-03-08T06:03:48.135 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-08T06:03:48.136 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-08T06:03:48.136 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-08T06:03:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.356+0000 7f866a200640 1 Processor -- start 2024-03-08T06:03:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.356+0000 7f866a200640 1 -- start start 2024-03-08T06:03:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.358+0000 7f866a200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f866415bea0 0x7f866415d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.358+0000 7f866a200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8664071df0 0x7f866406d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.358+0000 7f866a200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866415ceb0 con 0x7f8664145520 2024-03-08T06:03:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.358+0000 7f866a200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866415c330 con 0x7f8664071df0 2024-03-08T06:03:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.358+0000 7f866a200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866415c610 con 0x7f866415bea0 2024-03-08T06:03:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.359+0000 7f865be00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f866415bea0 0x7f866415d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.359+0000 7f8668e00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f8664145520 0x7f86640716e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.19:47928/0 (socket says 172.21.15.19:47928) 2024-03-08T06:03:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.359+0000 7f8668e00640 1 -- 172.21.15.19:0/2959039095 learned_addr learned my addr 172.21.15.19:0/2959039095 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.359+0000 7f8669800640 1 --2- 172.21.15.19:0/2959039095 >> v2:172.21.15.42:3300/0 conn(0x7f8664071df0 0x7f866406d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:48.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.360+0000 7f865be00640 1 -- 172.21.15.19:0/2959039095 >> v2:172.21.15.42:3300/0 conn(0x7f8664071df0 msgr2=0x7f866406d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:48.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.360+0000 7f865be00640 1 --2- 172.21.15.19:0/2959039095 >> v2:172.21.15.42:3300/0 conn(0x7f8664071df0 0x7f866406d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.360+0000 7f865be00640 1 -- 172.21.15.19:0/2959039095 >> v1:172.21.15.42:6789/0 conn(0x7f8664145520 legacy=0x7f86640716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.360+0000 7f865be00640 1 -- 172.21.15.19:0/2959039095 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866415c8f0 con 0x7f866415bea0 2024-03-08T06:03:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.360+0000 7f8669800640 1 --2- 172.21.15.19:0/2959039095 >> v2:172.21.15.42:3300/0 conn(0x7f8664071df0 0x7f866406d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T06:03:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.362+0000 7f865be00640 1 --2- 172.21.15.19:0/2959039095 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f866415bea0 0x7f866415d0a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f864c0097a0 tx=0x7f864c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d91dafa7f37b2dc2 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.363+0000 7f8663e00640 1 -- 172.21.15.19:0/2959039095 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c035020 con 0x7f866415bea0 2024-03-08T06:03:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.363+0000 7f8663e00640 1 -- 172.21.15.19:0/2959039095 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c031830 con 0x7f866415bea0 2024-03-08T06:03:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.363+0000 7f8663e00640 1 -- 172.21.15.19:0/2959039095 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c031c00 con 0x7f866415bea0 2024-03-08T06:03:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.363+0000 7f866a200640 1 -- 172.21.15.19:0/2959039095 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f866415bea0 msgr2=0x7f866415d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.363+0000 7f866a200640 1 --2- 172.21.15.19:0/2959039095 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f866415bea0 0x7f866415d0a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f864c0097a0 tx=0x7f864c02b8d0 comp rx=0 tx=0).stop 2024-03-08T06:03:48.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.363+0000 7f866a200640 1 -- 172.21.15.19:0/2959039095 shutdown_connections 2024-03-08T06:03:48.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.363+0000 7f866a200640 1 --2- 172.21.15.19:0/2959039095 >> v2:172.21.15.42:3300/0 conn(0x7f8664071df0 0x7f866406d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:48.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.363+0000 7f866a200640 1 --2- 172.21.15.19:0/2959039095 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f866415bea0 0x7f866415d0a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:48.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.363+0000 7f866a200640 1 -- 172.21.15.19:0/2959039095 >> 172.21.15.19:0/2959039095 conn(0x7f86640b1850 msgr2=0x7f86640b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:48.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.364+0000 7f866a200640 1 -- 172.21.15.19:0/2959039095 shutdown_connections 2024-03-08T06:03:48.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.364+0000 7f866a200640 1 -- 172.21.15.19:0/2959039095 wait complete. 2024-03-08T06:03:48.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.365+0000 7f866a200640 1 Processor -- start 2024-03-08T06:03:48.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.366+0000 7f866a200640 1 -- start start 2024-03-08T06:03:48.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.366+0000 7f866a200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8664071df0 0x7f86641f3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:48.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.366+0000 7f866a200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8664145520 0x7f86641531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:48.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.367+0000 7f866a200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f866415b140 0x7f866413c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:48.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.367+0000 7f866a200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86640af1c0 con 0x7f8664145520 2024-03-08T06:03:48.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.367+0000 7f866a200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86640af040 con 0x7f8664071df0 2024-03-08T06:03:48.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.367+0000 7f866a200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866406e410 con 0x7f866415b140 2024-03-08T06:03:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.367+0000 7f865be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8664145520 0x7f86641531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.367+0000 7f865be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8664145520 0x7f86641531e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44766/0 (socket says 172.21.15.19:44766) 2024-03-08T06:03:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.367+0000 7f865be00640 1 -- 172.21.15.19:0/3283825411 learned_addr learned my addr 172.21.15.19:0/3283825411 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.367+0000 7f8668e00640 1 --2- 172.21.15.19:0/3283825411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8664071df0 0x7f86641f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.367+0000 7f865be00640 1 -- 172.21.15.19:0/3283825411 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f866415b140 msgr2=0x7f866413c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.367+0000 7f865be00640 1 --2- 172.21.15.19:0/3283825411 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f866415b140 0x7f866413c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.367+0000 7f865be00640 1 -- 172.21.15.19:0/3283825411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8664071df0 msgr2=0x7f86641f3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.367+0000 7f865be00640 1 --2- 172.21.15.19:0/3283825411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8664071df0 0x7f86641f3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.367+0000 7f865be00640 1 -- 172.21.15.19:0/3283825411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8664153720 con 0x7f8664145520 2024-03-08T06:03:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.367+0000 7f8668e00640 1 --2- 172.21.15.19:0/3283825411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8664071df0 0x7f86641f3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:48.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.368+0000 7f865be00640 1 --2- 172.21.15.19:0/3283825411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8664145520 0x7f86641531e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f864c034040 tx=0x7f864c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:48.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.368+0000 7f8661600640 1 -- 172.21.15.19:0/3283825411 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c040070 con 0x7f8664145520 2024-03-08T06:03:48.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.368+0000 7f8661600640 1 -- 172.21.15.19:0/3283825411 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c03a910 con 0x7f8664145520 2024-03-08T06:03:48.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.368+0000 7f866a200640 1 -- 172.21.15.19:0/3283825411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86640b3030 con 0x7f8664145520 2024-03-08T06:03:48.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.368+0000 7f8661600640 1 -- 172.21.15.19:0/3283825411 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c035040 con 0x7f8664145520 2024-03-08T06:03:48.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.368+0000 7f866a200640 1 -- 172.21.15.19:0/3283825411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86640b35f0 con 0x7f8664145520 2024-03-08T06:03:48.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.369+0000 7f866a200640 1 -- 172.21.15.19:0/3283825411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8664075100 con 0x7f8664145520 2024-03-08T06:03:48.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.370+0000 7f8661600640 1 -- 172.21.15.19:0/3283825411 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f864c038020 con 0x7f8664145520 2024-03-08T06:03:48.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.371+0000 7f8661600640 1 --2- 172.21.15.19:0/3283825411 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f864006b4d0 0x7f864006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:48.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.371+0000 7f8661600640 1 -- 172.21.15.19:0/3283825411 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f864c0abc90 con 0x7f8664145520 2024-03-08T06:03:48.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.372+0000 7f8668e00640 1 --2- 172.21.15.19:0/3283825411 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f864006b4d0 0x7f864006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:48.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.372+0000 7f8668e00640 1 --2- 172.21.15.19:0/3283825411 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f864006b4d0 0x7f864006d990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f86540012e0 tx=0x7f8654009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.376+0000 7f8661600640 1 -- 172.21.15.19:0/3283825411 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f864c031800 con 0x7f8664145520 2024-03-08T06:03:48.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.609+0000 7f866a200640 1 -- 172.21.15.19:0/3283825411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8664071750 con 0x7f8664145520 2024-03-08T06:03:48.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.610+0000 7f8661600640 1 -- 172.21.15.19:0/3283825411 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f864c07ab00 con 0x7f8664145520 2024-03-08T06:03:48.611 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-08T06:03:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.613+0000 7f866a200640 1 -- 172.21.15.19:0/3283825411 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f864006b4d0 msgr2=0x7f864006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.613+0000 7f866a200640 1 --2- 172.21.15.19:0/3283825411 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f864006b4d0 0x7f864006d990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f86540012e0 tx=0x7f8654009040 comp rx=0 tx=0).stop 2024-03-08T06:03:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.613+0000 7f866a200640 1 -- 172.21.15.19:0/3283825411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8664145520 msgr2=0x7f86641531e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.613+0000 7f866a200640 1 --2- 172.21.15.19:0/3283825411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8664145520 0x7f86641531e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f864c034040 tx=0x7f864c0046c0 comp rx=0 tx=0).stop 2024-03-08T06:03:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.613+0000 7f866a200640 1 -- 172.21.15.19:0/3283825411 shutdown_connections 2024-03-08T06:03:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.613+0000 7f866a200640 1 --2- 172.21.15.19:0/3283825411 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f864006b4d0 0x7f864006d990 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.613+0000 7f866a200640 1 --2- 172.21.15.19:0/3283825411 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f866415b140 0x7f866413c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.613+0000 7f866a200640 1 --2- 172.21.15.19:0/3283825411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8664145520 0x7f86641531e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.613+0000 7f866a200640 1 --2- 172.21.15.19:0/3283825411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8664071df0 0x7f86641f3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.613+0000 7f866a200640 1 -- 172.21.15.19:0/3283825411 >> 172.21.15.19:0/3283825411 conn(0x7f86640b1850 msgr2=0x7f8664140800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.613+0000 7f866a200640 1 -- 172.21.15.19:0/3283825411 shutdown_connections 2024-03-08T06:03:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:48.613+0000 7f866a200640 1 -- 172.21.15.19:0/3283825411 wait complete. 2024-03-08T06:03:48.632 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-08T06:03:48.632 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-08T06:03:48.632 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-03-08T06:03:48.632 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-03-08T06:03:48.632 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-08T06:03:48.632 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-08T06:03:48.632 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-08T06:03:48.632 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-08T06:03:48.632 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-03-08T06:03:48.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:48.633 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-03-08T06:03:48.693 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-08T06:03:48.693 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-08T06:03:48.693 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-03-08T06:03:48.693 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:48.693 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-03-08T06:03:48.693 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:48.693 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T06:03:48.693 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-03-08T06:03:48.693 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-03-08T06:03:48.693 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T06:03:48.694 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-03-08T06:03:48.694 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-03-08T06:03:48.694 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-08T06:03:48.694 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-03-08T06:03:48.694 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-03-08T06:03:48.694 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-08T06:03:48.694 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42545sec preferred_lft 42545sec 2024-03-08T06:03:48.694 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link noprefixroute 2024-03-08T06:03:48.694 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:48.694 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T06:03:48.694 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-03-08T06:03:48.695 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-03-08T06:03:48.695 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-08T06:03:48.695 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 1e:35:4a:d3:ff:30 brd ff:ff:ff:ff:ff:ff 2024-03-08T06:03:48.695 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-08T06:03:48.695 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:48.695 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::d861:66ff:feb9:1384/64 scope link 2024-03-08T06:03:48.695 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:48.695 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-08T06:03:48.695 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 1e:35:4a:d3:ff:30 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-08T06:03:48.695 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::1c35:4aff:fed3:ff30/64 scope link 2024-03-08T06:03:48.695 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:48.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:48.696 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-08T06:03:48.789 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-03-08T06:03:48.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:48.793 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-03-08T06:03:48.847 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-03-08T06:03:48.847 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-08T06:03:48.847 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-08T06:03:48.847 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-08T06:03:48.847 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-08T06:03:48.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:48.848 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2024-03-08T06:03:48.848 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-03-08T06:03:48.848 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-08T06:03:48.848 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-08T06:03:48.848 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-08T06:03:48.848 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-03-08T06:03:49.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:49.028 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-03-08T06:03:49.080 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-08T06:03:49.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:49.082 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list-id 2024-03-08T06:03:49.133 INFO:teuthology.orchestra.run.smithi042.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-03-08T06:03:49.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:49.134 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2024-03-08T06:03:49.134 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-03-08T06:03:49.134 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-08T06:03:49.134 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-03-08T06:03:49.134 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-03-08T06:03:49.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:49.282 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-08T06:03:49.369 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-08T06:03:49.369 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-08T06:03:49.369 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-03-08T06:03:49.369 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:49.370 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-03-08T06:03:49.370 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:49.370 INFO:teuthology.orchestra.run.smithi042.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-08T06:03:49.370 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether b2:cb:93:98:3e:42 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-08T06:03:49.370 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-08T06:03:49.370 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:49.370 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::b0cb:93ff:fe98:3e42/64 scope link 2024-03-08T06:03:49.370 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:49.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:49.374 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-08T06:03:49.475 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-08T06:03:49.475 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-08T06:03:49.475 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-03-08T06:03:49.475 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:49.475 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-03-08T06:03:49.475 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:49.475 INFO:teuthology.orchestra.run.smithi042.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-08T06:03:49.475 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether b2:cb:93:98:3e:42 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-08T06:03:49.475 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-08T06:03:49.475 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:49.476 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::b0cb:93ff:fe98:3e42/64 scope link 2024-03-08T06:03:49.476 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:03:49.481 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-03-08T06:03:49.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:49.481 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2024-03-08T06:03:49.481 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-03-08T06:03:49.481 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-03-08T06:03:49.481 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-08T06:03:49.481 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-03-08T06:03:49.482 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-03-08T06:03:49.482 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-03-08T06:03:49.482 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-03-08T06:03:49.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:49.763 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2024-03-08T06:03:49.764 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-03-08T06:03:49.764 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.1 up 2024-03-08T06:03:49.764 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set dev brx.1 master ceph-brx 2024-03-08T06:03:49.764 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-03-08T06:03:49.939 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T06:03:49.940 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-03-08T06:03:49.993 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-03-08T06:03:49.993 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T06:03:49.993 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-03-08T06:03:50.044 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-03-08T06:03:50.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:50.044 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T06:03:50.191 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T06:03:50.191 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-08T06:03:50.226 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T06:03:50.226 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-08T06:03:50.227 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.42:3300,172.21.15.42:3301" 2024-03-08T06:03:50.227 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with new device syntax: 3@d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd.cephfs=/ 2024-03-08T06:03:50.227 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.19:3300/172.21.15.42:3300/172.21.15.42:3301" will pass to kernel 2024-03-08T06:03:50.229 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-03-08T06:03:50.229 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-03-08T06:03:50.229 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-08T06:03:50.229 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-03-08T06:03:50.230 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-08T06:03:50.235 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-08T06:03:50.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:50.235 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-03-08T06:03:50.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:50.328 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-08T06:03:50.388 INFO:teuthology.orchestra.run.smithi042.stdout:client4647 2024-03-08T06:03:50.388 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:03:50.388 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:03:50.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:50.445 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-08T06:03:50.504 INFO:teuthology.orchestra.run.smithi042.stdout:client4647 2024-03-08T06:03:50.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:50.505 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-08T06:03:50.567 INFO:teuthology.orchestra.run.smithi042.stdout:client4647 2024-03-08T06:03:50.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:03:50.568 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd.client4647/status') 2024-03-08T06:03:50.665 INFO:teuthology.orchestra.run.smithi042.stdout:instance: client.4647 (3)172.21.15.42:0/4270012826 2024-03-08T06:03:50.666 INFO:teuthology.orchestra.run.smithi042.stdout:blocklisted: false 2024-03-08T06:03:50.666 INFO:teuthology.orchestra.run.smithi042.stderr:0+1 records in 2024-03-08T06:03:50.666 INFO:teuthology.orchestra.run.smithi042.stderr:0+1 records out 2024-03-08T06:03:50.666 INFO:teuthology.orchestra.run.smithi042.stderr:70 bytes copied, 6.9575e-05 s, 1.0 MB/s 2024-03-08T06:03:50.670 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-08T06:03:50.687 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:03:50.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.912+0000 7ff573200640 1 Processor -- start 2024-03-08T06:03:50.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.912+0000 7ff573200640 1 -- start start 2024-03-08T06:03:50.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.913+0000 7ff573200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff56c15dd20 0x7ff56c0cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:50.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.913+0000 7ff573200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff56c0b5dc0 0x7ff56c0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:50.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.913+0000 7ff573200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56c15e100 con 0x7ff56c0d1800 2024-03-08T06:03:50.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.913+0000 7ff573200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56c0d3a60 con 0x7ff56c15dd20 2024-03-08T06:03:50.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.913+0000 7ff573200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0d35d0 con 0x7ff56c0b5dc0 2024-03-08T06:03:50.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.914+0000 7ff56b400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff56c0d1800 0x7ff56c0b56b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33518/0 (socket says 172.21.15.19:33518) 2024-03-08T06:03:50.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.914+0000 7ff56b400640 1 -- 172.21.15.19:0/2328422420 learned_addr learned my addr 172.21.15.19:0/2328422420 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:50.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.914+0000 7ff56be00640 1 --2- 172.21.15.19:0/2328422420 >> v2:172.21.15.42:3300/0 conn(0x7ff56c15dd20 0x7ff56c0cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:50.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.914+0000 7ff56aa00640 1 -- 172.21.15.19:0/2328422420 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566156740 0 0) 0x7ff56c15e100 con 0x7ff56c0d1800 2024-03-08T06:03:50.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.914+0000 7ff56aa00640 1 -- 172.21.15.19:0/2328422420 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff550003520 con 0x7ff56c0d1800 2024-03-08T06:03:50.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.914+0000 7ff571200640 1 --2- 172.21.15.19:0/2328422420 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff56c0b5dc0 0x7ff56c0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:50.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.915+0000 7ff56aa00640 1 -- 172.21.15.19:0/2328422420 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1113210102 0 0) 0x7ff550003520 con 0x7ff56c0d1800 2024-03-08T06:03:50.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.915+0000 7ff56aa00640 1 -- 172.21.15.19:0/2328422420 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff56c0b5dc0 msgr2=0x7ff56c0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:50.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.915+0000 7ff56aa00640 1 --2- 172.21.15.19:0/2328422420 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff56c0b5dc0 0x7ff56c0b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.915+0000 7ff56aa00640 1 -- 172.21.15.19:0/2328422420 >> v2:172.21.15.42:3300/0 conn(0x7ff56c15dd20 msgr2=0x7ff56c0cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.915+0000 7ff56aa00640 1 --2- 172.21.15.19:0/2328422420 >> v2:172.21.15.42:3300/0 conn(0x7ff56c15dd20 0x7ff56c0cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.915+0000 7ff56aa00640 1 -- 172.21.15.19:0/2328422420 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c0d29c0 con 0x7ff56c0d1800 2024-03-08T06:03:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.915+0000 7ff56aa00640 1 -- 172.21.15.19:0/2328422420 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7ff554001670 con 0x7ff56c0d1800 2024-03-08T06:03:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.915+0000 7ff56aa00640 1 -- 172.21.15.19:0/2328422420 >> v1:172.21.15.19:6789/0 conn(0x7ff56c0d1800 legacy=0x7ff56c0b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.915+0000 7ff56aa00640 1 --2- 172.21.15.19:0/2328422420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5500039b0 0x7ff550003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.915+0000 7ff56aa00640 1 --2- 172.21.15.19:0/2328422420 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff550004800 0x7ff550004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.915+0000 7ff56aa00640 1 --2- 172.21.15.19:0/2328422420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5500051c0 0x7ff55000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.915+0000 7ff56aa00640 1 -- 172.21.15.19:0/2328422420 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0d3a60 con 0x7ff5500039b0 2024-03-08T06:03:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.915+0000 7ff56aa00640 1 -- 172.21.15.19:0/2328422420 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0d35d0 con 0x7ff5500051c0 2024-03-08T06:03:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.915+0000 7ff56aa00640 1 -- 172.21.15.19:0/2328422420 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff55000bf80 con 0x7ff550004800 2024-03-08T06:03:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.915+0000 7ff571200640 1 --2- 172.21.15.19:0/2328422420 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff56c0b5dc0 0x7ff56c0b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:03:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.915+0000 7ff56be00640 1 --2- 172.21.15.19:0/2328422420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5500039b0 0x7ff550003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.916+0000 7ff56b400640 1 --2- 172.21.15.19:0/2328422420 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff550004800 0x7ff550004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:50.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.916+0000 7ff571200640 1 --2- 172.21.15.19:0/2328422420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5500051c0 0x7ff55000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:50.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.916+0000 7ff56be00640 1 -- 172.21.15.19:0/2328422420 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff550004800 msgr2=0x7ff550004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:50.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.916+0000 7ff56be00640 1 --2- 172.21.15.19:0/2328422420 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff550004800 0x7ff550004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:50.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.916+0000 7ff56be00640 1 -- 172.21.15.19:0/2328422420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5500051c0 msgr2=0x7ff55000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:50.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.916+0000 7ff56be00640 1 --2- 172.21.15.19:0/2328422420 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5500051c0 0x7ff55000b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:50.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.916+0000 7ff56be00640 1 -- 172.21.15.19:0/2328422420 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff550003520 con 0x7ff5500039b0 2024-03-08T06:03:50.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.916+0000 7ff56b400640 1 --2- 172.21.15.19:0/2328422420 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff550004800 0x7ff550004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:50.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.917+0000 7ff56be00640 1 --2- 172.21.15.19:0/2328422420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5500039b0 0x7ff550003dd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009ac0 tx=0x7ff550005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d180b2196b96a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:50.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.917+0000 7ff56aa00640 1 -- 172.21.15.19:0/2328422420 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c039070 con 0x7ff5500039b0 2024-03-08T06:03:50.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.917+0000 7ff56aa00640 1 -- 172.21.15.19:0/2328422420 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c02c710 con 0x7ff5500039b0 2024-03-08T06:03:50.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.917+0000 7ff56aa00640 1 -- 172.21.15.19:0/2328422420 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c009690 con 0x7ff5500039b0 2024-03-08T06:03:50.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.918+0000 7ff573200640 1 -- 172.21.15.19:0/2328422420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5500039b0 msgr2=0x7ff550003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:50.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.918+0000 7ff573200640 1 --2- 172.21.15.19:0/2328422420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5500039b0 0x7ff550003dd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009ac0 tx=0x7ff550005830 comp rx=0 tx=0).stop 2024-03-08T06:03:50.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.918+0000 7ff571200640 1 -- 172.21.15.19:0/2328422420 reap_dead start 2024-03-08T06:03:50.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.918+0000 7ff573200640 1 -- 172.21.15.19:0/2328422420 shutdown_connections 2024-03-08T06:03:50.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.918+0000 7ff573200640 1 -- 172.21.15.19:0/2328422420 >> 172.21.15.19:0/2328422420 conn(0x7ff56c067240 msgr2=0x7ff56c0d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:50.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.918+0000 7ff573200640 1 -- 172.21.15.19:0/2328422420 shutdown_connections 2024-03-08T06:03:50.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.918+0000 7ff573200640 1 -- 172.21.15.19:0/2328422420 wait complete. 2024-03-08T06:03:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.920+0000 7ff573200640 1 Processor -- start 2024-03-08T06:03:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.920+0000 7ff573200640 1 -- start start 2024-03-08T06:03:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.921+0000 7ff573200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff5500039b0 0x7ff56c159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.921+0000 7ff573200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff56c15f940 0x7ff56c15ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.921+0000 7ff573200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff56c0cc230 0x7ff56c0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.921+0000 7ff573200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0d3260 con 0x7ff56c15f940 2024-03-08T06:03:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.921+0000 7ff573200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0d2f80 con 0x7ff56c0cc230 2024-03-08T06:03:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.921+0000 7ff573200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c0cf190 con 0x7ff5500039b0 2024-03-08T06:03:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.921+0000 7ff56b400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff56c15f940 0x7ff56c15ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.921+0000 7ff56b400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff56c15f940 0x7ff56c15ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44784/0 (socket says 172.21.15.19:44784) 2024-03-08T06:03:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.921+0000 7ff56b400640 1 -- 172.21.15.19:0/3395175350 learned_addr learned my addr 172.21.15.19:0/3395175350 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.921+0000 7ff56be00640 1 --2- 172.21.15.19:0/3395175350 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff5500039b0 0x7ff56c159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.922+0000 7ff571200640 1 --2- 172.21.15.19:0/3395175350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff56c0cc230 0x7ff56c0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:50.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.922+0000 7ff56b400640 1 -- 172.21.15.19:0/3395175350 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff5500039b0 msgr2=0x7ff56c159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.922+0000 7ff56b400640 1 --2- 172.21.15.19:0/3395175350 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff5500039b0 0x7ff56c159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.922+0000 7ff56b400640 1 -- 172.21.15.19:0/3395175350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff56c0cc230 msgr2=0x7ff56c0cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.922+0000 7ff56b400640 1 --2- 172.21.15.19:0/3395175350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff56c0cc230 0x7ff56c0cc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.922+0000 7ff56b400640 1 -- 172.21.15.19:0/3395175350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c15ff00 con 0x7ff56c15f940 2024-03-08T06:03:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.922+0000 7ff56b400640 1 --2- 172.21.15.19:0/3395175350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff56c15f940 0x7ff56c15ef50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff55400d8e0 tx=0x7ff55400dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.922+0000 7ff563e00640 1 -- 172.21.15.19:0/3395175350 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff554019070 con 0x7ff56c15f940 2024-03-08T06:03:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.922+0000 7ff563e00640 1 -- 172.21.15.19:0/3395175350 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5540074e0 con 0x7ff56c15f940 2024-03-08T06:03:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.922+0000 7ff563e00640 1 -- 172.21.15.19:0/3395175350 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff554004a20 con 0x7ff56c15f940 2024-03-08T06:03:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.922+0000 7ff573200640 1 -- 172.21.15.19:0/3395175350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56c1601e0 con 0x7ff56c15f940 2024-03-08T06:03:50.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.922+0000 7ff573200640 1 -- 172.21.15.19:0/3395175350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56c1607a0 con 0x7ff56c15f940 2024-03-08T06:03:50.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.923+0000 7ff573200640 1 -- 172.21.15.19:0/3395175350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56c067cb0 con 0x7ff56c15f940 2024-03-08T06:03:50.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.925+0000 7ff563e00640 1 -- 172.21.15.19:0/3395175350 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff55401c070 con 0x7ff56c15f940 2024-03-08T06:03:50.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.926+0000 7ff563e00640 1 --2- 172.21.15.19:0/3395175350 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff54806b520 0x7ff54806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:50.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.926+0000 7ff563e00640 1 -- 172.21.15.19:0/3395175350 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff554089c10 con 0x7ff56c15f940 2024-03-08T06:03:50.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.926+0000 7ff56be00640 1 --2- 172.21.15.19:0/3395175350 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff54806b520 0x7ff54806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:50.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.927+0000 7ff56be00640 1 --2- 172.21.15.19:0/3395175350 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff54806b520 0x7ff54806d9e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff55c036000 tx=0x7ff55c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:50.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:50.931+0000 7ff563e00640 1 -- 172.21.15.19:0/3395175350 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff5540585e0 con 0x7ff56c15f940 2024-03-08T06:03:51.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.126+0000 7ff573200640 1 -- 172.21.15.19:0/3395175350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff56c15b690 con 0x7ff56c15f940 2024-03-08T06:03:51.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.129+0000 7ff563e00640 1 -- 172.21.15.19:0/3395175350 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7ff55405c680 con 0x7ff56c15f940 2024-03-08T06:03:51.131 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:51.131 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:03:22.069498+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:03:18.392703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T06:03:19.537912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:03:51.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.132+0000 7ff573200640 1 -- 172.21.15.19:0/3395175350 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff54806b520 msgr2=0x7ff54806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:51.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.132+0000 7ff573200640 1 --2- 172.21.15.19:0/3395175350 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff54806b520 0x7ff54806d9e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff55c036000 tx=0x7ff55c030000 comp rx=0 tx=0).stop 2024-03-08T06:03:51.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.132+0000 7ff573200640 1 -- 172.21.15.19:0/3395175350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff56c15f940 msgr2=0x7ff56c15ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:51.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.132+0000 7ff573200640 1 --2- 172.21.15.19:0/3395175350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff56c15f940 0x7ff56c15ef50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff55400d8e0 tx=0x7ff55400dda0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.132+0000 7ff573200640 1 -- 172.21.15.19:0/3395175350 shutdown_connections 2024-03-08T06:03:51.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.132+0000 7ff573200640 1 --2- 172.21.15.19:0/3395175350 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff54806b520 0x7ff54806d9e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.132+0000 7ff573200640 1 --2- 172.21.15.19:0/3395175350 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff56c0cc230 0x7ff56c0cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.132+0000 7ff573200640 1 --2- 172.21.15.19:0/3395175350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff56c15f940 0x7ff56c15ef50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.132+0000 7ff573200640 1 --2- 172.21.15.19:0/3395175350 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff5500039b0 0x7ff56c159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.132+0000 7ff573200640 1 -- 172.21.15.19:0/3395175350 >> 172.21.15.19:0/3395175350 conn(0x7ff56c067240 msgr2=0x7ff56c0b55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:51.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.132+0000 7ff573200640 1 -- 172.21.15.19:0/3395175350 shutdown_connections 2024-03-08T06:03:51.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.132+0000 7ff573200640 1 -- 172.21.15.19:0/3395175350 wait complete. 2024-03-08T06:03:51.150 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T06:03:14.149736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T06:03:18.392703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T06:03:19.537912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T06:03:51.151 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T06:03:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.370+0000 7fcc23200640 1 Processor -- start 2024-03-08T06:03:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.371+0000 7fcc23200640 1 -- start start 2024-03-08T06:03:51.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.372+0000 7fcc23200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcc240cf030 0x7fcc24161930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:51.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.372+0000 7fcc23200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcc240b9630 0x7fcc240d25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:51.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.372+0000 7fcc23200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc2415e240 con 0x7fcc2415de60 2024-03-08T06:03:51.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.372+0000 7fcc23200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc240b9ac0 con 0x7fcc240cf030 2024-03-08T06:03:51.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.372+0000 7fcc23200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc24162030 con 0x7fcc240b9630 2024-03-08T06:03:51.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.373+0000 7fcc21400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcc240cf030 0x7fcc24161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:51.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.373+0000 7fcc21400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcc240cf030 0x7fcc24161930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44794/0 (socket says 172.21.15.19:44794) 2024-03-08T06:03:51.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.373+0000 7fcc21400640 1 -- 172.21.15.19:0/3948521470 learned_addr learned my addr 172.21.15.19:0/3948521470 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:51.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.373+0000 7fcc22800640 1 --2- 172.21.15.19:0/3948521470 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcc240b9630 0x7fcc240d25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.373+0000 7fcc21400640 1 -- 172.21.15.19:0/3948521470 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcc240b9630 msgr2=0x7fcc240d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.373+0000 7fcc21400640 1 --2- 172.21.15.19:0/3948521470 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcc240b9630 0x7fcc240d25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.373+0000 7fcc21400640 1 -- 172.21.15.19:0/3948521470 >> v1:172.21.15.42:6789/0 conn(0x7fcc2415de60 legacy=0x7fcc240ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.373+0000 7fcc21400640 1 -- 172.21.15.19:0/3948521470 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc24162310 con 0x7fcc240cf030 2024-03-08T06:03:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.374+0000 7fcc21400640 1 --2- 172.21.15.19:0/3948521470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc240cf030 0x7fcc24161930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c009e50 tx=0x7fcc0c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b651e36a9b34bd7 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.375+0000 7fcc20a00640 1 -- 172.21.15.19:0/3948521470 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c02ca70 con 0x7fcc240cf030 2024-03-08T06:03:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.375+0000 7fcc20a00640 1 -- 172.21.15.19:0/3948521470 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0c02cc10 con 0x7fcc240cf030 2024-03-08T06:03:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.375+0000 7fcc20a00640 1 -- 172.21.15.19:0/3948521470 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c0343f0 con 0x7fcc240cf030 2024-03-08T06:03:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.375+0000 7fcc23200640 1 -- 172.21.15.19:0/3948521470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc240cf030 msgr2=0x7fcc24161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.375+0000 7fcc23200640 1 --2- 172.21.15.19:0/3948521470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc240cf030 0x7fcc24161930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c009e50 tx=0x7fcc0c02bed0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.375+0000 7fcc23200640 1 -- 172.21.15.19:0/3948521470 shutdown_connections 2024-03-08T06:03:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.375+0000 7fcc23200640 1 --2- 172.21.15.19:0/3948521470 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcc240b9630 0x7fcc240d25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.375+0000 7fcc23200640 1 --2- 172.21.15.19:0/3948521470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc240cf030 0x7fcc24161930 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.375+0000 7fcc23200640 1 -- 172.21.15.19:0/3948521470 >> 172.21.15.19:0/3948521470 conn(0x7fcc2406c500 msgr2=0x7fcc2406c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.375+0000 7fcc23200640 1 -- 172.21.15.19:0/3948521470 shutdown_connections 2024-03-08T06:03:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.375+0000 7fcc23200640 1 -- 172.21.15.19:0/3948521470 wait complete. 2024-03-08T06:03:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.377+0000 7fcc23200640 1 Processor -- start 2024-03-08T06:03:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.377+0000 7fcc23200640 1 -- start start 2024-03-08T06:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.378+0000 7fcc23200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc240b9630 0x7fcc240b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.378+0000 7fcc23200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcc240cf030 0x7fcc24154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.378+0000 7fcc23200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc2415de60 0x7fcc24155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.378+0000 7fcc23200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc240d2b20 con 0x7fcc240b9630 2024-03-08T06:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.378+0000 7fcc23200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc240d20c0 con 0x7fcc2415de60 2024-03-08T06:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.378+0000 7fcc23200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc240d2ca0 con 0x7fcc240cf030 2024-03-08T06:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.379+0000 7fcc21e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc240b9630 0x7fcc240b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.379+0000 7fcc21e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc240b9630 0x7fcc240b5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44796/0 (socket says 172.21.15.19:44796) 2024-03-08T06:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.379+0000 7fcc21e00640 1 -- 172.21.15.19:0/47557281 learned_addr learned my addr 172.21.15.19:0/47557281 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.379+0000 7fcc21400640 1 --2- 172.21.15.19:0/47557281 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcc240cf030 0x7fcc24154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:51.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.379+0000 7fcc21e00640 1 -- 172.21.15.19:0/47557281 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcc240cf030 msgr2=0x7fcc24154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:51.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.379+0000 7fcc21e00640 1 --2- 172.21.15.19:0/47557281 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcc240cf030 0x7fcc24154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.379+0000 7fcc21e00640 1 -- 172.21.15.19:0/47557281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc2415de60 msgr2=0x7fcc24155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:51.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.379+0000 7fcc21e00640 1 --2- 172.21.15.19:0/47557281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc2415de60 0x7fcc24155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.379+0000 7fcc21e00640 1 -- 172.21.15.19:0/47557281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc240b4980 con 0x7fcc240b9630 2024-03-08T06:03:51.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.379+0000 7fcc21e00640 1 --2- 172.21.15.19:0/47557281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc240b9630 0x7fcc240b5980 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400b3f0 tx=0x7fcc1400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.380+0000 7fcc1a000640 1 -- 172.21.15.19:0/47557281 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc14015020 con 0x7fcc240b9630 2024-03-08T06:03:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.380+0000 7fcc1a000640 1 -- 172.21.15.19:0/47557281 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc14011830 con 0x7fcc240b9630 2024-03-08T06:03:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.380+0000 7fcc1a000640 1 -- 172.21.15.19:0/47557281 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc14011c20 con 0x7fcc240b9630 2024-03-08T06:03:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.380+0000 7fcc23200640 1 -- 172.21.15.19:0/47557281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc240c82c0 con 0x7fcc240b9630 2024-03-08T06:03:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.380+0000 7fcc23200640 1 -- 172.21.15.19:0/47557281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc240c8880 con 0x7fcc240b9630 2024-03-08T06:03:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.381+0000 7fcc23200640 1 -- 172.21.15.19:0/47557281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc24075090 con 0x7fcc240b9630 2024-03-08T06:03:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.382+0000 7fcc1a000640 1 -- 172.21.15.19:0/47557281 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcc14018020 con 0x7fcc240b9630 2024-03-08T06:03:51.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.383+0000 7fcc1a000640 1 --2- 172.21.15.19:0/47557281 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fcc0006b4d0 0x7fcc0006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:51.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.383+0000 7fcc1a000640 1 -- 172.21.15.19:0/47557281 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc14089eb0 con 0x7fcc240b9630 2024-03-08T06:03:51.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.383+0000 7fcc21400640 1 --2- 172.21.15.19:0/47557281 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fcc0006b4d0 0x7fcc0006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:51.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.384+0000 7fcc21400640 1 --2- 172.21.15.19:0/47557281 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fcc0006b4d0 0x7fcc0006d990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c035000 tx=0x7fcc0c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:51.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.387+0000 7fcc1a000640 1 -- 172.21.15.19:0/47557281 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcc1401f030 con 0x7fcc240b9630 2024-03-08T06:03:51.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.585+0000 7fcc23200640 1 -- 172.21.15.19:0/47557281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc240d17f0 con 0x7fcc240b9630 2024-03-08T06:03:51.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.586+0000 7fcc1a000640 1 -- 172.21.15.19:0/47557281 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc140172c0 con 0x7fcc240b9630 2024-03-08T06:03:51.587 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-08T06:03:51.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.589+0000 7fcc23200640 1 -- 172.21.15.19:0/47557281 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fcc0006b4d0 msgr2=0x7fcc0006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:51.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.589+0000 7fcc23200640 1 --2- 172.21.15.19:0/47557281 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fcc0006b4d0 0x7fcc0006d990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c035000 tx=0x7fcc0c030000 comp rx=0 tx=0).stop 2024-03-08T06:03:51.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.589+0000 7fcc23200640 1 -- 172.21.15.19:0/47557281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc240b9630 msgr2=0x7fcc240b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:51.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.589+0000 7fcc23200640 1 --2- 172.21.15.19:0/47557281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc240b9630 0x7fcc240b5980 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400b3f0 tx=0x7fcc1400b8b0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.589+0000 7fcc23200640 1 -- 172.21.15.19:0/47557281 shutdown_connections 2024-03-08T06:03:51.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.589+0000 7fcc23200640 1 --2- 172.21.15.19:0/47557281 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fcc0006b4d0 0x7fcc0006d990 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.589+0000 7fcc23200640 1 --2- 172.21.15.19:0/47557281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc2415de60 0x7fcc24155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.589+0000 7fcc23200640 1 --2- 172.21.15.19:0/47557281 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcc240cf030 0x7fcc24154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.589+0000 7fcc23200640 1 --2- 172.21.15.19:0/47557281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc240b9630 0x7fcc240b5980 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.589+0000 7fcc23200640 1 -- 172.21.15.19:0/47557281 >> 172.21.15.19:0/47557281 conn(0x7fcc2406c500 msgr2=0x7fcc24074580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:51.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.589+0000 7fcc23200640 1 -- 172.21.15.19:0/47557281 shutdown_connections 2024-03-08T06:03:51.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.589+0000 7fcc23200640 1 -- 172.21.15.19:0/47557281 wait complete. 2024-03-08T06:03:51.609 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T06:03:51.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.836+0000 7fe134a00640 1 Processor -- start 2024-03-08T06:03:51.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.836+0000 7fe134a00640 1 -- start start 2024-03-08T06:03:51.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.837+0000 7fe134a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe130145500 0x7fe13006ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:51.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.837+0000 7fe134a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe13015bfb0 0x7fe1300716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:51.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.837+0000 7fe134a00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13015c460 con 0x7fe130071c20 2024-03-08T06:03:51.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.837+0000 7fe134a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe130072050 con 0x7fe130145500 2024-03-08T06:03:51.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.837+0000 7fe134a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13015c740 con 0x7fe13015bfb0 2024-03-08T06:03:51.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.838+0000 7fe12e800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe130145500 0x7fe13006ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:51.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.838+0000 7fe12e800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe130145500 0x7fe13006ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44810/0 (socket says 172.21.15.19:44810) 2024-03-08T06:03:51.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.838+0000 7fe12e800640 1 -- 172.21.15.19:0/3836564425 learned_addr learned my addr 172.21.15.19:0/3836564425 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:51.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.838+0000 7fe12e800640 1 -- 172.21.15.19:0/3836564425 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe13015bfb0 msgr2=0x7fe1300716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:51.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.838+0000 7fe12e800640 1 --2- 172.21.15.19:0/3836564425 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe13015bfb0 0x7fe1300716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.838+0000 7fe12e800640 1 -- 172.21.15.19:0/3836564425 >> v1:172.21.15.42:6789/0 conn(0x7fe130071c20 legacy=0x7fe13006d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:51.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.838+0000 7fe12e800640 1 -- 172.21.15.19:0/3836564425 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13015ca20 con 0x7fe130145500 2024-03-08T06:03:51.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.839+0000 7fe12e800640 1 --2- 172.21.15.19:0/3836564425 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe130145500 0x7fe13006ecb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe120009870 tx=0x7fe12002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d488d15172d3598 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:51.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.840+0000 7fe12d400640 1 -- 172.21.15.19:0/3836564425 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1200317c0 con 0x7fe130145500 2024-03-08T06:03:51.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.840+0000 7fe12d400640 1 -- 172.21.15.19:0/3836564425 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe120037070 con 0x7fe130145500 2024-03-08T06:03:51.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.840+0000 7fe12d400640 1 -- 172.21.15.19:0/3836564425 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe120031b80 con 0x7fe130145500 2024-03-08T06:03:51.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.840+0000 7fe134a00640 1 -- 172.21.15.19:0/3836564425 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe130145500 msgr2=0x7fe13006ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:51.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.840+0000 7fe134a00640 1 --2- 172.21.15.19:0/3836564425 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe130145500 0x7fe13006ecb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe120009870 tx=0x7fe12002b860 comp rx=0 tx=0).stop 2024-03-08T06:03:51.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.841+0000 7fe134a00640 1 -- 172.21.15.19:0/3836564425 shutdown_connections 2024-03-08T06:03:51.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.841+0000 7fe134a00640 1 --2- 172.21.15.19:0/3836564425 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe13015bfb0 0x7fe1300716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.841+0000 7fe134a00640 1 --2- 172.21.15.19:0/3836564425 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe130145500 0x7fe13006ecb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.841+0000 7fe134a00640 1 -- 172.21.15.19:0/3836564425 >> 172.21.15.19:0/3836564425 conn(0x7fe1300b1850 msgr2=0x7fe1300b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:51.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.841+0000 7fe134a00640 1 -- 172.21.15.19:0/3836564425 shutdown_connections 2024-03-08T06:03:51.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.841+0000 7fe134a00640 1 -- 172.21.15.19:0/3836564425 wait complete. 2024-03-08T06:03:51.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.843+0000 7fe134a00640 1 Processor -- start 2024-03-08T06:03:51.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.843+0000 7fe134a00640 1 -- start start 2024-03-08T06:03:51.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.844+0000 7fe134a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe130071c20 0x7fe13015b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:51.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.844+0000 7fe134a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe130145500 0x7fe1301e5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:51.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.844+0000 7fe134a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe13015bfb0 0x7fe1301e5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:51.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.844+0000 7fe134a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13006f370 con 0x7fe13015bfb0 2024-03-08T06:03:51.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.844+0000 7fe134a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13006f1f0 con 0x7fe130145500 2024-03-08T06:03:51.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.844+0000 7fe134a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1300cd510 con 0x7fe130071c20 2024-03-08T06:03:51.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.844+0000 7fe12f200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe13015bfb0 0x7fe1301e5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:51.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.844+0000 7fe12f200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe13015bfb0 0x7fe1301e5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44812/0 (socket says 172.21.15.19:44812) 2024-03-08T06:03:51.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.844+0000 7fe12f200640 1 -- 172.21.15.19:0/348899203 learned_addr learned my addr 172.21.15.19:0/348899203 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:51.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.844+0000 7fe12de00640 1 --2- 172.21.15.19:0/348899203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe130145500 0x7fe1301e5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:51.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.844+0000 7fe12e800640 1 --2- 172.21.15.19:0/348899203 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe130071c20 0x7fe13015b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:51.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.845+0000 7fe12f200640 1 -- 172.21.15.19:0/348899203 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe130071c20 msgr2=0x7fe13015b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:51.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.845+0000 7fe12f200640 1 --2- 172.21.15.19:0/348899203 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe130071c20 0x7fe13015b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.845+0000 7fe12f200640 1 -- 172.21.15.19:0/348899203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe130145500 msgr2=0x7fe1301e5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:51.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.845+0000 7fe12f200640 1 --2- 172.21.15.19:0/348899203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe130145500 0x7fe1301e5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:51.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.845+0000 7fe12f200640 1 -- 172.21.15.19:0/348899203 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1301e9330 con 0x7fe13015bfb0 2024-03-08T06:03:51.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.845+0000 7fe12de00640 1 --2- 172.21.15.19:0/348899203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe130145500 0x7fe1301e5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:03:51.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.845+0000 7fe12f200640 1 --2- 172.21.15.19:0/348899203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe13015bfb0 0x7fe1301e5bb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe12800c7b0 tx=0x7fe12800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:51.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.846+0000 7fe126a00640 1 -- 172.21.15.19:0/348899203 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe128017070 con 0x7fe13015bfb0 2024-03-08T06:03:51.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.846+0000 7fe126a00640 1 -- 172.21.15.19:0/348899203 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe128003da0 con 0x7fe13015bfb0 2024-03-08T06:03:51.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.846+0000 7fe126a00640 1 -- 172.21.15.19:0/348899203 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1280052b0 con 0x7fe13015bfb0 2024-03-08T06:03:51.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.846+0000 7fe134a00640 1 -- 172.21.15.19:0/348899203 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1301e9610 con 0x7fe13015bfb0 2024-03-08T06:03:51.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.846+0000 7fe134a00640 1 -- 172.21.15.19:0/348899203 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1301e9bd0 con 0x7fe13015bfb0 2024-03-08T06:03:51.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.847+0000 7fe134a00640 1 -- 172.21.15.19:0/348899203 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe130075090 con 0x7fe13015bfb0 2024-03-08T06:03:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.848+0000 7fe126a00640 1 -- 172.21.15.19:0/348899203 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe12801a070 con 0x7fe13015bfb0 2024-03-08T06:03:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.849+0000 7fe126a00640 1 --2- 172.21.15.19:0/348899203 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe11006b500 0x7fe11006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.849+0000 7fe126a00640 1 -- 172.21.15.19:0/348899203 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe128089960 con 0x7fe13015bfb0 2024-03-08T06:03:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.849+0000 7fe12e800640 1 --2- 172.21.15.19:0/348899203 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe11006b500 0x7fe11006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.850+0000 7fe12e800640 1 --2- 172.21.15.19:0/348899203 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe11006b500 0x7fe11006d9c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe120036000 tx=0x7fe12003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:51.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:51.853+0000 7fe126a00640 1 -- 172.21.15.19:0/348899203 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe128058740 con 0x7fe13015bfb0 2024-03-08T06:03:52.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.051+0000 7fe134a00640 1 -- 172.21.15.19:0/348899203 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe1300b0430 con 0x7fe13015bfb0 2024-03-08T06:03:52.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.052+0000 7fe126a00640 1 -- 172.21.15.19:0/348899203 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe128058040 con 0x7fe13015bfb0 2024-03-08T06:03:52.053 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-08T06:03:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.055+0000 7fe134a00640 1 -- 172.21.15.19:0/348899203 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe11006b500 msgr2=0x7fe11006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.055+0000 7fe134a00640 1 --2- 172.21.15.19:0/348899203 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe11006b500 0x7fe11006d9c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe120036000 tx=0x7fe12003d040 comp rx=0 tx=0).stop 2024-03-08T06:03:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.055+0000 7fe134a00640 1 -- 172.21.15.19:0/348899203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe13015bfb0 msgr2=0x7fe1301e5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.055+0000 7fe134a00640 1 --2- 172.21.15.19:0/348899203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe13015bfb0 0x7fe1301e5bb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe12800c7b0 tx=0x7fe12800cc70 comp rx=0 tx=0).stop 2024-03-08T06:03:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.055+0000 7fe134a00640 1 -- 172.21.15.19:0/348899203 shutdown_connections 2024-03-08T06:03:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.055+0000 7fe134a00640 1 --2- 172.21.15.19:0/348899203 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe11006b500 0x7fe11006d9c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.055+0000 7fe134a00640 1 --2- 172.21.15.19:0/348899203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe13015bfb0 0x7fe1301e5bb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.055+0000 7fe134a00640 1 --2- 172.21.15.19:0/348899203 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe130145500 0x7fe1301e5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.055+0000 7fe134a00640 1 --2- 172.21.15.19:0/348899203 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe130071c20 0x7fe13015b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.055+0000 7fe134a00640 1 -- 172.21.15.19:0/348899203 >> 172.21.15.19:0/348899203 conn(0x7fe1300b1850 msgr2=0x7fe13006d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.055+0000 7fe134a00640 1 -- 172.21.15.19:0/348899203 shutdown_connections 2024-03-08T06:03:52.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.055+0000 7fe134a00640 1 -- 172.21.15.19:0/348899203 wait complete. 2024-03-08T06:03:52.075 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T06:03:52.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.286+0000 7f5da1e00640 1 Processor -- start 2024-03-08T06:03:52.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.286+0000 7f5da1e00640 1 -- start start 2024-03-08T06:03:52.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.287+0000 7f5da1e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5d9c071bc0 0x7f5d9c0cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:52.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.287+0000 7f5da1e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d9c15e760 0x7f5d9c144000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:52.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.287+0000 7f5da1e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d9c15ebc0 con 0x7f5d9c071fa0 2024-03-08T06:03:52.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.287+0000 7f5da1e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d9c15ee70 con 0x7f5d9c15e760 2024-03-08T06:03:52.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.287+0000 7f5da1e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d9c15f150 con 0x7f5d9c071bc0 2024-03-08T06:03:52.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.287+0000 7f5d9b400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d9c15e760 0x7f5d9c144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:52.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.288+0000 7f5d9b400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d9c15e760 0x7f5d9c144000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45542/0 (socket says 172.21.15.19:45542) 2024-03-08T06:03:52.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.288+0000 7f5d9b400640 1 -- 172.21.15.19:0/1810725466 learned_addr learned my addr 172.21.15.19:0/1810725466 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:52.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.288+0000 7f5d9aa00640 1 --2- 172.21.15.19:0/1810725466 >> v2:172.21.15.42:3300/0 conn(0x7f5d9c071bc0 0x7f5d9c0cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:52.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.288+0000 7f5d9b400640 1 -- 172.21.15.19:0/1810725466 >> v2:172.21.15.42:3300/0 conn(0x7f5d9c071bc0 msgr2=0x7f5d9c0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:52.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.288+0000 7f5d9b400640 1 --2- 172.21.15.19:0/1810725466 >> v2:172.21.15.42:3300/0 conn(0x7f5d9c071bc0 0x7f5d9c0cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.288+0000 7f5d9b400640 1 -- 172.21.15.19:0/1810725466 >> v1:172.21.15.42:6789/0 conn(0x7f5d9c071fa0 legacy=0x7f5d9c15b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:52.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.288+0000 7f5d9b400640 1 -- 172.21.15.19:0/1810725466 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9c15f430 con 0x7f5d9c15e760 2024-03-08T06:03:52.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.289+0000 7f5d9b400640 1 --2- 172.21.15.19:0/1810725466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9c15e760 0x7f5d9c144000 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c06fb90 tx=0x7f5d9402e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777a2e448f003019 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:52.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.290+0000 7f5d99600640 1 -- 172.21.15.19:0/1810725466 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9403b070 con 0x7f5d9c15e760 2024-03-08T06:03:52.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.290+0000 7f5d99600640 1 -- 172.21.15.19:0/1810725466 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9402ee00 con 0x7f5d9c15e760 2024-03-08T06:03:52.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.290+0000 7f5d99600640 1 -- 172.21.15.19:0/1810725466 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94036660 con 0x7f5d9c15e760 2024-03-08T06:03:52.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.290+0000 7f5da1e00640 1 -- 172.21.15.19:0/1810725466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9c15e760 msgr2=0x7f5d9c144000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:52.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.290+0000 7f5da1e00640 1 --2- 172.21.15.19:0/1810725466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9c15e760 0x7f5d9c144000 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c06fb90 tx=0x7f5d9402e050 comp rx=0 tx=0).stop 2024-03-08T06:03:52.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.290+0000 7f5da1e00640 1 -- 172.21.15.19:0/1810725466 shutdown_connections 2024-03-08T06:03:52.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.290+0000 7f5da1e00640 1 --2- 172.21.15.19:0/1810725466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9c15e760 0x7f5d9c144000 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.290+0000 7f5da1e00640 1 --2- 172.21.15.19:0/1810725466 >> v2:172.21.15.42:3300/0 conn(0x7f5d9c071bc0 0x7f5d9c0cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.290+0000 7f5da1e00640 1 -- 172.21.15.19:0/1810725466 >> 172.21.15.19:0/1810725466 conn(0x7f5d9c06ae30 msgr2=0x7f5d9c06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:52.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.290+0000 7f5da1e00640 1 -- 172.21.15.19:0/1810725466 shutdown_connections 2024-03-08T06:03:52.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.290+0000 7f5da1e00640 1 -- 172.21.15.19:0/1810725466 wait complete. 2024-03-08T06:03:52.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.292+0000 7f5da1e00640 1 Processor -- start 2024-03-08T06:03:52.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.292+0000 7f5da1e00640 1 -- start start 2024-03-08T06:03:52.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.293+0000 7f5da1e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d9c071bc0 0x7f5d9c13e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.293+0000 7f5da1e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5d9c071fa0 0x7f5d9c141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.293+0000 7f5da1e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9c15e760 0x7f5d9c1417a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.293+0000 7f5da1e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c1448d0 con 0x7f5d9c15e760 2024-03-08T06:03:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.293+0000 7f5da1e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c144750 con 0x7f5d9c071bc0 2024-03-08T06:03:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.293+0000 7f5da1e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c0b3fd0 con 0x7f5d9c071fa0 2024-03-08T06:03:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.294+0000 7f5d9b400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9c15e760 0x7f5d9c1417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.294+0000 7f5d9b400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9c15e760 0x7f5d9c1417a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45554/0 (socket says 172.21.15.19:45554) 2024-03-08T06:03:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.294+0000 7f5d9b400640 1 -- 172.21.15.19:0/3361256814 learned_addr learned my addr 172.21.15.19:0/3361256814 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.294+0000 7f5d9a000640 1 --2- 172.21.15.19:0/3361256814 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5d9c071fa0 0x7f5d9c141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.294+0000 7f5d9b400640 1 -- 172.21.15.19:0/3361256814 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5d9c071fa0 msgr2=0x7f5d9c141260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.294+0000 7f5d9aa00640 1 --2- 172.21.15.19:0/3361256814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d9c071bc0 0x7f5d9c13e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:52.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.294+0000 7f5d9b400640 1 --2- 172.21.15.19:0/3361256814 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5d9c071fa0 0x7f5d9c141260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.294+0000 7f5d9b400640 1 -- 172.21.15.19:0/3361256814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d9c071bc0 msgr2=0x7f5d9c13e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:52.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.294+0000 7f5d9b400640 1 --2- 172.21.15.19:0/3361256814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d9c071bc0 0x7f5d9c13e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.294+0000 7f5d9b400640 1 -- 172.21.15.19:0/3361256814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9c15a6e0 con 0x7f5d9c15e760 2024-03-08T06:03:52.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.294+0000 7f5d9a000640 1 --2- 172.21.15.19:0/3361256814 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5d9c071fa0 0x7f5d9c141260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:52.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.295+0000 7f5d9b400640 1 --2- 172.21.15.19:0/3361256814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9c15e760 0x7f5d9c1417a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400b2c0 tx=0x7f5d940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:52.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.295+0000 7f5d93400640 1 -- 172.21.15.19:0/3361256814 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94045070 con 0x7f5d9c15e760 2024-03-08T06:03:52.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.295+0000 7f5d93400640 1 -- 172.21.15.19:0/3361256814 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d94040670 con 0x7f5d9c15e760 2024-03-08T06:03:52.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.295+0000 7f5da1e00640 1 -- 172.21.15.19:0/3361256814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d9c15a9c0 con 0x7f5d9c15e760 2024-03-08T06:03:52.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.295+0000 7f5d93400640 1 -- 172.21.15.19:0/3361256814 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9403b040 con 0x7f5d9c15e760 2024-03-08T06:03:52.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.295+0000 7f5da1e00640 1 -- 172.21.15.19:0/3361256814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d9c13eaf0 con 0x7f5d9c15e760 2024-03-08T06:03:52.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.296+0000 7f5da1e00640 1 -- 172.21.15.19:0/3361256814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d9c067cb0 con 0x7f5d9c15e760 2024-03-08T06:03:52.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.297+0000 7f5d93400640 1 -- 172.21.15.19:0/3361256814 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5d94048070 con 0x7f5d9c15e760 2024-03-08T06:03:52.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.298+0000 7f5d93400640 1 --2- 172.21.15.19:0/3361256814 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5d7c06b4d0 0x7f5d7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:52.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.298+0000 7f5d93400640 1 -- 172.21.15.19:0/3361256814 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d9402ee00 con 0x7f5d9c15e760 2024-03-08T06:03:52.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.298+0000 7f5d9aa00640 1 --2- 172.21.15.19:0/3361256814 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5d7c06b4d0 0x7f5d7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:52.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.299+0000 7f5d9aa00640 1 --2- 172.21.15.19:0/3361256814 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5d7c06b4d0 0x7f5d7c06d990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c009f30 tx=0x7f5d8c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:52.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.303+0000 7f5d93400640 1 -- 172.21.15.19:0/3361256814 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5d9407d770 con 0x7f5d9c15e760 2024-03-08T06:03:52.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.500+0000 7f5da1e00640 1 -- 172.21.15.19:0/3361256814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d9c0af320 con 0x7f5d9c15e760 2024-03-08T06:03:52.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.500+0000 7f5d93400640 1 -- 172.21.15.19:0/3361256814 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d9407d070 con 0x7f5d9c15e760 2024-03-08T06:03:52.501 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-08T06:03:52.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.503+0000 7f5da1e00640 1 -- 172.21.15.19:0/3361256814 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5d7c06b4d0 msgr2=0x7f5d7c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:52.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.503+0000 7f5da1e00640 1 --2- 172.21.15.19:0/3361256814 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5d7c06b4d0 0x7f5d7c06d990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c009f30 tx=0x7f5d8c00b040 comp rx=0 tx=0).stop 2024-03-08T06:03:52.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.503+0000 7f5da1e00640 1 -- 172.21.15.19:0/3361256814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9c15e760 msgr2=0x7f5d9c1417a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:52.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.503+0000 7f5da1e00640 1 --2- 172.21.15.19:0/3361256814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9c15e760 0x7f5d9c1417a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400b2c0 tx=0x7f5d940046c0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.503+0000 7f5da1e00640 1 -- 172.21.15.19:0/3361256814 shutdown_connections 2024-03-08T06:03:52.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.503+0000 7f5da1e00640 1 --2- 172.21.15.19:0/3361256814 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5d7c06b4d0 0x7f5d7c06d990 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.503+0000 7f5da1e00640 1 --2- 172.21.15.19:0/3361256814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d9c15e760 0x7f5d9c1417a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.503+0000 7f5da1e00640 1 --2- 172.21.15.19:0/3361256814 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5d9c071fa0 0x7f5d9c141260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.503+0000 7f5da1e00640 1 --2- 172.21.15.19:0/3361256814 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d9c071bc0 0x7f5d9c13e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.503+0000 7f5da1e00640 1 -- 172.21.15.19:0/3361256814 >> 172.21.15.19:0/3361256814 conn(0x7f5d9c06ae30 msgr2=0x7f5d9c0b1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:52.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.504+0000 7f5da1e00640 1 -- 172.21.15.19:0/3361256814 shutdown_connections 2024-03-08T06:03:52.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.504+0000 7f5da1e00640 1 -- 172.21.15.19:0/3361256814 wait complete. 2024-03-08T06:03:52.525 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:03:52.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.739+0000 7f0545c00640 1 Processor -- start 2024-03-08T06:03:52.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.739+0000 7f0545c00640 1 -- start start 2024-03-08T06:03:52.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.741+0000 7f0545c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f054015e3b0 0x7f0540166850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:52.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.741+0000 7f0545c00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054006da80 con 0x7f054006d600 2024-03-08T06:03:52.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.741+0000 7f0545c00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054006dd60 con 0x7f0540071ab0 2024-03-08T06:03:52.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.741+0000 7f0545c00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f054006ef40 con 0x7f054015e3b0 2024-03-08T06:03:52.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.741+0000 7f053e000640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f054006d600 0x7f0540144d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46084/0 (socket says 172.21.15.19:46084) 2024-03-08T06:03:52.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.741+0000 7f053e000640 1 -- 172.21.15.19:0/14015915 learned_addr learned my addr 172.21.15.19:0/14015915 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:52.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.741+0000 7f053f400640 1 --2- 172.21.15.19:0/14015915 >> v2:172.21.15.42:3300/0 conn(0x7f054015e3b0 0x7f0540166850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:52.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.742+0000 7f053d600640 1 -- 172.21.15.19:0/14015915 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407131427 0 0) 0x7f054006da80 con 0x7f054006d600 2024-03-08T06:03:52.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.742+0000 7f053d600640 1 -- 172.21.15.19:0/14015915 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0524003520 con 0x7f054006d600 2024-03-08T06:03:52.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.742+0000 7f053d600640 1 -- 172.21.15.19:0/14015915 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 645827431 0 0) 0x7f0524003520 con 0x7f054006d600 2024-03-08T06:03:52.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.742+0000 7f053d600640 1 -- 172.21.15.19:0/14015915 >> v2:172.21.15.42:3300/0 conn(0x7f054015e3b0 msgr2=0x7f0540166850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:52.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.742+0000 7f053d600640 1 --2- 172.21.15.19:0/14015915 >> v2:172.21.15.42:3300/0 conn(0x7f054015e3b0 0x7f0540166850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.742+0000 7f053d600640 1 -- 172.21.15.19:0/14015915 >> v1:172.21.15.42:6789/0 conn(0x7f0540071ab0 legacy=0x7f054015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:52.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.742+0000 7f053d600640 1 -- 172.21.15.19:0/14015915 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054006e040 con 0x7f054006d600 2024-03-08T06:03:52.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.742+0000 7f053d600640 1 -- 172.21.15.19:0/14015915 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f052c001670 con 0x7f054006d600 2024-03-08T06:03:52.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.742+0000 7f053d600640 1 -- 172.21.15.19:0/14015915 >> v1:172.21.15.19:6789/0 conn(0x7f054006d600 legacy=0x7f0540144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:52.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.742+0000 7f053d600640 1 --2- 172.21.15.19:0/14015915 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f05240039b0 0x7f0524003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:52.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.742+0000 7f053d600640 1 --2- 172.21.15.19:0/14015915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0524004800 0x7f0524004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:52.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.742+0000 7f053d600640 1 --2- 172.21.15.19:0/14015915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05240051c0 0x7f052400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:52.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.742+0000 7f053d600640 1 -- 172.21.15.19:0/14015915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052400c030 con 0x7f05240051c0 2024-03-08T06:03:52.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.742+0000 7f053d600640 1 -- 172.21.15.19:0/14015915 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052400c1e0 con 0x7f0524004800 2024-03-08T06:03:52.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.742+0000 7f053d600640 1 -- 172.21.15.19:0/14015915 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052400c3e0 con 0x7f05240039b0 2024-03-08T06:03:52.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.743+0000 7f053f400640 1 --2- 172.21.15.19:0/14015915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05240051c0 0x7f052400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:52.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.743+0000 7f053ea00640 1 --2- 172.21.15.19:0/14015915 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f05240039b0 0x7f0524003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:52.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.743+0000 7f053e000640 1 --2- 172.21.15.19:0/14015915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0524004800 0x7f0524004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:52.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.743+0000 7f053f400640 1 -- 172.21.15.19:0/14015915 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f05240039b0 msgr2=0x7f0524003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:52.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.743+0000 7f053f400640 1 --2- 172.21.15.19:0/14015915 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f05240039b0 0x7f0524003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.743+0000 7f053f400640 1 -- 172.21.15.19:0/14015915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0524004800 msgr2=0x7f0524004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:52.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.743+0000 7f053f400640 1 --2- 172.21.15.19:0/14015915 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0524004800 0x7f0524004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.743+0000 7f053f400640 1 -- 172.21.15.19:0/14015915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0524003520 con 0x7f05240051c0 2024-03-08T06:03:52.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.744+0000 7f053f400640 1 -- 172.21.15.19:0/14015915 reap_dead start 2024-03-08T06:03:52.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.744+0000 7f053f400640 1 --2- 172.21.15.19:0/14015915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05240051c0 0x7f052400b9c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0538009f90 tx=0x7f0524005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff014b696010ae8 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:52.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.744+0000 7f053d600640 1 -- 172.21.15.19:0/14015915 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538039070 con 0x7f05240051c0 2024-03-08T06:03:52.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.744+0000 7f053d600640 1 -- 172.21.15.19:0/14015915 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053802cc20 con 0x7f05240051c0 2024-03-08T06:03:52.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.744+0000 7f053d600640 1 -- 172.21.15.19:0/14015915 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538009c10 con 0x7f05240051c0 2024-03-08T06:03:52.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.745+0000 7f0545c00640 1 -- 172.21.15.19:0/14015915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05240051c0 msgr2=0x7f052400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:52.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.745+0000 7f0545c00640 1 --2- 172.21.15.19:0/14015915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05240051c0 0x7f052400b9c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0538009f90 tx=0x7f0524005830 comp rx=0 tx=0).stop 2024-03-08T06:03:52.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.745+0000 7f0545c00640 1 -- 172.21.15.19:0/14015915 shutdown_connections 2024-03-08T06:03:52.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.745+0000 7f0545c00640 1 --2- 172.21.15.19:0/14015915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05240051c0 0x7f052400b9c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.745+0000 7f0545c00640 1 -- 172.21.15.19:0/14015915 >> 172.21.15.19:0/14015915 conn(0x7f054006ae30 msgr2=0x7f054006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:52.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.745+0000 7f0545c00640 1 -- 172.21.15.19:0/14015915 shutdown_connections 2024-03-08T06:03:52.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.745+0000 7f0545c00640 1 -- 172.21.15.19:0/14015915 wait complete. 2024-03-08T06:03:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.747+0000 7f0545c00640 1 Processor -- start 2024-03-08T06:03:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.747+0000 7f0545c00640 1 -- start start 2024-03-08T06:03:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.748+0000 7f0545c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f05240051c0 0x7f054015b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.748+0000 7f0545c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0540141500 0x7f0540141980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.748+0000 7f0545c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05400adab0 0x7f05400adf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.748+0000 7f0545c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0540071e90 con 0x7f0540141500 2024-03-08T06:03:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.748+0000 7f0545c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054006e600 con 0x7f05400adab0 2024-03-08T06:03:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.748+0000 7f0545c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0540072010 con 0x7f05240051c0 2024-03-08T06:03:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.748+0000 7f053e000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0540141500 0x7f0540141980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.748+0000 7f053e000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0540141500 0x7f0540141980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45578/0 (socket says 172.21.15.19:45578) 2024-03-08T06:03:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.748+0000 7f053e000640 1 -- 172.21.15.19:0/3131509093 learned_addr learned my addr 172.21.15.19:0/3131509093 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.749+0000 7f053ea00640 1 --2- 172.21.15.19:0/3131509093 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f05240051c0 0x7f054015b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:52.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.749+0000 7f053e000640 1 -- 172.21.15.19:0/3131509093 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f05240051c0 msgr2=0x7f054015b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:52.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.749+0000 7f053f400640 1 --2- 172.21.15.19:0/3131509093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05400adab0 0x7f05400adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:52.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.749+0000 7f053e000640 1 --2- 172.21.15.19:0/3131509093 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f05240051c0 0x7f054015b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.749+0000 7f053e000640 1 -- 172.21.15.19:0/3131509093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05400adab0 msgr2=0x7f05400adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:52.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.749+0000 7f053e000640 1 --2- 172.21.15.19:0/3131509093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05400adab0 0x7f05400adf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.749+0000 7f053e000640 1 -- 172.21.15.19:0/3131509093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0540141f80 con 0x7f0540141500 2024-03-08T06:03:52.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.749+0000 7f053e000640 1 --2- 172.21.15.19:0/3131509093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0540141500 0x7f0540141980 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f052c00d770 tx=0x7f052c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:52.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.749+0000 7f0536a00640 1 -- 172.21.15.19:0/3131509093 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c019070 con 0x7f0540141500 2024-03-08T06:03:52.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.749+0000 7f0536a00640 1 -- 172.21.15.19:0/3131509093 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c0072d0 con 0x7f0540141500 2024-03-08T06:03:52.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.749+0000 7f0536a00640 1 -- 172.21.15.19:0/3131509093 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c0047e0 con 0x7f0540141500 2024-03-08T06:03:52.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.749+0000 7f0545c00640 1 -- 172.21.15.19:0/3131509093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0540142260 con 0x7f0540141500 2024-03-08T06:03:52.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.750+0000 7f0545c00640 1 -- 172.21.15.19:0/3131509093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0540142820 con 0x7f0540141500 2024-03-08T06:03:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.751+0000 7f0545c00640 1 -- 172.21.15.19:0/3131509093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0540067cb0 con 0x7f0540141500 2024-03-08T06:03:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.752+0000 7f0536a00640 1 -- 172.21.15.19:0/3131509093 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f052c01c070 con 0x7f0540141500 2024-03-08T06:03:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.753+0000 7f0536a00640 1 --2- 172.21.15.19:0/3131509093 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f052006b4d0 0x7f052006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.753+0000 7f0536a00640 1 -- 172.21.15.19:0/3131509093 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f052c089d10 con 0x7f0540141500 2024-03-08T06:03:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.753+0000 7f053ea00640 1 --2- 172.21.15.19:0/3131509093 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f052006b4d0 0x7f052006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.754+0000 7f053ea00640 1 --2- 172.21.15.19:0/3131509093 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f052006b4d0 0x7f052006d990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0530007fd0 tx=0x7f0530009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:52.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.757+0000 7f0536a00640 1 -- 172.21.15.19:0/3131509093 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f052c08f020 con 0x7f0540141500 2024-03-08T06:03:52.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.957+0000 7f0545c00640 1 -- 172.21.15.19:0/3131509093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0540144540 con 0x7f0540141500 2024-03-08T06:03:52.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.959+0000 7f0536a00640 1 -- 172.21.15.19:0/3131509093 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f052c058a60 con 0x7f0540141500 2024-03-08T06:03:52.961 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:52.961 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:03:22.069498+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:03:18.392703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T06:03:19.537912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:03:52.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.962+0000 7f0545c00640 1 -- 172.21.15.19:0/3131509093 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f052006b4d0 msgr2=0x7f052006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:52.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.962+0000 7f0545c00640 1 --2- 172.21.15.19:0/3131509093 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f052006b4d0 0x7f052006d990 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0530007fd0 tx=0x7f0530009040 comp rx=0 tx=0).stop 2024-03-08T06:03:52.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.962+0000 7f0545c00640 1 -- 172.21.15.19:0/3131509093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0540141500 msgr2=0x7f0540141980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:52.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.962+0000 7f0545c00640 1 --2- 172.21.15.19:0/3131509093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0540141500 0x7f0540141980 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f052c00d770 tx=0x7f052c00dc30 comp rx=0 tx=0).stop 2024-03-08T06:03:52.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.962+0000 7f0545c00640 1 -- 172.21.15.19:0/3131509093 shutdown_connections 2024-03-08T06:03:52.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.962+0000 7f0545c00640 1 --2- 172.21.15.19:0/3131509093 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f052006b4d0 0x7f052006d990 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.962+0000 7f0545c00640 1 --2- 172.21.15.19:0/3131509093 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05400adab0 0x7f05400adf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.962+0000 7f0545c00640 1 --2- 172.21.15.19:0/3131509093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0540141500 0x7f0540141980 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.962+0000 7f0545c00640 1 --2- 172.21.15.19:0/3131509093 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f05240051c0 0x7f054015b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:52.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.962+0000 7f0545c00640 1 -- 172.21.15.19:0/3131509093 >> 172.21.15.19:0/3131509093 conn(0x7f054006ae30 msgr2=0x7f054006b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:52.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.963+0000 7f0545c00640 1 -- 172.21.15.19:0/3131509093 shutdown_connections 2024-03-08T06:03:52.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:52.963+0000 7f0545c00640 1 -- 172.21.15.19:0/3131509093 wait complete. 2024-03-08T06:03:52.983 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T06:03:14.149736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T06:03:18.392703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T06:03:19.537912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T06:03:52.983 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T06:03:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.204+0000 7f1c82800640 1 Processor -- start 2024-03-08T06:03:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.205+0000 7f1c82800640 1 -- start start 2024-03-08T06:03:53.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.206+0000 7f1c82800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1c7c1604f0 0x7f1c7c0cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:53.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.206+0000 7f1c82800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7c0cd5a0 con 0x7f1c7c1455b0 2024-03-08T06:03:53.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.206+0000 7f1c82800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7c0ccfe0 con 0x7f1c7c071950 2024-03-08T06:03:53.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.206+0000 7f1c82800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7c0cdc20 con 0x7f1c7c1604f0 2024-03-08T06:03:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.207+0000 7f1c7aa00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1c7c1604f0 0x7f1c7c0cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.207+0000 7f1c7b400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1c7c1455b0 0x7f1c7c15c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46100/0 (socket says 172.21.15.19:46100) 2024-03-08T06:03:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.207+0000 7f1c7b400640 1 -- 172.21.15.19:0/1345049293 learned_addr learned my addr 172.21.15.19:0/1345049293 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.207+0000 7f1c7aa00640 1 -- 172.21.15.19:0/1345049293 >> v1:172.21.15.42:6789/0 conn(0x7f1c7c071950 legacy=0x7f1c7c0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.207+0000 7f1c7aa00640 1 -- 172.21.15.19:0/1345049293 >> v1:172.21.15.19:6789/0 conn(0x7f1c7c1455b0 legacy=0x7f1c7c15c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:53.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.208+0000 7f1c7aa00640 1 -- 172.21.15.19:0/1345049293 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c0cd2c0 con 0x7f1c7c1604f0 2024-03-08T06:03:53.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.209+0000 7f1c7aa00640 1 --2- 172.21.15.19:0/1345049293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c7c1604f0 0x7f1c7c0cc690 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0cdda0 tx=0x7f1c6802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00464cd20dccbff server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.209+0000 7f1c7a000640 1 -- 172.21.15.19:0/1345049293 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68035020 con 0x7f1c7c1604f0 2024-03-08T06:03:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.209+0000 7f1c7a000640 1 -- 172.21.15.19:0/1345049293 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c68031810 con 0x7f1c7c1604f0 2024-03-08T06:03:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.209+0000 7f1c7a000640 1 -- 172.21.15.19:0/1345049293 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68031be0 con 0x7f1c7c1604f0 2024-03-08T06:03:53.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.210+0000 7f1c82800640 1 -- 172.21.15.19:0/1345049293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c7c1604f0 msgr2=0x7f1c7c0cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:53.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.210+0000 7f1c82800640 1 --2- 172.21.15.19:0/1345049293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c7c1604f0 0x7f1c7c0cc690 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0cdda0 tx=0x7f1c6802b8b0 comp rx=0 tx=0).stop 2024-03-08T06:03:53.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.210+0000 7f1c82800640 1 -- 172.21.15.19:0/1345049293 shutdown_connections 2024-03-08T06:03:53.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.210+0000 7f1c82800640 1 --2- 172.21.15.19:0/1345049293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c7c1604f0 0x7f1c7c0cc690 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:53.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.210+0000 7f1c82800640 1 -- 172.21.15.19:0/1345049293 >> 172.21.15.19:0/1345049293 conn(0x7f1c7c06ae30 msgr2=0x7f1c7c06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:53.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.210+0000 7f1c82800640 1 -- 172.21.15.19:0/1345049293 shutdown_connections 2024-03-08T06:03:53.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.210+0000 7f1c82800640 1 -- 172.21.15.19:0/1345049293 wait complete. 2024-03-08T06:03:53.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.212+0000 7f1c82800640 1 Processor -- start 2024-03-08T06:03:53.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.212+0000 7f1c82800640 1 -- start start 2024-03-08T06:03:53.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.213+0000 7f1c82800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1c7c071950 0x7f1c7c0c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:53.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.213+0000 7f1c82800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c7c1455b0 0x7f1c7c1f8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:53.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.213+0000 7f1c82800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c7c1604f0 0x7f1c7c0b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.213+0000 7f1c82800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c0ccbd0 con 0x7f1c7c1455b0 2024-03-08T06:03:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.213+0000 7f1c82800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c145990 con 0x7f1c7c1604f0 2024-03-08T06:03:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.213+0000 7f1c82800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c0ccd50 con 0x7f1c7c071950 2024-03-08T06:03:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.213+0000 7f1c7aa00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c7c1455b0 0x7f1c7c1f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.213+0000 7f1c7aa00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c7c1455b0 0x7f1c7c1f8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45604/0 (socket says 172.21.15.19:45604) 2024-03-08T06:03:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.213+0000 7f1c7aa00640 1 -- 172.21.15.19:0/1872250812 learned_addr learned my addr 172.21.15.19:0/1872250812 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.213+0000 7f1c7b400640 1 --2- 172.21.15.19:0/1872250812 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1c7c071950 0x7f1c7c0c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.214+0000 7f1c7be00640 1 --2- 172.21.15.19:0/1872250812 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c7c1604f0 0x7f1c7c0b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.214+0000 7f1c7aa00640 1 -- 172.21.15.19:0/1872250812 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1c7c071950 msgr2=0x7f1c7c0c4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.214+0000 7f1c7aa00640 1 --2- 172.21.15.19:0/1872250812 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1c7c071950 0x7f1c7c0c4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.214+0000 7f1c7aa00640 1 -- 172.21.15.19:0/1872250812 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c7c1604f0 msgr2=0x7f1c7c0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.214+0000 7f1c7aa00640 1 --2- 172.21.15.19:0/1872250812 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c7c1604f0 0x7f1c7c0b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.214+0000 7f1c7aa00640 1 -- 172.21.15.19:0/1872250812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c1f4200 con 0x7f1c7c1455b0 2024-03-08T06:03:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.214+0000 7f1c7be00640 1 --2- 172.21.15.19:0/1872250812 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c7c1604f0 0x7f1c7c0b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.214+0000 7f1c7aa00640 1 --2- 172.21.15.19:0/1872250812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c7c1455b0 0x7f1c7c1f8240 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1c68000c00 tx=0x7f1c680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.214+0000 7f1c73400640 1 -- 172.21.15.19:0/1872250812 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68040070 con 0x7f1c7c1455b0 2024-03-08T06:03:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.214+0000 7f1c73400640 1 -- 172.21.15.19:0/1872250812 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c68039cf0 con 0x7f1c7c1455b0 2024-03-08T06:03:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.214+0000 7f1c73400640 1 -- 172.21.15.19:0/1872250812 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68035040 con 0x7f1c7c1455b0 2024-03-08T06:03:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.215+0000 7f1c82800640 1 -- 172.21.15.19:0/1872250812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c7c1f44c0 con 0x7f1c7c1455b0 2024-03-08T06:03:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.215+0000 7f1c82800640 1 -- 172.21.15.19:0/1872250812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7c1f4a80 con 0x7f1c7c1455b0 2024-03-08T06:03:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.216+0000 7f1c82800640 1 -- 172.21.15.19:0/1872250812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7c0cc990 con 0x7f1c7c1455b0 2024-03-08T06:03:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.217+0000 7f1c73400640 1 -- 172.21.15.19:0/1872250812 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1c6804b060 con 0x7f1c7c1455b0 2024-03-08T06:03:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.218+0000 7f1c73400640 1 --2- 172.21.15.19:0/1872250812 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1c5c06b4d0 0x7f1c5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.218+0000 7f1c73400640 1 -- 172.21.15.19:0/1872250812 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c680abed0 con 0x7f1c7c1455b0 2024-03-08T06:03:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.219+0000 7f1c7b400640 1 --2- 172.21.15.19:0/1872250812 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1c5c06b4d0 0x7f1c5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.219+0000 7f1c7b400640 1 --2- 172.21.15.19:0/1872250812 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1c5c06b4d0 0x7f1c5c06d990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c000f60 tx=0x7f1c6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.223+0000 7f1c73400640 1 -- 172.21.15.19:0/1872250812 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1c7c0cc990 con 0x7f1c7c1455b0 2024-03-08T06:03:53.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.421+0000 7f1c82800640 1 -- 172.21.15.19:0/1872250812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1c7c067cb0 con 0x7f1c7c1455b0 2024-03-08T06:03:53.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.422+0000 7f1c73400640 1 -- 172.21.15.19:0/1872250812 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1c6807ad40 con 0x7f1c7c1455b0 2024-03-08T06:03:53.422 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-08T06:03:53.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.424+0000 7f1c82800640 1 -- 172.21.15.19:0/1872250812 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1c5c06b4d0 msgr2=0x7f1c5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:53.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.424+0000 7f1c82800640 1 --2- 172.21.15.19:0/1872250812 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1c5c06b4d0 0x7f1c5c06d990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c000f60 tx=0x7f1c6c009040 comp rx=0 tx=0).stop 2024-03-08T06:03:53.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.424+0000 7f1c82800640 1 -- 172.21.15.19:0/1872250812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c7c1455b0 msgr2=0x7f1c7c1f8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:53.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.424+0000 7f1c82800640 1 --2- 172.21.15.19:0/1872250812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c7c1455b0 0x7f1c7c1f8240 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1c68000c00 tx=0x7f1c680046c0 comp rx=0 tx=0).stop 2024-03-08T06:03:53.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.424+0000 7f1c82800640 1 -- 172.21.15.19:0/1872250812 shutdown_connections 2024-03-08T06:03:53.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.424+0000 7f1c82800640 1 --2- 172.21.15.19:0/1872250812 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1c5c06b4d0 0x7f1c5c06d990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:53.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.424+0000 7f1c82800640 1 --2- 172.21.15.19:0/1872250812 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1c7c1604f0 0x7f1c7c0b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:53.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.424+0000 7f1c82800640 1 --2- 172.21.15.19:0/1872250812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c7c1455b0 0x7f1c7c1f8240 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:53.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.424+0000 7f1c82800640 1 --2- 172.21.15.19:0/1872250812 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1c7c071950 0x7f1c7c0c4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:53.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.424+0000 7f1c82800640 1 -- 172.21.15.19:0/1872250812 >> 172.21.15.19:0/1872250812 conn(0x7f1c7c06ae30 msgr2=0x7f1c7c0b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:53.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.424+0000 7f1c82800640 1 -- 172.21.15.19:0/1872250812 shutdown_connections 2024-03-08T06:03:53.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.424+0000 7f1c82800640 1 -- 172.21.15.19:0/1872250812 wait complete. 2024-03-08T06:03:53.443 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T06:03:53.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.661+0000 7fb71fe00640 1 Processor -- start 2024-03-08T06:03:53.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.661+0000 7fb71fe00640 1 -- start start 2024-03-08T06:03:53.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.662+0000 7fb71fe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb720145500 0x7fb72006ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:53.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.663+0000 7fb71fe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb72015bfb0 0x7fb7200716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:53.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.663+0000 7fb71fe00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72015c460 con 0x7fb720071c20 2024-03-08T06:03:53.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.663+0000 7fb71fe00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb720072050 con 0x7fb72015bfb0 2024-03-08T06:03:53.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.663+0000 7fb71fe00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb72015c740 con 0x7fb720145500 2024-03-08T06:03:53.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.663+0000 7fb717e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb72015bfb0 0x7fb7200716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:53.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.663+0000 7fb71f400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb720071c20 0x7fb72006d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46104/0 (socket says 172.21.15.19:46104) 2024-03-08T06:03:53.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.663+0000 7fb71f400640 1 -- 172.21.15.19:0/1197225451 learned_addr learned my addr 172.21.15.19:0/1197225451 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:53.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.663+0000 7fb71ea00640 1 --2- 172.21.15.19:0/1197225451 >> v2:172.21.15.42:3300/0 conn(0x7fb720145500 0x7fb72006ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:53.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.664+0000 7fb717e00640 1 -- 172.21.15.19:0/1197225451 >> v2:172.21.15.42:3300/0 conn(0x7fb720145500 msgr2=0x7fb72006ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:53.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.664+0000 7fb717e00640 1 --2- 172.21.15.19:0/1197225451 >> v2:172.21.15.42:3300/0 conn(0x7fb720145500 0x7fb72006ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:53.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.664+0000 7fb717e00640 1 -- 172.21.15.19:0/1197225451 >> v1:172.21.15.19:6789/0 conn(0x7fb720071c20 legacy=0x7fb72006d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:53.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.664+0000 7fb717e00640 1 -- 172.21.15.19:0/1197225451 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72015ca20 con 0x7fb72015bfb0 2024-03-08T06:03:53.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.664+0000 7fb71e000640 1 -- 172.21.15.19:0/1197225451 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543661140 0 0) 0x7fb72015c460 con 0x7fb720071c20 2024-03-08T06:03:53.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.666+0000 7fb717e00640 1 --2- 172.21.15.19:0/1197225451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb72015bfb0 0x7fb7200716e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb7200cf820 tx=0x7fb70802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e20e031e83cc1c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:53.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.666+0000 7fb71e000640 1 -- 172.21.15.19:0/1197225451 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7080315a0 con 0x7fb72015bfb0 2024-03-08T06:03:53.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.666+0000 7fb71e000640 1 -- 172.21.15.19:0/1197225451 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb708037070 con 0x7fb72015bfb0 2024-03-08T06:03:53.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.666+0000 7fb71e000640 1 -- 172.21.15.19:0/1197225451 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708031960 con 0x7fb72015bfb0 2024-03-08T06:03:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.667+0000 7fb71fe00640 1 -- 172.21.15.19:0/1197225451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb72015bfb0 msgr2=0x7fb7200716e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.667+0000 7fb71fe00640 1 --2- 172.21.15.19:0/1197225451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb72015bfb0 0x7fb7200716e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb7200cf820 tx=0x7fb70802b840 comp rx=0 tx=0).stop 2024-03-08T06:03:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.667+0000 7fb71fe00640 1 -- 172.21.15.19:0/1197225451 shutdown_connections 2024-03-08T06:03:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.667+0000 7fb71fe00640 1 --2- 172.21.15.19:0/1197225451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb72015bfb0 0x7fb7200716e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.667+0000 7fb71fe00640 1 --2- 172.21.15.19:0/1197225451 >> v2:172.21.15.42:3300/0 conn(0x7fb720145500 0x7fb72006ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.667+0000 7fb71fe00640 1 -- 172.21.15.19:0/1197225451 >> 172.21.15.19:0/1197225451 conn(0x7fb7200b1850 msgr2=0x7fb7200b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.667+0000 7fb71fe00640 1 -- 172.21.15.19:0/1197225451 shutdown_connections 2024-03-08T06:03:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.667+0000 7fb71fe00640 1 -- 172.21.15.19:0/1197225451 wait complete. 2024-03-08T06:03:53.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.669+0000 7fb71fe00640 1 Processor -- start 2024-03-08T06:03:53.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.669+0000 7fb71fe00640 1 -- start start 2024-03-08T06:03:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.670+0000 7fb71fe00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb720071c20 0x7fb720157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.670+0000 7fb71fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb720145500 0x7fb720155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.670+0000 7fb71fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb72015bfb0 0x7fb7201415d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.670+0000 7fb71fe00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72006f370 con 0x7fb720145500 2024-03-08T06:03:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.670+0000 7fb71fe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72006f1f0 con 0x7fb72015bfb0 2024-03-08T06:03:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.670+0000 7fb71fe00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7200cd510 con 0x7fb720071c20 2024-03-08T06:03:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.670+0000 7fb717e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb720145500 0x7fb720155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.671+0000 7fb717e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb720145500 0x7fb720155330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45620/0 (socket says 172.21.15.19:45620) 2024-03-08T06:03:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.671+0000 7fb717e00640 1 -- 172.21.15.19:0/3908591572 learned_addr learned my addr 172.21.15.19:0/3908591572 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.671+0000 7fb71f400640 1 --2- 172.21.15.19:0/3908591572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb72015bfb0 0x7fb7201415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.671+0000 7fb71ea00640 1 --2- 172.21.15.19:0/3908591572 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb720071c20 0x7fb720157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.671+0000 7fb717e00640 1 -- 172.21.15.19:0/3908591572 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb720071c20 msgr2=0x7fb720157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.671+0000 7fb717e00640 1 --2- 172.21.15.19:0/3908591572 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb720071c20 0x7fb720157bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:53.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.671+0000 7fb717e00640 1 -- 172.21.15.19:0/3908591572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb72015bfb0 msgr2=0x7fb7201415d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:53.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.671+0000 7fb717e00640 1 --2- 172.21.15.19:0/3908591572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb72015bfb0 0x7fb7201415d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:53.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.671+0000 7fb717e00640 1 -- 172.21.15.19:0/3908591572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb720158500 con 0x7fb720145500 2024-03-08T06:03:53.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.671+0000 7fb71f400640 1 --2- 172.21.15.19:0/3908591572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb72015bfb0 0x7fb7201415d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:53.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.671+0000 7fb717e00640 1 --2- 172.21.15.19:0/3908591572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb720145500 0x7fb720155330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb708000c00 tx=0x7fb7080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:53.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.672+0000 7fb716a00640 1 -- 172.21.15.19:0/3908591572 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708032840 con 0x7fb720145500 2024-03-08T06:03:53.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.672+0000 7fb716a00640 1 -- 172.21.15.19:0/3908591572 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb708032a00 con 0x7fb720145500 2024-03-08T06:03:53.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.672+0000 7fb716a00640 1 -- 172.21.15.19:0/3908591572 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708032df0 con 0x7fb720145500 2024-03-08T06:03:53.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.672+0000 7fb71fe00640 1 -- 172.21.15.19:0/3908591572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7201587e0 con 0x7fb720145500 2024-03-08T06:03:53.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.672+0000 7fb71fe00640 1 -- 172.21.15.19:0/3908591572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb720158da0 con 0x7fb720145500 2024-03-08T06:03:53.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.673+0000 7fb71fe00640 1 -- 172.21.15.19:0/3908591572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb720075090 con 0x7fb720145500 2024-03-08T06:03:53.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.674+0000 7fb716a00640 1 -- 172.21.15.19:0/3908591572 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb70803b3f0 con 0x7fb720145500 2024-03-08T06:03:53.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.675+0000 7fb716a00640 1 --2- 172.21.15.19:0/3908591572 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb6fc06b4d0 0x7fb6fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:53.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.675+0000 7fb716a00640 1 -- 172.21.15.19:0/3908591572 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb70802f030 con 0x7fb720145500 2024-03-08T06:03:53.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.675+0000 7fb71ea00640 1 --2- 172.21.15.19:0/3908591572 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb6fc06b4d0 0x7fb6fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:53.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.676+0000 7fb71ea00640 1 --2- 172.21.15.19:0/3908591572 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb6fc06b4d0 0x7fb6fc06d990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb710006fd0 tx=0x7fb710008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:53.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.680+0000 7fb716a00640 1 -- 172.21.15.19:0/3908591572 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb708040070 con 0x7fb720145500 2024-03-08T06:03:53.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.884+0000 7fb71fe00640 1 -- 172.21.15.19:0/3908591572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb72006c480 con 0x7fb720145500 2024-03-08T06:03:53.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.884+0000 7fb716a00640 1 -- 172.21.15.19:0/3908591572 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb70807b0f0 con 0x7fb720145500 2024-03-08T06:03:53.885 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-08T06:03:53.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.887+0000 7fb71fe00640 1 -- 172.21.15.19:0/3908591572 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb6fc06b4d0 msgr2=0x7fb6fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:53.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.887+0000 7fb71fe00640 1 --2- 172.21.15.19:0/3908591572 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb6fc06b4d0 0x7fb6fc06d990 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb710006fd0 tx=0x7fb710008040 comp rx=0 tx=0).stop 2024-03-08T06:03:53.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.887+0000 7fb71fe00640 1 -- 172.21.15.19:0/3908591572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb720145500 msgr2=0x7fb720155330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:53.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.887+0000 7fb71fe00640 1 --2- 172.21.15.19:0/3908591572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb720145500 0x7fb720155330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb708000c00 tx=0x7fb7080046c0 comp rx=0 tx=0).stop 2024-03-08T06:03:53.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.887+0000 7fb71fe00640 1 -- 172.21.15.19:0/3908591572 shutdown_connections 2024-03-08T06:03:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.887+0000 7fb71fe00640 1 --2- 172.21.15.19:0/3908591572 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb6fc06b4d0 0x7fb6fc06d990 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.887+0000 7fb71fe00640 1 --2- 172.21.15.19:0/3908591572 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb72015bfb0 0x7fb7201415d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.887+0000 7fb71fe00640 1 --2- 172.21.15.19:0/3908591572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb720145500 0x7fb720155330 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.887+0000 7fb71fe00640 1 --2- 172.21.15.19:0/3908591572 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb720071c20 0x7fb720157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.887+0000 7fb71fe00640 1 -- 172.21.15.19:0/3908591572 >> 172.21.15.19:0/3908591572 conn(0x7fb7200b1850 msgr2=0x7fb7200b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.888+0000 7fb71fe00640 1 -- 172.21.15.19:0/3908591572 shutdown_connections 2024-03-08T06:03:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:53.888+0000 7fb71fe00640 1 -- 172.21.15.19:0/3908591572 wait complete. 2024-03-08T06:03:53.907 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T06:03:54.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.131+0000 7fc9dc800640 1 Processor -- start 2024-03-08T06:03:54.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.132+0000 7fc9dc800640 1 -- start start 2024-03-08T06:03:54.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.133+0000 7fc9dc800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc9d415df50 0x7fc9d40d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:54.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.133+0000 7fc9dc800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc9d40cea10 0x7fc9d40cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:54.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.133+0000 7fc9dc800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d415e330 con 0x7fc9d40d20a0 2024-03-08T06:03:54.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.133+0000 7fc9dc800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d40cf380 con 0x7fc9d415df50 2024-03-08T06:03:54.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.133+0000 7fc9dc800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d40d3b10 con 0x7fc9d40cea10 2024-03-08T06:03:54.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.133+0000 7fc9d9e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc9d415df50 0x7fc9d40d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:54.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.134+0000 7fc9d9400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc9d40d20a0 0x7fc9d40b9660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46116/0 (socket says 172.21.15.19:46116) 2024-03-08T06:03:54.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.134+0000 7fc9d9400640 1 -- 172.21.15.19:0/624098379 learned_addr learned my addr 172.21.15.19:0/624098379 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:54.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.134+0000 7fc9da800640 1 --2- 172.21.15.19:0/624098379 >> v2:172.21.15.42:3300/0 conn(0x7fc9d40cea10 0x7fc9d40cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:54.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.134+0000 7fc9d9e00640 1 -- 172.21.15.19:0/624098379 >> v2:172.21.15.42:3300/0 conn(0x7fc9d40cea10 msgr2=0x7fc9d40cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:54.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.134+0000 7fc9d9e00640 1 --2- 172.21.15.19:0/624098379 >> v2:172.21.15.42:3300/0 conn(0x7fc9d40cea10 0x7fc9d40cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:54.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.134+0000 7fc9d9e00640 1 -- 172.21.15.19:0/624098379 >> v1:172.21.15.19:6789/0 conn(0x7fc9d40d20a0 legacy=0x7fc9d40b9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:54.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.134+0000 7fc9d9e00640 1 -- 172.21.15.19:0/624098379 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d40d2530 con 0x7fc9d415df50 2024-03-08T06:03:54.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.134+0000 7fc9d8a00640 1 -- 172.21.15.19:0/624098379 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2221167198 0 0) 0x7fc9c4001110 con 0x7fc9d40d20a0 2024-03-08T06:03:54.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.135+0000 7fc9d9e00640 1 --2- 172.21.15.19:0/624098379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d415df50 0x7fc9d40d35d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc9d408d1e0 tx=0x7fc9cc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5f29c585e2d467 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:54.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.135+0000 7fc9d8a00640 1 -- 172.21.15.19:0/624098379 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc039070 con 0x7fc9d415df50 2024-03-08T06:03:54.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.136+0000 7fc9d8a00640 1 -- 172.21.15.19:0/624098379 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9cc02cc80 con 0x7fc9d415df50 2024-03-08T06:03:54.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.136+0000 7fc9d8a00640 1 -- 172.21.15.19:0/624098379 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc034660 con 0x7fc9d415df50 2024-03-08T06:03:54.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.136+0000 7fc9dc800640 1 -- 172.21.15.19:0/624098379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d415df50 msgr2=0x7fc9d40d35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:54.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.136+0000 7fc9dc800640 1 --2- 172.21.15.19:0/624098379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d415df50 0x7fc9d40d35d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc9d408d1e0 tx=0x7fc9cc02bed0 comp rx=0 tx=0).stop 2024-03-08T06:03:54.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.136+0000 7fc9dc800640 1 -- 172.21.15.19:0/624098379 shutdown_connections 2024-03-08T06:03:54.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.136+0000 7fc9dc800640 1 --2- 172.21.15.19:0/624098379 >> v2:172.21.15.42:3300/0 conn(0x7fc9d40cea10 0x7fc9d40cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:54.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.136+0000 7fc9dc800640 1 --2- 172.21.15.19:0/624098379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d415df50 0x7fc9d40d35d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:54.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.136+0000 7fc9dc800640 1 -- 172.21.15.19:0/624098379 >> 172.21.15.19:0/624098379 conn(0x7fc9d4072c70 msgr2=0x7fc9d40d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:54.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.136+0000 7fc9dc800640 1 -- 172.21.15.19:0/624098379 shutdown_connections 2024-03-08T06:03:54.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.136+0000 7fc9dc800640 1 -- 172.21.15.19:0/624098379 wait complete. 2024-03-08T06:03:54.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.138+0000 7fc9dc800640 1 Processor -- start 2024-03-08T06:03:54.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.138+0000 7fc9dc800640 1 -- start start 2024-03-08T06:03:54.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.139+0000 7fc9dc800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d40cea10 0x7fc9d4156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:54.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.139+0000 7fc9dc800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d415df50 0x7fc9d40c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:54.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.139+0000 7fc9dc800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc9d4150050 0x7fc9d415eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:54.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.139+0000 7fc9dc800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d40d2dd0 con 0x7fc9d40cea10 2024-03-08T06:03:54.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.139+0000 7fc9dc800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d40d2af0 con 0x7fc9d415df50 2024-03-08T06:03:54.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.139+0000 7fc9dc800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d40b6e70 con 0x7fc9d4150050 2024-03-08T06:03:54.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.139+0000 7fc9d9e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d40cea10 0x7fc9d4156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:54.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.139+0000 7fc9d9e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d40cea10 0x7fc9d4156a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45624/0 (socket says 172.21.15.19:45624) 2024-03-08T06:03:54.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.140+0000 7fc9d9e00640 1 -- 172.21.15.19:0/536208941 learned_addr learned my addr 172.21.15.19:0/536208941 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:54.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.140+0000 7fc9d9e00640 1 -- 172.21.15.19:0/536208941 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc9d4150050 msgr2=0x7fc9d415eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:54.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.140+0000 7fc9d9e00640 1 --2- 172.21.15.19:0/536208941 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc9d4150050 0x7fc9d415eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:54.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.140+0000 7fc9d9e00640 1 -- 172.21.15.19:0/536208941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d415df50 msgr2=0x7fc9d40c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:54.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.140+0000 7fc9d9e00640 1 --2- 172.21.15.19:0/536208941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d415df50 0x7fc9d40c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:54.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.140+0000 7fc9d9e00640 1 -- 172.21.15.19:0/536208941 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d415f670 con 0x7fc9d40cea10 2024-03-08T06:03:54.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.140+0000 7fc9d9e00640 1 --2- 172.21.15.19:0/536208941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d40cea10 0x7fc9d4156a70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc037040 tx=0x7fc9cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:54.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.140+0000 7fc9ca000640 1 -- 172.21.15.19:0/536208941 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc039050 con 0x7fc9d40cea10 2024-03-08T06:03:54.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.141+0000 7fc9ca000640 1 -- 172.21.15.19:0/536208941 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9cc03a040 con 0x7fc9d40cea10 2024-03-08T06:03:54.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.141+0000 7fc9ca000640 1 -- 172.21.15.19:0/536208941 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc03e610 con 0x7fc9d40cea10 2024-03-08T06:03:54.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.141+0000 7fc9dc800640 1 -- 172.21.15.19:0/536208941 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d4154070 con 0x7fc9d40cea10 2024-03-08T06:03:54.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.141+0000 7fc9dc800640 1 -- 172.21.15.19:0/536208941 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d4154630 con 0x7fc9d40cea10 2024-03-08T06:03:54.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.142+0000 7fc9dc800640 1 -- 172.21.15.19:0/536208941 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d40683c0 con 0x7fc9d40cea10 2024-03-08T06:03:54.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.143+0000 7fc9ca000640 1 -- 172.21.15.19:0/536208941 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc9cc047020 con 0x7fc9d40cea10 2024-03-08T06:03:54.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.144+0000 7fc9ca000640 1 --2- 172.21.15.19:0/536208941 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc9b806b4d0 0x7fc9b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:54.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.144+0000 7fc9ca000640 1 -- 172.21.15.19:0/536208941 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9cc0ac6b0 con 0x7fc9d40cea10 2024-03-08T06:03:54.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.144+0000 7fc9d9400640 1 --2- 172.21.15.19:0/536208941 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc9b806b4d0 0x7fc9b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:54.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.145+0000 7fc9d9400640 1 --2- 172.21.15.19:0/536208941 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc9b806b4d0 0x7fc9b806d990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc9d415ca00 tx=0x7fc9c4001310 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:54.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.149+0000 7fc9ca000640 1 -- 172.21.15.19:0/536208941 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc9cc04e020 con 0x7fc9d40cea10 2024-03-08T06:03:54.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.355+0000 7fc9dc800640 1 -- 172.21.15.19:0/536208941 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc9d4154800 con 0x7fc9d40cea10 2024-03-08T06:03:54.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.356+0000 7fc9ca000640 1 -- 172.21.15.19:0/536208941 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc9cc07b520 con 0x7fc9d40cea10 2024-03-08T06:03:54.357 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-08T06:03:54.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.359+0000 7fc9dc800640 1 -- 172.21.15.19:0/536208941 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc9b806b4d0 msgr2=0x7fc9b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:54.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.359+0000 7fc9dc800640 1 --2- 172.21.15.19:0/536208941 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc9b806b4d0 0x7fc9b806d990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc9d415ca00 tx=0x7fc9c4001310 comp rx=0 tx=0).stop 2024-03-08T06:03:54.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.359+0000 7fc9dc800640 1 -- 172.21.15.19:0/536208941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d40cea10 msgr2=0x7fc9d4156a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:54.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.359+0000 7fc9dc800640 1 --2- 172.21.15.19:0/536208941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d40cea10 0x7fc9d4156a70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc037040 tx=0x7fc9cc004a40 comp rx=0 tx=0).stop 2024-03-08T06:03:54.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.359+0000 7fc9dc800640 1 -- 172.21.15.19:0/536208941 shutdown_connections 2024-03-08T06:03:54.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.359+0000 7fc9dc800640 1 --2- 172.21.15.19:0/536208941 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc9b806b4d0 0x7fc9b806d990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:54.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.359+0000 7fc9dc800640 1 --2- 172.21.15.19:0/536208941 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc9d4150050 0x7fc9d415eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:54.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.359+0000 7fc9dc800640 1 --2- 172.21.15.19:0/536208941 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc9d415df50 0x7fc9d40c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:54.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.359+0000 7fc9dc800640 1 --2- 172.21.15.19:0/536208941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9d40cea10 0x7fc9d4156a70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:54.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.359+0000 7fc9dc800640 1 -- 172.21.15.19:0/536208941 >> 172.21.15.19:0/536208941 conn(0x7fc9d4072c70 msgr2=0x7fc9d4152750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:54.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.359+0000 7fc9dc800640 1 -- 172.21.15.19:0/536208941 shutdown_connections 2024-03-08T06:03:54.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.359+0000 7fc9dc800640 1 -- 172.21.15.19:0/536208941 wait complete. 2024-03-08T06:03:54.379 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:03:54.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.599+0000 7f90d7200640 1 Processor -- start 2024-03-08T06:03:54.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.599+0000 7f90d7200640 1 -- start start 2024-03-08T06:03:54.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.600+0000 7f90d7200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f90d81445d0 0x7f90d806deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:54.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.601+0000 7f90d7200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f90d8071b80 0x7f90d80cc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:54.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.601+0000 7f90d7200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d806e3f0 con 0x7f90d8144d50 2024-03-08T06:03:54.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.601+0000 7f90d7200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d806ebf0 con 0x7f90d81445d0 2024-03-08T06:03:54.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.601+0000 7f90d7200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d806eed0 con 0x7f90d8071b80 2024-03-08T06:03:54.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.601+0000 7f90d5e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f90d81445d0 0x7f90d806deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:54.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.601+0000 7f90d5e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f90d81445d0 0x7f90d806deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45636/0 (socket says 172.21.15.19:45636) 2024-03-08T06:03:54.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.601+0000 7f90d5e00640 1 -- 172.21.15.19:0/243876182 learned_addr learned my addr 172.21.15.19:0/243876182 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:54.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.601+0000 7f90d5e00640 1 -- 172.21.15.19:0/243876182 >> v2:172.21.15.42:3300/0 conn(0x7f90d8071b80 msgr2=0x7f90d80cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.601+0000 7f90d5e00640 1 --2- 172.21.15.19:0/243876182 >> v2:172.21.15.42:3300/0 conn(0x7f90d8071b80 0x7f90d80cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.601+0000 7f90d5e00640 1 -- 172.21.15.19:0/243876182 >> v1:172.21.15.42:6789/0 conn(0x7f90d8144d50 legacy=0x7f90d8071470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.601+0000 7f90d5e00640 1 -- 172.21.15.19:0/243876182 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d806f1b0 con 0x7f90d81445d0 2024-03-08T06:03:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.602+0000 7f90d5e00640 1 --2- 172.21.15.19:0/243876182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90d81445d0 0x7f90d806deb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f90d806e6d0 tx=0x7f90c802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e49884b8201c1b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.603+0000 7f90d5400640 1 -- 172.21.15.19:0/243876182 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c8035020 con 0x7f90d81445d0 2024-03-08T06:03:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.603+0000 7f90d5400640 1 -- 172.21.15.19:0/243876182 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c8031870 con 0x7f90d81445d0 2024-03-08T06:03:54.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.603+0000 7f90d5400640 1 -- 172.21.15.19:0/243876182 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c8031c40 con 0x7f90d81445d0 2024-03-08T06:03:54.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.603+0000 7f90d7200640 1 -- 172.21.15.19:0/243876182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90d81445d0 msgr2=0x7f90d806deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:54.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.603+0000 7f90d7200640 1 --2- 172.21.15.19:0/243876182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90d81445d0 0x7f90d806deb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f90d806e6d0 tx=0x7f90c802b910 comp rx=0 tx=0).stop 2024-03-08T06:03:54.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.604+0000 7f90d7200640 1 -- 172.21.15.19:0/243876182 shutdown_connections 2024-03-08T06:03:54.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.604+0000 7f90d7200640 1 --2- 172.21.15.19:0/243876182 >> v2:172.21.15.42:3300/0 conn(0x7f90d8071b80 0x7f90d80cc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:54.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.604+0000 7f90d7200640 1 --2- 172.21.15.19:0/243876182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90d81445d0 0x7f90d806deb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:54.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.604+0000 7f90d7200640 1 -- 172.21.15.19:0/243876182 >> 172.21.15.19:0/243876182 conn(0x7f90d80b1600 msgr2=0x7f90d80b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:54.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.604+0000 7f90d7200640 1 -- 172.21.15.19:0/243876182 shutdown_connections 2024-03-08T06:03:54.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.604+0000 7f90d7200640 1 -- 172.21.15.19:0/243876182 wait complete. 2024-03-08T06:03:54.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.605+0000 7f90d7200640 1 Processor -- start 2024-03-08T06:03:54.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.606+0000 7f90d7200640 1 -- start start 2024-03-08T06:03:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.606+0000 7f90d7200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90d8071b80 0x7f90d815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.607+0000 7f90d7200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f90d81445d0 0x7f90d815a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.607+0000 7f90d7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90d8144d50 0x7f90d815abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.607+0000 7f90d7200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d81449b0 con 0x7f90d8071b80 2024-03-08T06:03:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.607+0000 7f90d7200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d80cc340 con 0x7f90d8144d50 2024-03-08T06:03:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.607+0000 7f90d7200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d8144b30 con 0x7f90d81445d0 2024-03-08T06:03:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.607+0000 7f90d5e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90d8071b80 0x7f90d815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.607+0000 7f90d5e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90d8071b80 0x7f90d815ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45640/0 (socket says 172.21.15.19:45640) 2024-03-08T06:03:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.607+0000 7f90d5e00640 1 -- 172.21.15.19:0/3263641163 learned_addr learned my addr 172.21.15.19:0/3263641163 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.607+0000 7f90cfe00640 1 --2- 172.21.15.19:0/3263641163 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f90d81445d0 0x7f90d815a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.607+0000 7f90d6800640 1 --2- 172.21.15.19:0/3263641163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90d8144d50 0x7f90d815abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:54.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.608+0000 7f90d5e00640 1 -- 172.21.15.19:0/3263641163 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f90d81445d0 msgr2=0x7f90d815a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:54.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.608+0000 7f90d5e00640 1 --2- 172.21.15.19:0/3263641163 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f90d81445d0 0x7f90d815a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:54.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.608+0000 7f90d5e00640 1 -- 172.21.15.19:0/3263641163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90d8144d50 msgr2=0x7f90d815abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:54.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.608+0000 7f90d5e00640 1 --2- 172.21.15.19:0/3263641163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90d8144d50 0x7f90d815abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:54.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.608+0000 7f90d5e00640 1 -- 172.21.15.19:0/3263641163 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d81f2920 con 0x7f90d8071b80 2024-03-08T06:03:54.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.608+0000 7f90d5e00640 1 --2- 172.21.15.19:0/3263641163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90d8071b80 0x7f90d815ddd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f90c802b950 tx=0x7f90c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:54.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.608+0000 7f90ce000640 1 -- 172.21.15.19:0/3263641163 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c803ad60 con 0x7f90d8071b80 2024-03-08T06:03:54.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.608+0000 7f90ce000640 1 -- 172.21.15.19:0/3263641163 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c80443f0 con 0x7f90d8071b80 2024-03-08T06:03:54.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.608+0000 7f90ce000640 1 -- 172.21.15.19:0/3263641163 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c80447e0 con 0x7f90d8071b80 2024-03-08T06:03:54.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.608+0000 7f90d7200640 1 -- 172.21.15.19:0/3263641163 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d81f1b60 con 0x7f90d8071b80 2024-03-08T06:03:54.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.608+0000 7f90d7200640 1 -- 172.21.15.19:0/3263641163 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d81f2120 con 0x7f90d8071b80 2024-03-08T06:03:54.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.610+0000 7f90d7200640 1 -- 172.21.15.19:0/3263641163 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d8075100 con 0x7f90d8071b80 2024-03-08T06:03:54.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.610+0000 7f90ce000640 1 -- 172.21.15.19:0/3263641163 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f90c8038020 con 0x7f90d8071b80 2024-03-08T06:03:54.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.611+0000 7f90ce000640 1 --2- 172.21.15.19:0/3263641163 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f90b406b4d0 0x7f90b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:54.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.611+0000 7f90ce000640 1 -- 172.21.15.19:0/3263641163 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90c80ac540 con 0x7f90d8071b80 2024-03-08T06:03:54.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.612+0000 7f90cfe00640 1 --2- 172.21.15.19:0/3263641163 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f90b406b4d0 0x7f90b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:54.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.612+0000 7f90cfe00640 1 --2- 172.21.15.19:0/3263641163 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f90b406b4d0 0x7f90b406d990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f90c0006fd0 tx=0x7f90c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:54.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.616+0000 7f90ce000640 1 -- 172.21.15.19:0/3263641163 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f90c803f070 con 0x7f90d8071b80 2024-03-08T06:03:54.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.821+0000 7f90d7200640 1 -- 172.21.15.19:0/3263641163 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90d80af350 con 0x7f90d8071b80 2024-03-08T06:03:54.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.823+0000 7f90ce000640 1 -- 172.21.15.19:0/3263641163 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f90c807b320 con 0x7f90d8071b80 2024-03-08T06:03:54.824 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:54.824 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:03:22.069498+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:03:18.392703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T06:03:19.537912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:03:54.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.825+0000 7f90d7200640 1 -- 172.21.15.19:0/3263641163 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f90b406b4d0 msgr2=0x7f90b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:54.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.825+0000 7f90d7200640 1 --2- 172.21.15.19:0/3263641163 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f90b406b4d0 0x7f90b406d990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f90c0006fd0 tx=0x7f90c0008040 comp rx=0 tx=0).stop 2024-03-08T06:03:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.825+0000 7f90d7200640 1 -- 172.21.15.19:0/3263641163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90d8071b80 msgr2=0x7f90d815ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.825+0000 7f90d7200640 1 --2- 172.21.15.19:0/3263641163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90d8071b80 0x7f90d815ddd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f90c802b950 tx=0x7f90c80046c0 comp rx=0 tx=0).stop 2024-03-08T06:03:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.826+0000 7f90d7200640 1 -- 172.21.15.19:0/3263641163 shutdown_connections 2024-03-08T06:03:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.826+0000 7f90d7200640 1 --2- 172.21.15.19:0/3263641163 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f90b406b4d0 0x7f90b406d990 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.826+0000 7f90d7200640 1 --2- 172.21.15.19:0/3263641163 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f90d8144d50 0x7f90d815abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.826+0000 7f90d7200640 1 --2- 172.21.15.19:0/3263641163 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f90d81445d0 0x7f90d815a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.826+0000 7f90d7200640 1 --2- 172.21.15.19:0/3263641163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90d8071b80 0x7f90d815ddd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.826+0000 7f90d7200640 1 -- 172.21.15.19:0/3263641163 >> 172.21.15.19:0/3263641163 conn(0x7f90d80b1600 msgr2=0x7f90d80af570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.826+0000 7f90d7200640 1 -- 172.21.15.19:0/3263641163 shutdown_connections 2024-03-08T06:03:54.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:54.826+0000 7f90d7200640 1 -- 172.21.15.19:0/3263641163 wait complete. 2024-03-08T06:03:54.847 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T06:03:14.149736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T06:03:18.392703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T06:03:19.537912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T06:03:54.847 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T06:03:55.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.062+0000 7f36ef200640 1 Processor -- start 2024-03-08T06:03:55.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.062+0000 7f36ef200640 1 -- start start 2024-03-08T06:03:55.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.064+0000 7f36ef200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f36e815df50 0x7f36e80d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:55.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.064+0000 7f36ef200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e815e330 con 0x7f36e80cea10 2024-03-08T06:03:55.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.064+0000 7f36ef200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e80d3b10 con 0x7f36e80d20a0 2024-03-08T06:03:55.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.064+0000 7f36ef200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e80d2530 con 0x7f36e815df50 2024-03-08T06:03:55.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.064+0000 7f36ed200640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f36e80cea10 0x7f36e80b6e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46126/0 (socket says 172.21.15.19:46126) 2024-03-08T06:03:55.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.064+0000 7f36ed200640 1 -- 172.21.15.19:0/1106085298 learned_addr learned my addr 172.21.15.19:0/1106085298 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.064+0000 7f36e7e00640 1 --2- 172.21.15.19:0/1106085298 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f36e815df50 0x7f36e80d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.065+0000 7f36e6a00640 1 -- 172.21.15.19:0/1106085298 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239219062 0 0) 0x7f36e0001490 con 0x7f36e80cea10 2024-03-08T06:03:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.065+0000 7f36e6a00640 1 -- 172.21.15.19:0/1106085298 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36c8003520 con 0x7f36e80cea10 2024-03-08T06:03:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.065+0000 7f36e6a00640 1 -- 172.21.15.19:0/1106085298 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2900852761 0 0) 0x7f36c8003520 con 0x7f36e80cea10 2024-03-08T06:03:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.065+0000 7f36e6a00640 1 -- 172.21.15.19:0/1106085298 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f36e815df50 msgr2=0x7f36e80d35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.065+0000 7f36e6a00640 1 --2- 172.21.15.19:0/1106085298 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f36e815df50 0x7f36e80d35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.065+0000 7f36e6a00640 1 -- 172.21.15.19:0/1106085298 >> v1:172.21.15.42:6789/0 conn(0x7f36e80d20a0 legacy=0x7f36e80b9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.065+0000 7f36e6a00640 1 -- 172.21.15.19:0/1106085298 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e80d2810 con 0x7f36e80cea10 2024-03-08T06:03:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.065+0000 7f36e6a00640 1 -- 172.21.15.19:0/1106085298 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f36e0001bc0 con 0x7f36e80cea10 2024-03-08T06:03:55.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.065+0000 7f36e6a00640 1 -- 172.21.15.19:0/1106085298 >> v1:172.21.15.19:6789/0 conn(0x7f36e80cea10 legacy=0x7f36e80b6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:55.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.065+0000 7f36e6a00640 1 --2- 172.21.15.19:0/1106085298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36c80039e0 0x7f36c8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:55.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.065+0000 7f36e6a00640 1 --2- 172.21.15.19:0/1106085298 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f36c8004390 0x7f36c8004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:55.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.065+0000 7f36e6a00640 1 --2- 172.21.15.19:0/1106085298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36c8005010 0x7f36c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:55.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.065+0000 7f36e6a00640 1 -- 172.21.15.19:0/1106085298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e80d2530 con 0x7f36c80039e0 2024-03-08T06:03:55.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.065+0000 7f36e6a00640 1 -- 172.21.15.19:0/1106085298 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36c800bf30 con 0x7f36c8005010 2024-03-08T06:03:55.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.065+0000 7f36e6a00640 1 -- 172.21.15.19:0/1106085298 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36c800c130 con 0x7f36c8004390 2024-03-08T06:03:55.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.065+0000 7f36e7e00640 1 --2- 172.21.15.19:0/1106085298 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f36e815df50 0x7f36e80d35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T06:03:55.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.066+0000 7f36e7e00640 1 --2- 172.21.15.19:0/1106085298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36c80039e0 0x7f36c8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:55.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.066+0000 7f36ed200640 1 --2- 172.21.15.19:0/1106085298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36c8005010 0x7f36c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:55.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.066+0000 7f36e7400640 1 --2- 172.21.15.19:0/1106085298 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f36c8004390 0x7f36c8004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:55.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.066+0000 7f36e7e00640 1 -- 172.21.15.19:0/1106085298 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f36c8004390 msgr2=0x7f36c8004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.066+0000 7f36e7e00640 1 --2- 172.21.15.19:0/1106085298 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f36c8004390 0x7f36c8004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.066+0000 7f36e7e00640 1 -- 172.21.15.19:0/1106085298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36c8005010 msgr2=0x7f36c800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.066+0000 7f36e7e00640 1 --2- 172.21.15.19:0/1106085298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36c8005010 0x7f36c800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.066+0000 7f36e7e00640 1 -- 172.21.15.19:0/1106085298 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c8003520 con 0x7f36c80039e0 2024-03-08T06:03:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.066+0000 7f36e7400640 1 --2- 172.21.15.19:0/1106085298 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f36c8004390 0x7f36c8004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.066+0000 7f36ed200640 1 --2- 172.21.15.19:0/1106085298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36c8005010 0x7f36c800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:03:55.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.067+0000 7f36e7e00640 1 --2- 172.21.15.19:0/1106085298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36c80039e0 0x7f36c8003dc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f36e8073360 tx=0x7f36c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e218b8de81c305df server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:55.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.068+0000 7f36e6a00640 1 -- 172.21.15.19:0/1106085298 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d80097d0 con 0x7f36c80039e0 2024-03-08T06:03:55.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.068+0000 7f36e6a00640 1 -- 172.21.15.19:0/1106085298 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d8004030 con 0x7f36c80039e0 2024-03-08T06:03:55.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.068+0000 7f36e6a00640 1 -- 172.21.15.19:0/1106085298 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8004400 con 0x7f36c80039e0 2024-03-08T06:03:55.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.068+0000 7f36ef200640 1 -- 172.21.15.19:0/1106085298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36c80039e0 msgr2=0x7f36c8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:55.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.068+0000 7f36ef200640 1 --2- 172.21.15.19:0/1106085298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36c80039e0 0x7f36c8003dc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f36e8073360 tx=0x7f36c8005830 comp rx=0 tx=0).stop 2024-03-08T06:03:55.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.068+0000 7f36ed200640 1 -- 172.21.15.19:0/1106085298 reap_dead start 2024-03-08T06:03:55.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.068+0000 7f36ef200640 1 -- 172.21.15.19:0/1106085298 shutdown_connections 2024-03-08T06:03:55.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.068+0000 7f36ef200640 1 -- 172.21.15.19:0/1106085298 >> 172.21.15.19:0/1106085298 conn(0x7f36e8072c70 msgr2=0x7f36e80d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:55.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.069+0000 7f36ef200640 1 -- 172.21.15.19:0/1106085298 shutdown_connections 2024-03-08T06:03:55.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.069+0000 7f36ef200640 1 -- 172.21.15.19:0/1106085298 wait complete. 2024-03-08T06:03:55.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.070+0000 7f36ef200640 1 Processor -- start 2024-03-08T06:03:55.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.071+0000 7f36ef200640 1 -- start start 2024-03-08T06:03:55.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.071+0000 7f36ef200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36c80039e0 0x7f36e80cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:55.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.071+0000 7f36ef200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36e80ca230 0x7f36e8155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:55.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.071+0000 7f36ef200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f36e80c76c0 0x7f36e80c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:55.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.071+0000 7f36ef200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e80d35d0 con 0x7f36c80039e0 2024-03-08T06:03:55.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.071+0000 7f36ef200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e80d2dd0 con 0x7f36e80ca230 2024-03-08T06:03:55.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.071+0000 7f36ef200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e80d3750 con 0x7f36e80c76c0 2024-03-08T06:03:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.072+0000 7f36e7e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36c80039e0 0x7f36e80cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.072+0000 7f36e7e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36c80039e0 0x7f36e80cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45656/0 (socket says 172.21.15.19:45656) 2024-03-08T06:03:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.072+0000 7f36e7e00640 1 -- 172.21.15.19:0/3133755669 learned_addr learned my addr 172.21.15.19:0/3133755669 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.072+0000 7f36e7400640 1 --2- 172.21.15.19:0/3133755669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36e80ca230 0x7f36e8155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.072+0000 7f36ed200640 1 --2- 172.21.15.19:0/3133755669 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f36e80c76c0 0x7f36e80c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.072+0000 7f36e7e00640 1 -- 172.21.15.19:0/3133755669 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f36e80c76c0 msgr2=0x7f36e80c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.072+0000 7f36e7e00640 1 --2- 172.21.15.19:0/3133755669 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f36e80c76c0 0x7f36e80c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.072+0000 7f36e7e00640 1 -- 172.21.15.19:0/3133755669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36e80ca230 msgr2=0x7f36e8155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.072+0000 7f36e7e00640 1 --2- 172.21.15.19:0/3133755669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36e80ca230 0x7f36e8155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.072+0000 7f36e7e00640 1 -- 172.21.15.19:0/3133755669 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e80c73f0 con 0x7f36c80039e0 2024-03-08T06:03:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.072+0000 7f36ed200640 1 --2- 172.21.15.19:0/3133755669 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f36e80c76c0 0x7f36e80c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.073+0000 7f36e7e00640 1 --2- 172.21.15.19:0/3133755669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36c80039e0 0x7f36e80cd8c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f36d802c380 tx=0x7f36d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:55.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.073+0000 7f36dfe00640 1 -- 172.21.15.19:0/3133755669 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8042070 con 0x7f36c80039e0 2024-03-08T06:03:55.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.073+0000 7f36dfe00640 1 -- 172.21.15.19:0/3133755669 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d802cb20 con 0x7f36c80039e0 2024-03-08T06:03:55.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.073+0000 7f36dfe00640 1 -- 172.21.15.19:0/3133755669 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d8003610 con 0x7f36c80039e0 2024-03-08T06:03:55.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.073+0000 7f36ef200640 1 -- 172.21.15.19:0/3133755669 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e81441d0 con 0x7f36c80039e0 2024-03-08T06:03:55.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.074+0000 7f36ef200640 1 -- 172.21.15.19:0/3133755669 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e8155a40 con 0x7f36c80039e0 2024-03-08T06:03:55.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.075+0000 7f36ef200640 1 -- 172.21.15.19:0/3133755669 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e80683c0 con 0x7f36c80039e0 2024-03-08T06:03:55.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.076+0000 7f36dfe00640 1 -- 172.21.15.19:0/3133755669 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f36d8045070 con 0x7f36c80039e0 2024-03-08T06:03:55.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.077+0000 7f36dfe00640 1 --2- 172.21.15.19:0/3133755669 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f36c406b500 0x7f36c406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:55.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.077+0000 7f36dfe00640 1 -- 172.21.15.19:0/3133755669 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36d80ac3e0 con 0x7f36c80039e0 2024-03-08T06:03:55.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.078+0000 7f36e7400640 1 --2- 172.21.15.19:0/3133755669 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f36c406b500 0x7f36c406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:55.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.078+0000 7f36e7400640 1 --2- 172.21.15.19:0/3133755669 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f36c406b500 0x7f36c406d9c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f36d0000f60 tx=0x7f36d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:55.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.084+0000 7f36dfe00640 1 -- 172.21.15.19:0/3133755669 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f36d807b250 con 0x7f36c80039e0 2024-03-08T06:03:55.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.283+0000 7f36ef200640 1 -- 172.21.15.19:0/3133755669 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36e815b280 con 0x7f36c80039e0 2024-03-08T06:03:55.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.284+0000 7f36dfe00640 1 -- 172.21.15.19:0/3133755669 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f36d807ab50 con 0x7f36c80039e0 2024-03-08T06:03:55.285 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-08T06:03:55.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.286+0000 7f36ef200640 1 -- 172.21.15.19:0/3133755669 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f36c406b500 msgr2=0x7f36c406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:55.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.286+0000 7f36ef200640 1 --2- 172.21.15.19:0/3133755669 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f36c406b500 0x7f36c406d9c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f36d0000f60 tx=0x7f36d0009040 comp rx=0 tx=0).stop 2024-03-08T06:03:55.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.286+0000 7f36ef200640 1 -- 172.21.15.19:0/3133755669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36c80039e0 msgr2=0x7f36e80cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:55.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.286+0000 7f36ef200640 1 --2- 172.21.15.19:0/3133755669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36c80039e0 0x7f36e80cd8c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f36d802c380 tx=0x7f36d8004730 comp rx=0 tx=0).stop 2024-03-08T06:03:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.286+0000 7f36ef200640 1 -- 172.21.15.19:0/3133755669 shutdown_connections 2024-03-08T06:03:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.286+0000 7f36ef200640 1 --2- 172.21.15.19:0/3133755669 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f36c406b500 0x7f36c406d9c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.286+0000 7f36ef200640 1 --2- 172.21.15.19:0/3133755669 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f36e80c76c0 0x7f36e80c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.286+0000 7f36ef200640 1 --2- 172.21.15.19:0/3133755669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36e80ca230 0x7f36e8155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.286+0000 7f36ef200640 1 --2- 172.21.15.19:0/3133755669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36c80039e0 0x7f36e80cd8c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.286+0000 7f36ef200640 1 -- 172.21.15.19:0/3133755669 >> 172.21.15.19:0/3133755669 conn(0x7f36e8072c70 msgr2=0x7f36e80b3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.287+0000 7f36ef200640 1 -- 172.21.15.19:0/3133755669 shutdown_connections 2024-03-08T06:03:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.287+0000 7f36ef200640 1 -- 172.21.15.19:0/3133755669 wait complete. 2024-03-08T06:03:55.307 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T06:03:55.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.531+0000 7fde31a00640 1 Processor -- start 2024-03-08T06:03:55.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.531+0000 7fde31a00640 1 -- start start 2024-03-08T06:03:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.533+0000 7fde31a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde2c15de60 0x7fde2c161930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.533+0000 7fde31a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fde2c0cf030 0x7fde2c0d25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.533+0000 7fde31a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde2c15e240 con 0x7fde2c0b9630 2024-03-08T06:03:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.533+0000 7fde31a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde2c162030 con 0x7fde2c0cf030 2024-03-08T06:03:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.533+0000 7fde31a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c162310 con 0x7fde2c15de60 2024-03-08T06:03:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.533+0000 7fde31000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fde2c0cf030 0x7fde2c0d25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.533+0000 7fde2b400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fde2c0b9630 0x7fde2c0ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46132/0 (socket says 172.21.15.19:46132) 2024-03-08T06:03:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.533+0000 7fde2b400640 1 -- 172.21.15.19:0/2348700855 learned_addr learned my addr 172.21.15.19:0/2348700855 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.534+0000 7fde2be00640 1 --2- 172.21.15.19:0/2348700855 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde2c15de60 0x7fde2c161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.534+0000 7fde31000640 1 -- 172.21.15.19:0/2348700855 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde2c15de60 msgr2=0x7fde2c161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:55.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.534+0000 7fde31000640 1 --2- 172.21.15.19:0/2348700855 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde2c15de60 0x7fde2c161930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:55.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.534+0000 7fde31000640 1 -- 172.21.15.19:0/2348700855 >> v1:172.21.15.19:6789/0 conn(0x7fde2c0b9630 legacy=0x7fde2c0ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:55.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.534+0000 7fde2aa00640 1 -- 172.21.15.19:0/2348700855 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838297528 0 0) 0x7fde2c15e240 con 0x7fde2c0b9630 2024-03-08T06:03:55.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.534+0000 7fde31000640 1 -- 172.21.15.19:0/2348700855 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2c1625f0 con 0x7fde2c0cf030 2024-03-08T06:03:55.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.534+0000 7fde2be00640 1 --2- 172.21.15.19:0/2348700855 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde2c15de60 0x7fde2c161930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:03:55.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.535+0000 7fde31000640 1 --2- 172.21.15.19:0/2348700855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde2c0cf030 0x7fde2c0d25e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fde240097a0 tx=0x7fde2402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721fba2d3972d6f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.536+0000 7fde2aa00640 1 -- 172.21.15.19:0/2348700855 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde24035020 con 0x7fde2c0cf030 2024-03-08T06:03:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.536+0000 7fde2aa00640 1 -- 172.21.15.19:0/2348700855 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde24031810 con 0x7fde2c0cf030 2024-03-08T06:03:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.536+0000 7fde2aa00640 1 -- 172.21.15.19:0/2348700855 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde24031be0 con 0x7fde2c0cf030 2024-03-08T06:03:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.536+0000 7fde31a00640 1 -- 172.21.15.19:0/2348700855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde2c0cf030 msgr2=0x7fde2c0d25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.536+0000 7fde31a00640 1 --2- 172.21.15.19:0/2348700855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde2c0cf030 0x7fde2c0d25e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fde240097a0 tx=0x7fde2402b8b0 comp rx=0 tx=0).stop 2024-03-08T06:03:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.536+0000 7fde31a00640 1 -- 172.21.15.19:0/2348700855 shutdown_connections 2024-03-08T06:03:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.536+0000 7fde31a00640 1 --2- 172.21.15.19:0/2348700855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde2c0cf030 0x7fde2c0d25e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.536+0000 7fde31a00640 1 --2- 172.21.15.19:0/2348700855 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde2c15de60 0x7fde2c161930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.536+0000 7fde31a00640 1 -- 172.21.15.19:0/2348700855 >> 172.21.15.19:0/2348700855 conn(0x7fde2c06c500 msgr2=0x7fde2c06c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.537+0000 7fde31a00640 1 -- 172.21.15.19:0/2348700855 shutdown_connections 2024-03-08T06:03:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.537+0000 7fde31a00640 1 -- 172.21.15.19:0/2348700855 wait complete. 2024-03-08T06:03:55.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.538+0000 7fde31a00640 1 Processor -- start 2024-03-08T06:03:55.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.538+0000 7fde31a00640 1 -- start start 2024-03-08T06:03:55.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.539+0000 7fde31a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde2c0b9630 0x7fde2c1534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:55.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.539+0000 7fde31a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde2c0cf030 0x7fde2c0c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:55.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.539+0000 7fde31a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde2c15de60 0x7fde2c1eaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:55.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.539+0000 7fde31a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c0d2b20 con 0x7fde2c15de60 2024-03-08T06:03:55.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.539+0000 7fde31a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c0b9a90 con 0x7fde2c0cf030 2024-03-08T06:03:55.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.539+0000 7fde31a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c0d2ca0 con 0x7fde2c0b9630 2024-03-08T06:03:55.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.540+0000 7fde31000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde2c15de60 0x7fde2c1eaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:55.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.540+0000 7fde31000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde2c15de60 0x7fde2c1eaf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45666/0 (socket says 172.21.15.19:45666) 2024-03-08T06:03:55.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.540+0000 7fde31000640 1 -- 172.21.15.19:0/355430506 learned_addr learned my addr 172.21.15.19:0/355430506 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:55.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.540+0000 7fde2be00640 1 --2- 172.21.15.19:0/355430506 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde2c0b9630 0x7fde2c1534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:55.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.540+0000 7fde2b400640 1 --2- 172.21.15.19:0/355430506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde2c0cf030 0x7fde2c0c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:55.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.540+0000 7fde31000640 1 -- 172.21.15.19:0/355430506 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde2c0b9630 msgr2=0x7fde2c1534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:55.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.540+0000 7fde31000640 1 --2- 172.21.15.19:0/355430506 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde2c0b9630 0x7fde2c1534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:55.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.540+0000 7fde31000640 1 -- 172.21.15.19:0/355430506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde2c0cf030 msgr2=0x7fde2c0c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:55.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.540+0000 7fde31000640 1 --2- 172.21.15.19:0/355430506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde2c0cf030 0x7fde2c0c9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:55.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.540+0000 7fde31000640 1 -- 172.21.15.19:0/355430506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2c0b4900 con 0x7fde2c15de60 2024-03-08T06:03:55.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.541+0000 7fde31000640 1 --2- 172.21.15.19:0/355430506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde2c15de60 0x7fde2c1eaf10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fde240098c0 tx=0x7fde240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:55.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.541+0000 7fde23e00640 1 -- 172.21.15.19:0/355430506 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde24041070 con 0x7fde2c15de60 2024-03-08T06:03:55.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.541+0000 7fde23e00640 1 -- 172.21.15.19:0/355430506 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2403ac80 con 0x7fde2c15de60 2024-03-08T06:03:55.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.541+0000 7fde23e00640 1 -- 172.21.15.19:0/355430506 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde24035040 con 0x7fde2c15de60 2024-03-08T06:03:55.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.541+0000 7fde31a00640 1 -- 172.21.15.19:0/355430506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde2c0b4be0 con 0x7fde2c15de60 2024-03-08T06:03:55.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.541+0000 7fde31a00640 1 -- 172.21.15.19:0/355430506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde2c0b51a0 con 0x7fde2c15de60 2024-03-08T06:03:55.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.542+0000 7fde31a00640 1 -- 172.21.15.19:0/355430506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde2c0b5980 con 0x7fde2c15de60 2024-03-08T06:03:55.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.543+0000 7fde23e00640 1 -- 172.21.15.19:0/355430506 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fde24038020 con 0x7fde2c15de60 2024-03-08T06:03:55.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.544+0000 7fde23e00640 1 --2- 172.21.15.19:0/355430506 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fde0c06b500 0x7fde0c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:55.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.544+0000 7fde23e00640 1 -- 172.21.15.19:0/355430506 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde240abdd0 con 0x7fde2c15de60 2024-03-08T06:03:55.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.544+0000 7fde2be00640 1 --2- 172.21.15.19:0/355430506 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fde0c06b500 0x7fde0c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:55.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.545+0000 7fde2be00640 1 --2- 172.21.15.19:0/355430506 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fde0c06b500 0x7fde0c06d9c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0096d0 tx=0x7fde1c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:55.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.549+0000 7fde23e00640 1 -- 172.21.15.19:0/355430506 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fde2c0b5980 con 0x7fde2c15de60 2024-03-08T06:03:55.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.749+0000 7fde31a00640 1 -- 172.21.15.19:0/355430506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fde2c0cdce0 con 0x7fde2c15de60 2024-03-08T06:03:55.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.750+0000 7fde23e00640 1 -- 172.21.15.19:0/355430506 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fde2407ace0 con 0x7fde2c15de60 2024-03-08T06:03:55.751 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-08T06:03:55.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.753+0000 7fde31a00640 1 -- 172.21.15.19:0/355430506 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fde0c06b500 msgr2=0x7fde0c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:55.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.753+0000 7fde31a00640 1 --2- 172.21.15.19:0/355430506 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fde0c06b500 0x7fde0c06d9c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0096d0 tx=0x7fde1c008040 comp rx=0 tx=0).stop 2024-03-08T06:03:55.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.753+0000 7fde31a00640 1 -- 172.21.15.19:0/355430506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde2c15de60 msgr2=0x7fde2c1eaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:55.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.753+0000 7fde31a00640 1 --2- 172.21.15.19:0/355430506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde2c15de60 0x7fde2c1eaf10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fde240098c0 tx=0x7fde240046c0 comp rx=0 tx=0).stop 2024-03-08T06:03:55.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.753+0000 7fde31a00640 1 -- 172.21.15.19:0/355430506 shutdown_connections 2024-03-08T06:03:55.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.753+0000 7fde31a00640 1 --2- 172.21.15.19:0/355430506 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fde0c06b500 0x7fde0c06d9c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:55.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.753+0000 7fde31a00640 1 --2- 172.21.15.19:0/355430506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde2c15de60 0x7fde2c1eaf10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:55.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.753+0000 7fde31a00640 1 --2- 172.21.15.19:0/355430506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde2c0cf030 0x7fde2c0c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:55.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.753+0000 7fde31a00640 1 --2- 172.21.15.19:0/355430506 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fde2c0b9630 0x7fde2c1534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:55.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.753+0000 7fde31a00640 1 -- 172.21.15.19:0/355430506 >> 172.21.15.19:0/355430506 conn(0x7fde2c06c500 msgr2=0x7fde2c0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:55.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.753+0000 7fde31a00640 1 -- 172.21.15.19:0/355430506 shutdown_connections 2024-03-08T06:03:55.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.753+0000 7fde31a00640 1 -- 172.21.15.19:0/355430506 wait complete. 2024-03-08T06:03:55.772 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T06:03:55.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.998+0000 7f9924a00640 1 Processor -- start 2024-03-08T06:03:55.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.998+0000 7f9924a00640 1 -- start start 2024-03-08T06:03:56.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:55.999+0000 7f9924a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9920144240 0x7f99200cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.000+0000 7f9924a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f99200b42c0 0x7f992006e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.000+0000 7f9924a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99200cd3e0 con 0x7f99200ccef0 2024-03-08T06:03:56.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.000+0000 7f9924a00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99200b3e30 con 0x7f9920144240 2024-03-08T06:03:56.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.000+0000 7f9924a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99200cd6c0 con 0x7f99200b42c0 2024-03-08T06:03:56.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.000+0000 7f991f200640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f99200ccef0 0x7f99200716e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46140/0 (socket says 172.21.15.19:46140) 2024-03-08T06:03:56.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.000+0000 7f991f200640 1 -- 172.21.15.19:0/3933854255 learned_addr learned my addr 172.21.15.19:0/3933854255 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:56.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.000+0000 7f991de00640 1 --2- 172.21.15.19:0/3933854255 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f99200b42c0 0x7f992006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:56.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.000+0000 7f991e800640 1 --2- 172.21.15.19:0/3933854255 >> v2:172.21.15.42:3300/0 conn(0x7f9920144240 0x7f99200cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:56.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.000+0000 7f991d400640 1 -- 172.21.15.19:0/3933854255 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579651798 0 0) 0x7f99200cd3e0 con 0x7f99200ccef0 2024-03-08T06:03:56.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.001+0000 7f991d400640 1 -- 172.21.15.19:0/3933854255 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9904003520 con 0x7f99200ccef0 2024-03-08T06:03:56.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.001+0000 7f991d400640 1 -- 172.21.15.19:0/3933854255 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3880545506 0 0) 0x7f9904003520 con 0x7f99200ccef0 2024-03-08T06:03:56.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.001+0000 7f991d400640 1 -- 172.21.15.19:0/3933854255 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f99200b42c0 msgr2=0x7f992006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:56.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.001+0000 7f991d400640 1 --2- 172.21.15.19:0/3933854255 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f99200b42c0 0x7f992006e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.001+0000 7f991d400640 1 -- 172.21.15.19:0/3933854255 >> v2:172.21.15.42:3300/0 conn(0x7f9920144240 msgr2=0x7f99200cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:56.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.001+0000 7f991d400640 1 --2- 172.21.15.19:0/3933854255 >> v2:172.21.15.42:3300/0 conn(0x7f9920144240 0x7f99200cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.001+0000 7f991d400640 1 -- 172.21.15.19:0/3933854255 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99200b37e0 con 0x7f99200ccef0 2024-03-08T06:03:56.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.001+0000 7f991d400640 1 -- 172.21.15.19:0/3933854255 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f99180019f0 con 0x7f99200ccef0 2024-03-08T06:03:56.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.001+0000 7f991d400640 1 -- 172.21.15.19:0/3933854255 >> v1:172.21.15.19:6789/0 conn(0x7f99200ccef0 legacy=0x7f99200716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:56.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.001+0000 7f991d400640 1 --2- 172.21.15.19:0/3933854255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9904003a20 0x7f9904003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.001+0000 7f991d400640 1 --2- 172.21.15.19:0/3933854255 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9904004800 0x7f9904004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.001+0000 7f991d400640 1 --2- 172.21.15.19:0/3933854255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9904005180 0x7f990400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.001+0000 7f991d400640 1 -- 172.21.15.19:0/3933854255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99200b3e30 con 0x7f9904003a20 2024-03-08T06:03:56.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.001+0000 7f991d400640 1 -- 172.21.15.19:0/3933854255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99200cd6c0 con 0x7f9904005180 2024-03-08T06:03:56.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.001+0000 7f991d400640 1 -- 172.21.15.19:0/3933854255 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990400bf00 con 0x7f9904004800 2024-03-08T06:03:56.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.001+0000 7f991e800640 1 --2- 172.21.15.19:0/3933854255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9904003a20 0x7f9904003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:56.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.002+0000 7f991f200640 1 --2- 172.21.15.19:0/3933854255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9904005180 0x7f990400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:56.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.002+0000 7f991e800640 1 -- 172.21.15.19:0/3933854255 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9904004800 msgr2=0x7f9904004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:56.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.002+0000 7f991de00640 1 --2- 172.21.15.19:0/3933854255 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9904004800 0x7f9904004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:56.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.002+0000 7f991e800640 1 --2- 172.21.15.19:0/3933854255 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9904004800 0x7f9904004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.002+0000 7f991e800640 1 -- 172.21.15.19:0/3933854255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9904005180 msgr2=0x7f990400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:56.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.002+0000 7f991e800640 1 --2- 172.21.15.19:0/3933854255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9904005180 0x7f990400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.002+0000 7f991e800640 1 -- 172.21.15.19:0/3933854255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9904003520 con 0x7f9904003a20 2024-03-08T06:03:56.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.002+0000 7f991f200640 1 --2- 172.21.15.19:0/3933854255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9904005180 0x7f990400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:56.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.003+0000 7f991e800640 1 --2- 172.21.15.19:0/3933854255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9904003a20 0x7f9904003e40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9910009650 tx=0x7f9904005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5dabde2806892b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:56.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.003+0000 7f991d400640 1 -- 172.21.15.19:0/3933854255 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991003b070 con 0x7f9904003a20 2024-03-08T06:03:56.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.003+0000 7f991d400640 1 -- 172.21.15.19:0/3933854255 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991002e920 con 0x7f9904003a20 2024-03-08T06:03:56.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.003+0000 7f991d400640 1 -- 172.21.15.19:0/3933854255 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910009690 con 0x7f9904003a20 2024-03-08T06:03:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.004+0000 7f9924a00640 1 -- 172.21.15.19:0/3933854255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9904003a20 msgr2=0x7f9904003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.004+0000 7f9924a00640 1 --2- 172.21.15.19:0/3933854255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9904003a20 0x7f9904003e40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9910009650 tx=0x7f9904005830 comp rx=0 tx=0).stop 2024-03-08T06:03:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.004+0000 7f991f200640 1 -- 172.21.15.19:0/3933854255 reap_dead start 2024-03-08T06:03:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.004+0000 7f9924a00640 1 -- 172.21.15.19:0/3933854255 shutdown_connections 2024-03-08T06:03:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.004+0000 7f9924a00640 1 -- 172.21.15.19:0/3933854255 >> 172.21.15.19:0/3933854255 conn(0x7f99200b1850 msgr2=0x7f99200b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.004+0000 7f9924a00640 1 -- 172.21.15.19:0/3933854255 shutdown_connections 2024-03-08T06:03:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.004+0000 7f9924a00640 1 -- 172.21.15.19:0/3933854255 wait complete. 2024-03-08T06:03:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.006+0000 7f9924a00640 1 Processor -- start 2024-03-08T06:03:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.006+0000 7f9924a00640 1 -- start start 2024-03-08T06:03:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.007+0000 7f9924a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9904003a20 0x7f9920143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.007+0000 7f9924a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99200a93b0 0x7f992015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.007+0000 7f9924a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f99200aa8e0 0x7f99200aad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.007+0000 7f9924a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99200b4b30 con 0x7f9904003a20 2024-03-08T06:03:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.007+0000 7f9924a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9920144620 con 0x7f99200a93b0 2024-03-08T06:03:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.007+0000 7f9924a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99200b4cb0 con 0x7f99200aa8e0 2024-03-08T06:03:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.007+0000 7f991e800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9904003a20 0x7f9920143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.007+0000 7f991e800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9904003a20 0x7f9920143700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45676/0 (socket says 172.21.15.19:45676) 2024-03-08T06:03:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.007+0000 7f991e800640 1 -- 172.21.15.19:0/1086452477 learned_addr learned my addr 172.21.15.19:0/1086452477 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.007+0000 7f991f200640 1 --2- 172.21.15.19:0/1086452477 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f99200aa8e0 0x7f99200aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.008+0000 7f991de00640 1 --2- 172.21.15.19:0/1086452477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99200a93b0 0x7f992015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.008+0000 7f991e800640 1 -- 172.21.15.19:0/1086452477 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f99200aa8e0 msgr2=0x7f99200aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:56.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.008+0000 7f991e800640 1 --2- 172.21.15.19:0/1086452477 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f99200aa8e0 0x7f99200aad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.008+0000 7f991e800640 1 -- 172.21.15.19:0/1086452477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99200a93b0 msgr2=0x7f992015a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:56.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.008+0000 7f991e800640 1 --2- 172.21.15.19:0/1086452477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99200a93b0 0x7f992015a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.008+0000 7f991e800640 1 -- 172.21.15.19:0/1086452477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9920141240 con 0x7f9904003a20 2024-03-08T06:03:56.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.008+0000 7f991f200640 1 --2- 172.21.15.19:0/1086452477 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f99200aa8e0 0x7f99200aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:56.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.008+0000 7f991e800640 1 --2- 172.21.15.19:0/1086452477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9904003a20 0x7f9920143700 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9910039040 tx=0x7f9910004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:56.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.008+0000 7f9916a00640 1 -- 172.21.15.19:0/1086452477 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991003b040 con 0x7f9904003a20 2024-03-08T06:03:56.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.008+0000 7f9916a00640 1 -- 172.21.15.19:0/1086452477 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9910044070 con 0x7f9904003a20 2024-03-08T06:03:56.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.008+0000 7f9916a00640 1 -- 172.21.15.19:0/1086452477 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910003610 con 0x7f9904003a20 2024-03-08T06:03:56.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.008+0000 7f9924a00640 1 -- 172.21.15.19:0/1086452477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99200a9a40 con 0x7f9904003a20 2024-03-08T06:03:56.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.009+0000 7f9924a00640 1 -- 172.21.15.19:0/1086452477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99200aa000 con 0x7f9904003a20 2024-03-08T06:03:56.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.010+0000 7f9924a00640 1 -- 172.21.15.19:0/1086452477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9920075090 con 0x7f9904003a20 2024-03-08T06:03:56.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.011+0000 7f9916a00640 1 -- 172.21.15.19:0/1086452477 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f99100037b0 con 0x7f9904003a20 2024-03-08T06:03:56.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.012+0000 7f9916a00640 1 --2- 172.21.15.19:0/1086452477 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f990006b4d0 0x7f990006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.012+0000 7f9916a00640 1 -- 172.21.15.19:0/1086452477 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99100aad30 con 0x7f9904003a20 2024-03-08T06:03:56.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.013+0000 7f991de00640 1 --2- 172.21.15.19:0/1086452477 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f990006b4d0 0x7f990006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:56.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.013+0000 7f991de00640 1 --2- 172.21.15.19:0/1086452477 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f990006b4d0 0x7f990006d990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f992006df70 tx=0x7f990c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:56.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.017+0000 7f9916a00640 1 -- 172.21.15.19:0/1086452477 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9910079ba0 con 0x7f9904003a20 2024-03-08T06:03:56.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.216+0000 7f9924a00640 1 -- 172.21.15.19:0/1086452477 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99200a9790 con 0x7f9904003a20 2024-03-08T06:03:56.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.217+0000 7f9916a00640 1 -- 172.21.15.19:0/1086452477 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f99100794a0 con 0x7f9904003a20 2024-03-08T06:03:56.218 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-08T06:03:56.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.219+0000 7f9924a00640 1 -- 172.21.15.19:0/1086452477 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f990006b4d0 msgr2=0x7f990006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:56.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.219+0000 7f9924a00640 1 --2- 172.21.15.19:0/1086452477 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f990006b4d0 0x7f990006d990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f992006df70 tx=0x7f990c008040 comp rx=0 tx=0).stop 2024-03-08T06:03:56.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.219+0000 7f9924a00640 1 -- 172.21.15.19:0/1086452477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9904003a20 msgr2=0x7f9920143700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:56.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.219+0000 7f9924a00640 1 --2- 172.21.15.19:0/1086452477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9904003a20 0x7f9920143700 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9910039040 tx=0x7f9910004730 comp rx=0 tx=0).stop 2024-03-08T06:03:56.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.219+0000 7f9924a00640 1 -- 172.21.15.19:0/1086452477 shutdown_connections 2024-03-08T06:03:56.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.219+0000 7f9924a00640 1 --2- 172.21.15.19:0/1086452477 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f990006b4d0 0x7f990006d990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.219+0000 7f9924a00640 1 --2- 172.21.15.19:0/1086452477 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f99200aa8e0 0x7f99200aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.219+0000 7f9924a00640 1 --2- 172.21.15.19:0/1086452477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99200a93b0 0x7f992015a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.219+0000 7f9924a00640 1 --2- 172.21.15.19:0/1086452477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9904003a20 0x7f9920143700 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.219+0000 7f9924a00640 1 -- 172.21.15.19:0/1086452477 >> 172.21.15.19:0/1086452477 conn(0x7f99200b1850 msgr2=0x7f992015e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:56.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.220+0000 7f9924a00640 1 -- 172.21.15.19:0/1086452477 shutdown_connections 2024-03-08T06:03:56.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.220+0000 7f9924a00640 1 -- 172.21.15.19:0/1086452477 wait complete. 2024-03-08T06:03:56.238 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:03:56.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.458+0000 7f9375a00640 1 Processor -- start 2024-03-08T06:03:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.458+0000 7f9375a00640 1 -- start start 2024-03-08T06:03:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.460+0000 7f9375a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f93701624d0 0x7f93700b4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.460+0000 7f9375a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9370162960 con 0x7f937015fa00 2024-03-08T06:03:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.460+0000 7f9375a00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9370162c40 con 0x7f93700b4b90 2024-03-08T06:03:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.460+0000 7f9375a00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93700b3080 con 0x7f93701624d0 2024-03-08T06:03:56.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.460+0000 7f936fe00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f937015fa00 0x7f93700b2970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46150/0 (socket says 172.21.15.19:46150) 2024-03-08T06:03:56.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.460+0000 7f936fe00640 1 -- 172.21.15.19:0/3446759517 learned_addr learned my addr 172.21.15.19:0/3446759517 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:56.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.460+0000 7f936f400640 1 --2- 172.21.15.19:0/3446759517 >> v2:172.21.15.42:3300/0 conn(0x7f93701624d0 0x7f93700b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:56.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.460+0000 7f936ea00640 1 -- 172.21.15.19:0/3446759517 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999862400 0 0) 0x7f9370162960 con 0x7f937015fa00 2024-03-08T06:03:56.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.461+0000 7f936ea00640 1 -- 172.21.15.19:0/3446759517 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9354003520 con 0x7f937015fa00 2024-03-08T06:03:56.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.461+0000 7f936ea00640 1 -- 172.21.15.19:0/3446759517 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1031259689 0 0) 0x7f9354003520 con 0x7f937015fa00 2024-03-08T06:03:56.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.461+0000 7f936ea00640 1 -- 172.21.15.19:0/3446759517 >> v2:172.21.15.42:3300/0 conn(0x7f93701624d0 msgr2=0x7f93700b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:56.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.461+0000 7f936ea00640 1 --2- 172.21.15.19:0/3446759517 >> v2:172.21.15.42:3300/0 conn(0x7f93701624d0 0x7f93700b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.461+0000 7f936ea00640 1 -- 172.21.15.19:0/3446759517 >> v1:172.21.15.42:6789/0 conn(0x7f93700b4b90 legacy=0x7f93700716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:56.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.461+0000 7f936ea00640 1 -- 172.21.15.19:0/3446759517 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9370162f20 con 0x7f937015fa00 2024-03-08T06:03:56.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.461+0000 7f936ea00640 1 -- 172.21.15.19:0/3446759517 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f9360001670 con 0x7f937015fa00 2024-03-08T06:03:56.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.461+0000 7f936ea00640 1 -- 172.21.15.19:0/3446759517 >> v1:172.21.15.19:6789/0 conn(0x7f937015fa00 legacy=0x7f93700b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:56.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.461+0000 7f936ea00640 1 --2- 172.21.15.19:0/3446759517 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9354003a00 0x7f9354003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.461+0000 7f936ea00640 1 --2- 172.21.15.19:0/3446759517 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9354004800 0x7f9354004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.461+0000 7f936ea00640 1 --2- 172.21.15.19:0/3446759517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9354005210 0x7f935400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.461+0000 7f936ea00640 1 -- 172.21.15.19:0/3446759517 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93700b3080 con 0x7f9354005210 2024-03-08T06:03:56.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.461+0000 7f936ea00640 1 -- 172.21.15.19:0/3446759517 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935400c140 con 0x7f9354003a00 2024-03-08T06:03:56.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.461+0000 7f936ea00640 1 -- 172.21.15.19:0/3446759517 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935400c340 con 0x7f9354004800 2024-03-08T06:03:56.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.461+0000 7f9375000640 1 --2- 172.21.15.19:0/3446759517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9354005210 0x7f935400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:56.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.462+0000 7f936fe00640 1 --2- 172.21.15.19:0/3446759517 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9354003a00 0x7f9354003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:56.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.462+0000 7f9375000640 1 -- 172.21.15.19:0/3446759517 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9354004800 msgr2=0x7f9354004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:56.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.462+0000 7f9375000640 1 --2- 172.21.15.19:0/3446759517 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9354004800 0x7f9354004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.462+0000 7f9375000640 1 -- 172.21.15.19:0/3446759517 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9354003a00 msgr2=0x7f9354003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:56.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.462+0000 7f9375000640 1 --2- 172.21.15.19:0/3446759517 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9354003a00 0x7f9354003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.462+0000 7f9375000640 1 -- 172.21.15.19:0/3446759517 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9354003520 con 0x7f9354005210 2024-03-08T06:03:56.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.462+0000 7f936fe00640 1 --2- 172.21.15.19:0/3446759517 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9354003a00 0x7f9354003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:56.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.463+0000 7f9375000640 1 -- 172.21.15.19:0/3446759517 reap_dead start 2024-03-08T06:03:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.463+0000 7f9375000640 1 --2- 172.21.15.19:0/3446759517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9354005210 0x7f935400b9c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f93680044b0 tx=0x7f9354005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed34bb968d400274 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.463+0000 7f936ea00640 1 -- 172.21.15.19:0/3446759517 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9368034070 con 0x7f9354005210 2024-03-08T06:03:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.463+0000 7f936ea00640 1 -- 172.21.15.19:0/3446759517 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9368006d70 con 0x7f9354005210 2024-03-08T06:03:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.463+0000 7f936ea00640 1 -- 172.21.15.19:0/3446759517 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9368004080 con 0x7f9354005210 2024-03-08T06:03:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.464+0000 7f9375a00640 1 -- 172.21.15.19:0/3446759517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9354005210 msgr2=0x7f935400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.464+0000 7f9375a00640 1 --2- 172.21.15.19:0/3446759517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9354005210 0x7f935400b9c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f93680044b0 tx=0x7f9354005830 comp rx=0 tx=0).stop 2024-03-08T06:03:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.464+0000 7f9375a00640 1 -- 172.21.15.19:0/3446759517 shutdown_connections 2024-03-08T06:03:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.464+0000 7f9375a00640 1 --2- 172.21.15.19:0/3446759517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9354005210 0x7f935400b9c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.464+0000 7f9375a00640 1 -- 172.21.15.19:0/3446759517 >> 172.21.15.19:0/3446759517 conn(0x7f93700b1850 msgr2=0x7f93700b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.464+0000 7f9375a00640 1 -- 172.21.15.19:0/3446759517 shutdown_connections 2024-03-08T06:03:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.464+0000 7f9375a00640 1 -- 172.21.15.19:0/3446759517 wait complete. 2024-03-08T06:03:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.466+0000 7f9375a00640 1 Processor -- start 2024-03-08T06:03:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.466+0000 7f9375a00640 1 -- start start 2024-03-08T06:03:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.467+0000 7f9375a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9354005210 0x7f9370160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.467+0000 7f9375a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9370151830 0x7f93701f7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.467+0000 7f9375a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93700c6d60 0x7f93700c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.467+0000 7f9375a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93700b4650 con 0x7f9370151830 2024-03-08T06:03:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.467+0000 7f9375a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937015fde0 con 0x7f93700c6d60 2024-03-08T06:03:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.467+0000 7f9375a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93700b47d0 con 0x7f9354005210 2024-03-08T06:03:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.467+0000 7f936f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9370151830 0x7f93701f7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.467+0000 7f936f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9370151830 0x7f93701f7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45704/0 (socket says 172.21.15.19:45704) 2024-03-08T06:03:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.467+0000 7f936f400640 1 -- 172.21.15.19:0/128684879 learned_addr learned my addr 172.21.15.19:0/128684879 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:56.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.467+0000 7f936f400640 1 -- 172.21.15.19:0/128684879 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9354005210 msgr2=0x7f9370160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:56.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.467+0000 7f936f400640 1 --2- 172.21.15.19:0/128684879 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9354005210 0x7f9370160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.467+0000 7f936f400640 1 -- 172.21.15.19:0/128684879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93700c6d60 msgr2=0x7f93700c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:56.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.467+0000 7f936f400640 1 --2- 172.21.15.19:0/128684879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93700c6d60 0x7f93700c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.467+0000 7f936f400640 1 -- 172.21.15.19:0/128684879 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9370160eb0 con 0x7f9370151830 2024-03-08T06:03:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.468+0000 7f936f400640 1 --2- 172.21.15.19:0/128684879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9370151830 0x7f93701f7150 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f935c00e7a0 tx=0x7f935c00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.468+0000 7f9367e00640 1 -- 172.21.15.19:0/128684879 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c017070 con 0x7f9370151830 2024-03-08T06:03:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.468+0000 7f9367e00640 1 -- 172.21.15.19:0/128684879 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c00c8e0 con 0x7f9370151830 2024-03-08T06:03:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.468+0000 7f9367e00640 1 -- 172.21.15.19:0/128684879 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c00ccb0 con 0x7f9370151830 2024-03-08T06:03:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.468+0000 7f9375a00640 1 -- 172.21.15.19:0/128684879 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9370161150 con 0x7f9370151830 2024-03-08T06:03:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.468+0000 7f9375a00640 1 -- 172.21.15.19:0/128684879 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9370161710 con 0x7f9370151830 2024-03-08T06:03:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.469+0000 7f9375a00640 1 -- 172.21.15.19:0/128684879 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9370075100 con 0x7f9370151830 2024-03-08T06:03:56.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.470+0000 7f9367e00640 1 -- 172.21.15.19:0/128684879 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f935c01a070 con 0x7f9370151830 2024-03-08T06:03:56.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.471+0000 7f9367e00640 1 --2- 172.21.15.19:0/128684879 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f935006b500 0x7f935006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.471+0000 7f9367e00640 1 -- 172.21.15.19:0/128684879 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f935c08a040 con 0x7f9370151830 2024-03-08T06:03:56.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.472+0000 7f936fe00640 1 --2- 172.21.15.19:0/128684879 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f935006b500 0x7f935006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:56.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.472+0000 7f936fe00640 1 --2- 172.21.15.19:0/128684879 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f935006b500 0x7f935006d9c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f93600017e0 tx=0x7f9360009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:56.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.476+0000 7f9367e00640 1 -- 172.21.15.19:0/128684879 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f935c058eb0 con 0x7f9370151830 2024-03-08T06:03:56.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.665+0000 7f9375a00640 1 -- 172.21.15.19:0/128684879 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f937006f170 con 0x7f9370151830 2024-03-08T06:03:56.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.668+0000 7f9367e00640 1 -- 172.21.15.19:0/128684879 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f935c0587b0 con 0x7f9370151830 2024-03-08T06:03:56.669 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:56.669 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:03:22.069498+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:03:18.392703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T06:03:19.537912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:03:56.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.671+0000 7f9375a00640 1 -- 172.21.15.19:0/128684879 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f935006b500 msgr2=0x7f935006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:56.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.671+0000 7f9375a00640 1 --2- 172.21.15.19:0/128684879 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f935006b500 0x7f935006d9c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f93600017e0 tx=0x7f9360009040 comp rx=0 tx=0).stop 2024-03-08T06:03:56.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.671+0000 7f9375a00640 1 -- 172.21.15.19:0/128684879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9370151830 msgr2=0x7f93701f7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:56.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.671+0000 7f9375a00640 1 --2- 172.21.15.19:0/128684879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9370151830 0x7f93701f7150 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f935c00e7a0 tx=0x7f935c00ec60 comp rx=0 tx=0).stop 2024-03-08T06:03:56.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.671+0000 7f9375a00640 1 -- 172.21.15.19:0/128684879 shutdown_connections 2024-03-08T06:03:56.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.671+0000 7f9375a00640 1 --2- 172.21.15.19:0/128684879 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f935006b500 0x7f935006d9c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.671+0000 7f9375a00640 1 --2- 172.21.15.19:0/128684879 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93700c6d60 0x7f93700c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.671+0000 7f9375a00640 1 --2- 172.21.15.19:0/128684879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9370151830 0x7f93701f7150 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.671+0000 7f9375a00640 1 --2- 172.21.15.19:0/128684879 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9354005210 0x7f9370160970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.671+0000 7f9375a00640 1 -- 172.21.15.19:0/128684879 >> 172.21.15.19:0/128684879 conn(0x7f93700b1850 msgr2=0x7f93700716b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:56.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.671+0000 7f9375a00640 1 -- 172.21.15.19:0/128684879 shutdown_connections 2024-03-08T06:03:56.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.671+0000 7f9375a00640 1 -- 172.21.15.19:0/128684879 wait complete. 2024-03-08T06:03:56.691 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T06:03:14.149736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T06:03:18.392703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T06:03:19.537912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T06:03:56.691 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T06:03:56.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.912+0000 7ff1f3000640 1 Processor -- start 2024-03-08T06:03:56.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.912+0000 7ff1f3000640 1 -- start start 2024-03-08T06:03:56.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.913+0000 7ff1f3000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff1ec145500 0x7ff1ec06ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.914+0000 7ff1f3000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff1ec15bfb0 0x7ff1ec0716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.914+0000 7ff1f3000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff1ec071c20 0x7ff1ec06d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.914+0000 7ff1f3000640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ec072050 con 0x7ff1ec145500 2024-03-08T06:03:56.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.914+0000 7ff1f3000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ec15c460 con 0x7ff1ec15bfb0 2024-03-08T06:03:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.914+0000 7ff1f3000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec15c740 con 0x7ff1ec071c20 2024-03-08T06:03:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.914+0000 7ff1f1c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff1ec145500 0x7ff1ec06ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.914+0000 7ff1f1c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff1ec145500 0x7ff1ec06ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45714/0 (socket says 172.21.15.19:45714) 2024-03-08T06:03:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.914+0000 7ff1f1c00640 1 -- 172.21.15.19:0/3754695061 learned_addr learned my addr 172.21.15.19:0/3754695061 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.914+0000 7ff1f1c00640 1 -- 172.21.15.19:0/3754695061 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff1ec071c20 msgr2=0x7ff1ec06d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.914+0000 7ff1f2600640 1 --2- 172.21.15.19:0/3754695061 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff1ec071c20 0x7ff1ec06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.914+0000 7ff1f1200640 1 --2- 172.21.15.19:0/3754695061 >> v2:172.21.15.42:3300/0 conn(0x7ff1ec15bfb0 0x7ff1ec0716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.914+0000 7ff1f1c00640 1 --2- 172.21.15.19:0/3754695061 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff1ec071c20 0x7ff1ec06d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.914+0000 7ff1f1c00640 1 -- 172.21.15.19:0/3754695061 >> v2:172.21.15.42:3300/0 conn(0x7ff1ec15bfb0 msgr2=0x7ff1ec0716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.914+0000 7ff1f1c00640 1 --2- 172.21.15.19:0/3754695061 >> v2:172.21.15.42:3300/0 conn(0x7ff1ec15bfb0 0x7ff1ec0716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.914+0000 7ff1f1c00640 1 -- 172.21.15.19:0/3754695061 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec15ca20 con 0x7ff1ec145500 2024-03-08T06:03:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.914+0000 7ff1f2600640 1 --2- 172.21.15.19:0/3754695061 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff1ec071c20 0x7ff1ec06d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.915+0000 7ff1f1200640 1 --2- 172.21.15.19:0/3754695061 >> v2:172.21.15.42:3300/0 conn(0x7ff1ec15bfb0 0x7ff1ec0716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:56.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.916+0000 7ff1f1c00640 1 --2- 172.21.15.19:0/3754695061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1ec145500 0x7ff1ec06ecb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec06ebc0 tx=0x7ff1e002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dfc26bcd2b7a2b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.916+0000 7ff1ebe00640 1 -- 172.21.15.19:0/3754695061 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e002e070 con 0x7ff1ec145500 2024-03-08T06:03:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.916+0000 7ff1ebe00640 1 -- 172.21.15.19:0/3754695061 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e0037070 con 0x7ff1ec145500 2024-03-08T06:03:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.916+0000 7ff1ebe00640 1 -- 172.21.15.19:0/3754695061 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0031a00 con 0x7ff1ec145500 2024-03-08T06:03:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.917+0000 7ff1f3000640 1 -- 172.21.15.19:0/3754695061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1ec145500 msgr2=0x7ff1ec06ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.917+0000 7ff1f3000640 1 --2- 172.21.15.19:0/3754695061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1ec145500 0x7ff1ec06ecb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec06ebc0 tx=0x7ff1e002b880 comp rx=0 tx=0).stop 2024-03-08T06:03:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.917+0000 7ff1f3000640 1 -- 172.21.15.19:0/3754695061 shutdown_connections 2024-03-08T06:03:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.917+0000 7ff1f3000640 1 --2- 172.21.15.19:0/3754695061 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff1ec071c20 0x7ff1ec06d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.917+0000 7ff1f3000640 1 --2- 172.21.15.19:0/3754695061 >> v2:172.21.15.42:3300/0 conn(0x7ff1ec15bfb0 0x7ff1ec0716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.917+0000 7ff1f3000640 1 --2- 172.21.15.19:0/3754695061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1ec145500 0x7ff1ec06ecb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.917+0000 7ff1f3000640 1 -- 172.21.15.19:0/3754695061 >> 172.21.15.19:0/3754695061 conn(0x7ff1ec0b1850 msgr2=0x7ff1ec0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.917+0000 7ff1f3000640 1 -- 172.21.15.19:0/3754695061 shutdown_connections 2024-03-08T06:03:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.917+0000 7ff1f3000640 1 -- 172.21.15.19:0/3754695061 wait complete. 2024-03-08T06:03:56.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.918+0000 7ff1f3000640 1 Processor -- start 2024-03-08T06:03:56.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.919+0000 7ff1f3000640 1 -- start start 2024-03-08T06:03:56.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.919+0000 7ff1f3000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff1ec071c20 0x7ff1ec13c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.919+0000 7ff1f3000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1ec145500 0x7ff1ec0acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.919+0000 7ff1f3000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1ec15bfb0 0x7ff1ec0ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.919+0000 7ff1f3000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec06f370 con 0x7ff1ec145500 2024-03-08T06:03:56.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.919+0000 7ff1f3000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec06f1f0 con 0x7ff1ec15bfb0 2024-03-08T06:03:56.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.919+0000 7ff1f3000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ec06d760 con 0x7ff1ec071c20 2024-03-08T06:03:56.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.920+0000 7ff1f1200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1ec145500 0x7ff1ec0acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:56.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.920+0000 7ff1f1200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1ec145500 0x7ff1ec0acc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45726/0 (socket says 172.21.15.19:45726) 2024-03-08T06:03:56.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.920+0000 7ff1f1200640 1 -- 172.21.15.19:0/1621246476 learned_addr learned my addr 172.21.15.19:0/1621246476 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:56.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.920+0000 7ff1f1200640 1 -- 172.21.15.19:0/1621246476 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff1ec071c20 msgr2=0x7ff1ec13c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:56.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.920+0000 7ff1f1200640 1 --2- 172.21.15.19:0/1621246476 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff1ec071c20 0x7ff1ec13c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.920+0000 7ff1f1200640 1 -- 172.21.15.19:0/1621246476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1ec15bfb0 msgr2=0x7ff1ec0ad190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:56.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.920+0000 7ff1f1200640 1 --2- 172.21.15.19:0/1621246476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1ec15bfb0 0x7ff1ec0ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:56.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.920+0000 7ff1f1200640 1 -- 172.21.15.19:0/1621246476 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec1f2440 con 0x7ff1ec145500 2024-03-08T06:03:56.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.920+0000 7ff1f1200640 1 --2- 172.21.15.19:0/1621246476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1ec145500 0x7ff1ec0acc50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800c7f0 tx=0x7ff1d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:56.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.921+0000 7ff1e9600640 1 -- 172.21.15.19:0/1621246476 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8015070 con 0x7ff1ec145500 2024-03-08T06:03:56.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.921+0000 7ff1e9600640 1 -- 172.21.15.19:0/1621246476 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d8007820 con 0x7ff1ec145500 2024-03-08T06:03:56.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.921+0000 7ff1e9600640 1 -- 172.21.15.19:0/1621246476 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8007bd0 con 0x7ff1ec145500 2024-03-08T06:03:56.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.921+0000 7ff1f3000640 1 -- 172.21.15.19:0/1621246476 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ec0a9190 con 0x7ff1ec145500 2024-03-08T06:03:56.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.921+0000 7ff1f3000640 1 -- 172.21.15.19:0/1621246476 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ec0a9750 con 0x7ff1ec145500 2024-03-08T06:03:56.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.922+0000 7ff1f3000640 1 -- 172.21.15.19:0/1621246476 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ec075090 con 0x7ff1ec145500 2024-03-08T06:03:56.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.923+0000 7ff1e9600640 1 -- 172.21.15.19:0/1621246476 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff1d8018070 con 0x7ff1ec145500 2024-03-08T06:03:56.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.923+0000 7ff1e9600640 1 --2- 172.21.15.19:0/1621246476 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff1cc06b500 0x7ff1cc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:56.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.924+0000 7ff1e9600640 1 -- 172.21.15.19:0/1621246476 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1d808a3b0 con 0x7ff1ec145500 2024-03-08T06:03:56.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.924+0000 7ff1f1c00640 1 --2- 172.21.15.19:0/1621246476 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff1cc06b500 0x7ff1cc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:56.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.924+0000 7ff1f1c00640 1 --2- 172.21.15.19:0/1621246476 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff1cc06b500 0x7ff1cc06d9c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0036000 tx=0x7ff1e0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:56.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:56.928+0000 7ff1e9600640 1 -- 172.21.15.19:0/1621246476 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff1d8059190 con 0x7ff1ec145500 2024-03-08T06:03:57.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.127+0000 7ff1f3000640 1 -- 172.21.15.19:0/1621246476 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1ec071900 con 0x7ff1ec145500 2024-03-08T06:03:57.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.128+0000 7ff1e9600640 1 -- 172.21.15.19:0/1621246476 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1d8058a90 con 0x7ff1ec145500 2024-03-08T06:03:57.129 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-08T06:03:57.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.130+0000 7ff1f3000640 1 -- 172.21.15.19:0/1621246476 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff1cc06b500 msgr2=0x7ff1cc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:57.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.130+0000 7ff1f3000640 1 --2- 172.21.15.19:0/1621246476 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff1cc06b500 0x7ff1cc06d9c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0036000 tx=0x7ff1e0030000 comp rx=0 tx=0).stop 2024-03-08T06:03:57.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.130+0000 7ff1f3000640 1 -- 172.21.15.19:0/1621246476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1ec145500 msgr2=0x7ff1ec0acc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:57.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.130+0000 7ff1f3000640 1 --2- 172.21.15.19:0/1621246476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1ec145500 0x7ff1ec0acc50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800c7f0 tx=0x7ff1d800ccb0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.131+0000 7ff1f3000640 1 -- 172.21.15.19:0/1621246476 shutdown_connections 2024-03-08T06:03:57.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.131+0000 7ff1f3000640 1 --2- 172.21.15.19:0/1621246476 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff1cc06b500 0x7ff1cc06d9c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.131+0000 7ff1f3000640 1 --2- 172.21.15.19:0/1621246476 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1ec15bfb0 0x7ff1ec0ad190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.131+0000 7ff1f3000640 1 --2- 172.21.15.19:0/1621246476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1ec145500 0x7ff1ec0acc50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.131+0000 7ff1f3000640 1 --2- 172.21.15.19:0/1621246476 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff1ec071c20 0x7ff1ec13c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.131+0000 7ff1f3000640 1 -- 172.21.15.19:0/1621246476 >> 172.21.15.19:0/1621246476 conn(0x7ff1ec0b1850 msgr2=0x7ff1ec0cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:57.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.131+0000 7ff1f3000640 1 -- 172.21.15.19:0/1621246476 shutdown_connections 2024-03-08T06:03:57.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.131+0000 7ff1f3000640 1 -- 172.21.15.19:0/1621246476 wait complete. 2024-03-08T06:03:57.152 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T06:03:57.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.375+0000 7f676a200640 1 Processor -- start 2024-03-08T06:03:57.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.376+0000 7f676a200640 1 -- start start 2024-03-08T06:03:57.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.377+0000 7f676a200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f676415de60 0x7f6764161930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:57.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.377+0000 7f676a200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f67640b9630 0x7f67640ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:57.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.377+0000 7f676a200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676415e240 con 0x7f67640cee60 2024-03-08T06:03:57.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.377+0000 7f676a200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6764162030 con 0x7f67640b9630 2024-03-08T06:03:57.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.377+0000 7f676a200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6764162310 con 0x7f676415de60 2024-03-08T06:03:57.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.377+0000 7f6763e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f67640b9630 0x7f67640ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:57.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.378+0000 7f6763e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f67640b9630 0x7f67640ce920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45732/0 (socket says 172.21.15.19:45732) 2024-03-08T06:03:57.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.378+0000 7f6763e00640 1 -- 172.21.15.19:0/391948369 learned_addr learned my addr 172.21.15.19:0/391948369 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:57.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.378+0000 7f6768e00640 1 --2- 172.21.15.19:0/391948369 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f676415de60 0x7f6764161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:57.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.378+0000 7f6763e00640 1 -- 172.21.15.19:0/391948369 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f676415de60 msgr2=0x7f6764161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:57.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.378+0000 7f6763e00640 1 --2- 172.21.15.19:0/391948369 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f676415de60 0x7f6764161930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.378+0000 7f6763e00640 1 -- 172.21.15.19:0/391948369 >> v1:172.21.15.42:6789/0 conn(0x7f67640cee60 legacy=0x7f67640b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:57.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.378+0000 7f6763e00640 1 -- 172.21.15.19:0/391948369 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67641625f0 con 0x7f67640b9630 2024-03-08T06:03:57.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.379+0000 7f6763e00640 1 --2- 172.21.15.19:0/391948369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67640b9630 0x7f67640ce920 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f674c009870 tx=0x7f674c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506ef3cd06d5b95c server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:57.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.379+0000 7f6763400640 1 -- 172.21.15.19:0/391948369 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c035020 con 0x7f67640b9630 2024-03-08T06:03:57.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.380+0000 7f6763400640 1 -- 172.21.15.19:0/391948369 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c031640 con 0x7f67640b9630 2024-03-08T06:03:57.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.380+0000 7f6763400640 1 -- 172.21.15.19:0/391948369 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c02d040 con 0x7f67640b9630 2024-03-08T06:03:57.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.380+0000 7f676a200640 1 -- 172.21.15.19:0/391948369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67640b9630 msgr2=0x7f67640ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:57.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.380+0000 7f676a200640 1 --2- 172.21.15.19:0/391948369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67640b9630 0x7f67640ce920 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f674c009870 tx=0x7f674c02b8f0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.380+0000 7f676a200640 1 -- 172.21.15.19:0/391948369 shutdown_connections 2024-03-08T06:03:57.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.380+0000 7f676a200640 1 --2- 172.21.15.19:0/391948369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67640b9630 0x7f67640ce920 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.380+0000 7f676a200640 1 --2- 172.21.15.19:0/391948369 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f676415de60 0x7f6764161930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.380+0000 7f676a200640 1 -- 172.21.15.19:0/391948369 >> 172.21.15.19:0/391948369 conn(0x7f676406c500 msgr2=0x7f676406c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:57.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.380+0000 7f676a200640 1 -- 172.21.15.19:0/391948369 shutdown_connections 2024-03-08T06:03:57.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.380+0000 7f676a200640 1 -- 172.21.15.19:0/391948369 wait complete. 2024-03-08T06:03:57.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.382+0000 7f676a200640 1 Processor -- start 2024-03-08T06:03:57.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.382+0000 7f676a200640 1 -- start start 2024-03-08T06:03:57.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.383+0000 7f676a200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67640b9630 0x7f67641f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:57.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.383+0000 7f676a200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67640cee60 0x7f67640b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:57.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.383+0000 7f676a200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f676415de60 0x7f676415c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:57.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.383+0000 7f676a200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67640d35f0 con 0x7f67640cee60 2024-03-08T06:03:57.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.383+0000 7f676a200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67640b9a90 con 0x7f67640b9630 2024-03-08T06:03:57.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.383+0000 7f676a200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67640d3770 con 0x7f676415de60 2024-03-08T06:03:57.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.383+0000 7f6763e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67640cee60 0x7f67640b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:57.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.384+0000 7f6763e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67640cee60 0x7f67640b53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45736/0 (socket says 172.21.15.19:45736) 2024-03-08T06:03:57.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.384+0000 7f6763e00640 1 -- 172.21.15.19:0/1759204833 learned_addr learned my addr 172.21.15.19:0/1759204833 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:57.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.384+0000 7f6768e00640 1 --2- 172.21.15.19:0/1759204833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67640b9630 0x7f67641f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:57.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.384+0000 7f6763e00640 1 -- 172.21.15.19:0/1759204833 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f676415de60 msgr2=0x7f676415c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:57.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.384+0000 7f6769800640 1 --2- 172.21.15.19:0/1759204833 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f676415de60 0x7f676415c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:57.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.384+0000 7f6763e00640 1 --2- 172.21.15.19:0/1759204833 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f676415de60 0x7f676415c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.384+0000 7f6763e00640 1 -- 172.21.15.19:0/1759204833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67640b9630 msgr2=0x7f67641f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:57.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.384+0000 7f6763e00640 1 --2- 172.21.15.19:0/1759204833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67640b9630 0x7f67641f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.384+0000 7f6763e00640 1 -- 172.21.15.19:0/1759204833 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67640b58f0 con 0x7f67640cee60 2024-03-08T06:03:57.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.384+0000 7f6768e00640 1 --2- 172.21.15.19:0/1759204833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67640b9630 0x7f67641f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:57.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.384+0000 7f6769800640 1 --2- 172.21.15.19:0/1759204833 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f676415de60 0x7f676415c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:57.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.385+0000 7f6763e00640 1 --2- 172.21.15.19:0/1759204833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67640cee60 0x7f67640b53b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f674c02b930 tx=0x7f674c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:57.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.385+0000 7f6760c00640 1 -- 172.21.15.19:0/1759204833 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c03ac60 con 0x7f67640cee60 2024-03-08T06:03:57.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.385+0000 7f6760c00640 1 -- 172.21.15.19:0/1759204833 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c03ae20 con 0x7f67640cee60 2024-03-08T06:03:57.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.385+0000 7f676a200640 1 -- 172.21.15.19:0/1759204833 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67640b5b70 con 0x7f67640cee60 2024-03-08T06:03:57.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.385+0000 7f6760c00640 1 -- 172.21.15.19:0/1759204833 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f674c044630 con 0x7f67640cee60 2024-03-08T06:03:57.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.385+0000 7f676a200640 1 -- 172.21.15.19:0/1759204833 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67640b6130 con 0x7f67640cee60 2024-03-08T06:03:57.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.387+0000 7f676a200640 1 -- 172.21.15.19:0/1759204833 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6764075090 con 0x7f67640cee60 2024-03-08T06:03:57.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.387+0000 7f6760c00640 1 -- 172.21.15.19:0/1759204833 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f674c04b060 con 0x7f67640cee60 2024-03-08T06:03:57.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.388+0000 7f6760c00640 1 --2- 172.21.15.19:0/1759204833 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f674006b4d0 0x7f674006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:57.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.388+0000 7f6760c00640 1 -- 172.21.15.19:0/1759204833 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f674c0ac0b0 con 0x7f67640cee60 2024-03-08T06:03:57.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.388+0000 7f6768e00640 1 --2- 172.21.15.19:0/1759204833 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f674006b4d0 0x7f674006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:57.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.389+0000 7f6768e00640 1 --2- 172.21.15.19:0/1759204833 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f674006b4d0 0x7f674006d990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f67640c7a70 tx=0x7f67540074c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:57.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.393+0000 7f6760c00640 1 -- 172.21.15.19:0/1759204833 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f67640b58f0 con 0x7f67640cee60 2024-03-08T06:03:57.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.588+0000 7f676a200640 1 -- 172.21.15.19:0/1759204833 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f67640b78a0 con 0x7f67640cee60 2024-03-08T06:03:57.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.589+0000 7f6760c00640 1 -- 172.21.15.19:0/1759204833 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f674c03f070 con 0x7f67640cee60 2024-03-08T06:03:57.590 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-08T06:03:57.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.593+0000 7f676a200640 1 -- 172.21.15.19:0/1759204833 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f674006b4d0 msgr2=0x7f674006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:57.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.593+0000 7f676a200640 1 --2- 172.21.15.19:0/1759204833 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f674006b4d0 0x7f674006d990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f67640c7a70 tx=0x7f67540074c0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.593+0000 7f676a200640 1 -- 172.21.15.19:0/1759204833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67640cee60 msgr2=0x7f67640b53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:57.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.593+0000 7f676a200640 1 --2- 172.21.15.19:0/1759204833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67640cee60 0x7f67640b53b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f674c02b930 tx=0x7f674c0046c0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.593+0000 7f676a200640 1 -- 172.21.15.19:0/1759204833 shutdown_connections 2024-03-08T06:03:57.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.593+0000 7f676a200640 1 --2- 172.21.15.19:0/1759204833 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f674006b4d0 0x7f674006d990 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.593+0000 7f676a200640 1 --2- 172.21.15.19:0/1759204833 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f676415de60 0x7f676415c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.593+0000 7f676a200640 1 --2- 172.21.15.19:0/1759204833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f67640cee60 0x7f67640b53b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.593+0000 7f676a200640 1 --2- 172.21.15.19:0/1759204833 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f67640b9630 0x7f67641f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.593+0000 7f676a200640 1 -- 172.21.15.19:0/1759204833 >> 172.21.15.19:0/1759204833 conn(0x7f676406c500 msgr2=0x7f6764159280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:57.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.593+0000 7f676a200640 1 -- 172.21.15.19:0/1759204833 shutdown_connections 2024-03-08T06:03:57.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.593+0000 7f676a200640 1 -- 172.21.15.19:0/1759204833 wait complete. 2024-03-08T06:03:57.615 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T06:03:57.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.829+0000 7f6ca6800640 1 Processor -- start 2024-03-08T06:03:57.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.829+0000 7f6ca6800640 1 -- start start 2024-03-08T06:03:57.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.831+0000 7f6ca6800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6ca00cf030 0x7f6ca0161930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:57.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.831+0000 7f6ca6800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6ca00b9630 0x7f6ca00d25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:57.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.831+0000 7f6ca6800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca015e240 con 0x7f6ca015de60 2024-03-08T06:03:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.831+0000 7f6ca6800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca00b9ac0 con 0x7f6ca00b9630 2024-03-08T06:03:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.831+0000 7f6ca6800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0162030 con 0x7f6ca00cf030 2024-03-08T06:03:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.831+0000 7f6ca5400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6ca015de60 0x7f6ca00ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46158/0 (socket says 172.21.15.19:46158) 2024-03-08T06:03:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.831+0000 7f6ca5400640 1 -- 172.21.15.19:0/3538342228 learned_addr learned my addr 172.21.15.19:0/3538342228 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.832+0000 7f6ca5e00640 1 --2- 172.21.15.19:0/3538342228 >> v2:172.21.15.42:3300/0 conn(0x7f6ca00b9630 0x7f6ca00d25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.832+0000 7f6ca4a00640 1 --2- 172.21.15.19:0/3538342228 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6ca00cf030 0x7f6ca0161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.832+0000 7f6c9fe00640 1 -- 172.21.15.19:0/3538342228 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833885041 0 0) 0x7f6ca015e240 con 0x7f6ca015de60 2024-03-08T06:03:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.832+0000 7f6c9fe00640 1 -- 172.21.15.19:0/3538342228 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c88003520 con 0x7f6ca015de60 2024-03-08T06:03:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.832+0000 7f6c9fe00640 1 -- 172.21.15.19:0/3538342228 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3738616478 0 0) 0x7f6c88003520 con 0x7f6ca015de60 2024-03-08T06:03:57.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.832+0000 7f6c9fe00640 1 -- 172.21.15.19:0/3538342228 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6ca00cf030 msgr2=0x7f6ca0161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:57.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.832+0000 7f6c9fe00640 1 --2- 172.21.15.19:0/3538342228 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6ca00cf030 0x7f6ca0161930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.832+0000 7f6c9fe00640 1 -- 172.21.15.19:0/3538342228 >> v2:172.21.15.42:3300/0 conn(0x7f6ca00b9630 msgr2=0x7f6ca00d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:57.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.832+0000 7f6c9fe00640 1 --2- 172.21.15.19:0/3538342228 >> v2:172.21.15.42:3300/0 conn(0x7f6ca00b9630 0x7f6ca00d25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.832+0000 7f6c9fe00640 1 -- 172.21.15.19:0/3538342228 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca0162310 con 0x7f6ca015de60 2024-03-08T06:03:57.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.832+0000 7f6c9fe00640 1 -- 172.21.15.19:0/3538342228 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f6c94001670 con 0x7f6ca015de60 2024-03-08T06:03:57.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.832+0000 7f6c9fe00640 1 -- 172.21.15.19:0/3538342228 >> v1:172.21.15.19:6789/0 conn(0x7f6ca015de60 legacy=0x7f6ca00ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:57.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.832+0000 7f6c9fe00640 1 --2- 172.21.15.19:0/3538342228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c88003a20 0x7f6c88003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:57.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.832+0000 7f6c9fe00640 1 --2- 172.21.15.19:0/3538342228 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6c88004800 0x7f6c88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:57.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.832+0000 7f6c9fe00640 1 --2- 172.21.15.19:0/3538342228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c880051c0 0x7f6c8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:57.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.832+0000 7f6c9fe00640 1 -- 172.21.15.19:0/3538342228 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00b9ac0 con 0x7f6c880051c0 2024-03-08T06:03:57.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.832+0000 7f6c9fe00640 1 -- 172.21.15.19:0/3538342228 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0162030 con 0x7f6c88003a20 2024-03-08T06:03:57.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.832+0000 7f6c9fe00640 1 -- 172.21.15.19:0/3538342228 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8800bfb0 con 0x7f6c88004800 2024-03-08T06:03:57.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.832+0000 7f6ca4a00640 1 --2- 172.21.15.19:0/3538342228 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6ca00cf030 0x7f6ca0161930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:03:57.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.833+0000 7f6ca5e00640 1 --2- 172.21.15.19:0/3538342228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c880051c0 0x7f6c8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:57.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.833+0000 7f6ca5e00640 1 -- 172.21.15.19:0/3538342228 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6c88004800 msgr2=0x7f6c88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:57.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.833+0000 7f6ca5e00640 1 --2- 172.21.15.19:0/3538342228 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6c88004800 0x7f6c88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.833+0000 7f6ca5e00640 1 -- 172.21.15.19:0/3538342228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c88003a20 msgr2=0x7f6c88003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:57.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.833+0000 7f6ca5e00640 1 --2- 172.21.15.19:0/3538342228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c88003a20 0x7f6c88003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.833+0000 7f6ca5e00640 1 -- 172.21.15.19:0/3538342228 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c88003520 con 0x7f6c880051c0 2024-03-08T06:03:57.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.834+0000 7f6ca5e00640 1 --2- 172.21.15.19:0/3538342228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c880051c0 0x7f6c8800b9c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009f90 tx=0x7f6c88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6374901365a4b28 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.835+0000 7f6c9fe00640 1 -- 172.21.15.19:0/3538342228 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98039070 con 0x7f6c880051c0 2024-03-08T06:03:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.835+0000 7f6c9fe00640 1 -- 172.21.15.19:0/3538342228 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9802cc20 con 0x7f6c880051c0 2024-03-08T06:03:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.835+0000 7f6c9fe00640 1 -- 172.21.15.19:0/3538342228 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98009c10 con 0x7f6c880051c0 2024-03-08T06:03:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.835+0000 7f6ca6800640 1 -- 172.21.15.19:0/3538342228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c880051c0 msgr2=0x7f6c8800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.835+0000 7f6ca6800640 1 --2- 172.21.15.19:0/3538342228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c880051c0 0x7f6c8800b9c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009f90 tx=0x7f6c88005830 comp rx=0 tx=0).stop 2024-03-08T06:03:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.835+0000 7f6ca5e00640 1 -- 172.21.15.19:0/3538342228 reap_dead start 2024-03-08T06:03:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.835+0000 7f6ca6800640 1 -- 172.21.15.19:0/3538342228 shutdown_connections 2024-03-08T06:03:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.835+0000 7f6ca6800640 1 -- 172.21.15.19:0/3538342228 >> 172.21.15.19:0/3538342228 conn(0x7f6ca006c500 msgr2=0x7f6ca006c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:57.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.835+0000 7f6ca6800640 1 -- 172.21.15.19:0/3538342228 shutdown_connections 2024-03-08T06:03:57.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.835+0000 7f6ca6800640 1 -- 172.21.15.19:0/3538342228 wait complete. 2024-03-08T06:03:57.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.837+0000 7f6ca6800640 1 Processor -- start 2024-03-08T06:03:57.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.837+0000 7f6ca6800640 1 -- start start 2024-03-08T06:03:57.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.838+0000 7f6ca6800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c880051c0 0x7f6ca01503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:57.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.838+0000 7f6ca6800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6ca00cb530 0x7f6ca00cd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:57.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.838+0000 7f6ca6800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ca01e8200 0x7f6ca00cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:57.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.838+0000 7f6ca6800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0161930 con 0x7f6c880051c0 2024-03-08T06:03:57.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.838+0000 7f6ca6800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca00d20c0 con 0x7f6ca01e8200 2024-03-08T06:03:57.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.838+0000 7f6ca6800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca0161ab0 con 0x7f6ca00cb530 2024-03-08T06:03:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.839+0000 7f6ca5400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c880051c0 0x7f6ca01503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.839+0000 7f6ca5400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c880051c0 0x7f6ca01503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45764/0 (socket says 172.21.15.19:45764) 2024-03-08T06:03:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.839+0000 7f6ca5400640 1 -- 172.21.15.19:0/2532718903 learned_addr learned my addr 172.21.15.19:0/2532718903 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.839+0000 7f6ca5e00640 1 --2- 172.21.15.19:0/2532718903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ca01e8200 0x7f6ca00cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.839+0000 7f6ca5400640 1 -- 172.21.15.19:0/2532718903 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6ca00cb530 msgr2=0x7f6ca00cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.839+0000 7f6ca5400640 1 --2- 172.21.15.19:0/2532718903 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6ca00cb530 0x7f6ca00cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.839+0000 7f6ca5400640 1 -- 172.21.15.19:0/2532718903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ca01e8200 msgr2=0x7f6ca00cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.839+0000 7f6ca5400640 1 --2- 172.21.15.19:0/2532718903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ca01e8200 0x7f6ca00cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.839+0000 7f6ca5400640 1 -- 172.21.15.19:0/2532718903 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca00b50b0 con 0x7f6c880051c0 2024-03-08T06:03:57.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.839+0000 7f6ca5e00640 1 --2- 172.21.15.19:0/2532718903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ca01e8200 0x7f6ca00cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:57.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.840+0000 7f6ca5400640 1 --2- 172.21.15.19:0/2532718903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c880051c0 0x7f6ca01503f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400c760 tx=0x7f6c9400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:57.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.840+0000 7f6c9d600640 1 -- 172.21.15.19:0/2532718903 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94018070 con 0x7f6c880051c0 2024-03-08T06:03:57.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.840+0000 7f6c9d600640 1 -- 172.21.15.19:0/2532718903 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c94007500 con 0x7f6c880051c0 2024-03-08T06:03:57.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.840+0000 7f6c9d600640 1 -- 172.21.15.19:0/2532718903 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94004a20 con 0x7f6c880051c0 2024-03-08T06:03:57.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.840+0000 7f6ca6800640 1 -- 172.21.15.19:0/2532718903 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca00b5390 con 0x7f6c880051c0 2024-03-08T06:03:57.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.840+0000 7f6ca6800640 1 -- 172.21.15.19:0/2532718903 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca00b5e70 con 0x7f6c880051c0 2024-03-08T06:03:57.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.841+0000 7f6ca6800640 1 -- 172.21.15.19:0/2532718903 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca0075090 con 0x7f6c880051c0 2024-03-08T06:03:57.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.842+0000 7f6c9d600640 1 -- 172.21.15.19:0/2532718903 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6c9401b070 con 0x7f6c880051c0 2024-03-08T06:03:57.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.843+0000 7f6c9d600640 1 --2- 172.21.15.19:0/2532718903 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6c8006b500 0x7f6c8006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:57.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.843+0000 7f6c9d600640 1 -- 172.21.15.19:0/2532718903 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c940896a0 con 0x7f6c880051c0 2024-03-08T06:03:57.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.843+0000 7f6ca4a00640 1 --2- 172.21.15.19:0/2532718903 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6c8006b500 0x7f6c8006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:57.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.844+0000 7f6ca4a00640 1 --2- 172.21.15.19:0/2532718903 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6c8006b500 0x7f6c8006d9c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c006fd0 tx=0x7f6c8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:57.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:57.847+0000 7f6c9d600640 1 -- 172.21.15.19:0/2532718903 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6c94058480 con 0x7f6c880051c0 2024-03-08T06:03:58.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.045+0000 7f6ca6800640 1 -- 172.21.15.19:0/2532718903 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6ca0067fe0 con 0x7f6c880051c0 2024-03-08T06:03:58.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.046+0000 7f6c9d600640 1 -- 172.21.15.19:0/2532718903 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6c94057d80 con 0x7f6c880051c0 2024-03-08T06:03:58.047 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-08T06:03:58.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.049+0000 7f6ca6800640 1 -- 172.21.15.19:0/2532718903 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6c8006b500 msgr2=0x7f6c8006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:58.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.049+0000 7f6ca6800640 1 --2- 172.21.15.19:0/2532718903 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6c8006b500 0x7f6c8006d9c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c006fd0 tx=0x7f6c8c008040 comp rx=0 tx=0).stop 2024-03-08T06:03:58.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.049+0000 7f6ca6800640 1 -- 172.21.15.19:0/2532718903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c880051c0 msgr2=0x7f6ca01503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:58.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.049+0000 7f6ca6800640 1 --2- 172.21.15.19:0/2532718903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c880051c0 0x7f6ca01503f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400c760 tx=0x7f6c9400cc20 comp rx=0 tx=0).stop 2024-03-08T06:03:58.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.049+0000 7f6ca6800640 1 -- 172.21.15.19:0/2532718903 shutdown_connections 2024-03-08T06:03:58.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.049+0000 7f6ca6800640 1 --2- 172.21.15.19:0/2532718903 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6c8006b500 0x7f6c8006d9c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.049+0000 7f6ca6800640 1 --2- 172.21.15.19:0/2532718903 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6ca01e8200 0x7f6ca00cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.049+0000 7f6ca6800640 1 --2- 172.21.15.19:0/2532718903 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6ca00cb530 0x7f6ca00cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.049+0000 7f6ca6800640 1 --2- 172.21.15.19:0/2532718903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c880051c0 0x7f6ca01503f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.049+0000 7f6ca6800640 1 -- 172.21.15.19:0/2532718903 >> 172.21.15.19:0/2532718903 conn(0x7f6ca006c500 msgr2=0x7f6ca015e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:58.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.049+0000 7f6ca6800640 1 -- 172.21.15.19:0/2532718903 shutdown_connections 2024-03-08T06:03:58.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.049+0000 7f6ca6800640 1 -- 172.21.15.19:0/2532718903 wait complete. 2024-03-08T06:03:58.101 INFO:tasks.cephfs_test_runner:Starting test: test_per_client_labeled_perf_counters (tasks.cephfs.test_admin.TestLabeledPerfCounters) That the per-client labelled perf counters depict the clients 2024-03-08T06:03:58.101 INFO:tasks.cephfs_test_runner:test_per_client_labeled_perf_counters (tasks.cephfs.test_admin.TestLabeledPerfCounters) 2024-03-08T06:03:58.102 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:03:58.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.330+0000 7fdf65000640 1 Processor -- start 2024-03-08T06:03:58.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.331+0000 7fdf65000640 1 -- start start 2024-03-08T06:03:58.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.332+0000 7fdf65000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fdf60145520 0x7fdf6015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:58.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.332+0000 7fdf65000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdf60071df0 0x7fdf6006d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:58.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.332+0000 7fdf65000640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf6015ceb0 con 0x7fdf6015bea0 2024-03-08T06:03:58.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.332+0000 7fdf65000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6015c330 con 0x7fdf60145520 2024-03-08T06:03:58.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.332+0000 7fdf65000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6015c610 con 0x7fdf60071df0 2024-03-08T06:03:58.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.333+0000 7fdf5ea00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdf6015bea0 0x7fdf600716e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46168/0 (socket says 172.21.15.19:46168) 2024-03-08T06:03:58.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.333+0000 7fdf5ea00640 1 -- 172.21.15.19:0/3671539621 learned_addr learned my addr 172.21.15.19:0/3671539621 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:58.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.333+0000 7fdf5f400640 1 --2- 172.21.15.19:0/3671539621 >> v2:172.21.15.42:3300/0 conn(0x7fdf60145520 0x7fdf6015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:58.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.333+0000 7fdf5e000640 1 -- 172.21.15.19:0/3671539621 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254341354 0 0) 0x7fdf6015ceb0 con 0x7fdf6015bea0 2024-03-08T06:03:58.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.333+0000 7fdf5e000640 1 -- 172.21.15.19:0/3671539621 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf44003520 con 0x7fdf6015bea0 2024-03-08T06:03:58.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.333+0000 7fdf5fe00640 1 --2- 172.21.15.19:0/3671539621 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdf60071df0 0x7fdf6006d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:58.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.333+0000 7fdf5e000640 1 -- 172.21.15.19:0/3671539621 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2558935101 0 0) 0x7fdf44003520 con 0x7fdf6015bea0 2024-03-08T06:03:58.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.333+0000 7fdf5e000640 1 -- 172.21.15.19:0/3671539621 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdf60071df0 msgr2=0x7fdf6006d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:58.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.333+0000 7fdf5e000640 1 --2- 172.21.15.19:0/3671539621 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdf60071df0 0x7fdf6006d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.333+0000 7fdf5e000640 1 -- 172.21.15.19:0/3671539621 >> v2:172.21.15.42:3300/0 conn(0x7fdf60145520 msgr2=0x7fdf6015d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:58.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.333+0000 7fdf5e000640 1 --2- 172.21.15.19:0/3671539621 >> v2:172.21.15.42:3300/0 conn(0x7fdf60145520 0x7fdf6015d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.333+0000 7fdf5e000640 1 -- 172.21.15.19:0/3671539621 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6015c8f0 con 0x7fdf6015bea0 2024-03-08T06:03:58.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.333+0000 7fdf5e000640 1 -- 172.21.15.19:0/3671539621 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7fdf4c001670 con 0x7fdf6015bea0 2024-03-08T06:03:58.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.334+0000 7fdf5e000640 1 -- 172.21.15.19:0/3671539621 >> v1:172.21.15.19:6789/0 conn(0x7fdf6015bea0 legacy=0x7fdf600716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:58.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.334+0000 7fdf5e000640 1 --2- 172.21.15.19:0/3671539621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf440039b0 0x7fdf44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:58.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.334+0000 7fdf5e000640 1 --2- 172.21.15.19:0/3671539621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf44004800 0x7fdf44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:58.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.334+0000 7fdf5e000640 1 --2- 172.21.15.19:0/3671539621 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdf60071df0 0x7fdf440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:58.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.334+0000 7fdf5e000640 1 -- 172.21.15.19:0/3671539621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6015c330 con 0x7fdf440039b0 2024-03-08T06:03:58.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.334+0000 7fdf5e000640 1 -- 172.21.15.19:0/3671539621 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6015c610 con 0x7fdf44004800 2024-03-08T06:03:58.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.334+0000 7fdf5e000640 1 -- 172.21.15.19:0/3671539621 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4400baf0 con 0x7fdf60071df0 2024-03-08T06:03:58.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.334+0000 7fdf5f400640 1 --2- 172.21.15.19:0/3671539621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf440039b0 0x7fdf44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:58.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.334+0000 7fdf5f400640 1 -- 172.21.15.19:0/3671539621 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdf60071df0 msgr2=0x7fdf440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:58.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.334+0000 7fdf5f400640 1 --2- 172.21.15.19:0/3671539621 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdf60071df0 0x7fdf440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.334+0000 7fdf5f400640 1 -- 172.21.15.19:0/3671539621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf44004800 msgr2=0x7fdf44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:58.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.334+0000 7fdf5f400640 1 --2- 172.21.15.19:0/3671539621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf44004800 0x7fdf44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.334+0000 7fdf5f400640 1 -- 172.21.15.19:0/3671539621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf44003520 con 0x7fdf440039b0 2024-03-08T06:03:58.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.335+0000 7fdf5f400640 1 --2- 172.21.15.19:0/3671539621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf440039b0 0x7fdf44003dd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000ba00 tx=0x7fdf44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3b1bea1c618f8c server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:58.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.336+0000 7fdf5e000640 1 -- 172.21.15.19:0/3671539621 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf50036020 con 0x7fdf440039b0 2024-03-08T06:03:58.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.336+0000 7fdf5e000640 1 -- 172.21.15.19:0/3671539621 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf50032630 con 0x7fdf440039b0 2024-03-08T06:03:58.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.336+0000 7fdf5e000640 1 -- 172.21.15.19:0/3671539621 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5000b600 con 0x7fdf440039b0 2024-03-08T06:03:58.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.336+0000 7fdf65000640 1 -- 172.21.15.19:0/3671539621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf440039b0 msgr2=0x7fdf44003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:58.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.336+0000 7fdf65000640 1 --2- 172.21.15.19:0/3671539621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf440039b0 0x7fdf44003dd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000ba00 tx=0x7fdf44005830 comp rx=0 tx=0).stop 2024-03-08T06:03:58.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.336+0000 7fdf5fe00640 1 -- 172.21.15.19:0/3671539621 reap_dead start 2024-03-08T06:03:58.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.336+0000 7fdf65000640 1 -- 172.21.15.19:0/3671539621 shutdown_connections 2024-03-08T06:03:58.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.336+0000 7fdf65000640 1 -- 172.21.15.19:0/3671539621 >> 172.21.15.19:0/3671539621 conn(0x7fdf600b1850 msgr2=0x7fdf600b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:58.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.337+0000 7fdf65000640 1 -- 172.21.15.19:0/3671539621 shutdown_connections 2024-03-08T06:03:58.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.337+0000 7fdf65000640 1 -- 172.21.15.19:0/3671539621 wait complete. 2024-03-08T06:03:58.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.338+0000 7fdf65000640 1 Processor -- start 2024-03-08T06:03:58.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.338+0000 7fdf65000640 1 -- start start 2024-03-08T06:03:58.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.339+0000 7fdf65000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdf440039b0 0x7fdf60151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:58.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.339+0000 7fdf65000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf6013afc0 0x7fdf60138dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:58.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.339+0000 7fdf65000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf60139310 0x7fdf60137790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.339+0000 7fdf65000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf600af1c0 con 0x7fdf60139310 2024-03-08T06:03:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.339+0000 7fdf65000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf600af040 con 0x7fdf6013afc0 2024-03-08T06:03:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.339+0000 7fdf65000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6006e410 con 0x7fdf440039b0 2024-03-08T06:03:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.340+0000 7fdf5fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf60139310 0x7fdf60137790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.340+0000 7fdf5fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf60139310 0x7fdf60137790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45774/0 (socket says 172.21.15.19:45774) 2024-03-08T06:03:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.340+0000 7fdf5fe00640 1 -- 172.21.15.19:0/148290600 learned_addr learned my addr 172.21.15.19:0/148290600 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.340+0000 7fdf5ea00640 1 --2- 172.21.15.19:0/148290600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf6013afc0 0x7fdf60138dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.340+0000 7fdf5fe00640 1 -- 172.21.15.19:0/148290600 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdf440039b0 msgr2=0x7fdf60151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.340+0000 7fdf5fe00640 1 --2- 172.21.15.19:0/148290600 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdf440039b0 0x7fdf60151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.340+0000 7fdf5fe00640 1 -- 172.21.15.19:0/148290600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf6013afc0 msgr2=0x7fdf60138dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.340+0000 7fdf5fe00640 1 --2- 172.21.15.19:0/148290600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf6013afc0 0x7fdf60138dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.340+0000 7fdf5fe00640 1 -- 172.21.15.19:0/148290600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf60138450 con 0x7fdf60139310 2024-03-08T06:03:58.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.340+0000 7fdf5fe00640 1 --2- 172.21.15.19:0/148290600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf60139310 0x7fdf60137790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdf60072490 tx=0x7fdf5800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:58.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.341+0000 7fdf57400640 1 -- 172.21.15.19:0/148290600 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5800eb90 con 0x7fdf60139310 2024-03-08T06:03:58.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.341+0000 7fdf57400640 1 -- 172.21.15.19:0/148290600 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5800ed50 con 0x7fdf60139310 2024-03-08T06:03:58.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.341+0000 7fdf57400640 1 -- 172.21.15.19:0/148290600 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf58003bd0 con 0x7fdf60139310 2024-03-08T06:03:58.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.341+0000 7fdf65000640 1 -- 172.21.15.19:0/148290600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf6015d2f0 con 0x7fdf60139310 2024-03-08T06:03:58.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.341+0000 7fdf65000640 1 -- 172.21.15.19:0/148290600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf6015d8b0 con 0x7fdf60139310 2024-03-08T06:03:58.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.342+0000 7fdf65000640 1 -- 172.21.15.19:0/148290600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf60075100 con 0x7fdf60139310 2024-03-08T06:03:58.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.343+0000 7fdf57400640 1 -- 172.21.15.19:0/148290600 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdf5801b020 con 0x7fdf60139310 2024-03-08T06:03:58.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.344+0000 7fdf57400640 1 --2- 172.21.15.19:0/148290600 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fdf4006b4d0 0x7fdf4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:58.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.344+0000 7fdf57400640 1 -- 172.21.15.19:0/148290600 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf5808a020 con 0x7fdf60139310 2024-03-08T06:03:58.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.344+0000 7fdf5f400640 1 --2- 172.21.15.19:0/148290600 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fdf4006b4d0 0x7fdf4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:58.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.345+0000 7fdf5f400640 1 --2- 172.21.15.19:0/148290600 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fdf4006b4d0 0x7fdf4006d990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdf440057e0 tx=0x7fdf50032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:58.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.348+0000 7fdf57400640 1 -- 172.21.15.19:0/148290600 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdf58058e90 con 0x7fdf60139310 2024-03-08T06:03:58.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.548+0000 7fdf65000640 1 -- 172.21.15.19:0/148290600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf6015da80 con 0x7fdf60139310 2024-03-08T06:03:58.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.551+0000 7fdf57400640 1 -- 172.21.15.19:0/148290600 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7fdf58058790 con 0x7fdf60139310 2024-03-08T06:03:58.552 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:03:58.553 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:03:22.069498+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:03:18.392703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T06:03:19.537912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:03:58.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.554+0000 7fdf65000640 1 -- 172.21.15.19:0/148290600 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fdf4006b4d0 msgr2=0x7fdf4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:58.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.554+0000 7fdf65000640 1 --2- 172.21.15.19:0/148290600 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fdf4006b4d0 0x7fdf4006d990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdf440057e0 tx=0x7fdf50032000 comp rx=0 tx=0).stop 2024-03-08T06:03:58.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.554+0000 7fdf65000640 1 -- 172.21.15.19:0/148290600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf60139310 msgr2=0x7fdf60137790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:58.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.554+0000 7fdf65000640 1 --2- 172.21.15.19:0/148290600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf60139310 0x7fdf60137790 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdf60072490 tx=0x7fdf5800e4b0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.555+0000 7fdf65000640 1 -- 172.21.15.19:0/148290600 shutdown_connections 2024-03-08T06:03:58.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.555+0000 7fdf65000640 1 --2- 172.21.15.19:0/148290600 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fdf4006b4d0 0x7fdf4006d990 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.555+0000 7fdf65000640 1 --2- 172.21.15.19:0/148290600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf60139310 0x7fdf60137790 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.555+0000 7fdf65000640 1 --2- 172.21.15.19:0/148290600 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdf6013afc0 0x7fdf60138dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.555+0000 7fdf65000640 1 --2- 172.21.15.19:0/148290600 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdf440039b0 0x7fdf60151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.555+0000 7fdf65000640 1 -- 172.21.15.19:0/148290600 >> 172.21.15.19:0/148290600 conn(0x7fdf600b1850 msgr2=0x7fdf60140540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:58.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.555+0000 7fdf65000640 1 -- 172.21.15.19:0/148290600 shutdown_connections 2024-03-08T06:03:58.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.555+0000 7fdf65000640 1 -- 172.21.15.19:0/148290600 wait complete. 2024-03-08T06:03:58.575 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T06:03:14.149736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T06:03:18.392703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T06:03:19.537912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T06:03:58.576 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T06:03:58.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.803+0000 7f9a03200640 1 Processor -- start 2024-03-08T06:03:58.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.803+0000 7f9a03200640 1 -- start start 2024-03-08T06:03:58.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.804+0000 7f9a03200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9a0415de60 0x7f9a04161930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:58.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.804+0000 7f9a03200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a040cf030 0x7f9a040d25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:58.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.804+0000 7f9a03200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0415e240 con 0x7f9a040b9630 2024-03-08T06:03:58.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.804+0000 7f9a03200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a04162030 con 0x7f9a0415de60 2024-03-08T06:03:58.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.805+0000 7f9a03200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a04162310 con 0x7f9a040cf030 2024-03-08T06:03:58.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.805+0000 7f9a01400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9a040b9630 0x7f9a040ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46172/0 (socket says 172.21.15.19:46172) 2024-03-08T06:03:58.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.805+0000 7f9a01400640 1 -- 172.21.15.19:0/253109613 learned_addr learned my addr 172.21.15.19:0/253109613 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:58.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.805+0000 7f9a02800640 1 --2- 172.21.15.19:0/253109613 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a040cf030 0x7f9a040d25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:58.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.805+0000 7f9a00a00640 1 -- 172.21.15.19:0/253109613 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606553146 0 0) 0x7f9a0415e240 con 0x7f9a040b9630 2024-03-08T06:03:58.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.805+0000 7f9a01e00640 1 --2- 172.21.15.19:0/253109613 >> v2:172.21.15.42:3300/0 conn(0x7f9a0415de60 0x7f9a04161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:58.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.805+0000 7f9a00a00640 1 -- 172.21.15.19:0/253109613 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99e8003520 con 0x7f9a040b9630 2024-03-08T06:03:58.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.806+0000 7f9a00a00640 1 -- 172.21.15.19:0/253109613 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1170866018 0 0) 0x7f99e8003520 con 0x7f9a040b9630 2024-03-08T06:03:58.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.806+0000 7f9a00a00640 1 -- 172.21.15.19:0/253109613 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a040cf030 msgr2=0x7f9a040d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:58.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.806+0000 7f9a00a00640 1 --2- 172.21.15.19:0/253109613 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a040cf030 0x7f9a040d25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.806+0000 7f9a00a00640 1 -- 172.21.15.19:0/253109613 >> v2:172.21.15.42:3300/0 conn(0x7f9a0415de60 msgr2=0x7f9a04161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:58.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.806+0000 7f9a00a00640 1 --2- 172.21.15.19:0/253109613 >> v2:172.21.15.42:3300/0 conn(0x7f9a0415de60 0x7f9a04161930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.806+0000 7f9a00a00640 1 -- 172.21.15.19:0/253109613 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a041625f0 con 0x7f9a040b9630 2024-03-08T06:03:58.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.806+0000 7f9a00a00640 1 -- 172.21.15.19:0/253109613 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f99f40019f0 con 0x7f9a040b9630 2024-03-08T06:03:58.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.806+0000 7f9a00a00640 1 -- 172.21.15.19:0/253109613 >> v1:172.21.15.19:6789/0 conn(0x7f9a040b9630 legacy=0x7f9a040ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:58.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.806+0000 7f9a00a00640 1 --2- 172.21.15.19:0/253109613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99e8003a20 0x7f99e8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:58.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.806+0000 7f9a00a00640 1 --2- 172.21.15.19:0/253109613 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a040cf030 0x7f99e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:58.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.806+0000 7f9a00a00640 1 --2- 172.21.15.19:0/253109613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99e8004d40 0x7f99e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:58.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.806+0000 7f9a00a00640 1 -- 172.21.15.19:0/253109613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a04162030 con 0x7f99e8003a20 2024-03-08T06:03:58.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.806+0000 7f9a00a00640 1 -- 172.21.15.19:0/253109613 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a04162310 con 0x7f99e8004d40 2024-03-08T06:03:58.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.806+0000 7f9a00a00640 1 -- 172.21.15.19:0/253109613 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e800b9c0 con 0x7f9a040cf030 2024-03-08T06:03:58.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.806+0000 7f9a01e00640 1 --2- 172.21.15.19:0/253109613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99e8003a20 0x7f99e8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:58.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.807+0000 7f9a01e00640 1 -- 172.21.15.19:0/253109613 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a040cf030 msgr2=0x7f99e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:58.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.807+0000 7f9a01e00640 1 --2- 172.21.15.19:0/253109613 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a040cf030 0x7f99e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.807+0000 7f9a01e00640 1 -- 172.21.15.19:0/253109613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99e8004d40 msgr2=0x7f99e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:58.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.807+0000 7f9a01e00640 1 --2- 172.21.15.19:0/253109613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99e8004d40 0x7f99e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.807+0000 7f9a01e00640 1 -- 172.21.15.19:0/253109613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e8003520 con 0x7f99e8003a20 2024-03-08T06:03:58.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.808+0000 7f9a01e00640 1 --2- 172.21.15.19:0/253109613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99e8003a20 0x7f99e8003e40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f99ec009ac0 tx=0x7f99e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0874766c10225 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:58.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.808+0000 7f9a00a00640 1 -- 172.21.15.19:0/253109613 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec039070 con 0x7f99e8003a20 2024-03-08T06:03:58.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.808+0000 7f9a00a00640 1 -- 172.21.15.19:0/253109613 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ec02c710 con 0x7f99e8003a20 2024-03-08T06:03:58.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.808+0000 7f9a00a00640 1 -- 172.21.15.19:0/253109613 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec009690 con 0x7f99e8003a20 2024-03-08T06:03:58.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.809+0000 7f9a03200640 1 -- 172.21.15.19:0/253109613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99e8003a20 msgr2=0x7f99e8003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:58.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.809+0000 7f9a03200640 1 --2- 172.21.15.19:0/253109613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99e8003a20 0x7f99e8003e40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f99ec009ac0 tx=0x7f99e8005830 comp rx=0 tx=0).stop 2024-03-08T06:03:58.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.809+0000 7f9a02800640 1 -- 172.21.15.19:0/253109613 reap_dead start 2024-03-08T06:03:58.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.809+0000 7f9a03200640 1 -- 172.21.15.19:0/253109613 shutdown_connections 2024-03-08T06:03:58.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.809+0000 7f9a03200640 1 -- 172.21.15.19:0/253109613 >> 172.21.15.19:0/253109613 conn(0x7f9a0406c500 msgr2=0x7f9a0406c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:58.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.809+0000 7f9a03200640 1 -- 172.21.15.19:0/253109613 shutdown_connections 2024-03-08T06:03:58.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.809+0000 7f9a03200640 1 -- 172.21.15.19:0/253109613 wait complete. 2024-03-08T06:03:58.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.811+0000 7f9a03200640 1 Processor -- start 2024-03-08T06:03:58.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.811+0000 7f9a03200640 1 -- start start 2024-03-08T06:03:58.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.812+0000 7f9a03200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99e8003a20 0x7f9a040cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:58.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.812+0000 7f9a03200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a040cae30 0x7f9a041496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:58.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.812+0000 7f9a03200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a041e75e0 0x7f9a0414c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:58.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.812+0000 7f9a03200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a040d25e0 con 0x7f9a040cae30 2024-03-08T06:03:58.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.812+0000 7f9a03200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a040b9a90 con 0x7f99e8003a20 2024-03-08T06:03:58.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.812+0000 7f9a03200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a040d2760 con 0x7f9a041e75e0 2024-03-08T06:03:58.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.813+0000 7f9a01400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a040cae30 0x7f9a041496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.813+0000 7f9a01400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a040cae30 0x7f9a041496b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45798/0 (socket says 172.21.15.19:45798) 2024-03-08T06:03:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.813+0000 7f9a01400640 1 -- 172.21.15.19:0/221299613 learned_addr learned my addr 172.21.15.19:0/221299613 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.813+0000 7f9a01e00640 1 --2- 172.21.15.19:0/221299613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99e8003a20 0x7f9a040cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.813+0000 7f9a01400640 1 -- 172.21.15.19:0/221299613 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a041e75e0 msgr2=0x7f9a0414c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.813+0000 7f9a02800640 1 --2- 172.21.15.19:0/221299613 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a041e75e0 0x7f9a0414c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.813+0000 7f9a01400640 1 --2- 172.21.15.19:0/221299613 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a041e75e0 0x7f9a0414c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.813+0000 7f9a01400640 1 -- 172.21.15.19:0/221299613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99e8003a20 msgr2=0x7f9a040cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.813+0000 7f9a01400640 1 --2- 172.21.15.19:0/221299613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99e8003a20 0x7f9a040cd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.813+0000 7f9a01400640 1 -- 172.21.15.19:0/221299613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0414a210 con 0x7f9a040cae30 2024-03-08T06:03:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.813+0000 7f9a01e00640 1 --2- 172.21.15.19:0/221299613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99e8003a20 0x7f9a040cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:03:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.813+0000 7f9a02800640 1 --2- 172.21.15.19:0/221299613 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a041e75e0 0x7f9a0414c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:03:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.814+0000 7f9a01400640 1 --2- 172.21.15.19:0/221299613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a040cae30 0x7f9a041496b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f99f400caa0 tx=0x7f99f400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:58.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.814+0000 7f99fa000640 1 -- 172.21.15.19:0/221299613 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4018070 con 0x7f9a040cae30 2024-03-08T06:03:58.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.814+0000 7f99fa000640 1 -- 172.21.15.19:0/221299613 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f400a730 con 0x7f9a040cae30 2024-03-08T06:03:58.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.814+0000 7f99fa000640 1 -- 172.21.15.19:0/221299613 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f400ab20 con 0x7f9a040cae30 2024-03-08T06:03:58.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.814+0000 7f9a03200640 1 -- 172.21.15.19:0/221299613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0414a4f0 con 0x7f9a040cae30 2024-03-08T06:03:58.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.814+0000 7f9a03200640 1 -- 172.21.15.19:0/221299613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0414aab0 con 0x7f9a040cae30 2024-03-08T06:03:58.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.816+0000 7f9a03200640 1 -- 172.21.15.19:0/221299613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0414acb0 con 0x7f9a040cae30 2024-03-08T06:03:58.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.816+0000 7f99fa000640 1 -- 172.21.15.19:0/221299613 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f99f401b070 con 0x7f9a040cae30 2024-03-08T06:03:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.817+0000 7f99fa000640 1 --2- 172.21.15.19:0/221299613 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f99e006b500 0x7f99e006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.817+0000 7f99fa000640 1 -- 172.21.15.19:0/221299613 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99f4089a50 con 0x7f9a040cae30 2024-03-08T06:03:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.818+0000 7f9a01e00640 1 --2- 172.21.15.19:0/221299613 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f99e006b500 0x7f99e006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.818+0000 7f9a01e00640 1 --2- 172.21.15.19:0/221299613 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f99e006b500 0x7f99e006d9c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f99ec036000 tx=0x7f99ec030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:58.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:58.822+0000 7f99fa000640 1 -- 172.21.15.19:0/221299613 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9a0414acb0 con 0x7f9a040cae30 2024-03-08T06:03:59.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.020+0000 7f9a03200640 1 -- 172.21.15.19:0/221299613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a04075090 con 0x7f9a040cae30 2024-03-08T06:03:59.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.021+0000 7f99fa000640 1 -- 172.21.15.19:0/221299613 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f99f40588d0 con 0x7f9a040cae30 2024-03-08T06:03:59.022 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-08T06:03:59.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.023+0000 7f9a03200640 1 -- 172.21.15.19:0/221299613 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f99e006b500 msgr2=0x7f99e006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:59.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.023+0000 7f9a03200640 1 --2- 172.21.15.19:0/221299613 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f99e006b500 0x7f99e006d9c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f99ec036000 tx=0x7f99ec030000 comp rx=0 tx=0).stop 2024-03-08T06:03:59.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.023+0000 7f9a03200640 1 -- 172.21.15.19:0/221299613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a040cae30 msgr2=0x7f9a041496b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:59.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.023+0000 7f9a03200640 1 --2- 172.21.15.19:0/221299613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a040cae30 0x7f9a041496b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f99f400caa0 tx=0x7f99f400cea0 comp rx=0 tx=0).stop 2024-03-08T06:03:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.023+0000 7f9a03200640 1 -- 172.21.15.19:0/221299613 shutdown_connections 2024-03-08T06:03:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.024+0000 7f9a03200640 1 --2- 172.21.15.19:0/221299613 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f99e006b500 0x7f99e006d9c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.024+0000 7f9a03200640 1 --2- 172.21.15.19:0/221299613 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a041e75e0 0x7f9a0414c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.024+0000 7f9a03200640 1 --2- 172.21.15.19:0/221299613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a040cae30 0x7f9a041496b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.024+0000 7f9a03200640 1 --2- 172.21.15.19:0/221299613 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99e8003a20 0x7f9a040cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.024+0000 7f9a03200640 1 -- 172.21.15.19:0/221299613 >> 172.21.15.19:0/221299613 conn(0x7f9a0406c500 msgr2=0x7f9a040d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.024+0000 7f9a03200640 1 -- 172.21.15.19:0/221299613 shutdown_connections 2024-03-08T06:03:59.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.024+0000 7f9a03200640 1 -- 172.21.15.19:0/221299613 wait complete. 2024-03-08T06:03:59.044 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T06:03:59.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.267+0000 7f0b77e00640 1 Processor -- start 2024-03-08T06:03:59.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.268+0000 7f0b77e00640 1 -- start start 2024-03-08T06:03:59.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.269+0000 7f0b77e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0b7815de40 0x7f0b78161910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:59.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.269+0000 7f0b77e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b7815e220 con 0x7f0b780b9610 2024-03-08T06:03:59.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.269+0000 7f0b77e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b78162010 con 0x7f0b780cf010 2024-03-08T06:03:59.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.269+0000 7f0b77e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b781622f0 con 0x7f0b7815de40 2024-03-08T06:03:59.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.269+0000 7f0b76a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0b7815de40 0x7f0b78161910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:59.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.269+0000 7f0b76000640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0b780b9610 0x7f0b780ce900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46182/0 (socket says 172.21.15.19:46182) 2024-03-08T06:03:59.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.269+0000 7f0b76000640 1 -- 172.21.15.19:0/1671442734 learned_addr learned my addr 172.21.15.19:0/1671442734 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:03:59.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.270+0000 7f0b76a00640 1 -- 172.21.15.19:0/1671442734 >> v1:172.21.15.42:6789/0 conn(0x7f0b780cf010 legacy=0x7f0b780d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:59.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.270+0000 7f0b76a00640 1 -- 172.21.15.19:0/1671442734 >> v1:172.21.15.19:6789/0 conn(0x7f0b780b9610 legacy=0x7f0b780ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:59.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.270+0000 7f0b75600640 1 -- 172.21.15.19:0/1671442734 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449524926 0 0) 0x7f0b7815e220 con 0x7f0b780b9610 2024-03-08T06:03:59.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.270+0000 7f0b76a00640 1 -- 172.21.15.19:0/1671442734 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b781625d0 con 0x7f0b7815de40 2024-03-08T06:03:59.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.271+0000 7f0b76a00640 1 --2- 172.21.15.19:0/1671442734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b7815de40 0x7f0b78161910 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0b600097a0 tx=0x7f0b6002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59abab0ac4551a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:59.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.271+0000 7f0b75600640 1 -- 172.21.15.19:0/1671442734 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b60035020 con 0x7f0b7815de40 2024-03-08T06:03:59.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.272+0000 7f0b75600640 1 -- 172.21.15.19:0/1671442734 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b60031830 con 0x7f0b7815de40 2024-03-08T06:03:59.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.272+0000 7f0b75600640 1 -- 172.21.15.19:0/1671442734 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b60031c00 con 0x7f0b7815de40 2024-03-08T06:03:59.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.272+0000 7f0b77e00640 1 -- 172.21.15.19:0/1671442734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b7815de40 msgr2=0x7f0b78161910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:59.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.272+0000 7f0b77e00640 1 --2- 172.21.15.19:0/1671442734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b7815de40 0x7f0b78161910 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0b600097a0 tx=0x7f0b6002b8d0 comp rx=0 tx=0).stop 2024-03-08T06:03:59.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.272+0000 7f0b77e00640 1 -- 172.21.15.19:0/1671442734 shutdown_connections 2024-03-08T06:03:59.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.272+0000 7f0b77e00640 1 --2- 172.21.15.19:0/1671442734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b7815de40 0x7f0b78161910 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:59.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.272+0000 7f0b77e00640 1 -- 172.21.15.19:0/1671442734 >> 172.21.15.19:0/1671442734 conn(0x7f0b7806c500 msgr2=0x7f0b7806c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:59.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.272+0000 7f0b77e00640 1 -- 172.21.15.19:0/1671442734 shutdown_connections 2024-03-08T06:03:59.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.272+0000 7f0b77e00640 1 -- 172.21.15.19:0/1671442734 wait complete. 2024-03-08T06:03:59.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.274+0000 7f0b77e00640 1 Processor -- start 2024-03-08T06:03:59.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.274+0000 7f0b77e00640 1 -- start start 2024-03-08T06:03:59.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.275+0000 7f0b77e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f0b780b9610 0x7f0b780c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:59.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.275+0000 7f0b77e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b780cf010 0x7f0b7815b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:59.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.275+0000 7f0b77e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b7815de40 0x7f0b780c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:59.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.275+0000 7f0b77e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b780d2cd0 con 0x7f0b780cf010 2024-03-08T06:03:59.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.275+0000 7f0b77e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b780b9a90 con 0x7f0b7815de40 2024-03-08T06:03:59.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.275+0000 7f0b77e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b780d2e50 con 0x7f0b780b9610 2024-03-08T06:03:59.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.276+0000 7f0b76000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b780cf010 0x7f0b7815b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:59.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.276+0000 7f0b76000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b780cf010 0x7f0b7815b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45812/0 (socket says 172.21.15.19:45812) 2024-03-08T06:03:59.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.276+0000 7f0b76000640 1 -- 172.21.15.19:0/3346103435 learned_addr learned my addr 172.21.15.19:0/3346103435 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:59.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.276+0000 7f0b76000640 1 -- 172.21.15.19:0/3346103435 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f0b780b9610 msgr2=0x7f0b780c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:59.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.276+0000 7f0b76000640 1 --2- 172.21.15.19:0/3346103435 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f0b780b9610 0x7f0b780c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:59.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.276+0000 7f0b76000640 1 -- 172.21.15.19:0/3346103435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b7815de40 msgr2=0x7f0b780c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:59.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.276+0000 7f0b76000640 1 --2- 172.21.15.19:0/3346103435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b7815de40 0x7f0b780c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:59.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.276+0000 7f0b76000640 1 -- 172.21.15.19:0/3346103435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b780c7bb0 con 0x7f0b780cf010 2024-03-08T06:03:59.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.276+0000 7f0b76000640 1 --2- 172.21.15.19:0/3346103435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b780cf010 0x7f0b7815b140 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800c890 tx=0x7f0b6800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:59.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.277+0000 7f0b6ea00640 1 -- 172.21.15.19:0/3346103435 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b68018070 con 0x7f0b780cf010 2024-03-08T06:03:59.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.277+0000 7f0b6ea00640 1 -- 172.21.15.19:0/3346103435 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6800a5e0 con 0x7f0b780cf010 2024-03-08T06:03:59.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.277+0000 7f0b6ea00640 1 -- 172.21.15.19:0/3346103435 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6800a9d0 con 0x7f0b780cf010 2024-03-08T06:03:59.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.277+0000 7f0b77e00640 1 -- 172.21.15.19:0/3346103435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b780c7e90 con 0x7f0b780cf010 2024-03-08T06:03:59.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.277+0000 7f0b77e00640 1 -- 172.21.15.19:0/3346103435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b780c8450 con 0x7f0b780cf010 2024-03-08T06:03:59.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.278+0000 7f0b77e00640 1 -- 172.21.15.19:0/3346103435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b78075090 con 0x7f0b780cf010 2024-03-08T06:03:59.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.279+0000 7f0b6ea00640 1 -- 172.21.15.19:0/3346103435 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0b6800ab70 con 0x7f0b780cf010 2024-03-08T06:03:59.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.280+0000 7f0b6ea00640 1 --2- 172.21.15.19:0/3346103435 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f0b5406b4d0 0x7f0b5406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:59.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.280+0000 7f0b6ea00640 1 -- 172.21.15.19:0/3346103435 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b680898f0 con 0x7f0b780cf010 2024-03-08T06:03:59.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.280+0000 7f0b76a00640 1 --2- 172.21.15.19:0/3346103435 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f0b5406b4d0 0x7f0b5406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:59.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.281+0000 7f0b76a00640 1 --2- 172.21.15.19:0/3346103435 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f0b5406b4d0 0x7f0b5406d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0b60036000 tx=0x7f0b60030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:59.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.284+0000 7f0b6ea00640 1 -- 172.21.15.19:0/3346103435 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0b680586d0 con 0x7f0b780cf010 2024-03-08T06:03:59.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.484+0000 7f0b77e00640 1 -- 172.21.15.19:0/3346103435 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0b780d17d0 con 0x7f0b780cf010 2024-03-08T06:03:59.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.485+0000 7f0b6ea00640 1 -- 172.21.15.19:0/3346103435 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0b68057fd0 con 0x7f0b780cf010 2024-03-08T06:03:59.486 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-08T06:03:59.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.488+0000 7f0b77e00640 1 -- 172.21.15.19:0/3346103435 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f0b5406b4d0 msgr2=0x7f0b5406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:59.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.488+0000 7f0b77e00640 1 --2- 172.21.15.19:0/3346103435 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f0b5406b4d0 0x7f0b5406d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0b60036000 tx=0x7f0b60030000 comp rx=0 tx=0).stop 2024-03-08T06:03:59.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.488+0000 7f0b77e00640 1 -- 172.21.15.19:0/3346103435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b780cf010 msgr2=0x7f0b7815b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:59.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.488+0000 7f0b77e00640 1 --2- 172.21.15.19:0/3346103435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b780cf010 0x7f0b7815b140 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800c890 tx=0x7f0b6800cd50 comp rx=0 tx=0).stop 2024-03-08T06:03:59.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.488+0000 7f0b77e00640 1 -- 172.21.15.19:0/3346103435 shutdown_connections 2024-03-08T06:03:59.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.488+0000 7f0b77e00640 1 --2- 172.21.15.19:0/3346103435 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f0b5406b4d0 0x7f0b5406d990 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:59.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.488+0000 7f0b77e00640 1 --2- 172.21.15.19:0/3346103435 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0b7815de40 0x7f0b780c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:59.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.488+0000 7f0b77e00640 1 --2- 172.21.15.19:0/3346103435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b780cf010 0x7f0b7815b140 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:59.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.488+0000 7f0b77e00640 1 --2- 172.21.15.19:0/3346103435 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f0b780b9610 0x7f0b780c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:59.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.488+0000 7f0b77e00640 1 -- 172.21.15.19:0/3346103435 >> 172.21.15.19:0/3346103435 conn(0x7f0b7806c500 msgr2=0x7f0b7815e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:59.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.488+0000 7f0b77e00640 1 -- 172.21.15.19:0/3346103435 shutdown_connections 2024-03-08T06:03:59.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.488+0000 7f0b77e00640 1 -- 172.21.15.19:0/3346103435 wait complete. 2024-03-08T06:03:59.509 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T06:03:59.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.734+0000 7ff9d4200640 1 Processor -- start 2024-03-08T06:03:59.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.735+0000 7ff9d4200640 1 -- start start 2024-03-08T06:03:59.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.736+0000 7ff9d4200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff9cc0b5f20 0x7ff9cc0b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:59.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.736+0000 7ff9d4200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9cc0b9a40 con 0x7ff9cc15e030 2024-03-08T06:03:59.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.736+0000 7ff9d4200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9cc0d20e0 con 0x7ff9cc0b95d0 2024-03-08T06:03:59.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.736+0000 7ff9d4200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9cc0d2380 con 0x7ff9cc0b5f20 2024-03-08T06:03:59.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.736+0000 7ff9d2200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff9cc0b5f20 0x7ff9cc0b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:59.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.737+0000 7ff9d2200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff9cc0b5f20 0x7ff9cc0b31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45820/0 (socket says 172.21.15.19:45820) 2024-03-08T06:03:59.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.737+0000 7ff9d2200640 1 -- 172.21.15.19:0/86920159 learned_addr learned my addr 172.21.15.19:0/86920159 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:59.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.737+0000 7ff9d2200640 1 -- 172.21.15.19:0/86920159 >> v1:172.21.15.42:6789/0 conn(0x7ff9cc0b95d0 legacy=0x7ff9cc0b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:03:59.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.737+0000 7ff9d2200640 1 -- 172.21.15.19:0/86920159 >> v1:172.21.15.19:6789/0 conn(0x7ff9cc15e030 legacy=0x7ff9cc0b6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:59.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.737+0000 7ff9d2200640 1 -- 172.21.15.19:0/86920159 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc0d2660 con 0x7ff9cc0b5f20 2024-03-08T06:03:59.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.738+0000 7ff9d2200640 1 --2- 172.21.15.19:0/86920159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9cc0b5f20 0x7ff9cc0b31a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009e50 tx=0x7ff9c402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab51fbba79aa9d server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:59.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.738+0000 7ff9cbe00640 1 -- 172.21.15.19:0/86920159 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c402cbb0 con 0x7ff9cc0b5f20 2024-03-08T06:03:59.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.738+0000 7ff9cbe00640 1 -- 172.21.15.19:0/86920159 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c402cd50 con 0x7ff9cc0b5f20 2024-03-08T06:03:59.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.739+0000 7ff9cbe00640 1 -- 172.21.15.19:0/86920159 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4034610 con 0x7ff9cc0b5f20 2024-03-08T06:03:59.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.739+0000 7ff9d4200640 1 -- 172.21.15.19:0/86920159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9cc0b5f20 msgr2=0x7ff9cc0b31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:59.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.739+0000 7ff9d4200640 1 --2- 172.21.15.19:0/86920159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9cc0b5f20 0x7ff9cc0b31a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4009e50 tx=0x7ff9c402c010 comp rx=0 tx=0).stop 2024-03-08T06:03:59.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.739+0000 7ff9d4200640 1 -- 172.21.15.19:0/86920159 shutdown_connections 2024-03-08T06:03:59.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.739+0000 7ff9d4200640 1 --2- 172.21.15.19:0/86920159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9cc0b5f20 0x7ff9cc0b31a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.739+0000 7ff9d4200640 1 -- 172.21.15.19:0/86920159 >> 172.21.15.19:0/86920159 conn(0x7ff9cc067270 msgr2=0x7ff9cc0d0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.739+0000 7ff9d4200640 1 -- 172.21.15.19:0/86920159 shutdown_connections 2024-03-08T06:03:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.739+0000 7ff9d4200640 1 -- 172.21.15.19:0/86920159 wait complete. 2024-03-08T06:03:59.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.741+0000 7ff9d4200640 1 Processor -- start 2024-03-08T06:03:59.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.741+0000 7ff9d4200640 1 -- start start 2024-03-08T06:03:59.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.742+0000 7ff9d4200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9cc0b5f20 0x7ff9cc15ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:59.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.742+0000 7ff9d4200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff9cc0b95d0 0x7ff9cc157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:59.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.742+0000 7ff9d4200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9cc15e030 0x7ff9cc158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:59.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.742+0000 7ff9d4200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc0d2e60 con 0x7ff9cc15e030 2024-03-08T06:03:59.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.742+0000 7ff9d4200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc0b9cb0 con 0x7ff9cc0b5f20 2024-03-08T06:03:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.742+0000 7ff9d4200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc0d2fe0 con 0x7ff9cc0b95d0 2024-03-08T06:03:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.742+0000 7ff9d2200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9cc15e030 0x7ff9cc158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.742+0000 7ff9d2200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9cc15e030 0x7ff9cc158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45834/0 (socket says 172.21.15.19:45834) 2024-03-08T06:03:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.742+0000 7ff9d2200640 1 -- 172.21.15.19:0/4227132383 learned_addr learned my addr 172.21.15.19:0/4227132383 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:03:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.743+0000 7ff9d0e00640 1 --2- 172.21.15.19:0/4227132383 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff9cc0b95d0 0x7ff9cc157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.743+0000 7ff9d1800640 1 --2- 172.21.15.19:0/4227132383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9cc0b5f20 0x7ff9cc15ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.743+0000 7ff9d2200640 1 -- 172.21.15.19:0/4227132383 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff9cc0b95d0 msgr2=0x7ff9cc157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.743+0000 7ff9d2200640 1 --2- 172.21.15.19:0/4227132383 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff9cc0b95d0 0x7ff9cc157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.743+0000 7ff9d2200640 1 -- 172.21.15.19:0/4227132383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9cc0b5f20 msgr2=0x7ff9cc15ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.743+0000 7ff9d2200640 1 --2- 172.21.15.19:0/4227132383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9cc0b5f20 0x7ff9cc15ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:59.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.743+0000 7ff9d2200640 1 -- 172.21.15.19:0/4227132383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc158ab0 con 0x7ff9cc15e030 2024-03-08T06:03:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.743+0000 7ff9d2200640 1 --2- 172.21.15.19:0/4227132383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9cc15e030 0x7ff9cc158320 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4036040 tx=0x7ff9c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.743+0000 7ff9c9600640 1 -- 172.21.15.19:0/4227132383 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4043020 con 0x7ff9cc15e030 2024-03-08T06:03:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.743+0000 7ff9c9600640 1 -- 172.21.15.19:0/4227132383 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c403e450 con 0x7ff9cc15e030 2024-03-08T06:03:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.743+0000 7ff9c9600640 1 -- 172.21.15.19:0/4227132383 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c403e860 con 0x7ff9cc15e030 2024-03-08T06:03:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.744+0000 7ff9d4200640 1 -- 172.21.15.19:0/4227132383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9cc158d90 con 0x7ff9cc15e030 2024-03-08T06:03:59.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.744+0000 7ff9d4200640 1 -- 172.21.15.19:0/4227132383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9cc1596d0 con 0x7ff9cc15e030 2024-03-08T06:03:59.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.745+0000 7ff9d4200640 1 -- 172.21.15.19:0/4227132383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9cc067cb0 con 0x7ff9cc15e030 2024-03-08T06:03:59.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.746+0000 7ff9c9600640 1 -- 172.21.15.19:0/4227132383 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff9c4046020 con 0x7ff9cc15e030 2024-03-08T06:03:59.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.747+0000 7ff9c9600640 1 --2- 172.21.15.19:0/4227132383 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff9ac06b500 0x7ff9ac06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:03:59.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.747+0000 7ff9c9600640 1 -- 172.21.15.19:0/4227132383 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9c40ac860 con 0x7ff9cc15e030 2024-03-08T06:03:59.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.747+0000 7ff9d1800640 1 --2- 172.21.15.19:0/4227132383 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff9ac06b500 0x7ff9ac06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:03:59.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.748+0000 7ff9d1800640 1 --2- 172.21.15.19:0/4227132383 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff9ac06b500 0x7ff9ac06d9c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0007fd0 tx=0x7ff9c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:03:59.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.751+0000 7ff9c9600640 1 -- 172.21.15.19:0/4227132383 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff9c404d070 con 0x7ff9cc15e030 2024-03-08T06:03:59.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.953+0000 7ff9d4200640 1 -- 172.21.15.19:0/4227132383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9cc0cee70 con 0x7ff9cc15e030 2024-03-08T06:03:59.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.954+0000 7ff9c9600640 1 -- 172.21.15.19:0/4227132383 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff9c407b6d0 con 0x7ff9cc15e030 2024-03-08T06:03:59.955 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-08T06:03:59.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.956+0000 7ff9d4200640 1 -- 172.21.15.19:0/4227132383 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff9ac06b500 msgr2=0x7ff9ac06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:59.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.957+0000 7ff9d4200640 1 --2- 172.21.15.19:0/4227132383 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff9ac06b500 0x7ff9ac06d9c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0007fd0 tx=0x7ff9c0009040 comp rx=0 tx=0).stop 2024-03-08T06:03:59.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.957+0000 7ff9d4200640 1 -- 172.21.15.19:0/4227132383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9cc15e030 msgr2=0x7ff9cc158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:03:59.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.957+0000 7ff9d4200640 1 --2- 172.21.15.19:0/4227132383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9cc15e030 0x7ff9cc158320 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4036040 tx=0x7ff9c4004a40 comp rx=0 tx=0).stop 2024-03-08T06:03:59.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.957+0000 7ff9d4200640 1 -- 172.21.15.19:0/4227132383 shutdown_connections 2024-03-08T06:03:59.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.957+0000 7ff9d4200640 1 --2- 172.21.15.19:0/4227132383 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff9ac06b500 0x7ff9ac06d9c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:59.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.957+0000 7ff9d4200640 1 --2- 172.21.15.19:0/4227132383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9cc15e030 0x7ff9cc158320 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:59.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.957+0000 7ff9d4200640 1 --2- 172.21.15.19:0/4227132383 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff9cc0b95d0 0x7ff9cc157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:59.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.957+0000 7ff9d4200640 1 --2- 172.21.15.19:0/4227132383 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9cc0b5f20 0x7ff9cc15ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:03:59.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.957+0000 7ff9d4200640 1 -- 172.21.15.19:0/4227132383 >> 172.21.15.19:0/4227132383 conn(0x7ff9cc067270 msgr2=0x7ff9cc074510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:03:59.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.957+0000 7ff9d4200640 1 -- 172.21.15.19:0/4227132383 shutdown_connections 2024-03-08T06:03:59.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:03:59.957+0000 7ff9d4200640 1 -- 172.21.15.19:0/4227132383 wait complete. 2024-03-08T06:03:59.977 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_admin.TestLabeledPerfCounters.test_per_client_labeled_perf_counters' 2024-03-08T06:04:00.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.197+0000 7f993a000640 1 Processor -- start 2024-03-08T06:04:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.198+0000 7f993a000640 1 -- start start 2024-03-08T06:04:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.199+0000 7f993a000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f993415df20 0x7f99340ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.199+0000 7f993a000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f99340b6bd0 0x7f9934162400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.199+0000 7f993a000640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993415e300 con 0x7f99340d0aa0 2024-03-08T06:04:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.199+0000 7f993a000640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99340d3990 con 0x7f99340b6bd0 2024-03-08T06:04:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.199+0000 7f993a000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9934162940 con 0x7f993415df20 2024-03-08T06:04:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.200+0000 7f9933e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f99340b6bd0 0x7f9934162400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.200+0000 7f9933e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f99340b6bd0 0x7f9934162400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45840/0 (socket says 172.21.15.19:45840) 2024-03-08T06:04:00.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.200+0000 7f9933e00640 1 -- 172.21.15.19:0/3063496259 learned_addr learned my addr 172.21.15.19:0/3063496259 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:00.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.200+0000 7f9938c00640 1 --2- 172.21.15.19:0/3063496259 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f993415df20 0x7f99340ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:00.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.200+0000 7f9933e00640 1 -- 172.21.15.19:0/3063496259 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f993415df20 msgr2=0x7f99340ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:00.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.200+0000 7f9933e00640 1 --2- 172.21.15.19:0/3063496259 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f993415df20 0x7f99340ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:00.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.200+0000 7f9933e00640 1 -- 172.21.15.19:0/3063496259 >> v1:172.21.15.42:6789/0 conn(0x7f99340d0aa0 legacy=0x7f99340b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:00.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.200+0000 7f9933e00640 1 -- 172.21.15.19:0/3063496259 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99340cf030 con 0x7f99340b6bd0 2024-03-08T06:04:00.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.201+0000 7f9933e00640 1 --2- 172.21.15.19:0/3063496259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99340b6bd0 0x7f9934162400 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9920009870 tx=0x7f992002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbfc42f10d47a61 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.202+0000 7f9933400640 1 -- 172.21.15.19:0/3063496259 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9920034070 con 0x7f99340b6bd0 2024-03-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.202+0000 7f9933400640 1 -- 172.21.15.19:0/3063496259 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9920030840 con 0x7f99340b6bd0 2024-03-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.202+0000 7f9933400640 1 -- 172.21.15.19:0/3063496259 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9920030c10 con 0x7f99340b6bd0 2024-03-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.202+0000 7f993a000640 1 -- 172.21.15.19:0/3063496259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99340b6bd0 msgr2=0x7f9934162400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.202+0000 7f993a000640 1 --2- 172.21.15.19:0/3063496259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99340b6bd0 0x7f9934162400 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9920009870 tx=0x7f992002b980 comp rx=0 tx=0).stop 2024-03-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.203+0000 7f993a000640 1 -- 172.21.15.19:0/3063496259 shutdown_connections 2024-03-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.203+0000 7f993a000640 1 --2- 172.21.15.19:0/3063496259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99340b6bd0 0x7f9934162400 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.203+0000 7f993a000640 1 --2- 172.21.15.19:0/3063496259 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f993415df20 0x7f99340ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.203+0000 7f993a000640 1 -- 172.21.15.19:0/3063496259 >> 172.21.15.19:0/3063496259 conn(0x7f993406c740 msgr2=0x7f993406cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.203+0000 7f993a000640 1 -- 172.21.15.19:0/3063496259 shutdown_connections 2024-03-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.203+0000 7f993a000640 1 -- 172.21.15.19:0/3063496259 wait complete. 2024-03-08T06:04:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.204+0000 7f993a000640 1 Processor -- start 2024-03-08T06:04:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.205+0000 7f993a000640 1 -- start start 2024-03-08T06:04:00.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.206+0000 7f993a000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99340b6bd0 0x7f99340c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:00.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.206+0000 7f993a000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99340d0aa0 0x7f99340cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:00.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.206+0000 7f993a000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f993415df20 0x7f9934146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:00.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.206+0000 7f993a000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99340d2180 con 0x7f99340b6bd0 2024-03-08T06:04:00.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.206+0000 7f993a000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99340d1ea0 con 0x7f99340d0aa0 2024-03-08T06:04:00.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.206+0000 7f993a000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99340d2460 con 0x7f993415df20 2024-03-08T06:04:00.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.206+0000 7f9938c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99340b6bd0 0x7f99340c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:00.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.206+0000 7f9938c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99340b6bd0 0x7f99340c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45852/0 (socket says 172.21.15.19:45852) 2024-03-08T06:04:00.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.206+0000 7f9938c00640 1 -- 172.21.15.19:0/1579020685 learned_addr learned my addr 172.21.15.19:0/1579020685 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:00.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.206+0000 7f9933e00640 1 --2- 172.21.15.19:0/1579020685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99340d0aa0 0x7f99340cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:00.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.206+0000 7f9939600640 1 --2- 172.21.15.19:0/1579020685 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f993415df20 0x7f9934146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:00.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.207+0000 7f9938c00640 1 -- 172.21.15.19:0/1579020685 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f993415df20 msgr2=0x7f9934146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:00.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.207+0000 7f9938c00640 1 --2- 172.21.15.19:0/1579020685 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f993415df20 0x7f9934146f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:00.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.207+0000 7f9938c00640 1 -- 172.21.15.19:0/1579020685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99340d0aa0 msgr2=0x7f99340cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:00.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.207+0000 7f9938c00640 1 --2- 172.21.15.19:0/1579020685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99340d0aa0 0x7f99340cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:00.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.207+0000 7f9938c00640 1 -- 172.21.15.19:0/1579020685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99340c8c70 con 0x7f99340b6bd0 2024-03-08T06:04:00.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.207+0000 7f9939600640 1 --2- 172.21.15.19:0/1579020685 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f993415df20 0x7f9934146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:00.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.207+0000 7f9938c00640 1 --2- 172.21.15.19:0/1579020685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99340b6bd0 0x7f99340c8690 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f992400d620 tx=0x7f992400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:00.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.207+0000 7f9930c00640 1 -- 172.21.15.19:0/1579020685 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992400b620 con 0x7f99340b6bd0 2024-03-08T06:04:00.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.207+0000 7f9930c00640 1 -- 172.21.15.19:0/1579020685 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9924019070 con 0x7f99340b6bd0 2024-03-08T06:04:00.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.207+0000 7f993a000640 1 -- 172.21.15.19:0/1579020685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99340c8f50 con 0x7f99340b6bd0 2024-03-08T06:04:00.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.207+0000 7f9930c00640 1 -- 172.21.15.19:0/1579020685 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992400ba00 con 0x7f99340b6bd0 2024-03-08T06:04:00.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.207+0000 7f993a000640 1 -- 172.21.15.19:0/1579020685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99340c9510 con 0x7f99340b6bd0 2024-03-08T06:04:00.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.209+0000 7f993a000640 1 -- 172.21.15.19:0/1579020685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9934075100 con 0x7f99340b6bd0 2024-03-08T06:04:00.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.210+0000 7f9930c00640 1 -- 172.21.15.19:0/1579020685 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f992400bba0 con 0x7f99340b6bd0 2024-03-08T06:04:00.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.211+0000 7f9930c00640 1 --2- 172.21.15.19:0/1579020685 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f991406b4d0 0x7f991406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:00.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.211+0000 7f9930c00640 1 -- 172.21.15.19:0/1579020685 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f992408a6d0 con 0x7f99340b6bd0 2024-03-08T06:04:00.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.211+0000 7f9933e00640 1 --2- 172.21.15.19:0/1579020685 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f991406b4d0 0x7f991406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:00.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.212+0000 7f9933e00640 1 --2- 172.21.15.19:0/1579020685 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f991406b4d0 0x7f991406d990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9920036000 tx=0x7f992003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:00.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.216+0000 7f9930c00640 1 -- 172.21.15.19:0/1579020685 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f99240594c0 con 0x7f99340b6bd0 2024-03-08T06:04:00.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:00.490+0000 7f993a000640 1 -- 172.21.15.19:0/1579020685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_admin.TestLabeledPerfCounters.test_per_client_labeled_perf_counters"]} v 0) v1 -- 0x7f99340ce450 con 0x7f99340b6bd0 2024-03-08T06:04:01.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.309+0000 7f9930c00640 1 -- 172.21.15.19:0/1579020685 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_admin.TestLabeledPerfCounters.test_per_client_labeled_perf_counters"]}]=0 v56) v1 ==== 167+0+0 (secure 0 0 0) 0x7f9924058dc0 con 0x7f99340b6bd0 2024-03-08T06:04:01.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.312+0000 7f993a000640 1 -- 172.21.15.19:0/1579020685 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f991406b4d0 msgr2=0x7f991406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:01.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.312+0000 7f993a000640 1 --2- 172.21.15.19:0/1579020685 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f991406b4d0 0x7f991406d990 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9920036000 tx=0x7f992003b040 comp rx=0 tx=0).stop 2024-03-08T06:04:01.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.312+0000 7f993a000640 1 -- 172.21.15.19:0/1579020685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99340b6bd0 msgr2=0x7f99340c8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:01.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.312+0000 7f993a000640 1 --2- 172.21.15.19:0/1579020685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99340b6bd0 0x7f99340c8690 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f992400d620 tx=0x7f992400dae0 comp rx=0 tx=0).stop 2024-03-08T06:04:01.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.313+0000 7f993a000640 1 -- 172.21.15.19:0/1579020685 shutdown_connections 2024-03-08T06:04:01.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.313+0000 7f993a000640 1 --2- 172.21.15.19:0/1579020685 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f991406b4d0 0x7f991406d990 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:01.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.313+0000 7f993a000640 1 --2- 172.21.15.19:0/1579020685 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f993415df20 0x7f9934146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:01.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.313+0000 7f993a000640 1 --2- 172.21.15.19:0/1579020685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f99340d0aa0 0x7f99340cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:01.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.313+0000 7f993a000640 1 --2- 172.21.15.19:0/1579020685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99340b6bd0 0x7f99340c8690 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:01.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.313+0000 7f993a000640 1 -- 172.21.15.19:0/1579020685 >> 172.21.15.19:0/1579020685 conn(0x7f993406c740 msgr2=0x7f9934161ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:01.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.313+0000 7f993a000640 1 -- 172.21.15.19:0/1579020685 shutdown_connections 2024-03-08T06:04:01.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.313+0000 7f993a000640 1 -- 172.21.15.19:0/1579020685 wait complete. 2024-03-08T06:04:01.335 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-08T06:04:01.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.563+0000 7f8a1f200640 1 Processor -- start 2024-03-08T06:04:01.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.563+0000 7f8a1f200640 1 -- start start 2024-03-08T06:04:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.564+0000 7f8a1f200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8a2015de60 0x7f8a20161930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.564+0000 7f8a1f200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2015e240 con 0x7f8a200b9630 2024-03-08T06:04:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.564+0000 7f8a1f200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a20162030 con 0x7f8a200cf030 2024-03-08T06:04:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.564+0000 7f8a1f200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a20162310 con 0x7f8a2015de60 2024-03-08T06:04:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.565+0000 7f8a1d400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8a200b9630 0x7f8a200ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46192/0 (socket says 172.21.15.19:46192) 2024-03-08T06:04:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.565+0000 7f8a1d400640 1 -- 172.21.15.19:0/2955851315 learned_addr learned my addr 172.21.15.19:0/2955851315 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.565+0000 7f8a1de00640 1 --2- 172.21.15.19:0/2955851315 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8a2015de60 0x7f8a20161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.565+0000 7f8a1ca00640 1 -- 172.21.15.19:0/2955851315 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473526007 0 0) 0x7f8a2015e240 con 0x7f8a200b9630 2024-03-08T06:04:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.565+0000 7f8a1ca00640 1 -- 172.21.15.19:0/2955851315 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a04003520 con 0x7f8a200b9630 2024-03-08T06:04:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.566+0000 7f8a1ca00640 1 -- 172.21.15.19:0/2955851315 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3820393314 0 0) 0x7f8a04003520 con 0x7f8a200b9630 2024-03-08T06:04:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.566+0000 7f8a1ca00640 1 -- 172.21.15.19:0/2955851315 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8a2015de60 msgr2=0x7f8a20161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.566+0000 7f8a1ca00640 1 --2- 172.21.15.19:0/2955851315 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8a2015de60 0x7f8a20161930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.566+0000 7f8a1ca00640 1 -- 172.21.15.19:0/2955851315 >> v1:172.21.15.42:6789/0 conn(0x7f8a200cf030 legacy=0x7f8a200d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.566+0000 7f8a1ca00640 1 -- 172.21.15.19:0/2955851315 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a201625f0 con 0x7f8a200b9630 2024-03-08T06:04:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.566+0000 7f8a1ca00640 1 -- 172.21.15.19:0/2955851315 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f8a08001670 con 0x7f8a200b9630 2024-03-08T06:04:01.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.566+0000 7f8a1ca00640 1 -- 172.21.15.19:0/2955851315 >> v1:172.21.15.19:6789/0 conn(0x7f8a200b9630 legacy=0x7f8a200ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:01.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.566+0000 7f8a1ca00640 1 --2- 172.21.15.19:0/2955851315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a04003a50 0x7f8a04003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:01.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.566+0000 7f8a1ca00640 1 --2- 172.21.15.19:0/2955851315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a04004800 0x7f8a04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:01.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.566+0000 7f8a1ca00640 1 --2- 172.21.15.19:0/2955851315 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8a2015de60 0x7f8a040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:01.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.566+0000 7f8a1ca00640 1 -- 172.21.15.19:0/2955851315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a20162310 con 0x7f8a04004800 2024-03-08T06:04:01.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.566+0000 7f8a1ca00640 1 -- 172.21.15.19:0/2955851315 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0400bac0 con 0x7f8a04003a50 2024-03-08T06:04:01.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.566+0000 7f8a1ca00640 1 -- 172.21.15.19:0/2955851315 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0400bcc0 con 0x7f8a2015de60 2024-03-08T06:04:01.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.566+0000 7f8a1d400640 1 --2- 172.21.15.19:0/2955851315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a04004800 0x7f8a04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:01.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.566+0000 7f8a1e800640 1 --2- 172.21.15.19:0/2955851315 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8a2015de60 0x7f8a040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:01.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.567+0000 7f8a1de00640 1 --2- 172.21.15.19:0/2955851315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a04003a50 0x7f8a04003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:01.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.567+0000 7f8a1d400640 1 -- 172.21.15.19:0/2955851315 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8a2015de60 msgr2=0x7f8a040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:01.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.567+0000 7f8a1d400640 1 --2- 172.21.15.19:0/2955851315 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8a2015de60 0x7f8a040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:01.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.567+0000 7f8a1d400640 1 -- 172.21.15.19:0/2955851315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a04003a50 msgr2=0x7f8a04003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:01.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.567+0000 7f8a1d400640 1 --2- 172.21.15.19:0/2955851315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a04003a50 0x7f8a04003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:01.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.567+0000 7f8a1d400640 1 -- 172.21.15.19:0/2955851315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a04003520 con 0x7f8a04004800 2024-03-08T06:04:01.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.567+0000 7f8a1e800640 1 --2- 172.21.15.19:0/2955851315 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8a2015de60 0x7f8a040051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:04:01.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.569+0000 7f8a1d400640 1 --2- 172.21.15.19:0/2955851315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a04004800 0x7f8a04004c80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800c210 tx=0x7f8a04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e37ab7838d8a82b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.569+0000 7f8a1ca00640 1 -- 172.21.15.19:0/2955851315 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a08007d30 con 0x7f8a04004800 2024-03-08T06:04:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.569+0000 7f8a1ca00640 1 -- 172.21.15.19:0/2955851315 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a08030070 con 0x7f8a04004800 2024-03-08T06:04:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.569+0000 7f8a1ca00640 1 -- 172.21.15.19:0/2955851315 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0802cd60 con 0x7f8a04004800 2024-03-08T06:04:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.570+0000 7f8a1f200640 1 -- 172.21.15.19:0/2955851315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a04004800 msgr2=0x7f8a04004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.570+0000 7f8a1f200640 1 --2- 172.21.15.19:0/2955851315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a04004800 0x7f8a04004c80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800c210 tx=0x7f8a04005830 comp rx=0 tx=0).stop 2024-03-08T06:04:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.570+0000 7f8a1e800640 1 -- 172.21.15.19:0/2955851315 reap_dead start 2024-03-08T06:04:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.570+0000 7f8a1f200640 1 -- 172.21.15.19:0/2955851315 shutdown_connections 2024-03-08T06:04:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.570+0000 7f8a1f200640 1 -- 172.21.15.19:0/2955851315 >> 172.21.15.19:0/2955851315 conn(0x7f8a2006c500 msgr2=0x7f8a2006c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.570+0000 7f8a1f200640 1 -- 172.21.15.19:0/2955851315 shutdown_connections 2024-03-08T06:04:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.570+0000 7f8a1f200640 1 -- 172.21.15.19:0/2955851315 wait complete. 2024-03-08T06:04:01.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.572+0000 7f8a1f200640 1 Processor -- start 2024-03-08T06:04:01.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.572+0000 7f8a1f200640 1 -- start start 2024-03-08T06:04:01.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.573+0000 7f8a1f200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a201e88a0 0x7f8a2015e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:01.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.573+0000 7f8a1f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a200b5e30 0x7f8a200b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:01.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.573+0000 7f8a1f200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8a200b5930 0x7f8a201f4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:01.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.573+0000 7f8a1f200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a20161930 con 0x7f8a201e88a0 2024-03-08T06:04:01.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.573+0000 7f8a1f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a200b9a90 con 0x7f8a200b5e30 2024-03-08T06:04:01.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.573+0000 7f8a1f200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a20161ab0 con 0x7f8a200b5930 2024-03-08T06:04:01.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.573+0000 7f8a1de00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a201e88a0 0x7f8a2015e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:01.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.573+0000 7f8a1de00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a201e88a0 0x7f8a2015e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45872/0 (socket says 172.21.15.19:45872) 2024-03-08T06:04:01.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.573+0000 7f8a1de00640 1 -- 172.21.15.19:0/3359323553 learned_addr learned my addr 172.21.15.19:0/3359323553 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:01.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.573+0000 7f8a1e800640 1 --2- 172.21.15.19:0/3359323553 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8a200b5930 0x7f8a201f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:01.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.573+0000 7f8a1d400640 1 --2- 172.21.15.19:0/3359323553 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a200b5e30 0x7f8a200b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:01.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.573+0000 7f8a1de00640 1 -- 172.21.15.19:0/3359323553 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8a200b5930 msgr2=0x7f8a201f4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:01.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.573+0000 7f8a1de00640 1 --2- 172.21.15.19:0/3359323553 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8a200b5930 0x7f8a201f4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:01.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.573+0000 7f8a1de00640 1 -- 172.21.15.19:0/3359323553 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a200b5e30 msgr2=0x7f8a200b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:01.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.573+0000 7f8a1de00640 1 --2- 172.21.15.19:0/3359323553 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a200b5e30 0x7f8a200b53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:01.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.574+0000 7f8a1de00640 1 -- 172.21.15.19:0/3359323553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a200b4950 con 0x7f8a201e88a0 2024-03-08T06:04:01.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.574+0000 7f8a1e800640 1 --2- 172.21.15.19:0/3359323553 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8a200b5930 0x7f8a201f4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:01.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.574+0000 7f8a1de00640 1 --2- 172.21.15.19:0/3359323553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a201e88a0 0x7f8a2015e770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8a10007f30 tx=0x7f8a10011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:01.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.574+0000 7f8a16000640 1 -- 172.21.15.19:0/3359323553 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1001a020 con 0x7f8a201e88a0 2024-03-08T06:04:01.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.574+0000 7f8a16000640 1 -- 172.21.15.19:0/3359323553 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a10016470 con 0x7f8a201e88a0 2024-03-08T06:04:01.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.574+0000 7f8a16000640 1 -- 172.21.15.19:0/3359323553 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10016860 con 0x7f8a201e88a0 2024-03-08T06:04:01.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.574+0000 7f8a1f200640 1 -- 172.21.15.19:0/3359323553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2015eec0 con 0x7f8a201e88a0 2024-03-08T06:04:01.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.574+0000 7f8a1f200640 1 -- 172.21.15.19:0/3359323553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2015f1a0 con 0x7f8a201e88a0 2024-03-08T06:04:01.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.575+0000 7f8a1f200640 1 -- 172.21.15.19:0/3359323553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a20075090 con 0x7f8a201e88a0 2024-03-08T06:04:01.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.576+0000 7f8a16000640 1 -- 172.21.15.19:0/3359323553 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8a10005d10 con 0x7f8a201e88a0 2024-03-08T06:04:01.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.578+0000 7f8a16000640 1 --2- 172.21.15.19:0/3359323553 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f89fc06b4d0 0x7f89fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:01.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.578+0000 7f8a16000640 1 -- 172.21.15.19:0/3359323553 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a1008b2c0 con 0x7f8a201e88a0 2024-03-08T06:04:01.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.578+0000 7f8a1d400640 1 --2- 172.21.15.19:0/3359323553 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f89fc06b4d0 0x7f89fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:01.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.579+0000 7f8a1d400640 1 --2- 172.21.15.19:0/3359323553 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f89fc06b4d0 0x7f89fc06d990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8a08034000 tx=0x7f8a08039040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:01.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.583+0000 7f8a16000640 1 -- 172.21.15.19:0/3359323553 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8a10024030 con 0x7f8a201e88a0 2024-03-08T06:04:01.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.781+0000 7f8a1f200640 1 -- 172.21.15.19:0/3359323553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8a200c7420 con 0x7f8a201e88a0 2024-03-08T06:04:01.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.788+0000 7f8a16000640 1 -- 172.21.15.19:0/3359323553 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8a1005a010 con 0x7f8a201e88a0 2024-03-08T06:04:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.790+0000 7f8a1f200640 1 -- 172.21.15.19:0/3359323553 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f89fc06b4d0 msgr2=0x7f89fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.790+0000 7f8a1f200640 1 --2- 172.21.15.19:0/3359323553 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f89fc06b4d0 0x7f89fc06d990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8a08034000 tx=0x7f8a08039040 comp rx=0 tx=0).stop 2024-03-08T06:04:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.790+0000 7f8a1f200640 1 -- 172.21.15.19:0/3359323553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a201e88a0 msgr2=0x7f8a2015e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.790+0000 7f8a1f200640 1 --2- 172.21.15.19:0/3359323553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a201e88a0 0x7f8a2015e770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8a10007f30 tx=0x7f8a10011660 comp rx=0 tx=0).stop 2024-03-08T06:04:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.791+0000 7f8a1f200640 1 -- 172.21.15.19:0/3359323553 shutdown_connections 2024-03-08T06:04:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.791+0000 7f8a1f200640 1 --2- 172.21.15.19:0/3359323553 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f89fc06b4d0 0x7f89fc06d990 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.791+0000 7f8a1f200640 1 --2- 172.21.15.19:0/3359323553 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8a200b5930 0x7f8a201f4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:01.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.791+0000 7f8a1f200640 1 --2- 172.21.15.19:0/3359323553 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a200b5e30 0x7f8a200b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.791+0000 7f8a1f200640 1 --2- 172.21.15.19:0/3359323553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a201e88a0 0x7f8a2015e770 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.791+0000 7f8a1f200640 1 -- 172.21.15.19:0/3359323553 >> 172.21.15.19:0/3359323553 conn(0x7f8a2006c500 msgr2=0x7f8a200c88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.791+0000 7f8a1f200640 1 -- 172.21.15.19:0/3359323553 shutdown_connections 2024-03-08T06:04:01.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:01.791+0000 7f8a1f200640 1 -- 172.21.15.19:0/3359323553 wait complete. 2024-03-08T06:04:01.810 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-08T06:04:01.810 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-08T06:04:01.914 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-08T06:04:02.048 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-08T06:04:02.049 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:04:02.049 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:04:02.107 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:04:02.107 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:04:02.157 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:04:02.157 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:04:02.211 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:04:02.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.432+0000 7ff05da00640 1 Processor -- start 2024-03-08T06:04:02.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.432+0000 7ff05da00640 1 -- start start 2024-03-08T06:04:02.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.434+0000 7ff05da00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff058144d50 0x7ff058071470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:02.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.434+0000 7ff05da00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0580719b0 0x7ff0580cc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:02.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.434+0000 7ff05da00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05806ebf0 con 0x7ff0581445d0 2024-03-08T06:04:02.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.434+0000 7ff05da00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff058071de0 con 0x7ff058144d50 2024-03-08T06:04:02.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.434+0000 7ff05da00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05806eed0 con 0x7ff0580719b0 2024-03-08T06:04:02.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.434+0000 7ff057e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff0581445d0 0x7ff05806deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53390/0 (socket says 172.21.15.19:53390) 2024-03-08T06:04:02.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.434+0000 7ff057e00640 1 -- 172.21.15.19:0/2087776646 learned_addr learned my addr 172.21.15.19:0/2087776646 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:02.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.435+0000 7ff057400640 1 --2- 172.21.15.19:0/2087776646 >> v2:172.21.15.42:3300/0 conn(0x7ff058144d50 0x7ff058071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:02.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.435+0000 7ff05d000640 1 --2- 172.21.15.19:0/2087776646 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0580719b0 0x7ff0580cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:02.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.435+0000 7ff056a00640 1 -- 172.21.15.19:0/2087776646 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4150543771 0 0) 0x7ff05806ebf0 con 0x7ff0581445d0 2024-03-08T06:04:02.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.435+0000 7ff056a00640 1 -- 172.21.15.19:0/2087776646 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff03c003520 con 0x7ff0581445d0 2024-03-08T06:04:02.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.435+0000 7ff056a00640 1 -- 172.21.15.19:0/2087776646 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4108530856 0 0) 0x7ff03c003520 con 0x7ff0581445d0 2024-03-08T06:04:02.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.435+0000 7ff056a00640 1 -- 172.21.15.19:0/2087776646 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0580719b0 msgr2=0x7ff0580cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:02.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.435+0000 7ff056a00640 1 --2- 172.21.15.19:0/2087776646 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0580719b0 0x7ff0580cc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:02.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.435+0000 7ff056a00640 1 -- 172.21.15.19:0/2087776646 >> v2:172.21.15.42:3300/0 conn(0x7ff058144d50 msgr2=0x7ff058071470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:02.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.435+0000 7ff056a00640 1 --2- 172.21.15.19:0/2087776646 >> v2:172.21.15.42:3300/0 conn(0x7ff058144d50 0x7ff058071470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:02.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.435+0000 7ff056a00640 1 -- 172.21.15.19:0/2087776646 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05806f1b0 con 0x7ff0581445d0 2024-03-08T06:04:02.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.435+0000 7ff056a00640 1 -- 172.21.15.19:0/2087776646 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7ff048001690 con 0x7ff0581445d0 2024-03-08T06:04:02.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.435+0000 7ff056a00640 1 -- 172.21.15.19:0/2087776646 >> v1:172.21.15.19:6789/0 conn(0x7ff0581445d0 legacy=0x7ff05806deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:02.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.436+0000 7ff056a00640 1 --2- 172.21.15.19:0/2087776646 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0580719b0 0x7ff03c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:02.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.436+0000 7ff056a00640 1 --2- 172.21.15.19:0/2087776646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff03c003f80 0x7ff03c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:02.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.436+0000 7ff056a00640 1 --2- 172.21.15.19:0/2087776646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff03c004d40 0x7ff03c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:02.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.436+0000 7ff056a00640 1 -- 172.21.15.19:0/2087776646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff058071de0 con 0x7ff03c003f80 2024-03-08T06:04:02.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.436+0000 7ff056a00640 1 -- 172.21.15.19:0/2087776646 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05806eed0 con 0x7ff03c004d40 2024-03-08T06:04:02.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.436+0000 7ff056a00640 1 -- 172.21.15.19:0/2087776646 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c00fdd0 con 0x7ff0580719b0 2024-03-08T06:04:02.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.436+0000 7ff057400640 1 --2- 172.21.15.19:0/2087776646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff03c003f80 0x7ff03c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:02.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.436+0000 7ff057400640 1 -- 172.21.15.19:0/2087776646 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0580719b0 msgr2=0x7ff03c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:02.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.436+0000 7ff057400640 1 --2- 172.21.15.19:0/2087776646 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0580719b0 0x7ff03c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:02.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.436+0000 7ff057400640 1 -- 172.21.15.19:0/2087776646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff03c004d40 msgr2=0x7ff03c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:02.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.436+0000 7ff057400640 1 --2- 172.21.15.19:0/2087776646 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff03c004d40 0x7ff03c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:02.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.436+0000 7ff057400640 1 -- 172.21.15.19:0/2087776646 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03c003520 con 0x7ff03c003f80 2024-03-08T06:04:02.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.437+0000 7ff057400640 1 --2- 172.21.15.19:0/2087776646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff03c003f80 0x7ff03c004800 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff044009af0 tx=0x7ff03c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a242f4912a86291 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:02.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.438+0000 7ff056a00640 1 -- 172.21.15.19:0/2087776646 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044039070 con 0x7ff03c003f80 2024-03-08T06:04:02.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.438+0000 7ff056a00640 1 -- 172.21.15.19:0/2087776646 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04402c6f0 con 0x7ff03c003f80 2024-03-08T06:04:02.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.438+0000 7ff056a00640 1 -- 172.21.15.19:0/2087776646 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044009690 con 0x7ff03c003f80 2024-03-08T06:04:02.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.438+0000 7ff05da00640 1 -- 172.21.15.19:0/2087776646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff03c003f80 msgr2=0x7ff03c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:02.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.438+0000 7ff05da00640 1 --2- 172.21.15.19:0/2087776646 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff03c003f80 0x7ff03c004800 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff044009af0 tx=0x7ff03c005830 comp rx=0 tx=0).stop 2024-03-08T06:04:02.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.438+0000 7ff05d000640 1 -- 172.21.15.19:0/2087776646 reap_dead start 2024-03-08T06:04:02.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.439+0000 7ff05da00640 1 -- 172.21.15.19:0/2087776646 shutdown_connections 2024-03-08T06:04:02.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.439+0000 7ff05da00640 1 -- 172.21.15.19:0/2087776646 >> 172.21.15.19:0/2087776646 conn(0x7ff0580b1600 msgr2=0x7ff0580b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:02.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.439+0000 7ff05da00640 1 -- 172.21.15.19:0/2087776646 shutdown_connections 2024-03-08T06:04:02.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.439+0000 7ff05da00640 1 -- 172.21.15.19:0/2087776646 wait complete. 2024-03-08T06:04:02.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.440+0000 7ff05da00640 1 Processor -- start 2024-03-08T06:04:02.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.441+0000 7ff05da00640 1 -- start start 2024-03-08T06:04:02.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.441+0000 7ff05da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff03c003f80 0x7ff05813acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.441+0000 7ff05da00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff05813a7a0 0x7ff05813c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.441+0000 7ff05da00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0581f2690 0x7ff05813e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.441+0000 7ff05da00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0581449b0 con 0x7ff05813a7a0 2024-03-08T06:04:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.441+0000 7ff05da00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0580cc340 con 0x7ff03c003f80 2024-03-08T06:04:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.441+0000 7ff05da00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff058144b30 con 0x7ff0581f2690 2024-03-08T06:04:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.442+0000 7ff057400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff05813a7a0 0x7ff05813c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.442+0000 7ff057400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff05813a7a0 0x7ff05813c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55638/0 (socket says 172.21.15.19:55638) 2024-03-08T06:04:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.442+0000 7ff057400640 1 -- 172.21.15.19:0/67765608 learned_addr learned my addr 172.21.15.19:0/67765608 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.442+0000 7ff057400640 1 -- 172.21.15.19:0/67765608 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0581f2690 msgr2=0x7ff05813e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.442+0000 7ff057400640 1 --2- 172.21.15.19:0/67765608 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0581f2690 0x7ff05813e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.442+0000 7ff057400640 1 -- 172.21.15.19:0/67765608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff03c003f80 msgr2=0x7ff05813acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.442+0000 7ff057400640 1 --2- 172.21.15.19:0/67765608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff03c003f80 0x7ff05813acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:02.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.442+0000 7ff057400640 1 -- 172.21.15.19:0/67765608 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05813f2d0 con 0x7ff05813a7a0 2024-03-08T06:04:02.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.442+0000 7ff057400640 1 --2- 172.21.15.19:0/67765608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff05813a7a0 0x7ff05813c7d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff044037040 tx=0x7ff044004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:02.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.443+0000 7ff04fe00640 1 -- 172.21.15.19:0/67765608 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044039050 con 0x7ff05813a7a0 2024-03-08T06:04:02.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.443+0000 7ff04fe00640 1 -- 172.21.15.19:0/67765608 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff044045070 con 0x7ff05813a7a0 2024-03-08T06:04:02.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.443+0000 7ff04fe00640 1 -- 172.21.15.19:0/67765608 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044003850 con 0x7ff05813a7a0 2024-03-08T06:04:02.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.443+0000 7ff05da00640 1 -- 172.21.15.19:0/67765608 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05813dd10 con 0x7ff05813a7a0 2024-03-08T06:04:02.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.443+0000 7ff05da00640 1 -- 172.21.15.19:0/67765608 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05813f590 con 0x7ff05813a7a0 2024-03-08T06:04:02.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.444+0000 7ff05da00640 1 -- 172.21.15.19:0/67765608 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff058075100 con 0x7ff05813a7a0 2024-03-08T06:04:02.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.445+0000 7ff04fe00640 1 -- 172.21.15.19:0/67765608 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff0440039f0 con 0x7ff05813a7a0 2024-03-08T06:04:02.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.446+0000 7ff04fe00640 1 --2- 172.21.15.19:0/67765608 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff03806b500 0x7ff03806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:02.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.446+0000 7ff04fe00640 1 -- 172.21.15.19:0/67765608 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0440abda0 con 0x7ff05813a7a0 2024-03-08T06:04:02.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.447+0000 7ff057e00640 1 --2- 172.21.15.19:0/67765608 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff03806b500 0x7ff03806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:02.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.447+0000 7ff057e00640 1 --2- 172.21.15.19:0/67765608 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff03806b500 0x7ff03806d9c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff048001880 tx=0x7ff0480014f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.451+0000 7ff04fe00640 1 -- 172.21.15.19:0/67765608 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff04404e020 con 0x7ff05813a7a0 2024-03-08T06:04:02.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.660+0000 7ff05da00640 1 -- 172.21.15.19:0/67765608 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0580af350 con 0x7ff05813a7a0 2024-03-08T06:04:02.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.662+0000 7ff04fe00640 1 -- 172.21.15.19:0/67765608 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7ff04407acd0 con 0x7ff05813a7a0 2024-03-08T06:04:02.664 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:02.664 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:03:22.069498+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:03:18.392703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T06:03:19.537912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:04:02.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.665+0000 7ff05da00640 1 -- 172.21.15.19:0/67765608 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff03806b500 msgr2=0x7ff03806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:02.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.665+0000 7ff05da00640 1 --2- 172.21.15.19:0/67765608 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff03806b500 0x7ff03806d9c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff048001880 tx=0x7ff0480014f0 comp rx=0 tx=0).stop 2024-03-08T06:04:02.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.665+0000 7ff05da00640 1 -- 172.21.15.19:0/67765608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff05813a7a0 msgr2=0x7ff05813c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:02.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.665+0000 7ff05da00640 1 --2- 172.21.15.19:0/67765608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff05813a7a0 0x7ff05813c7d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff044037040 tx=0x7ff044004730 comp rx=0 tx=0).stop 2024-03-08T06:04:02.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.665+0000 7ff05da00640 1 -- 172.21.15.19:0/67765608 shutdown_connections 2024-03-08T06:04:02.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.665+0000 7ff05da00640 1 --2- 172.21.15.19:0/67765608 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff03806b500 0x7ff03806d9c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:02.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.665+0000 7ff05da00640 1 --2- 172.21.15.19:0/67765608 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0581f2690 0x7ff05813e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:02.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.665+0000 7ff05da00640 1 --2- 172.21.15.19:0/67765608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff05813a7a0 0x7ff05813c7d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:02.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.665+0000 7ff05da00640 1 --2- 172.21.15.19:0/67765608 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff03c003f80 0x7ff05813acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:02.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.666+0000 7ff05da00640 1 -- 172.21.15.19:0/67765608 >> 172.21.15.19:0/67765608 conn(0x7ff0580b1600 msgr2=0x7ff058071f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:02.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.666+0000 7ff05da00640 1 -- 172.21.15.19:0/67765608 shutdown_connections 2024-03-08T06:04:02.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.666+0000 7ff05da00640 1 -- 172.21.15.19:0/67765608 wait complete. 2024-03-08T06:04:02.685 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T06:03:14.149736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T06:03:18.392703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T06:03:19.537912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T06:04:02.686 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T06:04:02.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.908+0000 7f8ddac00640 1 Processor -- start 2024-03-08T06:04:02.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.908+0000 7f8ddac00640 1 -- start start 2024-03-08T06:04:02.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.910+0000 7f8ddac00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8dd41455b0 0x7f8dd415c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:02.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.910+0000 7f8ddac00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8dd4071950 0x7f8dd4071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:02.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.910+0000 7f8ddac00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd40cd5a0 con 0x7f8dd41604f0 2024-03-08T06:04:02.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.910+0000 7f8ddac00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd40ccda0 con 0x7f8dd4071950 2024-03-08T06:04:02.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.910+0000 7f8ddac00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd40cdc20 con 0x7f8dd41455b0 2024-03-08T06:04:02.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.911+0000 7f8dd8c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8dd4071950 0x7f8dd4071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:02.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.911+0000 7f8dd3e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8dd41455b0 0x7f8dd415c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:02.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.911+0000 7f8dd8c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8dd4071950 0x7f8dd4071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.19:49264/0 (socket says 172.21.15.19:49264) 2024-03-08T06:04:02.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.911+0000 7f8dd8c00640 1 -- 172.21.15.19:0/1182224039 learned_addr learned my addr 172.21.15.19:0/1182224039 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:02.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.912+0000 7f8dd3e00640 1 -- 172.21.15.19:0/1182224039 >> v2:172.21.15.42:3300/0 conn(0x7f8dd4071950 msgr2=0x7f8dd4071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:02.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.912+0000 7f8dd3e00640 1 --2- 172.21.15.19:0/1182224039 >> v2:172.21.15.42:3300/0 conn(0x7f8dd4071950 0x7f8dd4071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:02.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.912+0000 7f8dd3e00640 1 -- 172.21.15.19:0/1182224039 >> v1:172.21.15.42:6789/0 conn(0x7f8dd41604f0 legacy=0x7f8dd40cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:02.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.912+0000 7f8dd3e00640 1 -- 172.21.15.19:0/1182224039 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd40ccfe0 con 0x7f8dd41455b0 2024-03-08T06:04:02.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.912+0000 7f8dd8c00640 1 --2- 172.21.15.19:0/1182224039 >> v2:172.21.15.42:3300/0 conn(0x7f8dd4071950 0x7f8dd4071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T06:04:02.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.913+0000 7f8dd3e00640 1 --2- 172.21.15.19:0/1182224039 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8dd41455b0 0x7f8dd415c1d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40097a0 tx=0x7f8dc402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=653e64a4318ab380 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:02.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.914+0000 7f8dd2a00640 1 -- 172.21.15.19:0/1182224039 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4035020 con 0x7f8dd41455b0 2024-03-08T06:04:02.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.914+0000 7f8dd2a00640 1 -- 172.21.15.19:0/1182224039 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc4031810 con 0x7f8dd41455b0 2024-03-08T06:04:02.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.914+0000 7f8dd2a00640 1 -- 172.21.15.19:0/1182224039 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4031be0 con 0x7f8dd41455b0 2024-03-08T06:04:02.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.915+0000 7f8ddac00640 1 -- 172.21.15.19:0/1182224039 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8dd41455b0 msgr2=0x7f8dd415c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:02.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.915+0000 7f8ddac00640 1 --2- 172.21.15.19:0/1182224039 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8dd41455b0 0x7f8dd415c1d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40097a0 tx=0x7f8dc402b8b0 comp rx=0 tx=0).stop 2024-03-08T06:04:02.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.915+0000 7f8ddac00640 1 -- 172.21.15.19:0/1182224039 shutdown_connections 2024-03-08T06:04:02.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.915+0000 7f8ddac00640 1 --2- 172.21.15.19:0/1182224039 >> v2:172.21.15.42:3300/0 conn(0x7f8dd4071950 0x7f8dd4071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:02.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.915+0000 7f8ddac00640 1 --2- 172.21.15.19:0/1182224039 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8dd41455b0 0x7f8dd415c1d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:02.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.915+0000 7f8ddac00640 1 -- 172.21.15.19:0/1182224039 >> 172.21.15.19:0/1182224039 conn(0x7f8dd406ae30 msgr2=0x7f8dd406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:02.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.915+0000 7f8ddac00640 1 -- 172.21.15.19:0/1182224039 shutdown_connections 2024-03-08T06:04:02.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.915+0000 7f8ddac00640 1 -- 172.21.15.19:0/1182224039 wait complete. 2024-03-08T06:04:02.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.918+0000 7f8ddac00640 1 Processor -- start 2024-03-08T06:04:02.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.918+0000 7f8ddac00640 1 -- start start 2024-03-08T06:04:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.919+0000 7f8ddac00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8dd4071950 0x7f8dd415b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.919+0000 7f8ddac00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8dd41455b0 0x7f8dd41f7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.919+0000 7f8ddac00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dd41604f0 0x7f8dd413b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.919+0000 7f8ddac00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd40cd8b0 con 0x7f8dd41455b0 2024-03-08T06:04:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.919+0000 7f8ddac00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd40722c0 con 0x7f8dd41604f0 2024-03-08T06:04:02.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.919+0000 7f8ddac00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd415c710 con 0x7f8dd4071950 2024-03-08T06:04:02.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.920+0000 7f8dd3400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8dd41455b0 0x7f8dd41f7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:02.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.920+0000 7f8dd3400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8dd41455b0 0x7f8dd41f7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55654/0 (socket says 172.21.15.19:55654) 2024-03-08T06:04:02.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.920+0000 7f8dd3400640 1 -- 172.21.15.19:0/1721305388 learned_addr learned my addr 172.21.15.19:0/1721305388 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:02.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.920+0000 7f8dd8c00640 1 --2- 172.21.15.19:0/1721305388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dd41604f0 0x7f8dd413b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:02.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.920+0000 7f8dd3e00640 1 --2- 172.21.15.19:0/1721305388 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8dd4071950 0x7f8dd415b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:02.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.920+0000 7f8dd3400640 1 -- 172.21.15.19:0/1721305388 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8dd4071950 msgr2=0x7f8dd415b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:02.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.920+0000 7f8dd3400640 1 --2- 172.21.15.19:0/1721305388 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8dd4071950 0x7f8dd415b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:02.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.920+0000 7f8dd3400640 1 -- 172.21.15.19:0/1721305388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dd41604f0 msgr2=0x7f8dd413b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:02.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.920+0000 7f8dd3400640 1 --2- 172.21.15.19:0/1721305388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dd41604f0 0x7f8dd413b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:02.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.920+0000 7f8dd3400640 1 -- 172.21.15.19:0/1721305388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd41f87e0 con 0x7f8dd41455b0 2024-03-08T06:04:02.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.920+0000 7f8dd8c00640 1 --2- 172.21.15.19:0/1721305388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dd41604f0 0x7f8dd413b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:04:02.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.921+0000 7f8dd3400640 1 --2- 172.21.15.19:0/1721305388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8dd41455b0 0x7f8dd41f7f70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000c440 tx=0x7f8dc000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:02.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.921+0000 7f8dcbe00640 1 -- 172.21.15.19:0/1721305388 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc00052d0 con 0x7f8dd41455b0 2024-03-08T06:04:02.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.921+0000 7f8dcbe00640 1 -- 172.21.15.19:0/1721305388 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc0005470 con 0x7f8dd41455b0 2024-03-08T06:04:02.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.921+0000 7f8ddac00640 1 -- 172.21.15.19:0/1721305388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd41f8ac0 con 0x7f8dd41455b0 2024-03-08T06:04:02.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.921+0000 7f8dcbe00640 1 -- 172.21.15.19:0/1721305388 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0007260 con 0x7f8dd41455b0 2024-03-08T06:04:02.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.921+0000 7f8ddac00640 1 -- 172.21.15.19:0/1721305388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd4142360 con 0x7f8dd41455b0 2024-03-08T06:04:02.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.922+0000 7f8ddac00640 1 -- 172.21.15.19:0/1721305388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd41f8570 con 0x7f8dd41455b0 2024-03-08T06:04:02.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.923+0000 7f8dcbe00640 1 -- 172.21.15.19:0/1721305388 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8dc00074c0 con 0x7f8dd41455b0 2024-03-08T06:04:02.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.924+0000 7f8dcbe00640 1 --2- 172.21.15.19:0/1721305388 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f8db406b4d0 0x7f8db406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:02.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.924+0000 7f8dcbe00640 1 -- 172.21.15.19:0/1721305388 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8dc0089660 con 0x7f8dd41455b0 2024-03-08T06:04:02.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.924+0000 7f8dd3e00640 1 --2- 172.21.15.19:0/1721305388 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f8db406b4d0 0x7f8db406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:02.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.925+0000 7f8dd3e00640 1 --2- 172.21.15.19:0/1721305388 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f8db406b4d0 0x7f8db406d990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4036000 tx=0x7f8dc4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:02.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:02.929+0000 7f8dcbe00640 1 -- 172.21.15.19:0/1721305388 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8dc00584d0 con 0x7f8dd41455b0 2024-03-08T06:04:03.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.128+0000 7f8ddac00640 1 -- 172.21.15.19:0/1721305388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8dd4067cb0 con 0x7f8dd41455b0 2024-03-08T06:04:03.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.129+0000 7f8dcbe00640 1 -- 172.21.15.19:0/1721305388 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8dc0057dd0 con 0x7f8dd41455b0 2024-03-08T06:04:03.129 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-08T06:04:03.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.132+0000 7f8ddac00640 1 -- 172.21.15.19:0/1721305388 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f8db406b4d0 msgr2=0x7f8db406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:03.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.132+0000 7f8ddac00640 1 --2- 172.21.15.19:0/1721305388 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f8db406b4d0 0x7f8db406d990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4036000 tx=0x7f8dc4008030 comp rx=0 tx=0).stop 2024-03-08T06:04:03.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.132+0000 7f8ddac00640 1 -- 172.21.15.19:0/1721305388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8dd41455b0 msgr2=0x7f8dd41f7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:03.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.132+0000 7f8ddac00640 1 --2- 172.21.15.19:0/1721305388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8dd41455b0 0x7f8dd41f7f70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000c440 tx=0x7f8dc000c900 comp rx=0 tx=0).stop 2024-03-08T06:04:03.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.132+0000 7f8ddac00640 1 -- 172.21.15.19:0/1721305388 shutdown_connections 2024-03-08T06:04:03.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.132+0000 7f8ddac00640 1 --2- 172.21.15.19:0/1721305388 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f8db406b4d0 0x7f8db406d990 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:03.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.132+0000 7f8ddac00640 1 --2- 172.21.15.19:0/1721305388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8dd41604f0 0x7f8dd413b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:03.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.132+0000 7f8ddac00640 1 --2- 172.21.15.19:0/1721305388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8dd41455b0 0x7f8dd41f7f70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:03.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.132+0000 7f8ddac00640 1 --2- 172.21.15.19:0/1721305388 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8dd4071950 0x7f8dd415b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:03.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.132+0000 7f8ddac00640 1 -- 172.21.15.19:0/1721305388 >> 172.21.15.19:0/1721305388 conn(0x7f8dd406ae30 msgr2=0x7f8dd406b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:03.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.132+0000 7f8ddac00640 1 -- 172.21.15.19:0/1721305388 shutdown_connections 2024-03-08T06:04:03.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.132+0000 7f8ddac00640 1 -- 172.21.15.19:0/1721305388 wait complete. 2024-03-08T06:04:03.153 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T06:04:03.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.375+0000 7feccb200640 1 Processor -- start 2024-03-08T06:04:03.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.375+0000 7feccb200640 1 -- start start 2024-03-08T06:04:03.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.377+0000 7feccb200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feccc145500 0x7feccc06ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:03.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.377+0000 7feccb200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7feccc071df0 0x7feccc0cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:03.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.377+0000 7feccb200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feccc15c460 con 0x7feccc15bfb0 2024-03-08T06:04:03.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.377+0000 7feccb200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feccc15c740 con 0x7feccc071df0 2024-03-08T06:04:03.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.377+0000 7feccb200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feccc15ca20 con 0x7feccc145500 2024-03-08T06:04:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.378+0000 7fecc9e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feccc145500 0x7feccc06ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.378+0000 7fecca800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7feccc071df0 0x7feccc0cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.378+0000 7fecc9e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feccc145500 0x7feccc06ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.19:58448/0 (socket says 172.21.15.19:58448) 2024-03-08T06:04:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.378+0000 7fecc9e00640 1 -- 172.21.15.19:0/2562773751 learned_addr learned my addr 172.21.15.19:0/2562773751 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.378+0000 7fecc9e00640 1 -- 172.21.15.19:0/2562773751 >> v2:172.21.15.42:3300/0 conn(0x7feccc071df0 msgr2=0x7feccc0cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.378+0000 7fecc9e00640 1 --2- 172.21.15.19:0/2562773751 >> v2:172.21.15.42:3300/0 conn(0x7feccc071df0 0x7feccc0cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.378+0000 7fecc9e00640 1 -- 172.21.15.19:0/2562773751 >> v1:172.21.15.42:6789/0 conn(0x7feccc15bfb0 legacy=0x7feccc0716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.378+0000 7fecc9e00640 1 -- 172.21.15.19:0/2562773751 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc15cd00 con 0x7feccc145500 2024-03-08T06:04:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.380+0000 7fecc9e00640 1 --2- 172.21.15.19:0/2562773751 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feccc145500 0x7feccc06ecb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009870 tx=0x7fecbc02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12c2f74830e5a7b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.380+0000 7fecc8a00640 1 -- 172.21.15.19:0/2562773751 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc035020 con 0x7feccc145500 2024-03-08T06:04:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.380+0000 7fecc8a00640 1 -- 172.21.15.19:0/2562773751 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc031640 con 0x7feccc145500 2024-03-08T06:04:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.380+0000 7fecc8a00640 1 -- 172.21.15.19:0/2562773751 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc02d040 con 0x7feccc145500 2024-03-08T06:04:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.381+0000 7feccb200640 1 -- 172.21.15.19:0/2562773751 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feccc145500 msgr2=0x7feccc06ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.381+0000 7feccb200640 1 --2- 172.21.15.19:0/2562773751 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feccc145500 0x7feccc06ecb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009870 tx=0x7fecbc02b8f0 comp rx=0 tx=0).stop 2024-03-08T06:04:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.381+0000 7feccb200640 1 -- 172.21.15.19:0/2562773751 shutdown_connections 2024-03-08T06:04:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.381+0000 7feccb200640 1 --2- 172.21.15.19:0/2562773751 >> v2:172.21.15.42:3300/0 conn(0x7feccc071df0 0x7feccc0cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.381+0000 7feccb200640 1 --2- 172.21.15.19:0/2562773751 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feccc145500 0x7feccc06ecb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.381+0000 7feccb200640 1 -- 172.21.15.19:0/2562773751 >> 172.21.15.19:0/2562773751 conn(0x7feccc0b1850 msgr2=0x7feccc0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.381+0000 7feccb200640 1 -- 172.21.15.19:0/2562773751 shutdown_connections 2024-03-08T06:04:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.381+0000 7feccb200640 1 -- 172.21.15.19:0/2562773751 wait complete. 2024-03-08T06:04:03.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.383+0000 7feccb200640 1 Processor -- start 2024-03-08T06:04:03.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.383+0000 7feccb200640 1 -- start start 2024-03-08T06:04:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.384+0000 7feccb200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feccc071df0 0x7feccc1e35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.384+0000 7feccb200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feccc145500 0x7feccc1e5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.384+0000 7feccb200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feccc15bfb0 0x7feccc0b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.384+0000 7feccb200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc0ccbc0 con 0x7feccc15bfb0 2024-03-08T06:04:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.384+0000 7feccb200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc0cca40 con 0x7feccc071df0 2024-03-08T06:04:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.384+0000 7feccb200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feccc0ccd40 con 0x7feccc145500 2024-03-08T06:04:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.385+0000 7fecca800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feccc15bfb0 0x7feccc0b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.385+0000 7fecca800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feccc15bfb0 0x7feccc0b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55662/0 (socket says 172.21.15.19:55662) 2024-03-08T06:04:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.385+0000 7fecca800640 1 -- 172.21.15.19:0/2847817192 learned_addr learned my addr 172.21.15.19:0/2847817192 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.385+0000 7fecc9400640 1 --2- 172.21.15.19:0/2847817192 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feccc145500 0x7feccc1e5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.385+0000 7fecc9e00640 1 --2- 172.21.15.19:0/2847817192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feccc071df0 0x7feccc1e35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:03.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.385+0000 7fecca800640 1 -- 172.21.15.19:0/2847817192 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feccc145500 msgr2=0x7feccc1e5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:03.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.385+0000 7fecca800640 1 --2- 172.21.15.19:0/2847817192 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feccc145500 0x7feccc1e5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:03.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.385+0000 7fecca800640 1 -- 172.21.15.19:0/2847817192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feccc071df0 msgr2=0x7feccc1e35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:03.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.385+0000 7fecca800640 1 --2- 172.21.15.19:0/2847817192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feccc071df0 0x7feccc1e35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:03.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.385+0000 7fecca800640 1 -- 172.21.15.19:0/2847817192 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc1e6090 con 0x7feccc15bfb0 2024-03-08T06:04:03.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.385+0000 7fecca800640 1 --2- 172.21.15.19:0/2847817192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feccc15bfb0 0x7feccc0b3ef0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fecc400efc0 tx=0x7fecc400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:03.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.386+0000 7fecc2000640 1 -- 172.21.15.19:0/2847817192 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4018020 con 0x7feccc15bfb0 2024-03-08T06:04:03.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.386+0000 7fecc2000640 1 -- 172.21.15.19:0/2847817192 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc4014480 con 0x7feccc15bfb0 2024-03-08T06:04:03.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.386+0000 7fecc2000640 1 -- 172.21.15.19:0/2847817192 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4014870 con 0x7feccc15bfb0 2024-03-08T06:04:03.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.386+0000 7feccb200640 1 -- 172.21.15.19:0/2847817192 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feccc1e3ca0 con 0x7feccc15bfb0 2024-03-08T06:04:03.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.386+0000 7feccb200640 1 -- 172.21.15.19:0/2847817192 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feccc1e4260 con 0x7feccc15bfb0 2024-03-08T06:04:03.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.387+0000 7feccb200640 1 -- 172.21.15.19:0/2847817192 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feccc0725f0 con 0x7feccc15bfb0 2024-03-08T06:04:03.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.388+0000 7fecc2000640 1 -- 172.21.15.19:0/2847817192 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fecc4005d10 con 0x7feccc15bfb0 2024-03-08T06:04:03.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.389+0000 7fecc2000640 1 --2- 172.21.15.19:0/2847817192 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fecac06b500 0x7fecac06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:03.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.389+0000 7fecc2000640 1 -- 172.21.15.19:0/2847817192 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fecc408b0e0 con 0x7feccc15bfb0 2024-03-08T06:04:03.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.389+0000 7fecc9e00640 1 --2- 172.21.15.19:0/2847817192 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fecac06b500 0x7fecac06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:03.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.390+0000 7fecc9e00640 1 --2- 172.21.15.19:0/2847817192 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fecac06b500 0x7fecac06d9c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fecbc036000 tx=0x7fecbc03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:03.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.393+0000 7fecc2000640 1 -- 172.21.15.19:0/2847817192 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7feccc0725f0 con 0x7feccc15bfb0 2024-03-08T06:04:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.592+0000 7feccb200640 1 -- 172.21.15.19:0/2847817192 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feccc075090 con 0x7feccc15bfb0 2024-03-08T06:04:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.593+0000 7fecc2000640 1 -- 172.21.15.19:0/2847817192 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fecc4022030 con 0x7feccc15bfb0 2024-03-08T06:04:03.594 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-08T06:04:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.595+0000 7feccb200640 1 -- 172.21.15.19:0/2847817192 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fecac06b500 msgr2=0x7fecac06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.595+0000 7feccb200640 1 --2- 172.21.15.19:0/2847817192 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fecac06b500 0x7fecac06d9c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fecbc036000 tx=0x7fecbc03c040 comp rx=0 tx=0).stop 2024-03-08T06:04:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.595+0000 7feccb200640 1 -- 172.21.15.19:0/2847817192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feccc15bfb0 msgr2=0x7feccc0b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.595+0000 7feccb200640 1 --2- 172.21.15.19:0/2847817192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feccc15bfb0 0x7feccc0b3ef0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fecc400efc0 tx=0x7fecc400c490 comp rx=0 tx=0).stop 2024-03-08T06:04:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.595+0000 7feccb200640 1 -- 172.21.15.19:0/2847817192 shutdown_connections 2024-03-08T06:04:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.595+0000 7feccb200640 1 --2- 172.21.15.19:0/2847817192 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fecac06b500 0x7fecac06d9c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.595+0000 7feccb200640 1 --2- 172.21.15.19:0/2847817192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feccc15bfb0 0x7feccc0b3ef0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.595+0000 7feccb200640 1 --2- 172.21.15.19:0/2847817192 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7feccc145500 0x7feccc1e5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.595+0000 7feccb200640 1 --2- 172.21.15.19:0/2847817192 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7feccc071df0 0x7feccc1e35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.595+0000 7feccb200640 1 -- 172.21.15.19:0/2847817192 >> 172.21.15.19:0/2847817192 conn(0x7feccc0b1850 msgr2=0x7feccc0afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.596+0000 7feccb200640 1 -- 172.21.15.19:0/2847817192 shutdown_connections 2024-03-08T06:04:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.596+0000 7feccb200640 1 -- 172.21.15.19:0/2847817192 wait complete. 2024-03-08T06:04:03.615 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T06:04:03.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.840+0000 7f3ce1400640 1 Processor -- start 2024-03-08T06:04:03.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.841+0000 7f3ce1400640 1 -- start start 2024-03-08T06:04:03.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.842+0000 7f3ce1400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3cdc15de60 0x7f3cdc161930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:03.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.842+0000 7f3ce1400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cdc15e240 con 0x7f3cdc0b9630 2024-03-08T06:04:03.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.842+0000 7f3ce1400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cdc162030 con 0x7f3cdc0cf030 2024-03-08T06:04:03.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.842+0000 7f3ce1400640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cdc162310 con 0x7f3cdc15de60 2024-03-08T06:04:03.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.842+0000 7f3cdbe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3cdc15de60 0x7f3cdc161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:03.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.842+0000 7f3cd3e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3cdc0b9630 0x7f3cdc0ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53406/0 (socket says 172.21.15.19:53406) 2024-03-08T06:04:03.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.842+0000 7f3cd3e00640 1 -- 172.21.15.19:0/1476874689 learned_addr learned my addr 172.21.15.19:0/1476874689 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:03.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.843+0000 7f3cdbe00640 1 -- 172.21.15.19:0/1476874689 >> v1:172.21.15.42:6789/0 conn(0x7f3cdc0cf030 legacy=0x7f3cdc0d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:03.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.843+0000 7f3cdbe00640 1 -- 172.21.15.19:0/1476874689 >> v1:172.21.15.19:6789/0 conn(0x7f3cdc0b9630 legacy=0x7f3cdc0ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:03.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.843+0000 7f3cdb400640 1 -- 172.21.15.19:0/1476874689 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3315943438 0 0) 0x7f3cdc15e240 con 0x7f3cdc0b9630 2024-03-08T06:04:03.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.843+0000 7f3cdbe00640 1 -- 172.21.15.19:0/1476874689 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc1625f0 con 0x7f3cdc15de60 2024-03-08T06:04:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.844+0000 7f3cdbe00640 1 --2- 172.21.15.19:0/1476874689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cdc15de60 0x7f3cdc161930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0097a0 tx=0x7f3ccc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc1944418d3eb1b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.844+0000 7f3cdb400640 1 -- 172.21.15.19:0/1476874689 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc035020 con 0x7f3cdc15de60 2024-03-08T06:04:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.845+0000 7f3cdb400640 1 -- 172.21.15.19:0/1476874689 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ccc031830 con 0x7f3cdc15de60 2024-03-08T06:04:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.845+0000 7f3cdb400640 1 -- 172.21.15.19:0/1476874689 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc031c00 con 0x7f3cdc15de60 2024-03-08T06:04:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.845+0000 7f3ce1400640 1 -- 172.21.15.19:0/1476874689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cdc15de60 msgr2=0x7f3cdc161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.845+0000 7f3ce1400640 1 --2- 172.21.15.19:0/1476874689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cdc15de60 0x7f3cdc161930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0097a0 tx=0x7f3ccc02b8d0 comp rx=0 tx=0).stop 2024-03-08T06:04:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.845+0000 7f3ce1400640 1 -- 172.21.15.19:0/1476874689 shutdown_connections 2024-03-08T06:04:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.845+0000 7f3ce1400640 1 --2- 172.21.15.19:0/1476874689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cdc15de60 0x7f3cdc161930 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.845+0000 7f3ce1400640 1 -- 172.21.15.19:0/1476874689 >> 172.21.15.19:0/1476874689 conn(0x7f3cdc06c500 msgr2=0x7f3cdc06c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.845+0000 7f3ce1400640 1 -- 172.21.15.19:0/1476874689 shutdown_connections 2024-03-08T06:04:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.845+0000 7f3ce1400640 1 -- 172.21.15.19:0/1476874689 wait complete. 2024-03-08T06:04:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.847+0000 7f3ce1400640 1 Processor -- start 2024-03-08T06:04:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.847+0000 7f3ce1400640 1 -- start start 2024-03-08T06:04:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.848+0000 7f3ce1400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cdc0b9630 0x7f3cdc0ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.848+0000 7f3ce1400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3cdc0cf030 0x7f3cdc158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.848+0000 7f3ce1400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cdc15de60 0x7f3cdc0b8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.848+0000 7f3ce1400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0d2cf0 con 0x7f3cdc0b9630 2024-03-08T06:04:03.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.848+0000 7f3ce1400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0b9a90 con 0x7f3cdc15de60 2024-03-08T06:04:03.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.848+0000 7f3ce1400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc0d2e70 con 0x7f3cdc0cf030 2024-03-08T06:04:03.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.849+0000 7f3cdbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cdc0b9630 0x7f3cdc0ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:03.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.849+0000 7f3cdbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cdc0b9630 0x7f3cdc0ccb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55674/0 (socket says 172.21.15.19:55674) 2024-03-08T06:04:03.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.849+0000 7f3cdbe00640 1 -- 172.21.15.19:0/1529703831 learned_addr learned my addr 172.21.15.19:0/1529703831 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.849+0000 7f3cdbe00640 1 -- 172.21.15.19:0/1529703831 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3cdc0cf030 msgr2=0x7f3cdc158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.849+0000 7f3cdbe00640 1 --2- 172.21.15.19:0/1529703831 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3cdc0cf030 0x7f3cdc158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.849+0000 7f3cdbe00640 1 -- 172.21.15.19:0/1529703831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cdc15de60 msgr2=0x7f3cdc0b8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.849+0000 7f3ce0a00640 1 --2- 172.21.15.19:0/1529703831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cdc15de60 0x7f3cdc0b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.849+0000 7f3cdbe00640 1 --2- 172.21.15.19:0/1529703831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cdc15de60 0x7f3cdc0b8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.849+0000 7f3cdbe00640 1 -- 172.21.15.19:0/1529703831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc0cd350 con 0x7f3cdc0b9630 2024-03-08T06:04:03.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.849+0000 7f3ce0a00640 1 --2- 172.21.15.19:0/1529703831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cdc15de60 0x7f3cdc0b8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:03.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.850+0000 7f3cdbe00640 1 --2- 172.21.15.19:0/1529703831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cdc0b9630 0x7f3cdc0ccb20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0098c0 tx=0x7f3ccc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:03.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.850+0000 7f3cd8c00640 1 -- 172.21.15.19:0/1529703831 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc03aa70 con 0x7f3cdc0b9630 2024-03-08T06:04:03.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.850+0000 7f3cd8c00640 1 -- 172.21.15.19:0/1529703831 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ccc03ac10 con 0x7f3cdc0b9630 2024-03-08T06:04:03.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.850+0000 7f3cd8c00640 1 -- 172.21.15.19:0/1529703831 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc0443f0 con 0x7f3cdc0b9630 2024-03-08T06:04:03.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.850+0000 7f3ce1400640 1 -- 172.21.15.19:0/1529703831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cdc1f7830 con 0x7f3cdc0b9630 2024-03-08T06:04:03.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.850+0000 7f3ce1400640 1 -- 172.21.15.19:0/1529703831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cdc0cd060 con 0x7f3cdc0b9630 2024-03-08T06:04:03.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.851+0000 7f3ce1400640 1 -- 172.21.15.19:0/1529703831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cdc075090 con 0x7f3cdc0b9630 2024-03-08T06:04:03.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.852+0000 7f3cd8c00640 1 -- 172.21.15.19:0/1529703831 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3ccc04b060 con 0x7f3cdc0b9630 2024-03-08T06:04:03.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.853+0000 7f3cd8c00640 1 --2- 172.21.15.19:0/1529703831 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3cb806b4d0 0x7f3cb806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:03.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.853+0000 7f3cd8c00640 1 -- 172.21.15.19:0/1529703831 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ccc0abeb0 con 0x7f3cdc0b9630 2024-03-08T06:04:03.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.854+0000 7f3cd3e00640 1 --2- 172.21.15.19:0/1529703831 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3cb806b4d0 0x7f3cb806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:03.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.854+0000 7f3cd3e00640 1 --2- 172.21.15.19:0/1529703831 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3cb806b4d0 0x7f3cb806d990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4007fd0 tx=0x7f3cc4007920 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:03.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:03.858+0000 7f3cd8c00640 1 -- 172.21.15.19:0/1529703831 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3ccc03f070 con 0x7f3cdc0b9630 2024-03-08T06:04:04.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.058+0000 7f3ce1400640 1 -- 172.21.15.19:0/1529703831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3cdc0c7420 con 0x7f3cdc0b9630 2024-03-08T06:04:04.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.059+0000 7f3cd8c00640 1 -- 172.21.15.19:0/1529703831 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ccc02f2e0 con 0x7f3cdc0b9630 2024-03-08T06:04:04.060 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-08T06:04:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.062+0000 7f3ce1400640 1 -- 172.21.15.19:0/1529703831 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3cb806b4d0 msgr2=0x7f3cb806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.062+0000 7f3ce1400640 1 --2- 172.21.15.19:0/1529703831 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3cb806b4d0 0x7f3cb806d990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3cc4007fd0 tx=0x7f3cc4007920 comp rx=0 tx=0).stop 2024-03-08T06:04:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.062+0000 7f3ce1400640 1 -- 172.21.15.19:0/1529703831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cdc0b9630 msgr2=0x7f3cdc0ccb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.062+0000 7f3ce1400640 1 --2- 172.21.15.19:0/1529703831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cdc0b9630 0x7f3cdc0ccb20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0098c0 tx=0x7f3ccc0046c0 comp rx=0 tx=0).stop 2024-03-08T06:04:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.062+0000 7f3ce1400640 1 -- 172.21.15.19:0/1529703831 shutdown_connections 2024-03-08T06:04:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.062+0000 7f3ce1400640 1 --2- 172.21.15.19:0/1529703831 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3cb806b4d0 0x7f3cb806d990 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.062+0000 7f3ce1400640 1 --2- 172.21.15.19:0/1529703831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cdc15de60 0x7f3cdc0b8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.062+0000 7f3ce1400640 1 --2- 172.21.15.19:0/1529703831 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3cdc0cf030 0x7f3cdc158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.062+0000 7f3ce1400640 1 --2- 172.21.15.19:0/1529703831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cdc0b9630 0x7f3cdc0ccb20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.062+0000 7f3ce1400640 1 -- 172.21.15.19:0/1529703831 >> 172.21.15.19:0/1529703831 conn(0x7f3cdc06c500 msgr2=0x7f3cdc0b6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.062+0000 7f3ce1400640 1 -- 172.21.15.19:0/1529703831 shutdown_connections 2024-03-08T06:04:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.062+0000 7f3ce1400640 1 -- 172.21.15.19:0/1529703831 wait complete. 2024-03-08T06:04:04.082 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-08T06:04:04.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.301+0000 7f0923200640 1 Processor -- start 2024-03-08T06:04:04.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.301+0000 7f0923200640 1 -- start start 2024-03-08T06:04:04.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.303+0000 7f0923200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f09240aee90 0x7f09241631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:04.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.303+0000 7f0923200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0924071b10 0x7f09240b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:04.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.303+0000 7f0923200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f092406d500 con 0x7f09240b44c0 2024-03-08T06:04:04.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.303+0000 7f0923200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f092406de30 con 0x7f0924071b10 2024-03-08T06:04:04.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.303+0000 7f0923200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092406d7e0 con 0x7f09240aee90 2024-03-08T06:04:04.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.304+0000 7f0922800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0924071b10 0x7f09240b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:04.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.304+0000 7f0922800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0924071b10 0x7f09240b2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55684/0 (socket says 172.21.15.19:55684) 2024-03-08T06:04:04.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.304+0000 7f0922800640 1 -- 172.21.15.19:0/3801426173 learned_addr learned my addr 172.21.15.19:0/3801426173 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.304+0000 7f0921e00640 1 --2- 172.21.15.19:0/3801426173 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f09240aee90 0x7f09241631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.304+0000 7f0922800640 1 -- 172.21.15.19:0/3801426173 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f09240aee90 msgr2=0x7f09241631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.304+0000 7f0922800640 1 --2- 172.21.15.19:0/3801426173 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f09240aee90 0x7f09241631c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.304+0000 7f0922800640 1 -- 172.21.15.19:0/3801426173 >> v1:172.21.15.42:6789/0 conn(0x7f09240b44c0 legacy=0x7f0924071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.304+0000 7f0922800640 1 -- 172.21.15.19:0/3801426173 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092406dac0 con 0x7f0924071b10 2024-03-08T06:04:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.304+0000 7f0921e00640 1 --2- 172.21.15.19:0/3801426173 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f09240aee90 0x7f09241631c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:04.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.306+0000 7f0922800640 1 --2- 172.21.15.19:0/3801426173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0924071b10 0x7f09240b2890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f091c009e50 tx=0x7f091c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220994103d89a2d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.306+0000 7f0921400640 1 -- 172.21.15.19:0/3801426173 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c02cb00 con 0x7f0924071b10 2024-03-08T06:04:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.306+0000 7f0921400640 1 -- 172.21.15.19:0/3801426173 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c02cca0 con 0x7f0924071b10 2024-03-08T06:04:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.306+0000 7f0921400640 1 -- 172.21.15.19:0/3801426173 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c034610 con 0x7f0924071b10 2024-03-08T06:04:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.306+0000 7f0923200640 1 -- 172.21.15.19:0/3801426173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0924071b10 msgr2=0x7f09240b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.306+0000 7f0923200640 1 --2- 172.21.15.19:0/3801426173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0924071b10 0x7f09240b2890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f091c009e50 tx=0x7f091c02bf60 comp rx=0 tx=0).stop 2024-03-08T06:04:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.307+0000 7f0923200640 1 -- 172.21.15.19:0/3801426173 shutdown_connections 2024-03-08T06:04:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.307+0000 7f0923200640 1 --2- 172.21.15.19:0/3801426173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0924071b10 0x7f09240b2890 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.307+0000 7f0923200640 1 --2- 172.21.15.19:0/3801426173 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f09240aee90 0x7f09241631c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.307+0000 7f0923200640 1 -- 172.21.15.19:0/3801426173 >> 172.21.15.19:0/3801426173 conn(0x7f09240b1590 msgr2=0x7f09240b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.307+0000 7f0923200640 1 -- 172.21.15.19:0/3801426173 shutdown_connections 2024-03-08T06:04:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.307+0000 7f0923200640 1 -- 172.21.15.19:0/3801426173 wait complete. 2024-03-08T06:04:04.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.308+0000 7f0923200640 1 Processor -- start 2024-03-08T06:04:04.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.309+0000 7f0923200640 1 -- start start 2024-03-08T06:04:04.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.310+0000 7f0923200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f0924071b10 0x7f09240adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:04.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.310+0000 7f0923200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09240aee90 0x7f0924151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:04.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.310+0000 7f0923200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09240b44c0 0x7f09240cda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:04.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.310+0000 7f0923200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092406e2c0 con 0x7f09240b44c0 2024-03-08T06:04:04.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.310+0000 7f0923200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09240b4d10 con 0x7f09240aee90 2024-03-08T06:04:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.310+0000 7f0923200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092406e440 con 0x7f0924071b10 2024-03-08T06:04:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.310+0000 7f0922800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09240b44c0 0x7f09240cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.310+0000 7f0922800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09240b44c0 0x7f09240cda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55690/0 (socket says 172.21.15.19:55690) 2024-03-08T06:04:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.310+0000 7f0922800640 1 -- 172.21.15.19:0/441210286 learned_addr learned my addr 172.21.15.19:0/441210286 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.310+0000 7f0921e00640 1 --2- 172.21.15.19:0/441210286 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f0924071b10 0x7f09240adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.310+0000 7f091be00640 1 --2- 172.21.15.19:0/441210286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09240aee90 0x7f0924151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.310+0000 7f0922800640 1 -- 172.21.15.19:0/441210286 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f0924071b10 msgr2=0x7f09240adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.311+0000 7f0922800640 1 --2- 172.21.15.19:0/441210286 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f0924071b10 0x7f09240adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.311+0000 7f0922800640 1 -- 172.21.15.19:0/441210286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09240aee90 msgr2=0x7f0924151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.311+0000 7f0922800640 1 --2- 172.21.15.19:0/441210286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09240aee90 0x7f0924151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.311+0000 7f0922800640 1 -- 172.21.15.19:0/441210286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09241505a0 con 0x7f09240b44c0 2024-03-08T06:04:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.311+0000 7f0921e00640 1 --2- 172.21.15.19:0/441210286 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f0924071b10 0x7f09240adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:04:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.311+0000 7f0922800640 1 --2- 172.21.15.19:0/441210286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09240b44c0 0x7f09240cda30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f091c009e50 tx=0x7f091c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.311+0000 7f091a000640 1 -- 172.21.15.19:0/441210286 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c043020 con 0x7f09240b44c0 2024-03-08T06:04:04.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.311+0000 7f091a000640 1 -- 172.21.15.19:0/441210286 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c02ce50 con 0x7f09240b44c0 2024-03-08T06:04:04.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.311+0000 7f091a000640 1 -- 172.21.15.19:0/441210286 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c009510 con 0x7f09240b44c0 2024-03-08T06:04:04.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.311+0000 7f0923200640 1 -- 172.21.15.19:0/441210286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0924150880 con 0x7f09240b44c0 2024-03-08T06:04:04.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.312+0000 7f0923200640 1 -- 172.21.15.19:0/441210286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0924151120 con 0x7f09240b44c0 2024-03-08T06:04:04.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.313+0000 7f0923200640 1 -- 172.21.15.19:0/441210286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0924075090 con 0x7f09240b44c0 2024-03-08T06:04:04.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.314+0000 7f091a000640 1 -- 172.21.15.19:0/441210286 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f091c046020 con 0x7f09240b44c0 2024-03-08T06:04:04.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.315+0000 7f091a000640 1 --2- 172.21.15.19:0/441210286 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f090006b4d0 0x7f090006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:04.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.315+0000 7f091a000640 1 -- 172.21.15.19:0/441210286 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f091c0ac950 con 0x7f09240b44c0 2024-03-08T06:04:04.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.315+0000 7f0921e00640 1 --2- 172.21.15.19:0/441210286 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f090006b4d0 0x7f090006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:04.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.316+0000 7f0921e00640 1 --2- 172.21.15.19:0/441210286 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f090006b4d0 0x7f090006d990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f091400aa30 tx=0x7f0914008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:04.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.319+0000 7f091a000640 1 -- 172.21.15.19:0/441210286 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f091c04d030 con 0x7f09240b44c0 2024-03-08T06:04:04.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.534+0000 7f0923200640 1 -- 172.21.15.19:0/441210286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f09240723b0 con 0x7f09240b44c0 2024-03-08T06:04:04.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.535+0000 7f091a000640 1 -- 172.21.15.19:0/441210286 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f091c07b7c0 con 0x7f09240b44c0 2024-03-08T06:04:04.535 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-08T06:04:04.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.537+0000 7f0923200640 1 -- 172.21.15.19:0/441210286 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f090006b4d0 msgr2=0x7f090006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:04.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.537+0000 7f0923200640 1 --2- 172.21.15.19:0/441210286 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f090006b4d0 0x7f090006d990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f091400aa30 tx=0x7f0914008040 comp rx=0 tx=0).stop 2024-03-08T06:04:04.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.537+0000 7f0923200640 1 -- 172.21.15.19:0/441210286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09240b44c0 msgr2=0x7f09240cda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:04.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.537+0000 7f0923200640 1 --2- 172.21.15.19:0/441210286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09240b44c0 0x7f09240cda30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f091c009e50 tx=0x7f091c004a40 comp rx=0 tx=0).stop 2024-03-08T06:04:04.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.537+0000 7f0923200640 1 -- 172.21.15.19:0/441210286 shutdown_connections 2024-03-08T06:04:04.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.537+0000 7f0923200640 1 --2- 172.21.15.19:0/441210286 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f090006b4d0 0x7f090006d990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:04.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.537+0000 7f0923200640 1 --2- 172.21.15.19:0/441210286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09240b44c0 0x7f09240cda30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:04.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.538+0000 7f0923200640 1 --2- 172.21.15.19:0/441210286 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f09240aee90 0x7f0924151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:04.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.538+0000 7f0923200640 1 --2- 172.21.15.19:0/441210286 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f0924071b10 0x7f09240adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:04.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.538+0000 7f0923200640 1 -- 172.21.15.19:0/441210286 >> 172.21.15.19:0/441210286 conn(0x7f09240b1590 msgr2=0x7f09241601b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:04.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.538+0000 7f0923200640 1 -- 172.21.15.19:0/441210286 shutdown_connections 2024-03-08T06:04:04.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:04.538+0000 7f0923200640 1 -- 172.21.15.19:0/441210286 wait complete. 2024-03-08T06:04:04.556 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-08T06:04:04.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:04.556 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-03-08T06:04:04.655 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-03-08T06:04:04.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:04.655 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-08T06:04:04.718 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:04:04.718 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:04:04.779 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:04:04.779 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:04:04.835 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:04:04.835 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:04:04.892 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:04:05.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.122+0000 7f724be00640 1 Processor -- start 2024-03-08T06:04:05.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.122+0000 7f724be00640 1 -- start start 2024-03-08T06:04:05.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.124+0000 7f724be00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f724c145520 0x7f724c15d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:05.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.124+0000 7f724be00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f724c15ceb0 con 0x7f724c071df0 2024-03-08T06:04:05.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.124+0000 7f724be00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f724c15c330 con 0x7f724c15bea0 2024-03-08T06:04:05.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.124+0000 7f724be00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f724c15c610 con 0x7f724c145520 2024-03-08T06:04:05.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.124+0000 7f724b400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f724c071df0 0x7f724c06d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53418/0 (socket says 172.21.15.19:53418) 2024-03-08T06:04:05.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.124+0000 7f724b400640 1 -- 172.21.15.19:0/3604670318 learned_addr learned my addr 172.21.15.19:0/3604670318 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:05.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.125+0000 7f724aa00640 1 --2- 172.21.15.19:0/3604670318 >> v2:172.21.15.42:3300/0 conn(0x7f724c145520 0x7f724c15d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:05.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.125+0000 7f7249600640 1 -- 172.21.15.19:0/3604670318 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820072576 0 0) 0x7f724c15ceb0 con 0x7f724c071df0 2024-03-08T06:04:05.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.125+0000 7f7249600640 1 -- 172.21.15.19:0/3604670318 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7230003520 con 0x7f724c071df0 2024-03-08T06:04:05.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.125+0000 7f7249600640 1 -- 172.21.15.19:0/3604670318 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1372004177 0 0) 0x7f7230003520 con 0x7f724c071df0 2024-03-08T06:04:05.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.125+0000 7f7249600640 1 -- 172.21.15.19:0/3604670318 >> v2:172.21.15.42:3300/0 conn(0x7f724c145520 msgr2=0x7f724c15d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:05.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.125+0000 7f7249600640 1 --2- 172.21.15.19:0/3604670318 >> v2:172.21.15.42:3300/0 conn(0x7f724c145520 0x7f724c15d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:05.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.125+0000 7f7249600640 1 -- 172.21.15.19:0/3604670318 >> v1:172.21.15.42:6789/0 conn(0x7f724c15bea0 legacy=0x7f724c0716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:05.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.125+0000 7f7249600640 1 -- 172.21.15.19:0/3604670318 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724c15c8f0 con 0x7f724c071df0 2024-03-08T06:04:05.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.125+0000 7f7249600640 1 -- 172.21.15.19:0/3604670318 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f72440019f0 con 0x7f724c071df0 2024-03-08T06:04:05.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.125+0000 7f7249600640 1 -- 172.21.15.19:0/3604670318 >> v1:172.21.15.19:6789/0 conn(0x7f724c071df0 legacy=0x7f724c06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:05.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.125+0000 7f7249600640 1 --2- 172.21.15.19:0/3604670318 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f72300039b0 0x7f7230003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:05.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.125+0000 7f7249600640 1 --2- 172.21.15.19:0/3604670318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7230004800 0x7f7230004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:05.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.125+0000 7f7249600640 1 --2- 172.21.15.19:0/3604670318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72300051c0 0x7f723000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:05.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.126+0000 7f7249600640 1 -- 172.21.15.19:0/3604670318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724c15c610 con 0x7f7230004800 2024-03-08T06:04:05.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.126+0000 7f7249600640 1 -- 172.21.15.19:0/3604670318 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723000c0f0 con 0x7f72300051c0 2024-03-08T06:04:05.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.126+0000 7f7249600640 1 -- 172.21.15.19:0/3604670318 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723000c2f0 con 0x7f72300039b0 2024-03-08T06:04:05.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.126+0000 7f724a000640 1 --2- 172.21.15.19:0/3604670318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7230004800 0x7f7230004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:05.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.126+0000 7f724aa00640 1 --2- 172.21.15.19:0/3604670318 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f72300039b0 0x7f7230003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:05.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.126+0000 7f724b400640 1 --2- 172.21.15.19:0/3604670318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72300051c0 0x7f723000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:05.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.126+0000 7f724a000640 1 -- 172.21.15.19:0/3604670318 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f72300039b0 msgr2=0x7f7230003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:05.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.126+0000 7f724a000640 1 --2- 172.21.15.19:0/3604670318 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f72300039b0 0x7f7230003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:05.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.126+0000 7f724a000640 1 -- 172.21.15.19:0/3604670318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72300051c0 msgr2=0x7f723000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:05.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.126+0000 7f724a000640 1 --2- 172.21.15.19:0/3604670318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f72300051c0 0x7f723000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:05.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.127+0000 7f724b400640 1 -- 172.21.15.19:0/3604670318 reap_dead start 2024-03-08T06:04:05.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.127+0000 7f724a000640 1 -- 172.21.15.19:0/3604670318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7230003520 con 0x7f7230004800 2024-03-08T06:04:05.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.127+0000 7f724aa00640 1 --2- 172.21.15.19:0/3604670318 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f72300039b0 0x7f7230003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:04:05.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.128+0000 7f724a000640 1 --2- 172.21.15.19:0/3604670318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7230004800 0x7f7230004c80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7238001620 tx=0x7f7230005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b53d5d534a817bbc server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:05.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.128+0000 7f7249600640 1 -- 172.21.15.19:0/3604670318 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7238001220 con 0x7f7230004800 2024-03-08T06:04:05.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.128+0000 7f7249600640 1 -- 172.21.15.19:0/3604670318 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7238005070 con 0x7f7230004800 2024-03-08T06:04:05.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.128+0000 7f7249600640 1 -- 172.21.15.19:0/3604670318 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7238005480 con 0x7f7230004800 2024-03-08T06:04:05.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.129+0000 7f724be00640 1 -- 172.21.15.19:0/3604670318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7230004800 msgr2=0x7f7230004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:05.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.129+0000 7f724be00640 1 --2- 172.21.15.19:0/3604670318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7230004800 0x7f7230004c80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7238001620 tx=0x7f7230005830 comp rx=0 tx=0).stop 2024-03-08T06:04:05.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.129+0000 7f724be00640 1 -- 172.21.15.19:0/3604670318 shutdown_connections 2024-03-08T06:04:05.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.129+0000 7f724be00640 1 --2- 172.21.15.19:0/3604670318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7230004800 0x7f7230004c80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:05.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.129+0000 7f724be00640 1 -- 172.21.15.19:0/3604670318 >> 172.21.15.19:0/3604670318 conn(0x7f724c0b1850 msgr2=0x7f724c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:05.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.129+0000 7f724be00640 1 -- 172.21.15.19:0/3604670318 shutdown_connections 2024-03-08T06:04:05.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.129+0000 7f724be00640 1 -- 172.21.15.19:0/3604670318 wait complete. 2024-03-08T06:04:05.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.131+0000 7f724be00640 1 Processor -- start 2024-03-08T06:04:05.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.131+0000 7f724be00640 1 -- start start 2024-03-08T06:04:05.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.132+0000 7f724be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7230004800 0x7f724c1f0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:05.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.132+0000 7f724be00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f724c137050 0x7f724c159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:05.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.132+0000 7f724be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f724c15a3e0 0x7f724c139480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:05.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.132+0000 7f724be00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724c0af1c0 con 0x7f724c15a3e0 2024-03-08T06:04:05.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.132+0000 7f724be00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724c0af040 con 0x7f7230004800 2024-03-08T06:04:05.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.132+0000 7f724be00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724c06e410 con 0x7f724c137050 2024-03-08T06:04:05.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.132+0000 7f724b400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f724c15a3e0 0x7f724c139480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:05.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.132+0000 7f724b400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f724c15a3e0 0x7f724c139480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55714/0 (socket says 172.21.15.19:55714) 2024-03-08T06:04:05.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.132+0000 7f724b400640 1 -- 172.21.15.19:0/3137019144 learned_addr learned my addr 172.21.15.19:0/3137019144 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:05.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.133+0000 7f724aa00640 1 --2- 172.21.15.19:0/3137019144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7230004800 0x7f724c1f0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:05.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.133+0000 7f724a000640 1 --2- 172.21.15.19:0/3137019144 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f724c137050 0x7f724c159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:05.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.133+0000 7f724b400640 1 -- 172.21.15.19:0/3137019144 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f724c137050 msgr2=0x7f724c159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:05.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.133+0000 7f724b400640 1 --2- 172.21.15.19:0/3137019144 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f724c137050 0x7f724c159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:05.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.133+0000 7f724b400640 1 -- 172.21.15.19:0/3137019144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7230004800 msgr2=0x7f724c1f0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:05.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.133+0000 7f724b400640 1 --2- 172.21.15.19:0/3137019144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7230004800 0x7f724c1f0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:05.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.133+0000 7f724b400640 1 -- 172.21.15.19:0/3137019144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724c15a960 con 0x7f724c15a3e0 2024-03-08T06:04:05.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.133+0000 7f724b400640 1 --2- 172.21.15.19:0/3137019144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f724c15a3e0 0x7f724c139480 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f724c072850 tx=0x7f724400e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:05.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.134+0000 7f7242a00640 1 -- 172.21.15.19:0/3137019144 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724400ec30 con 0x7f724c15a3e0 2024-03-08T06:04:05.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.134+0000 7f7242a00640 1 -- 172.21.15.19:0/3137019144 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724400edd0 con 0x7f724c15a3e0 2024-03-08T06:04:05.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.134+0000 7f7242a00640 1 -- 172.21.15.19:0/3137019144 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7244014650 con 0x7f724c15a3e0 2024-03-08T06:04:05.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.134+0000 7f724be00640 1 -- 172.21.15.19:0/3137019144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f724c13bba0 con 0x7f724c15a3e0 2024-03-08T06:04:05.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.134+0000 7f724be00640 1 -- 172.21.15.19:0/3137019144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f724c1591c0 con 0x7f724c15a3e0 2024-03-08T06:04:05.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.135+0000 7f724be00640 1 -- 172.21.15.19:0/3137019144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f724c075100 con 0x7f724c15a3e0 2024-03-08T06:04:05.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.136+0000 7f7242a00640 1 -- 172.21.15.19:0/3137019144 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f72440147f0 con 0x7f724c15a3e0 2024-03-08T06:04:05.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.137+0000 7f7242a00640 1 --2- 172.21.15.19:0/3137019144 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f722c06b4d0 0x7f722c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:05.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.137+0000 7f7242a00640 1 -- 172.21.15.19:0/3137019144 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f724408a0a0 con 0x7f724c15a3e0 2024-03-08T06:04:05.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.137+0000 7f724aa00640 1 --2- 172.21.15.19:0/3137019144 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f722c06b4d0 0x7f722c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:05.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.138+0000 7f724aa00640 1 --2- 172.21.15.19:0/3137019144 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f722c06b4d0 0x7f722c06d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f724c0507a0 tx=0x7f723c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:05.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.142+0000 7f7242a00640 1 -- 172.21.15.19:0/3137019144 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7244058f10 con 0x7f724c15a3e0 2024-03-08T06:04:05.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.343+0000 7f724be00640 1 -- 172.21.15.19:0/3137019144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f724c06c480 con 0x7f724c15a3e0 2024-03-08T06:04:05.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.345+0000 7f7242a00640 1 -- 172.21.15.19:0/3137019144 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16545 (secure 0 0 0) 0x7f7244058810 con 0x7f724c15a3e0 2024-03-08T06:04:05.347 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:05.347 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":21,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:03:22.069498+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:03:18.392703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T06:03:19.537912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:04:05.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.347+0000 7f724be00640 1 -- 172.21.15.19:0/3137019144 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f722c06b4d0 msgr2=0x7f722c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:05.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.348+0000 7f724be00640 1 --2- 172.21.15.19:0/3137019144 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f722c06b4d0 0x7f722c06d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f724c0507a0 tx=0x7f723c008040 comp rx=0 tx=0).stop 2024-03-08T06:04:05.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.348+0000 7f724be00640 1 -- 172.21.15.19:0/3137019144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f724c15a3e0 msgr2=0x7f724c139480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:05.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.348+0000 7f724be00640 1 --2- 172.21.15.19:0/3137019144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f724c15a3e0 0x7f724c139480 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f724c072850 tx=0x7f724400e160 comp rx=0 tx=0).stop 2024-03-08T06:04:05.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.348+0000 7f724be00640 1 -- 172.21.15.19:0/3137019144 shutdown_connections 2024-03-08T06:04:05.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.348+0000 7f724be00640 1 --2- 172.21.15.19:0/3137019144 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f722c06b4d0 0x7f722c06d990 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:05.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.348+0000 7f724be00640 1 --2- 172.21.15.19:0/3137019144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f724c15a3e0 0x7f724c139480 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:05.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.348+0000 7f724be00640 1 --2- 172.21.15.19:0/3137019144 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f724c137050 0x7f724c159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:05.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.348+0000 7f724be00640 1 --2- 172.21.15.19:0/3137019144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7230004800 0x7f724c1f0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:05.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.348+0000 7f724be00640 1 -- 172.21.15.19:0/3137019144 >> 172.21.15.19:0/3137019144 conn(0x7f724c0b1850 msgr2=0x7f724c13fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:05.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.348+0000 7f724be00640 1 -- 172.21.15.19:0/3137019144 shutdown_connections 2024-03-08T06:04:05.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.348+0000 7f724be00640 1 -- 172.21.15.19:0/3137019144 wait complete. 2024-03-08T06:04:05.370 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T06:03:14.149736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T06:03:18.392703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T06:03:19.537912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T06:04:05.370 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T06:04:05.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.600+0000 7eff0ee00640 1 Processor -- start 2024-03-08T06:04:05.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.601+0000 7eff0ee00640 1 -- start start 2024-03-08T06:04:05.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.602+0000 7eff0ee00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7eff0815de60 0x7eff08161930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:05.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.602+0000 7eff0ee00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0815e240 con 0x7eff080cf030 2024-03-08T06:04:05.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.602+0000 7eff0ee00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff08162030 con 0x7eff080b9630 2024-03-08T06:04:05.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.602+0000 7eff0ee00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff08162310 con 0x7eff0815de60 2024-03-08T06:04:05.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.602+0000 7eff0e400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7eff080cf030 0x7eff080d25e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53434/0 (socket says 172.21.15.19:53434) 2024-03-08T06:04:05.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.602+0000 7eff0e400640 1 -- 172.21.15.19:0/2643558137 learned_addr learned my addr 172.21.15.19:0/2643558137 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:05.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.603+0000 7eff0da00640 1 --2- 172.21.15.19:0/2643558137 >> v2:172.21.15.42:3300/0 conn(0x7eff0815de60 0x7eff08161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:05.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.603+0000 7eff07e00640 1 -- 172.21.15.19:0/2643558137 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015940306 0 0) 0x7eff0815e240 con 0x7eff080cf030 2024-03-08T06:04:05.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.603+0000 7eff07e00640 1 -- 172.21.15.19:0/2643558137 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeec003520 con 0x7eff080cf030 2024-03-08T06:04:05.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.603+0000 7eff07e00640 1 -- 172.21.15.19:0/2643558137 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 886167301 0 0) 0x7efeec003520 con 0x7eff080cf030 2024-03-08T06:04:05.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.603+0000 7eff07e00640 1 -- 172.21.15.19:0/2643558137 >> v2:172.21.15.42:3300/0 conn(0x7eff0815de60 msgr2=0x7eff08161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:05.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.603+0000 7eff07e00640 1 --2- 172.21.15.19:0/2643558137 >> v2:172.21.15.42:3300/0 conn(0x7eff0815de60 0x7eff08161930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:05.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.603+0000 7eff07e00640 1 -- 172.21.15.19:0/2643558137 >> v1:172.21.15.42:6789/0 conn(0x7eff080b9630 legacy=0x7eff080ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:05.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.603+0000 7eff07e00640 1 -- 172.21.15.19:0/2643558137 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff081625f0 con 0x7eff080cf030 2024-03-08T06:04:05.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.603+0000 7eff07e00640 1 -- 172.21.15.19:0/2643558137 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7eff00001670 con 0x7eff080cf030 2024-03-08T06:04:05.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.603+0000 7eff07e00640 1 -- 172.21.15.19:0/2643558137 >> v1:172.21.15.19:6789/0 conn(0x7eff080cf030 legacy=0x7eff080d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:05.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.603+0000 7eff07e00640 1 --2- 172.21.15.19:0/2643558137 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efeec003a70 0x7efeec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:05.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.603+0000 7eff07e00640 1 --2- 172.21.15.19:0/2643558137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeec004800 0x7efeec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:05.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.603+0000 7eff07e00640 1 --2- 172.21.15.19:0/2643558137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efeec0052e0 0x7efeec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:05.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.603+0000 7eff07e00640 1 -- 172.21.15.19:0/2643558137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff08162310 con 0x7efeec0052e0 2024-03-08T06:04:05.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.603+0000 7eff07e00640 1 -- 172.21.15.19:0/2643558137 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec00c1b0 con 0x7efeec004800 2024-03-08T06:04:05.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.603+0000 7eff07e00640 1 -- 172.21.15.19:0/2643558137 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec00c3b0 con 0x7efeec003a70 2024-03-08T06:04:05.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.604+0000 7eff0e400640 1 --2- 172.21.15.19:0/2643558137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efeec0052e0 0x7efeec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:05.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.604+0000 7eff0d000640 1 --2- 172.21.15.19:0/2643558137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeec004800 0x7efeec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:05.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.604+0000 7eff0e400640 1 -- 172.21.15.19:0/2643558137 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efeec003a70 msgr2=0x7efeec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:05.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.604+0000 7eff0e400640 1 --2- 172.21.15.19:0/2643558137 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efeec003a70 0x7efeec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:05.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.604+0000 7eff0e400640 1 -- 172.21.15.19:0/2643558137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeec004800 msgr2=0x7efeec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:05.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.604+0000 7eff0e400640 1 --2- 172.21.15.19:0/2643558137 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeec004800 0x7efeec004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:05.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.604+0000 7eff0e400640 1 -- 172.21.15.19:0/2643558137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec003520 con 0x7efeec0052e0 2024-03-08T06:04:05.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.605+0000 7eff0e400640 1 -- 172.21.15.19:0/2643558137 reap_dead start 2024-03-08T06:04:05.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.605+0000 7eff0e400640 1 --2- 172.21.15.19:0/2643558137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efeec0052e0 0x7efeec00b9c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7eff0808d020 tx=0x7efeec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc8a96e7eba192 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:05.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.606+0000 7eff07e00640 1 -- 172.21.15.19:0/2643558137 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00007c60 con 0x7efeec0052e0 2024-03-08T06:04:05.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.606+0000 7eff07e00640 1 -- 172.21.15.19:0/2643558137 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff00030070 con 0x7efeec0052e0 2024-03-08T06:04:05.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.606+0000 7eff07e00640 1 -- 172.21.15.19:0/2643558137 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00005d10 con 0x7efeec0052e0 2024-03-08T06:04:05.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.606+0000 7eff0ee00640 1 -- 172.21.15.19:0/2643558137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efeec0052e0 msgr2=0x7efeec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:05.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.606+0000 7eff0ee00640 1 --2- 172.21.15.19:0/2643558137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efeec0052e0 0x7efeec00b9c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7eff0808d020 tx=0x7efeec005830 comp rx=0 tx=0).stop 2024-03-08T06:04:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.606+0000 7eff0ee00640 1 -- 172.21.15.19:0/2643558137 shutdown_connections 2024-03-08T06:04:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.606+0000 7eff0ee00640 1 --2- 172.21.15.19:0/2643558137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efeec0052e0 0x7efeec00b9c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.606+0000 7eff0ee00640 1 -- 172.21.15.19:0/2643558137 >> 172.21.15.19:0/2643558137 conn(0x7eff0806c500 msgr2=0x7eff0806c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.607+0000 7eff0ee00640 1 -- 172.21.15.19:0/2643558137 shutdown_connections 2024-03-08T06:04:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.607+0000 7eff0ee00640 1 -- 172.21.15.19:0/2643558137 wait complete. 2024-03-08T06:04:05.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.608+0000 7eff0ee00640 1 Processor -- start 2024-03-08T06:04:05.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.608+0000 7eff0ee00640 1 -- start start 2024-03-08T06:04:05.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.609+0000 7eff0ee00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeec0052e0 0x7eff08153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:05.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.609+0000 7eff0ee00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7eff0815acc0 0x7eff0815b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:05.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.609+0000 7eff0ee00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff080cac20 0x7eff080cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:05.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.609+0000 7eff0ee00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff08161930 con 0x7eff080cac20 2024-03-08T06:04:05.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.609+0000 7eff0ee00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff080b9a90 con 0x7efeec0052e0 2024-03-08T06:04:05.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.609+0000 7eff0ee00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff08161ab0 con 0x7eff0815acc0 2024-03-08T06:04:05.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.610+0000 7eff0e400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff080cac20 0x7eff080cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:05.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.610+0000 7eff0e400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff080cac20 0x7eff080cb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55738/0 (socket says 172.21.15.19:55738) 2024-03-08T06:04:05.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.610+0000 7eff0e400640 1 -- 172.21.15.19:0/2772973380 learned_addr learned my addr 172.21.15.19:0/2772973380 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:05.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.610+0000 7eff0d000640 1 --2- 172.21.15.19:0/2772973380 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7eff0815acc0 0x7eff0815b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:05.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.610+0000 7eff0da00640 1 --2- 172.21.15.19:0/2772973380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeec0052e0 0x7eff08153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:05.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.610+0000 7eff0e400640 1 -- 172.21.15.19:0/2772973380 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7eff0815acc0 msgr2=0x7eff0815b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:05.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.610+0000 7eff0e400640 1 --2- 172.21.15.19:0/2772973380 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7eff0815acc0 0x7eff0815b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:05.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.610+0000 7eff0e400640 1 -- 172.21.15.19:0/2772973380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeec0052e0 msgr2=0x7eff08153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:05.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.610+0000 7eff0e400640 1 --2- 172.21.15.19:0/2772973380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeec0052e0 0x7eff08153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:05.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.610+0000 7eff0e400640 1 -- 172.21.15.19:0/2772973380 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0815b810 con 0x7eff080cac20 2024-03-08T06:04:05.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.610+0000 7eff0da00640 1 --2- 172.21.15.19:0/2772973380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeec0052e0 0x7eff08153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:05.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.611+0000 7eff0e400640 1 --2- 172.21.15.19:0/2772973380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff080cac20 0x7eff080cb0d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7eff0000c220 tx=0x7eff08162200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:05.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.611+0000 7eff05600640 1 -- 172.21.15.19:0/2772973380 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00007c60 con 0x7eff080cac20 2024-03-08T06:04:05.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.611+0000 7eff05600640 1 -- 172.21.15.19:0/2772973380 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0002cbd0 con 0x7eff080cac20 2024-03-08T06:04:05.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.611+0000 7eff0ee00640 1 -- 172.21.15.19:0/2772973380 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0815baf0 con 0x7eff080cac20 2024-03-08T06:04:05.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.611+0000 7eff05600640 1 -- 172.21.15.19:0/2772973380 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00007070 con 0x7eff080cac20 2024-03-08T06:04:05.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.611+0000 7eff0ee00640 1 -- 172.21.15.19:0/2772973380 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0815c0b0 con 0x7eff080cac20 2024-03-08T06:04:05.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.612+0000 7eff0ee00640 1 -- 172.21.15.19:0/2772973380 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff08075090 con 0x7eff080cac20 2024-03-08T06:04:05.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.613+0000 7eff05600640 1 -- 172.21.15.19:0/2772973380 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7eff00007210 con 0x7eff080cac20 2024-03-08T06:04:05.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.614+0000 7eff05600640 1 --2- 172.21.15.19:0/2772973380 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efee806b4d0 0x7efee806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:05.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.614+0000 7eff05600640 1 -- 172.21.15.19:0/2772973380 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff000ab370 con 0x7eff080cac20 2024-03-08T06:04:05.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.614+0000 7eff0da00640 1 --2- 172.21.15.19:0/2772973380 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efee806b4d0 0x7efee806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:05.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.615+0000 7eff0da00640 1 --2- 172.21.15.19:0/2772973380 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efee806b4d0 0x7efee806d990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efef80070b0 tx=0x7efef800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:05.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.619+0000 7eff05600640 1 -- 172.21.15.19:0/2772973380 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7eff0007a150 con 0x7eff080cac20 2024-03-08T06:04:05.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.817+0000 7eff0ee00640 1 -- 172.21.15.19:0/2772973380 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7eff08153670 con 0x7eff080cac20 2024-03-08T06:04:05.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.818+0000 7eff05600640 1 -- 172.21.15.19:0/2772973380 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7eff00079a50 con 0x7eff080cac20 2024-03-08T06:04:05.819 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-08T06:04:05.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.820+0000 7eff0ee00640 1 -- 172.21.15.19:0/2772973380 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efee806b4d0 msgr2=0x7efee806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:05.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.820+0000 7eff0ee00640 1 --2- 172.21.15.19:0/2772973380 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efee806b4d0 0x7efee806d990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efef80070b0 tx=0x7efef800b040 comp rx=0 tx=0).stop 2024-03-08T06:04:05.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.820+0000 7eff0ee00640 1 -- 172.21.15.19:0/2772973380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff080cac20 msgr2=0x7eff080cb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:05.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.820+0000 7eff0ee00640 1 --2- 172.21.15.19:0/2772973380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff080cac20 0x7eff080cb0d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7eff0000c220 tx=0x7eff08162200 comp rx=0 tx=0).stop 2024-03-08T06:04:05.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.821+0000 7eff0ee00640 1 -- 172.21.15.19:0/2772973380 shutdown_connections 2024-03-08T06:04:05.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.821+0000 7eff0ee00640 1 --2- 172.21.15.19:0/2772973380 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efee806b4d0 0x7efee806d990 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:05.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.821+0000 7eff0ee00640 1 --2- 172.21.15.19:0/2772973380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff080cac20 0x7eff080cb0d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:05.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.821+0000 7eff0ee00640 1 --2- 172.21.15.19:0/2772973380 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7eff0815acc0 0x7eff0815b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:05.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.821+0000 7eff0ee00640 1 --2- 172.21.15.19:0/2772973380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efeec0052e0 0x7eff08153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:05.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.821+0000 7eff0ee00640 1 -- 172.21.15.19:0/2772973380 >> 172.21.15.19:0/2772973380 conn(0x7eff0806c500 msgr2=0x7eff0806c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:05.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.821+0000 7eff0ee00640 1 -- 172.21.15.19:0/2772973380 shutdown_connections 2024-03-08T06:04:05.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:05.821+0000 7eff0ee00640 1 -- 172.21.15.19:0/2772973380 wait complete. 2024-03-08T06:04:05.843 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T06:04:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.069+0000 7f3ab6200640 1 Processor -- start 2024-03-08T06:04:06.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.069+0000 7f3ab6200640 1 -- start start 2024-03-08T06:04:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.071+0000 7f3ab6200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3ab01604f0 0x7f3ab00cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.071+0000 7f3ab6200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ab0071950 0x7f3ab0071d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:06.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.071+0000 7f3ab6200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab00cd5a0 con 0x7f3ab01455b0 2024-03-08T06:04:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.071+0000 7f3ab6200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab00cdc20 con 0x7f3ab01604f0 2024-03-08T06:04:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.071+0000 7f3ab6200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00722d0 con 0x7f3ab0071950 2024-03-08T06:04:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.071+0000 7f3aafe00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ab0071950 0x7f3ab0071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.071+0000 7f3aaf400640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f3ab01455b0 0x7f3ab015c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.19:54990/0 (socket says 172.21.15.19:54990) 2024-03-08T06:04:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.071+0000 7f3aaf400640 1 -- 172.21.15.19:0/1614530564 learned_addr learned my addr 172.21.15.19:0/1614530564 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:06.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.072+0000 7f3aaea00640 1 --2- 172.21.15.19:0/1614530564 >> v2:172.21.15.42:3300/0 conn(0x7f3ab01604f0 0x7f3ab00cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:06.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.072+0000 7f3aafe00640 1 -- 172.21.15.19:0/1614530564 >> v2:172.21.15.42:3300/0 conn(0x7f3ab01604f0 msgr2=0x7f3ab00cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:06.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.072+0000 7f3aafe00640 1 --2- 172.21.15.19:0/1614530564 >> v2:172.21.15.42:3300/0 conn(0x7f3ab01604f0 0x7f3ab00cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.072+0000 7f3aafe00640 1 -- 172.21.15.19:0/1614530564 >> v1:172.21.15.42:6789/0 conn(0x7f3ab01455b0 legacy=0x7f3ab015c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:06.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.072+0000 7f3aafe00640 1 -- 172.21.15.19:0/1614530564 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab00ccfe0 con 0x7f3ab0071950 2024-03-08T06:04:06.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.074+0000 7f3aafe00640 1 --2- 172.21.15.19:0/1614530564 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ab0071950 0x7f3ab0071d90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009d90 tx=0x7f3aa802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e16ea70f497cb0b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:06.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.074+0000 7f3aae000640 1 -- 172.21.15.19:0/1614530564 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8039070 con 0x7f3ab0071950 2024-03-08T06:04:06.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.074+0000 7f3aae000640 1 -- 172.21.15.19:0/1614530564 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa802cc50 con 0x7f3ab0071950 2024-03-08T06:04:06.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.074+0000 7f3aae000640 1 -- 172.21.15.19:0/1614530564 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8034440 con 0x7f3ab0071950 2024-03-08T06:04:06.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.075+0000 7f3ab6200640 1 -- 172.21.15.19:0/1614530564 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ab0071950 msgr2=0x7f3ab0071d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:06.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.075+0000 7f3ab6200640 1 --2- 172.21.15.19:0/1614530564 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ab0071950 0x7f3ab0071d90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009d90 tx=0x7f3aa802bea0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.075+0000 7f3ab6200640 1 -- 172.21.15.19:0/1614530564 shutdown_connections 2024-03-08T06:04:06.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.075+0000 7f3ab6200640 1 --2- 172.21.15.19:0/1614530564 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ab0071950 0x7f3ab0071d90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.075+0000 7f3ab6200640 1 --2- 172.21.15.19:0/1614530564 >> v2:172.21.15.42:3300/0 conn(0x7f3ab01604f0 0x7f3ab00cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.075+0000 7f3ab6200640 1 -- 172.21.15.19:0/1614530564 >> 172.21.15.19:0/1614530564 conn(0x7f3ab006ae30 msgr2=0x7f3ab006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:06.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.075+0000 7f3ab6200640 1 -- 172.21.15.19:0/1614530564 shutdown_connections 2024-03-08T06:04:06.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.075+0000 7f3ab6200640 1 -- 172.21.15.19:0/1614530564 wait complete. 2024-03-08T06:04:06.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.077+0000 7f3ab6200640 1 Processor -- start 2024-03-08T06:04:06.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.077+0000 7f3ab6200640 1 -- start start 2024-03-08T06:04:06.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.078+0000 7f3ab6200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ab0071950 0x7f3ab01e7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:06.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.078+0000 7f3ab6200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ab01455b0 0x7f3ab015b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:06.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.078+0000 7f3ab6200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ab01604f0 0x7f3ab01e8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:06.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.078+0000 7f3ab6200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab0145990 con 0x7f3ab0071950 2024-03-08T06:04:06.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.078+0000 7f3ab6200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00cd8b0 con 0x7f3ab01455b0 2024-03-08T06:04:06.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.078+0000 7f3ab6200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00ccbd0 con 0x7f3ab01604f0 2024-03-08T06:04:06.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.078+0000 7f3aaf400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ab0071950 0x7f3ab01e7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:06.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.078+0000 7f3aaf400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ab0071950 0x7f3ab01e7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55754/0 (socket says 172.21.15.19:55754) 2024-03-08T06:04:06.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.078+0000 7f3aaf400640 1 -- 172.21.15.19:0/1060294442 learned_addr learned my addr 172.21.15.19:0/1060294442 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:06.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.078+0000 7f3aaea00640 1 --2- 172.21.15.19:0/1060294442 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ab01455b0 0x7f3ab015b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:06.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.078+0000 7f3aaf400640 1 -- 172.21.15.19:0/1060294442 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ab01604f0 msgr2=0x7f3ab01e8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:06.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.078+0000 7f3aaf400640 1 --2- 172.21.15.19:0/1060294442 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ab01604f0 0x7f3ab01e8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.079+0000 7f3aaf400640 1 -- 172.21.15.19:0/1060294442 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ab01455b0 msgr2=0x7f3ab015b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:06.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.079+0000 7f3aaf400640 1 --2- 172.21.15.19:0/1060294442 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ab01455b0 0x7f3ab015b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.079+0000 7f3aaf400640 1 -- 172.21.15.19:0/1060294442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab01e65c0 con 0x7f3ab0071950 2024-03-08T06:04:06.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.079+0000 7f3aaf400640 1 --2- 172.21.15.19:0/1060294442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ab0071950 0x7f3ab01e7660 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000c400 tx=0x7f3aa000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:06.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.079+0000 7f3aa7400640 1 -- 172.21.15.19:0/1060294442 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0017070 con 0x7f3ab0071950 2024-03-08T06:04:06.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.079+0000 7f3aa7400640 1 -- 172.21.15.19:0/1060294442 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa0005ce0 con 0x7f3ab0071950 2024-03-08T06:04:06.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.079+0000 7f3aa7400640 1 -- 172.21.15.19:0/1060294442 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa00072f0 con 0x7f3ab0071950 2024-03-08T06:04:06.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.079+0000 7f3ab6200640 1 -- 172.21.15.19:0/1060294442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab01e68a0 con 0x7f3ab0071950 2024-03-08T06:04:06.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.079+0000 7f3ab6200640 1 -- 172.21.15.19:0/1060294442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab01e6e60 con 0x7f3ab0071950 2024-03-08T06:04:06.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.081+0000 7f3ab6200640 1 -- 172.21.15.19:0/1060294442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab0067cb0 con 0x7f3ab0071950 2024-03-08T06:04:06.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.083+0000 7f3aa7400640 1 -- 172.21.15.19:0/1060294442 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3aa001a070 con 0x7f3ab0071950 2024-03-08T06:04:06.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.083+0000 7f3aa7400640 1 --2- 172.21.15.19:0/1060294442 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3a9006b4d0 0x7f3a9006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:06.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.083+0000 7f3aa7400640 1 -- 172.21.15.19:0/1060294442 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3aa0089670 con 0x7f3ab0071950 2024-03-08T06:04:06.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.083+0000 7f3aaea00640 1 --2- 172.21.15.19:0/1060294442 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3a9006b4d0 0x7f3a9006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:06.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.084+0000 7f3aaea00640 1 --2- 172.21.15.19:0/1060294442 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3a9006b4d0 0x7f3a9006d990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3ab015e590 tx=0x7f3a9c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:06.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.089+0000 7f3aa7400640 1 -- 172.21.15.19:0/1060294442 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3aa0058450 con 0x7f3ab0071950 2024-03-08T06:04:06.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.288+0000 7f3ab6200640 1 -- 172.21.15.19:0/1060294442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3ab00b2810 con 0x7f3ab0071950 2024-03-08T06:04:06.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.289+0000 7f3aa7400640 1 -- 172.21.15.19:0/1060294442 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3aa0057d50 con 0x7f3ab0071950 2024-03-08T06:04:06.290 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-08T06:04:06.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.291+0000 7f3ab6200640 1 -- 172.21.15.19:0/1060294442 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3a9006b4d0 msgr2=0x7f3a9006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:06.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.291+0000 7f3ab6200640 1 --2- 172.21.15.19:0/1060294442 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3a9006b4d0 0x7f3a9006d990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3ab015e590 tx=0x7f3a9c008040 comp rx=0 tx=0).stop 2024-03-08T06:04:06.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.291+0000 7f3ab6200640 1 -- 172.21.15.19:0/1060294442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ab0071950 msgr2=0x7f3ab01e7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:06.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.291+0000 7f3ab6200640 1 --2- 172.21.15.19:0/1060294442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ab0071950 0x7f3ab01e7660 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000c400 tx=0x7f3aa000c8c0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.291+0000 7f3ab6200640 1 -- 172.21.15.19:0/1060294442 shutdown_connections 2024-03-08T06:04:06.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.291+0000 7f3ab6200640 1 --2- 172.21.15.19:0/1060294442 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3a9006b4d0 0x7f3a9006d990 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.291+0000 7f3ab6200640 1 --2- 172.21.15.19:0/1060294442 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ab01604f0 0x7f3ab01e8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.291+0000 7f3ab6200640 1 --2- 172.21.15.19:0/1060294442 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ab01455b0 0x7f3ab015b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.291+0000 7f3ab6200640 1 --2- 172.21.15.19:0/1060294442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ab0071950 0x7f3ab01e7660 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.291+0000 7f3ab6200640 1 -- 172.21.15.19:0/1060294442 >> 172.21.15.19:0/1060294442 conn(0x7f3ab006ae30 msgr2=0x7f3ab00b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:06.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.292+0000 7f3ab6200640 1 -- 172.21.15.19:0/1060294442 shutdown_connections 2024-03-08T06:04:06.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.292+0000 7f3ab6200640 1 -- 172.21.15.19:0/1060294442 wait complete. 2024-03-08T06:04:06.313 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T06:04:06.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.527+0000 7f094b200640 1 Processor -- start 2024-03-08T06:04:06.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.528+0000 7f094b200640 1 -- start start 2024-03-08T06:04:06.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.529+0000 7f094b200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f094c0cf030 0x7f094c161930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:06.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.529+0000 7f094b200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094c15e240 con 0x7f094c15de60 2024-03-08T06:04:06.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.529+0000 7f094b200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094c162030 con 0x7f094c0b9630 2024-03-08T06:04:06.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.529+0000 7f094b200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094c162310 con 0x7f094c0cf030 2024-03-08T06:04:06.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.530+0000 7f0949e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f094c15de60 0x7f094c0ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53448/0 (socket says 172.21.15.19:53448) 2024-03-08T06:04:06.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.530+0000 7f0949e00640 1 -- 172.21.15.19:0/1189851511 learned_addr learned my addr 172.21.15.19:0/1189851511 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:06.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.530+0000 7f0949400640 1 --2- 172.21.15.19:0/1189851511 >> v2:172.21.15.19:3300/0 conn(0x7f094c0cf030 0x7f094c161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:06.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.530+0000 7f0948a00640 1 -- 172.21.15.19:0/1189851511 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179654826 0 0) 0x7f094c15e240 con 0x7f094c15de60 2024-03-08T06:04:06.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.530+0000 7f0948a00640 1 -- 172.21.15.19:0/1189851511 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0930003520 con 0x7f094c15de60 2024-03-08T06:04:06.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.530+0000 7f0949400640 1 -- 172.21.15.19:0/1189851511 >> v1:172.21.15.42:6789/0 conn(0x7f094c0b9630 legacy=0x7f094c0d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:06.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.530+0000 7f0949400640 1 -- 172.21.15.19:0/1189851511 >> v1:172.21.15.19:6789/0 conn(0x7f094c15de60 legacy=0x7f094c0ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:06.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.530+0000 7f0949400640 1 -- 172.21.15.19:0/1189851511 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c1625f0 con 0x7f094c0cf030 2024-03-08T06:04:06.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.532+0000 7f0949400640 1 --2- 172.21.15.19:0/1189851511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f094c0cf030 0x7f094c161930 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f09340097a0 tx=0x7f093402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdabaaf1cc1ca369 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:06.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.532+0000 7f0948a00640 1 -- 172.21.15.19:0/1189851511 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934035020 con 0x7f094c0cf030 2024-03-08T06:04:06.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.532+0000 7f0948a00640 1 -- 172.21.15.19:0/1189851511 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0934031830 con 0x7f094c0cf030 2024-03-08T06:04:06.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.532+0000 7f0948a00640 1 -- 172.21.15.19:0/1189851511 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934031c00 con 0x7f094c0cf030 2024-03-08T06:04:06.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.532+0000 7f094b200640 1 -- 172.21.15.19:0/1189851511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f094c0cf030 msgr2=0x7f094c161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:06.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.532+0000 7f094b200640 1 --2- 172.21.15.19:0/1189851511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f094c0cf030 0x7f094c161930 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f09340097a0 tx=0x7f093402b8d0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.533+0000 7f094b200640 1 -- 172.21.15.19:0/1189851511 shutdown_connections 2024-03-08T06:04:06.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.533+0000 7f094b200640 1 --2- 172.21.15.19:0/1189851511 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f094c0cf030 0x7f094c161930 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.533+0000 7f094b200640 1 -- 172.21.15.19:0/1189851511 >> 172.21.15.19:0/1189851511 conn(0x7f094c06c500 msgr2=0x7f094c06c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:06.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.533+0000 7f094b200640 1 -- 172.21.15.19:0/1189851511 shutdown_connections 2024-03-08T06:04:06.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.533+0000 7f094b200640 1 -- 172.21.15.19:0/1189851511 wait complete. 2024-03-08T06:04:06.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.534+0000 7f094b200640 1 Processor -- start 2024-03-08T06:04:06.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.535+0000 7f094b200640 1 -- start start 2024-03-08T06:04:06.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.535+0000 7f094b200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f094c0b9630 0x7f094c0b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:06.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.535+0000 7f094b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f094c0cf030 0x7f094c0c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:06.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.536+0000 7f094b200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f094c15de60 0x7f094c0b5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:06.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.536+0000 7f094b200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0d2cf0 con 0x7f094c0b9630 2024-03-08T06:04:06.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.536+0000 7f094b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0b9a80 con 0x7f094c0cf030 2024-03-08T06:04:06.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.536+0000 7f094b200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094c0d2e70 con 0x7f094c15de60 2024-03-08T06:04:06.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.536+0000 7f0949e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f094c0b9630 0x7f094c0b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:06.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.536+0000 7f0949e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f094c0b9630 0x7f094c0b81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55766/0 (socket says 172.21.15.19:55766) 2024-03-08T06:04:06.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.536+0000 7f0949e00640 1 -- 172.21.15.19:0/3913126407 learned_addr learned my addr 172.21.15.19:0/3913126407 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:06.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.536+0000 7f0949400640 1 --2- 172.21.15.19:0/3913126407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f094c0cf030 0x7f094c0c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:06.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.536+0000 7f0949e00640 1 -- 172.21.15.19:0/3913126407 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f094c15de60 msgr2=0x7f094c0b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:06.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.536+0000 7f0949e00640 1 --2- 172.21.15.19:0/3913126407 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f094c15de60 0x7f094c0b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.536+0000 7f0949e00640 1 -- 172.21.15.19:0/3913126407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f094c0cf030 msgr2=0x7f094c0c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:06.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.536+0000 7f0949e00640 1 --2- 172.21.15.19:0/3913126407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f094c0cf030 0x7f094c0c6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.536+0000 7f0949e00640 1 -- 172.21.15.19:0/3913126407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c160550 con 0x7f094c0b9630 2024-03-08T06:04:06.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.536+0000 7f0949e00640 1 --2- 172.21.15.19:0/3913126407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f094c0b9630 0x7f094c0b81b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f093c00caa0 tx=0x7f093c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:06.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.537+0000 7f0942000640 1 -- 172.21.15.19:0/3913126407 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c017070 con 0x7f094c0b9630 2024-03-08T06:04:06.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.537+0000 7f0942000640 1 -- 172.21.15.19:0/3913126407 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c00ac00 con 0x7f094c0b9630 2024-03-08T06:04:06.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.537+0000 7f0942000640 1 -- 172.21.15.19:0/3913126407 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c012400 con 0x7f094c0b9630 2024-03-08T06:04:06.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.537+0000 7f094b200640 1 -- 172.21.15.19:0/3913126407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094c160830 con 0x7f094c0b9630 2024-03-08T06:04:06.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.537+0000 7f094b200640 1 -- 172.21.15.19:0/3913126407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094c160df0 con 0x7f094c0b9630 2024-03-08T06:04:06.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.538+0000 7f094b200640 1 -- 172.21.15.19:0/3913126407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f094c161db0 con 0x7f094c0b9630 2024-03-08T06:04:06.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.539+0000 7f0942000640 1 -- 172.21.15.19:0/3913126407 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f093c01a070 con 0x7f094c0b9630 2024-03-08T06:04:06.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.540+0000 7f0942000640 1 --2- 172.21.15.19:0/3913126407 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f092806b4d0 0x7f092806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:06.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.540+0000 7f0942000640 1 -- 172.21.15.19:0/3913126407 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f093c08a100 con 0x7f094c0b9630 2024-03-08T06:04:06.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.540+0000 7f0949400640 1 --2- 172.21.15.19:0/3913126407 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f092806b4d0 0x7f092806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:06.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.541+0000 7f0949400640 1 --2- 172.21.15.19:0/3913126407 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f092806b4d0 0x7f092806d990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0934036000 tx=0x7f0934008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:06.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.545+0000 7f0942000640 1 -- 172.21.15.19:0/3913126407 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f094c161db0 con 0x7f094c0b9630 2024-03-08T06:04:06.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.746+0000 7f094b200640 1 -- 172.21.15.19:0/3913126407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f094c075090 con 0x7f094c0b9630 2024-03-08T06:04:06.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.746+0000 7f0942000640 1 -- 172.21.15.19:0/3913126407 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f093c058e60 con 0x7f094c0b9630 2024-03-08T06:04:06.747 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-08T06:04:06.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.751+0000 7f094b200640 1 -- 172.21.15.19:0/3913126407 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f092806b4d0 msgr2=0x7f092806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:06.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.751+0000 7f094b200640 1 --2- 172.21.15.19:0/3913126407 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f092806b4d0 0x7f092806d990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0934036000 tx=0x7f0934008030 comp rx=0 tx=0).stop 2024-03-08T06:04:06.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.751+0000 7f094b200640 1 -- 172.21.15.19:0/3913126407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f094c0b9630 msgr2=0x7f094c0b81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:06.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.751+0000 7f094b200640 1 --2- 172.21.15.19:0/3913126407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f094c0b9630 0x7f094c0b81b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f093c00caa0 tx=0x7f093c00cf60 comp rx=0 tx=0).stop 2024-03-08T06:04:06.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.751+0000 7f094b200640 1 -- 172.21.15.19:0/3913126407 shutdown_connections 2024-03-08T06:04:06.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.751+0000 7f094b200640 1 --2- 172.21.15.19:0/3913126407 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f092806b4d0 0x7f092806d990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.751+0000 7f094b200640 1 --2- 172.21.15.19:0/3913126407 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f094c15de60 0x7f094c0b5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.751+0000 7f094b200640 1 --2- 172.21.15.19:0/3913126407 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f094c0cf030 0x7f094c0c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.751+0000 7f094b200640 1 --2- 172.21.15.19:0/3913126407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f094c0b9630 0x7f094c0b81b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.751+0000 7f094b200640 1 -- 172.21.15.19:0/3913126407 >> 172.21.15.19:0/3913126407 conn(0x7f094c06c500 msgr2=0x7f094c0d25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:06.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.751+0000 7f094b200640 1 -- 172.21.15.19:0/3913126407 shutdown_connections 2024-03-08T06:04:06.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.751+0000 7f094b200640 1 -- 172.21.15.19:0/3913126407 wait complete. 2024-03-08T06:04:06.772 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-08T06:04:06.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.991+0000 7f34b2800640 1 Processor -- start 2024-03-08T06:04:06.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.991+0000 7f34b2800640 1 -- start start 2024-03-08T06:04:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.992+0000 7f34b2800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f34ac0b46a0 0x7f34ac0aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.992+0000 7f34b2800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f34ac0717d0 0x7f34ac071c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.992+0000 7f34b2800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ac0b4c80 con 0x7f34ac1444f0 2024-03-08T06:04:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.992+0000 7f34b2800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ac0ae050 con 0x7f34ac0717d0 2024-03-08T06:04:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.992+0000 7f34b2800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ac0b4f60 con 0x7f34ac0b46a0 2024-03-08T06:04:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.993+0000 7f34abe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f34ac0717d0 0x7f34ac071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.993+0000 7f34abe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f34ac0717d0 0x7f34ac071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55780/0 (socket says 172.21.15.19:55780) 2024-03-08T06:04:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.993+0000 7f34abe00640 1 -- 172.21.15.19:0/87969638 learned_addr learned my addr 172.21.15.19:0/87969638 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.993+0000 7f34aaa00640 1 --2- 172.21.15.19:0/87969638 >> v2:172.21.15.42:3300/0 conn(0x7f34ac0b46a0 0x7f34ac0aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:06.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.993+0000 7f34abe00640 1 -- 172.21.15.19:0/87969638 >> v2:172.21.15.42:3300/0 conn(0x7f34ac0b46a0 msgr2=0x7f34ac0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:06.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.993+0000 7f34abe00640 1 --2- 172.21.15.19:0/87969638 >> v2:172.21.15.42:3300/0 conn(0x7f34ac0b46a0 0x7f34ac0aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.993+0000 7f34abe00640 1 -- 172.21.15.19:0/87969638 >> v1:172.21.15.42:6789/0 conn(0x7f34ac1444f0 legacy=0x7f34ac162300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:06.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.993+0000 7f34abe00640 1 -- 172.21.15.19:0/87969638 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac0ae280 con 0x7f34ac0717d0 2024-03-08T06:04:06.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.994+0000 7f34abe00640 1 --2- 172.21.15.19:0/87969638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34ac0717d0 0x7f34ac071c00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f34ac06eae0 tx=0x7f34a402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5340ef204bc1d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:06.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.995+0000 7f34aa000640 1 -- 172.21.15.19:0/87969638 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a4035020 con 0x7f34ac0717d0 2024-03-08T06:04:06.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.995+0000 7f34aa000640 1 -- 172.21.15.19:0/87969638 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a4031870 con 0x7f34ac0717d0 2024-03-08T06:04:06.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.995+0000 7f34aa000640 1 -- 172.21.15.19:0/87969638 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a4031c40 con 0x7f34ac0717d0 2024-03-08T06:04:06.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.995+0000 7f34b2800640 1 -- 172.21.15.19:0/87969638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34ac0717d0 msgr2=0x7f34ac071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:06.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.995+0000 7f34b2800640 1 --2- 172.21.15.19:0/87969638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34ac0717d0 0x7f34ac071c00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f34ac06eae0 tx=0x7f34a402b910 comp rx=0 tx=0).stop 2024-03-08T06:04:06.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.995+0000 7f34b2800640 1 -- 172.21.15.19:0/87969638 shutdown_connections 2024-03-08T06:04:06.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.996+0000 7f34b2800640 1 --2- 172.21.15.19:0/87969638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34ac0717d0 0x7f34ac071c00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.996+0000 7f34b2800640 1 --2- 172.21.15.19:0/87969638 >> v2:172.21.15.42:3300/0 conn(0x7f34ac0b46a0 0x7f34ac0aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:06.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.996+0000 7f34b2800640 1 -- 172.21.15.19:0/87969638 >> 172.21.15.19:0/87969638 conn(0x7f34ac06ae30 msgr2=0x7f34ac06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:06.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.996+0000 7f34b2800640 1 -- 172.21.15.19:0/87969638 shutdown_connections 2024-03-08T06:04:06.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.996+0000 7f34b2800640 1 -- 172.21.15.19:0/87969638 wait complete. 2024-03-08T06:04:07.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.997+0000 7f34b2800640 1 Processor -- start 2024-03-08T06:04:07.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.998+0000 7f34b2800640 1 -- start start 2024-03-08T06:04:07.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.999+0000 7f34b2800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34ac0717d0 0x7f34ac15aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:07.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.999+0000 7f34b2800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34ac0b46a0 0x7f34ac13c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:07.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.999+0000 7f34b2800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f34ac1444f0 0x7f34ac13d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:07.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.999+0000 7f34b2800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac0ae840 con 0x7f34ac0b46a0 2024-03-08T06:04:07.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.999+0000 7f34b2800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac072140 con 0x7f34ac0717d0 2024-03-08T06:04:07.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.999+0000 7f34b2800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac0af2a0 con 0x7f34ac1444f0 2024-03-08T06:04:07.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.999+0000 7f34aaa00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34ac0b46a0 0x7f34ac13c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:07.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.999+0000 7f34aaa00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34ac0b46a0 0x7f34ac13c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55794/0 (socket says 172.21.15.19:55794) 2024-03-08T06:04:07.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.999+0000 7f34aaa00640 1 -- 172.21.15.19:0/328908167 learned_addr learned my addr 172.21.15.19:0/328908167 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.999+0000 7f34ab400640 1 --2- 172.21.15.19:0/328908167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34ac0717d0 0x7f34ac15aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.999+0000 7f34abe00640 1 --2- 172.21.15.19:0/328908167 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f34ac1444f0 0x7f34ac13d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.999+0000 7f34aaa00640 1 -- 172.21.15.19:0/328908167 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f34ac1444f0 msgr2=0x7f34ac13d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.999+0000 7f34aaa00640 1 --2- 172.21.15.19:0/328908167 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f34ac1444f0 0x7f34ac13d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.999+0000 7f34aaa00640 1 -- 172.21.15.19:0/328908167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34ac0717d0 msgr2=0x7f34ac15aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:06.999+0000 7f34aaa00640 1 --2- 172.21.15.19:0/328908167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34ac0717d0 0x7f34ac15aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.000+0000 7f34aaa00640 1 -- 172.21.15.19:0/328908167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac13f710 con 0x7f34ac0b46a0 2024-03-08T06:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.000+0000 7f34aaa00640 1 --2- 172.21.15.19:0/328908167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34ac0b46a0 0x7f34ac13c8c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f349400d800 tx=0x7f349400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.000+0000 7f34a3400640 1 -- 172.21.15.19:0/328908167 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400b6c0 con 0x7f34ac0b46a0 2024-03-08T06:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.000+0000 7f34a3400640 1 -- 172.21.15.19:0/328908167 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3494019070 con 0x7f34ac0b46a0 2024-03-08T06:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.000+0000 7f34a3400640 1 -- 172.21.15.19:0/328908167 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349400ba80 con 0x7f34ac0b46a0 2024-03-08T06:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.000+0000 7f34b2800640 1 -- 172.21.15.19:0/328908167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ac13f9f0 con 0x7f34ac0b46a0 2024-03-08T06:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.000+0000 7f34b2800640 1 -- 172.21.15.19:0/328908167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac13f370 con 0x7f34ac0b46a0 2024-03-08T06:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.002+0000 7f34b2800640 1 -- 172.21.15.19:0/328908167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac0b1200 con 0x7f34ac0b46a0 2024-03-08T06:04:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.003+0000 7f34a3400640 1 -- 172.21.15.19:0/328908167 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f349400bc20 con 0x7f34ac0b46a0 2024-03-08T06:04:07.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.003+0000 7f34a3400640 1 --2- 172.21.15.19:0/328908167 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f348806b4d0 0x7f348806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:07.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.004+0000 7f34a3400640 1 -- 172.21.15.19:0/328908167 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f349408a800 con 0x7f34ac0b46a0 2024-03-08T06:04:07.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.004+0000 7f34ab400640 1 --2- 172.21.15.19:0/328908167 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f348806b4d0 0x7f348806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:07.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.005+0000 7f34ab400640 1 --2- 172.21.15.19:0/328908167 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f348806b4d0 0x7f348806d990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f349c009f20 tx=0x7f349c0094d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:07.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.009+0000 7f34a3400640 1 -- 172.21.15.19:0/328908167 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3494059560 con 0x7f34ac0b46a0 2024-03-08T06:04:07.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.220+0000 7f34b2800640 1 -- 172.21.15.19:0/328908167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f34ac067cb0 con 0x7f34ac0b46a0 2024-03-08T06:04:07.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.221+0000 7f34a3400640 1 -- 172.21.15.19:0/328908167 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3494058e60 con 0x7f34ac0b46a0 2024-03-08T06:04:07.222 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-08T06:04:07.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.224+0000 7f34b2800640 1 -- 172.21.15.19:0/328908167 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f348806b4d0 msgr2=0x7f348806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:07.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.224+0000 7f34b2800640 1 --2- 172.21.15.19:0/328908167 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f348806b4d0 0x7f348806d990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f349c009f20 tx=0x7f349c0094d0 comp rx=0 tx=0).stop 2024-03-08T06:04:07.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.224+0000 7f34b2800640 1 -- 172.21.15.19:0/328908167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34ac0b46a0 msgr2=0x7f34ac13c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:07.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.224+0000 7f34b2800640 1 --2- 172.21.15.19:0/328908167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34ac0b46a0 0x7f34ac13c8c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f349400d800 tx=0x7f349400dcc0 comp rx=0 tx=0).stop 2024-03-08T06:04:07.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.224+0000 7f34b2800640 1 -- 172.21.15.19:0/328908167 shutdown_connections 2024-03-08T06:04:07.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.224+0000 7f34b2800640 1 --2- 172.21.15.19:0/328908167 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f348806b4d0 0x7f348806d990 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:07.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.224+0000 7f34b2800640 1 --2- 172.21.15.19:0/328908167 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f34ac1444f0 0x7f34ac13d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:07.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.224+0000 7f34b2800640 1 --2- 172.21.15.19:0/328908167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34ac0b46a0 0x7f34ac13c8c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:07.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.224+0000 7f34b2800640 1 --2- 172.21.15.19:0/328908167 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f34ac0717d0 0x7f34ac15aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:07.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.224+0000 7f34b2800640 1 -- 172.21.15.19:0/328908167 >> 172.21.15.19:0/328908167 conn(0x7f34ac06ae30 msgr2=0x7f34ac15e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:07.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.224+0000 7f34b2800640 1 -- 172.21.15.19:0/328908167 shutdown_connections 2024-03-08T06:04:07.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.224+0000 7f34b2800640 1 -- 172.21.15.19:0/328908167 wait complete. 2024-03-08T06:04:07.242 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-08T06:04:07.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:07.242 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-03-08T06:04:07.356 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-03-08T06:04:07.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:07.357 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-08T06:04:07.406 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:04:07.406 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:04:07.463 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:04:07.464 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:04:07.515 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:04:07.515 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:04:07.567 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:04:07.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.786+0000 7f596da00640 1 Processor -- start 2024-03-08T06:04:07.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.786+0000 7f596da00640 1 -- start start 2024-03-08T06:04:07.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.787+0000 7f596da00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f596815df20 0x7f59680ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.787+0000 7f596da00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f59680b6bd0 0x7f5968162400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.787+0000 7f596da00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f59680d0aa0 0x7f59680d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.788+0000 7f596da00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5968162940 con 0x7f59680d0aa0 2024-03-08T06:04:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.788+0000 7f596da00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f596815e300 con 0x7f596815df20 2024-03-08T06:04:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.788+0000 7f596da00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59680cf030 con 0x7f59680b6bd0 2024-03-08T06:04:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.788+0000 7f596d000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f59680d0aa0 0x7f59680d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.788+0000 7f596d000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f59680d0aa0 0x7f59680d0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55806/0 (socket says 172.21.15.19:55806) 2024-03-08T06:04:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.788+0000 7f596d000640 1 -- 172.21.15.19:0/3040079676 learned_addr learned my addr 172.21.15.19:0/3040079676 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.788+0000 7f596d000640 1 -- 172.21.15.19:0/3040079676 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f59680b6bd0 msgr2=0x7f5968162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.788+0000 7f596d000640 1 --2- 172.21.15.19:0/3040079676 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f59680b6bd0 0x7f5968162400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.788+0000 7f596d000640 1 -- 172.21.15.19:0/3040079676 >> v2:172.21.15.42:3300/0 conn(0x7f596815df20 msgr2=0x7f59680ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.788+0000 7f596d000640 1 --2- 172.21.15.19:0/3040079676 >> v2:172.21.15.42:3300/0 conn(0x7f596815df20 0x7f59680ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.788+0000 7f596d000640 1 -- 172.21.15.19:0/3040079676 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59680d1bc0 con 0x7f59680d0aa0 2024-03-08T06:04:07.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.789+0000 7f596d000640 1 --2- 172.21.15.19:0/3040079676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59680d0aa0 0x7f59680d0f30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5968073150 tx=0x7f596002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13cd740f5bc7d0f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:07.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.790+0000 7f5967400640 1 -- 172.21.15.19:0/3040079676 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596002cb00 con 0x7f59680d0aa0 2024-03-08T06:04:07.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.790+0000 7f5967400640 1 -- 172.21.15.19:0/3040079676 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596002cca0 con 0x7f59680d0aa0 2024-03-08T06:04:07.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.790+0000 7f5967400640 1 -- 172.21.15.19:0/3040079676 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5960034610 con 0x7f59680d0aa0 2024-03-08T06:04:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.790+0000 7f596da00640 1 -- 172.21.15.19:0/3040079676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59680d0aa0 msgr2=0x7f59680d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.790+0000 7f596da00640 1 --2- 172.21.15.19:0/3040079676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59680d0aa0 0x7f59680d0f30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5968073150 tx=0x7f596002bf60 comp rx=0 tx=0).stop 2024-03-08T06:04:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.791+0000 7f596da00640 1 -- 172.21.15.19:0/3040079676 shutdown_connections 2024-03-08T06:04:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.791+0000 7f596da00640 1 --2- 172.21.15.19:0/3040079676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f59680d0aa0 0x7f59680d0f30 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.791+0000 7f596da00640 1 --2- 172.21.15.19:0/3040079676 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f59680b6bd0 0x7f5968162400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.791+0000 7f596da00640 1 --2- 172.21.15.19:0/3040079676 >> v2:172.21.15.42:3300/0 conn(0x7f596815df20 0x7f59680ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.791+0000 7f596da00640 1 -- 172.21.15.19:0/3040079676 >> 172.21.15.19:0/3040079676 conn(0x7f596806c740 msgr2=0x7f596806cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.791+0000 7f596da00640 1 -- 172.21.15.19:0/3040079676 shutdown_connections 2024-03-08T06:04:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.791+0000 7f596da00640 1 -- 172.21.15.19:0/3040079676 wait complete. 2024-03-08T06:04:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.792+0000 7f596da00640 1 Processor -- start 2024-03-08T06:04:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.793+0000 7f596da00640 1 -- start start 2024-03-08T06:04:07.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.793+0000 7f596da00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f59680b6bd0 0x7f59680cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:07.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.793+0000 7f596da00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59680d0aa0 0x7f5968149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:07.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.793+0000 7f596da00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f596815df20 0x7f5968149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:07.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.793+0000 7f596da00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59680d2460 con 0x7f596815df20 2024-03-08T06:04:07.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.793+0000 7f596da00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59680d2180 con 0x7f59680d0aa0 2024-03-08T06:04:07.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.793+0000 7f596da00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59680b5590 con 0x7f59680b6bd0 2024-03-08T06:04:07.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.794+0000 7f596d000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f596815df20 0x7f5968149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.794+0000 7f596d000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f596815df20 0x7f5968149d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55822/0 (socket says 172.21.15.19:55822) 2024-03-08T06:04:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.794+0000 7f596d000640 1 -- 172.21.15.19:0/3511056035 learned_addr learned my addr 172.21.15.19:0/3511056035 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.794+0000 7f5967e00640 1 --2- 172.21.15.19:0/3511056035 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f59680b6bd0 0x7f59680cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.794+0000 7f595fe00640 1 --2- 172.21.15.19:0/3511056035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59680d0aa0 0x7f5968149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.794+0000 7f596d000640 1 -- 172.21.15.19:0/3511056035 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f59680b6bd0 msgr2=0x7f59680cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.794+0000 7f596d000640 1 --2- 172.21.15.19:0/3511056035 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f59680b6bd0 0x7f59680cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.794+0000 7f596d000640 1 -- 172.21.15.19:0/3511056035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59680d0aa0 msgr2=0x7f5968149850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.794+0000 7f596d000640 1 --2- 172.21.15.19:0/3511056035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59680d0aa0 0x7f5968149850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.794+0000 7f596d000640 1 -- 172.21.15.19:0/3511056035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5968150820 con 0x7f596815df20 2024-03-08T06:04:07.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.795+0000 7f596d000640 1 --2- 172.21.15.19:0/3511056035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f596815df20 0x7f5968149d90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5960036040 tx=0x7f5960004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:07.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.795+0000 7f5964c00640 1 -- 172.21.15.19:0/3511056035 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5960043020 con 0x7f596815df20 2024-03-08T06:04:07.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.795+0000 7f5964c00640 1 -- 172.21.15.19:0/3511056035 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596002ce50 con 0x7f596815df20 2024-03-08T06:04:07.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.795+0000 7f5964c00640 1 -- 172.21.15.19:0/3511056035 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596003e650 con 0x7f596815df20 2024-03-08T06:04:07.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.795+0000 7f596da00640 1 -- 172.21.15.19:0/3511056035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59680cd7d0 con 0x7f596815df20 2024-03-08T06:04:07.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.795+0000 7f596da00640 1 -- 172.21.15.19:0/3511056035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59680cdd90 con 0x7f596815df20 2024-03-08T06:04:07.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.796+0000 7f596da00640 1 -- 172.21.15.19:0/3511056035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5968075100 con 0x7f596815df20 2024-03-08T06:04:07.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.797+0000 7f5964c00640 1 -- 172.21.15.19:0/3511056035 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5960046020 con 0x7f596815df20 2024-03-08T06:04:07.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.798+0000 7f5964c00640 1 --2- 172.21.15.19:0/3511056035 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f594406b4d0 0x7f594406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:07.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.798+0000 7f5964c00640 1 -- 172.21.15.19:0/3511056035 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f59600ac9f0 con 0x7f596815df20 2024-03-08T06:04:07.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.798+0000 7f5967e00640 1 --2- 172.21.15.19:0/3511056035 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f594406b4d0 0x7f594406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:07.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.799+0000 7f5967e00640 1 --2- 172.21.15.19:0/3511056035 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f594406b4d0 0x7f594406d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f595800b810 tx=0x7f5958008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:07.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:07.803+0000 7f5964c00640 1 -- 172.21.15.19:0/3511056035 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f596004d030 con 0x7f596815df20 2024-03-08T06:04:08.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.003+0000 7f596da00640 1 -- 172.21.15.19:0/3511056035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59680d16e0 con 0x7f596815df20 2024-03-08T06:04:08.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.005+0000 7f5964c00640 1 -- 172.21.15.19:0/3511056035 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16795 (secure 0 0 0) 0x7f596007b7e0 con 0x7f596815df20 2024-03-08T06:04:08.005 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:08.005 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":23,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:04:07.332571+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:03:18.392703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T06:03:19.537912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.007+0000 7f596da00640 1 -- 172.21.15.19:0/3511056035 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f594406b4d0 msgr2=0x7f594406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.007+0000 7f596da00640 1 --2- 172.21.15.19:0/3511056035 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f594406b4d0 0x7f594406d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f595800b810 tx=0x7f5958008040 comp rx=0 tx=0).stop 2024-03-08T06:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.008+0000 7f596da00640 1 -- 172.21.15.19:0/3511056035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f596815df20 msgr2=0x7f5968149d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.008+0000 7f596da00640 1 --2- 172.21.15.19:0/3511056035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f596815df20 0x7f5968149d90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5960036040 tx=0x7f5960004a40 comp rx=0 tx=0).stop 2024-03-08T06:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.008+0000 7f596da00640 1 -- 172.21.15.19:0/3511056035 shutdown_connections 2024-03-08T06:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.008+0000 7f596da00640 1 --2- 172.21.15.19:0/3511056035 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f594406b4d0 0x7f594406d990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.008+0000 7f596da00640 1 --2- 172.21.15.19:0/3511056035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f596815df20 0x7f5968149d90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.008+0000 7f596da00640 1 --2- 172.21.15.19:0/3511056035 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f59680d0aa0 0x7f5968149850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.008+0000 7f596da00640 1 --2- 172.21.15.19:0/3511056035 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f59680b6bd0 0x7f59680cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.008+0000 7f596da00640 1 -- 172.21.15.19:0/3511056035 >> 172.21.15.19:0/3511056035 conn(0x7f596806c740 msgr2=0x7f5968161ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.008+0000 7f596da00640 1 -- 172.21.15.19:0/3511056035 shutdown_connections 2024-03-08T06:04:08.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.008+0000 7f596da00640 1 -- 172.21.15.19:0/3511056035 wait complete. 2024-03-08T06:04:08.029 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T06:03:14.149736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T06:03:18.392703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T06:03:19.537912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T06:04:08.030 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T06:04:08.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.252+0000 7f61ac400640 1 Processor -- start 2024-03-08T06:04:08.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.252+0000 7f61ac400640 1 -- start start 2024-03-08T06:04:08.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.254+0000 7f61ac400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f61a41604f0 0x7f61a40cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:08.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.254+0000 7f61ac400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f61a4071950 0x7f61a4071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:08.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.254+0000 7f61ac400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a40cd5a0 con 0x7f61a41455b0 2024-03-08T06:04:08.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.254+0000 7f61ac400640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a40cdc20 con 0x7f61a4071950 2024-03-08T06:04:08.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.254+0000 7f61ac400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a40722c0 con 0x7f61a41604f0 2024-03-08T06:04:08.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.255+0000 7f61aa400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f61a4071950 0x7f61a4071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:08.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.255+0000 7f61a9000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f61a41604f0 0x7f61a40cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:08.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.255+0000 7f61aa400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f61a4071950 0x7f61a4071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.19:49416/0 (socket says 172.21.15.19:49416) 2024-03-08T06:04:08.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.255+0000 7f61aa400640 1 -- 172.21.15.19:0/719738922 learned_addr learned my addr 172.21.15.19:0/719738922 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:08.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.256+0000 7f61a9000640 1 -- 172.21.15.19:0/719738922 >> v2:172.21.15.42:3300/0 conn(0x7f61a4071950 msgr2=0x7f61a4071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:08.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.256+0000 7f61a9000640 1 --2- 172.21.15.19:0/719738922 >> v2:172.21.15.42:3300/0 conn(0x7f61a4071950 0x7f61a4071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.256+0000 7f61a9000640 1 -- 172.21.15.19:0/719738922 >> v1:172.21.15.42:6789/0 conn(0x7f61a41455b0 legacy=0x7f61a415c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:08.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.256+0000 7f61a9000640 1 -- 172.21.15.19:0/719738922 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a40ccfe0 con 0x7f61a41604f0 2024-03-08T06:04:08.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.257+0000 7f61a9000640 1 --2- 172.21.15.19:0/719738922 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f61a41604f0 0x7f61a40cc690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f61a40cdda0 tx=0x7f619002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef75049b9932af35 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:08.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.258+0000 7f61a3e00640 1 -- 172.21.15.19:0/719738922 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190035020 con 0x7f61a41604f0 2024-03-08T06:04:08.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.258+0000 7f61a3e00640 1 -- 172.21.15.19:0/719738922 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6190031810 con 0x7f61a41604f0 2024-03-08T06:04:08.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.258+0000 7f61a3e00640 1 -- 172.21.15.19:0/719738922 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190031be0 con 0x7f61a41604f0 2024-03-08T06:04:08.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.258+0000 7f61ac400640 1 -- 172.21.15.19:0/719738922 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f61a41604f0 msgr2=0x7f61a40cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:08.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.258+0000 7f61ac400640 1 --2- 172.21.15.19:0/719738922 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f61a41604f0 0x7f61a40cc690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f61a40cdda0 tx=0x7f619002b8b0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.259+0000 7f61ac400640 1 -- 172.21.15.19:0/719738922 shutdown_connections 2024-03-08T06:04:08.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.259+0000 7f61ac400640 1 --2- 172.21.15.19:0/719738922 >> v2:172.21.15.42:3300/0 conn(0x7f61a4071950 0x7f61a4071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.259+0000 7f61ac400640 1 --2- 172.21.15.19:0/719738922 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f61a41604f0 0x7f61a40cc690 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.259+0000 7f61ac400640 1 -- 172.21.15.19:0/719738922 >> 172.21.15.19:0/719738922 conn(0x7f61a406ae30 msgr2=0x7f61a406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:08.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.259+0000 7f61ac400640 1 -- 172.21.15.19:0/719738922 shutdown_connections 2024-03-08T06:04:08.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.259+0000 7f61ac400640 1 -- 172.21.15.19:0/719738922 wait complete. 2024-03-08T06:04:08.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.261+0000 7f61ac400640 1 Processor -- start 2024-03-08T06:04:08.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.261+0000 7f61ac400640 1 -- start start 2024-03-08T06:04:08.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.262+0000 7f61ac400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61a4071950 0x7f61a415b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:08.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.262+0000 7f61ac400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a41455b0 0x7f61a4138060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:08.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.262+0000 7f61ac400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f61a41604f0 0x7f61a41385a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:08.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.262+0000 7f61ac400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a4145990 con 0x7f61a41455b0 2024-03-08T06:04:08.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.262+0000 7f61ac400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a40cd8b0 con 0x7f61a4071950 2024-03-08T06:04:08.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.262+0000 7f61ac400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a40ccbd0 con 0x7f61a41604f0 2024-03-08T06:04:08.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.263+0000 7f61a9000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a41455b0 0x7f61a4138060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:08.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.263+0000 7f61a9000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a41455b0 0x7f61a4138060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55834/0 (socket says 172.21.15.19:55834) 2024-03-08T06:04:08.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.263+0000 7f61a9000640 1 -- 172.21.15.19:0/2788530218 learned_addr learned my addr 172.21.15.19:0/2788530218 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:08.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.263+0000 7f61a9a00640 1 --2- 172.21.15.19:0/2788530218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61a4071950 0x7f61a415b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:08.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.263+0000 7f61aa400640 1 --2- 172.21.15.19:0/2788530218 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f61a41604f0 0x7f61a41385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:08.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.263+0000 7f61a9000640 1 -- 172.21.15.19:0/2788530218 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f61a41604f0 msgr2=0x7f61a41385a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:08.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.263+0000 7f61a9000640 1 --2- 172.21.15.19:0/2788530218 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f61a41604f0 0x7f61a41385a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.263+0000 7f61a9000640 1 -- 172.21.15.19:0/2788530218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61a4071950 msgr2=0x7f61a415b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:08.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.263+0000 7f61a9000640 1 --2- 172.21.15.19:0/2788530218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61a4071950 0x7f61a415b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.263+0000 7f61a9000640 1 -- 172.21.15.19:0/2788530218 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a415cb60 con 0x7f61a41455b0 2024-03-08T06:04:08.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.264+0000 7f61a9000640 1 --2- 172.21.15.19:0/2788530218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a41455b0 0x7f61a4138060 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6190000c00 tx=0x7f61900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:08.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.264+0000 7f61a1600640 1 -- 172.21.15.19:0/2788530218 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190040070 con 0x7f61a41455b0 2024-03-08T06:04:08.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.264+0000 7f61a1600640 1 -- 172.21.15.19:0/2788530218 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6190039cf0 con 0x7f61a41455b0 2024-03-08T06:04:08.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.264+0000 7f61a1600640 1 -- 172.21.15.19:0/2788530218 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190035040 con 0x7f61a41455b0 2024-03-08T06:04:08.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.264+0000 7f61ac400640 1 -- 172.21.15.19:0/2788530218 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a415ce40 con 0x7f61a41455b0 2024-03-08T06:04:08.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.264+0000 7f61ac400640 1 -- 172.21.15.19:0/2788530218 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a415d400 con 0x7f61a41455b0 2024-03-08T06:04:08.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.266+0000 7f61ac400640 1 -- 172.21.15.19:0/2788530218 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a4067cb0 con 0x7f61a41455b0 2024-03-08T06:04:08.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.267+0000 7f61a1600640 1 -- 172.21.15.19:0/2788530218 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f619004b060 con 0x7f61a41455b0 2024-03-08T06:04:08.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.267+0000 7f61a1600640 1 --2- 172.21.15.19:0/2788530218 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f618406b4d0 0x7f618406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:08.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.268+0000 7f61a1600640 1 -- 172.21.15.19:0/2788530218 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f61900abdf0 con 0x7f61a41455b0 2024-03-08T06:04:08.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.268+0000 7f61a9a00640 1 --2- 172.21.15.19:0/2788530218 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f618406b4d0 0x7f618406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:08.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.268+0000 7f61a9a00640 1 --2- 172.21.15.19:0/2788530218 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f618406b4d0 0x7f618406d990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6198001640 tx=0x7f6198009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:08.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.273+0000 7f61a1600640 1 -- 172.21.15.19:0/2788530218 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f619007abe0 con 0x7f61a41455b0 2024-03-08T06:04:08.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.470+0000 7f61ac400640 1 -- 172.21.15.19:0/2788530218 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61a40b1b70 con 0x7f61a41455b0 2024-03-08T06:04:08.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.472+0000 7f61a1600640 1 -- 172.21.15.19:0/2788530218 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f619007a4e0 con 0x7f61a41455b0 2024-03-08T06:04:08.471 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-08T06:04:08.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.474+0000 7f61ac400640 1 -- 172.21.15.19:0/2788530218 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f618406b4d0 msgr2=0x7f618406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:08.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.474+0000 7f61ac400640 1 --2- 172.21.15.19:0/2788530218 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f618406b4d0 0x7f618406d990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6198001640 tx=0x7f6198009040 comp rx=0 tx=0).stop 2024-03-08T06:04:08.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.474+0000 7f61ac400640 1 -- 172.21.15.19:0/2788530218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a41455b0 msgr2=0x7f61a4138060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:08.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.474+0000 7f61ac400640 1 --2- 172.21.15.19:0/2788530218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a41455b0 0x7f61a4138060 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6190000c00 tx=0x7f61900046c0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.474+0000 7f61ac400640 1 -- 172.21.15.19:0/2788530218 shutdown_connections 2024-03-08T06:04:08.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.474+0000 7f61ac400640 1 --2- 172.21.15.19:0/2788530218 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f618406b4d0 0x7f618406d990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.474+0000 7f61ac400640 1 --2- 172.21.15.19:0/2788530218 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f61a41604f0 0x7f61a41385a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.474+0000 7f61ac400640 1 --2- 172.21.15.19:0/2788530218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61a41455b0 0x7f61a4138060 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.474+0000 7f61ac400640 1 --2- 172.21.15.19:0/2788530218 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f61a4071950 0x7f61a415b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.474+0000 7f61ac400640 1 -- 172.21.15.19:0/2788530218 >> 172.21.15.19:0/2788530218 conn(0x7f61a406ae30 msgr2=0x7f61a40b0500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:08.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.475+0000 7f61ac400640 1 -- 172.21.15.19:0/2788530218 shutdown_connections 2024-03-08T06:04:08.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.475+0000 7f61ac400640 1 -- 172.21.15.19:0/2788530218 wait complete. 2024-03-08T06:04:08.494 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T06:04:08.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.715+0000 7fa67f600640 1 Processor -- start 2024-03-08T06:04:08.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.715+0000 7fa67f600640 1 -- start start 2024-03-08T06:04:08.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.717+0000 7fa67f600640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa678145590 0x7fa6780cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:08.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.717+0000 7fa67f600640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa678160610 con 0x7fa6780b3bd0 2024-03-08T06:04:08.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.717+0000 7fa67f600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa678071990 con 0x7fa6780ccc70 2024-03-08T06:04:08.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.717+0000 7fa67f600640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa678071c70 con 0x7fa678145590 2024-03-08T06:04:08.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.717+0000 7fa67d600640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa6780b3bd0 0x7fa67815ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53456/0 (socket says 172.21.15.19:53456) 2024-03-08T06:04:08.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.718+0000 7fa67d600640 1 -- 172.21.15.19:0/619724311 learned_addr learned my addr 172.21.15.19:0/619724311 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:08.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.717+0000 7fa67cc00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa678145590 0x7fa6780cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:08.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.718+0000 7fa67cc00640 1 -- 172.21.15.19:0/619724311 >> v1:172.21.15.42:6789/0 conn(0x7fa6780ccc70 legacy=0x7fa67815f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:08.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.718+0000 7fa67cc00640 1 -- 172.21.15.19:0/619724311 >> v1:172.21.15.19:6789/0 conn(0x7fa6780b3bd0 legacy=0x7fa67815ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:08.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.718+0000 7fa67cc00640 1 -- 172.21.15.19:0/619724311 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa678071f50 con 0x7fa678145590 2024-03-08T06:04:08.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.718+0000 7fa677400640 1 -- 172.21.15.19:0/619724311 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891011881 0 0) 0x7fa678160610 con 0x7fa6780b3bd0 2024-03-08T06:04:08.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.719+0000 7fa67cc00640 1 --2- 172.21.15.19:0/619724311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa678145590 0x7fa6780cf1a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa668009d90 tx=0x7fa66802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a361d7104b71b44 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:08.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.720+0000 7fa677400640 1 -- 172.21.15.19:0/619724311 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa668039070 con 0x7fa678145590 2024-03-08T06:04:08.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.720+0000 7fa677400640 1 -- 172.21.15.19:0/619724311 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66802cc60 con 0x7fa678145590 2024-03-08T06:04:08.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.720+0000 7fa677400640 1 -- 172.21.15.19:0/619724311 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa668034660 con 0x7fa678145590 2024-03-08T06:04:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.720+0000 7fa67f600640 1 -- 172.21.15.19:0/619724311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa678145590 msgr2=0x7fa6780cf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.720+0000 7fa67f600640 1 --2- 172.21.15.19:0/619724311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa678145590 0x7fa6780cf1a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa668009d90 tx=0x7fa66802beb0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.720+0000 7fa67f600640 1 -- 172.21.15.19:0/619724311 shutdown_connections 2024-03-08T06:04:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.720+0000 7fa67f600640 1 --2- 172.21.15.19:0/619724311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa678145590 0x7fa6780cf1a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.720+0000 7fa67f600640 1 -- 172.21.15.19:0/619724311 >> 172.21.15.19:0/619724311 conn(0x7fa6780cfaa0 msgr2=0x7fa6780cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.720+0000 7fa67f600640 1 -- 172.21.15.19:0/619724311 shutdown_connections 2024-03-08T06:04:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.721+0000 7fa67f600640 1 -- 172.21.15.19:0/619724311 wait complete. 2024-03-08T06:04:08.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.722+0000 7fa67f600640 1 Processor -- start 2024-03-08T06:04:08.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.722+0000 7fa67f600640 1 -- start start 2024-03-08T06:04:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.723+0000 7fa67f600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6780b3bd0 0x7fa6781f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.723+0000 7fa67f600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6780ccc70 0x7fa67815b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.723+0000 7fa67f600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa678145590 0x7fa67815b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.723+0000 7fa67f600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa678145970 con 0x7fa6780ccc70 2024-03-08T06:04:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.723+0000 7fa67f600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa678072510 con 0x7fa6780b3bd0 2024-03-08T06:04:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.723+0000 7fa67f600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6780cd960 con 0x7fa678145590 2024-03-08T06:04:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.724+0000 7fa677e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6780ccc70 0x7fa67815b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.724+0000 7fa677e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6780ccc70 0x7fa67815b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55850/0 (socket says 172.21.15.19:55850) 2024-03-08T06:04:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.724+0000 7fa677e00640 1 -- 172.21.15.19:0/3046063850 learned_addr learned my addr 172.21.15.19:0/3046063850 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.724+0000 7fa67cc00640 1 --2- 172.21.15.19:0/3046063850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6780b3bd0 0x7fa6781f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.724+0000 7fa677e00640 1 -- 172.21.15.19:0/3046063850 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa678145590 msgr2=0x7fa67815b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.724+0000 7fa677e00640 1 --2- 172.21.15.19:0/3046063850 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa678145590 0x7fa67815b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.724+0000 7fa677e00640 1 -- 172.21.15.19:0/3046063850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6780b3bd0 msgr2=0x7fa6781f3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.724+0000 7fa677e00640 1 --2- 172.21.15.19:0/3046063850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6780b3bd0 0x7fa6781f3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.724+0000 7fa677e00640 1 -- 172.21.15.19:0/3046063850 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa678156010 con 0x7fa6780ccc70 2024-03-08T06:04:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.724+0000 7fa677e00640 1 --2- 172.21.15.19:0/3046063850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6780ccc70 0x7fa67815b340 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa66400b420 tx=0x7fa66400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.725+0000 7fa674c00640 1 -- 172.21.15.19:0/3046063850 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa664011830 con 0x7fa6780ccc70 2024-03-08T06:04:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.725+0000 7fa674c00640 1 -- 172.21.15.19:0/3046063850 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa664016070 con 0x7fa6780ccc70 2024-03-08T06:04:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.725+0000 7fa674c00640 1 -- 172.21.15.19:0/3046063850 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa664011c10 con 0x7fa6780ccc70 2024-03-08T06:04:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.725+0000 7fa67f600640 1 -- 172.21.15.19:0/3046063850 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67812f140 con 0x7fa6780ccc70 2024-03-08T06:04:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.725+0000 7fa67f600640 1 -- 172.21.15.19:0/3046063850 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67812f700 con 0x7fa6780ccc70 2024-03-08T06:04:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.726+0000 7fa67f600640 1 -- 172.21.15.19:0/3046063850 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa678067cb0 con 0x7fa6780ccc70 2024-03-08T06:04:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.727+0000 7fa674c00640 1 -- 172.21.15.19:0/3046063850 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa66401b460 con 0x7fa6780ccc70 2024-03-08T06:04:08.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.728+0000 7fa674c00640 1 --2- 172.21.15.19:0/3046063850 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa65806b4d0 0x7fa65806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:08.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.728+0000 7fa674c00640 1 -- 172.21.15.19:0/3046063850 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa664089e40 con 0x7fa6780ccc70 2024-03-08T06:04:08.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.728+0000 7fa67cc00640 1 --2- 172.21.15.19:0/3046063850 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa65806b4d0 0x7fa65806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:08.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.729+0000 7fa67cc00640 1 --2- 172.21.15.19:0/3046063850 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa65806b4d0 0x7fa65806d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa668036000 tx=0x7fa668030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:08.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.733+0000 7fa674c00640 1 -- 172.21.15.19:0/3046063850 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa664020020 con 0x7fa6780ccc70 2024-03-08T06:04:08.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.932+0000 7fa67f600640 1 -- 172.21.15.19:0/3046063850 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6780729c0 con 0x7fa6780ccc70 2024-03-08T06:04:08.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.933+0000 7fa674c00640 1 -- 172.21.15.19:0/3046063850 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa664058ba0 con 0x7fa6780ccc70 2024-03-08T06:04:08.933 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-08T06:04:08.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.937+0000 7fa67f600640 1 -- 172.21.15.19:0/3046063850 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa65806b4d0 msgr2=0x7fa65806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:08.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.937+0000 7fa67f600640 1 --2- 172.21.15.19:0/3046063850 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa65806b4d0 0x7fa65806d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa668036000 tx=0x7fa668030000 comp rx=0 tx=0).stop 2024-03-08T06:04:08.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.937+0000 7fa67f600640 1 -- 172.21.15.19:0/3046063850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6780ccc70 msgr2=0x7fa67815b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:08.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.937+0000 7fa67f600640 1 --2- 172.21.15.19:0/3046063850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6780ccc70 0x7fa67815b340 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa66400b420 tx=0x7fa66400b8e0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.937+0000 7fa67f600640 1 -- 172.21.15.19:0/3046063850 shutdown_connections 2024-03-08T06:04:08.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.937+0000 7fa67f600640 1 --2- 172.21.15.19:0/3046063850 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa65806b4d0 0x7fa65806d990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.937+0000 7fa67f600640 1 --2- 172.21.15.19:0/3046063850 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa678145590 0x7fa67815b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.937+0000 7fa67f600640 1 --2- 172.21.15.19:0/3046063850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6780ccc70 0x7fa67815b340 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.937+0000 7fa67f600640 1 --2- 172.21.15.19:0/3046063850 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6780b3bd0 0x7fa6781f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:08.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.937+0000 7fa67f600640 1 -- 172.21.15.19:0/3046063850 >> 172.21.15.19:0/3046063850 conn(0x7fa6780cfaa0 msgr2=0x7fa6780cd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:08.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.937+0000 7fa67f600640 1 -- 172.21.15.19:0/3046063850 shutdown_connections 2024-03-08T06:04:08.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:08.937+0000 7fa67f600640 1 -- 172.21.15.19:0/3046063850 wait complete. 2024-03-08T06:04:08.955 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T06:04:09.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.182+0000 7f9a0fe00640 1 Processor -- start 2024-03-08T06:04:09.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.183+0000 7f9a0fe00640 1 -- start start 2024-03-08T06:04:09.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.184+0000 7f9a0fe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9a10145500 0x7f9a1006ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:09.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.184+0000 7f9a0fe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9a10071df0 0x7f9a100cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:09.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.184+0000 7f9a0fe00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1015c460 con 0x7f9a1015bfb0 2024-03-08T06:04:09.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.184+0000 7f9a0fe00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1015c740 con 0x7f9a10071df0 2024-03-08T06:04:09.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.184+0000 7f9a0fe00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1015ca20 con 0x7f9a10145500 2024-03-08T06:04:09.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.185+0000 7f9a0f400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9a10071df0 0x7f9a100cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:09.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.185+0000 7f9a0f400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9a10071df0 0x7f9a100cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55864/0 (socket says 172.21.15.19:55864) 2024-03-08T06:04:09.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.185+0000 7f9a0f400640 1 -- 172.21.15.19:0/682402324 learned_addr learned my addr 172.21.15.19:0/682402324 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:09.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.185+0000 7f9a0ea00640 1 --2- 172.21.15.19:0/682402324 >> v2:172.21.15.42:3300/0 conn(0x7f9a10145500 0x7f9a1006ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:09.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.185+0000 7f9a0f400640 1 -- 172.21.15.19:0/682402324 >> v2:172.21.15.42:3300/0 conn(0x7f9a10145500 msgr2=0x7f9a1006ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:09.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.185+0000 7f9a0f400640 1 --2- 172.21.15.19:0/682402324 >> v2:172.21.15.42:3300/0 conn(0x7f9a10145500 0x7f9a1006ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.185+0000 7f9a0f400640 1 -- 172.21.15.19:0/682402324 >> v1:172.21.15.42:6789/0 conn(0x7f9a1015bfb0 legacy=0x7f9a100716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:09.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.185+0000 7f9a0f400640 1 -- 172.21.15.19:0/682402324 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1015cd00 con 0x7f9a10071df0 2024-03-08T06:04:09.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.187+0000 7f9a0f400640 1 --2- 172.21.15.19:0/682402324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a10071df0 0x7f9a100cc500 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9a100cf820 tx=0x7f9a0802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c81a2a833b6b41b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:09.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.187+0000 7f9a0e000640 1 -- 172.21.15.19:0/682402324 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0802e070 con 0x7f9a10071df0 2024-03-08T06:04:09.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.187+0000 7f9a0e000640 1 -- 172.21.15.19:0/682402324 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a08037070 con 0x7f9a10071df0 2024-03-08T06:04:09.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.187+0000 7f9a0e000640 1 -- 172.21.15.19:0/682402324 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08031a00 con 0x7f9a10071df0 2024-03-08T06:04:09.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.187+0000 7f9a0fe00640 1 -- 172.21.15.19:0/682402324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a10071df0 msgr2=0x7f9a100cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:09.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.187+0000 7f9a0fe00640 1 --2- 172.21.15.19:0/682402324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a10071df0 0x7f9a100cc500 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9a100cf820 tx=0x7f9a0802b880 comp rx=0 tx=0).stop 2024-03-08T06:04:09.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.188+0000 7f9a0fe00640 1 -- 172.21.15.19:0/682402324 shutdown_connections 2024-03-08T06:04:09.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.188+0000 7f9a0fe00640 1 --2- 172.21.15.19:0/682402324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a10071df0 0x7f9a100cc500 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.188+0000 7f9a0fe00640 1 --2- 172.21.15.19:0/682402324 >> v2:172.21.15.42:3300/0 conn(0x7f9a10145500 0x7f9a1006ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.188+0000 7f9a0fe00640 1 -- 172.21.15.19:0/682402324 >> 172.21.15.19:0/682402324 conn(0x7f9a100b1850 msgr2=0x7f9a100b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:09.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.188+0000 7f9a0fe00640 1 -- 172.21.15.19:0/682402324 shutdown_connections 2024-03-08T06:04:09.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.188+0000 7f9a0fe00640 1 -- 172.21.15.19:0/682402324 wait complete. 2024-03-08T06:04:09.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.190+0000 7f9a0fe00640 1 Processor -- start 2024-03-08T06:04:09.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.190+0000 7f9a0fe00640 1 -- start start 2024-03-08T06:04:09.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.191+0000 7f9a0fe00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a10071df0 0x7f9a101584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.191+0000 7f9a0fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a10145500 0x7f9a101392d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.191+0000 7f9a0fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a1015bfb0 0x7f9a101f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.191+0000 7f9a0fe00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100ccbc0 con 0x7f9a1015bfb0 2024-03-08T06:04:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.191+0000 7f9a0fe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100cca40 con 0x7f9a10145500 2024-03-08T06:04:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.191+0000 7f9a0fe00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100ccd40 con 0x7f9a10071df0 2024-03-08T06:04:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.191+0000 7f9a0f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a1015bfb0 0x7f9a101f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.191+0000 7f9a0ea00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a10071df0 0x7f9a101584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.191+0000 7f9a0f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a1015bfb0 0x7f9a101f35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55878/0 (socket says 172.21.15.19:55878) 2024-03-08T06:04:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.191+0000 7f9a0f400640 1 -- 172.21.15.19:0/2297357107 learned_addr learned my addr 172.21.15.19:0/2297357107 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.192+0000 7f9a06000640 1 --2- 172.21.15.19:0/2297357107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a10145500 0x7f9a101392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.192+0000 7f9a0f400640 1 -- 172.21.15.19:0/2297357107 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a10071df0 msgr2=0x7f9a101584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.192+0000 7f9a0f400640 1 --2- 172.21.15.19:0/2297357107 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a10071df0 0x7f9a101584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.192+0000 7f9a0f400640 1 -- 172.21.15.19:0/2297357107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a10145500 msgr2=0x7f9a101392d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.192+0000 7f9a0f400640 1 --2- 172.21.15.19:0/2297357107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a10145500 0x7f9a101392d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.192+0000 7f9a0f400640 1 -- 172.21.15.19:0/2297357107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a101f3b20 con 0x7f9a1015bfb0 2024-03-08T06:04:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.192+0000 7f9a06000640 1 --2- 172.21.15.19:0/2297357107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a10145500 0x7f9a101392d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.192+0000 7f9a0f400640 1 --2- 172.21.15.19:0/2297357107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a1015bfb0 0x7f9a101f35e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9a080090b0 tx=0x7f9a080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.193+0000 7f9a07e00640 1 -- 172.21.15.19:0/2297357107 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08032670 con 0x7f9a1015bfb0 2024-03-08T06:04:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.193+0000 7f9a07e00640 1 -- 172.21.15.19:0/2297357107 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a08032810 con 0x7f9a1015bfb0 2024-03-08T06:04:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.193+0000 7f9a0fe00640 1 -- 172.21.15.19:0/2297357107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a101f3dc0 con 0x7f9a1015bfb0 2024-03-08T06:04:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.193+0000 7f9a07e00640 1 -- 172.21.15.19:0/2297357107 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08032c00 con 0x7f9a1015bfb0 2024-03-08T06:04:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.193+0000 7f9a0fe00640 1 -- 172.21.15.19:0/2297357107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a101f4380 con 0x7f9a1015bfb0 2024-03-08T06:04:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.194+0000 7f9a0fe00640 1 -- 172.21.15.19:0/2297357107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a10075090 con 0x7f9a1015bfb0 2024-03-08T06:04:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.195+0000 7f9a07e00640 1 -- 172.21.15.19:0/2297357107 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9a0804c060 con 0x7f9a1015bfb0 2024-03-08T06:04:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.196+0000 7f9a07e00640 1 --2- 172.21.15.19:0/2297357107 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f99ec06b4d0 0x7f99ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.196+0000 7f9a07e00640 1 -- 172.21.15.19:0/2297357107 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9a080abad0 con 0x7f9a1015bfb0 2024-03-08T06:04:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.196+0000 7f9a0ea00640 1 --2- 172.21.15.19:0/2297357107 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f99ec06b4d0 0x7f99ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.197+0000 7f9a0ea00640 1 --2- 172.21.15.19:0/2297357107 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f99ec06b4d0 0x7f99ec06d990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9a00003b80 tx=0x7f9a000098d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.200+0000 7f9a07e00640 1 -- 172.21.15.19:0/2297357107 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9a08040070 con 0x7f9a1015bfb0 2024-03-08T06:04:09.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.399+0000 7f9a0fe00640 1 -- 172.21.15.19:0/2297357107 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9a1006ed50 con 0x7f9a1015bfb0 2024-03-08T06:04:09.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.400+0000 7f9a07e00640 1 -- 172.21.15.19:0/2297357107 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9a0807a830 con 0x7f9a1015bfb0 2024-03-08T06:04:09.400 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-08T06:04:09.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.403+0000 7f9a0fe00640 1 -- 172.21.15.19:0/2297357107 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f99ec06b4d0 msgr2=0x7f99ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:09.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.403+0000 7f9a0fe00640 1 --2- 172.21.15.19:0/2297357107 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f99ec06b4d0 0x7f99ec06d990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9a00003b80 tx=0x7f9a000098d0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.403+0000 7f9a0fe00640 1 -- 172.21.15.19:0/2297357107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a1015bfb0 msgr2=0x7f9a101f35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:09.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.403+0000 7f9a0fe00640 1 --2- 172.21.15.19:0/2297357107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a1015bfb0 0x7f9a101f35e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9a080090b0 tx=0x7f9a080046c0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.403+0000 7f9a0fe00640 1 -- 172.21.15.19:0/2297357107 shutdown_connections 2024-03-08T06:04:09.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.403+0000 7f9a0fe00640 1 --2- 172.21.15.19:0/2297357107 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f99ec06b4d0 0x7f99ec06d990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.403+0000 7f9a0fe00640 1 --2- 172.21.15.19:0/2297357107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a1015bfb0 0x7f9a101f35e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.403+0000 7f9a0fe00640 1 --2- 172.21.15.19:0/2297357107 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a10145500 0x7f9a101392d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.403+0000 7f9a0fe00640 1 --2- 172.21.15.19:0/2297357107 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a10071df0 0x7f9a101584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.403+0000 7f9a0fe00640 1 -- 172.21.15.19:0/2297357107 >> 172.21.15.19:0/2297357107 conn(0x7f9a100b1850 msgr2=0x7f9a100b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:09.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.403+0000 7f9a0fe00640 1 -- 172.21.15.19:0/2297357107 shutdown_connections 2024-03-08T06:04:09.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.403+0000 7f9a0fe00640 1 -- 172.21.15.19:0/2297357107 wait complete. 2024-03-08T06:04:09.423 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-08T06:04:09.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.648+0000 7f702de00640 1 Processor -- start 2024-03-08T06:04:09.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.648+0000 7f702de00640 1 -- start start 2024-03-08T06:04:09.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.650+0000 7f702de00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f70281451b0 0x7f702815ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:09.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.650+0000 7f702de00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f702806f050 0x7f7028071400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:09.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.650+0000 7f702de00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702815cf70 con 0x7f7028071940 2024-03-08T06:04:09.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.650+0000 7f702de00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702806d600 con 0x7f70281451b0 2024-03-08T06:04:09.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.650+0000 7f702de00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702806d8e0 con 0x7f702806f050 2024-03-08T06:04:09.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.650+0000 7f702ca00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f70281451b0 0x7f702815ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:09.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.650+0000 7f702ca00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f70281451b0 0x7f702815ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55880/0 (socket says 172.21.15.19:55880) 2024-03-08T06:04:09.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.650+0000 7f702ca00640 1 -- 172.21.15.19:0/530037262 learned_addr learned my addr 172.21.15.19:0/530037262 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:09.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.651+0000 7f702ca00640 1 -- 172.21.15.19:0/530037262 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f702806f050 msgr2=0x7f7028071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:09.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.651+0000 7f702ca00640 1 --2- 172.21.15.19:0/530037262 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f702806f050 0x7f7028071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.651+0000 7f702ca00640 1 -- 172.21.15.19:0/530037262 >> v1:172.21.15.42:6789/0 conn(0x7f7028071940 legacy=0x7f702815f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:09.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.651+0000 7f702ca00640 1 -- 172.21.15.19:0/530037262 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702806dbc0 con 0x7f70281451b0 2024-03-08T06:04:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.652+0000 7f702ca00640 1 --2- 172.21.15.19:0/530037262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70281451b0 0x7f702815ca30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f701c009870 tx=0x7f701c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2927c2e73e6233e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.652+0000 7f7027400640 1 -- 172.21.15.19:0/530037262 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c035020 con 0x7f70281451b0 2024-03-08T06:04:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.652+0000 7f7027400640 1 -- 172.21.15.19:0/530037262 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701c031640 con 0x7f70281451b0 2024-03-08T06:04:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.652+0000 7f7027400640 1 -- 172.21.15.19:0/530037262 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c02d040 con 0x7f70281451b0 2024-03-08T06:04:09.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.653+0000 7f702de00640 1 -- 172.21.15.19:0/530037262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70281451b0 msgr2=0x7f702815ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:09.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.653+0000 7f702de00640 1 --2- 172.21.15.19:0/530037262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70281451b0 0x7f702815ca30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f701c009870 tx=0x7f701c02b8f0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.653+0000 7f702de00640 1 -- 172.21.15.19:0/530037262 shutdown_connections 2024-03-08T06:04:09.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.653+0000 7f702de00640 1 --2- 172.21.15.19:0/530037262 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f702806f050 0x7f7028071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.653+0000 7f702de00640 1 --2- 172.21.15.19:0/530037262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70281451b0 0x7f702815ca30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.653+0000 7f702de00640 1 -- 172.21.15.19:0/530037262 >> 172.21.15.19:0/530037262 conn(0x7f70280b1590 msgr2=0x7f70280b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:09.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.653+0000 7f702de00640 1 -- 172.21.15.19:0/530037262 shutdown_connections 2024-03-08T06:04:09.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.653+0000 7f702de00640 1 -- 172.21.15.19:0/530037262 wait complete. 2024-03-08T06:04:09.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.655+0000 7f702de00640 1 Processor -- start 2024-03-08T06:04:09.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.655+0000 7f702de00640 1 -- start start 2024-03-08T06:04:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.656+0000 7f702de00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f702806f050 0x7f7028141d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.656+0000 7f702de00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7028071940 0x7f70281e5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.656+0000 7f702de00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70281451b0 0x7f70280b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.656+0000 7f702de00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7028145710 con 0x7f70281451b0 2024-03-08T06:04:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.656+0000 7f702de00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7028145590 con 0x7f702806f050 2024-03-08T06:04:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.656+0000 7f702de00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702815e1b0 con 0x7f7028071940 2024-03-08T06:04:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.656+0000 7f702d400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70281451b0 0x7f70280b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.657+0000 7f702d400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70281451b0 0x7f70280b34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55884/0 (socket says 172.21.15.19:55884) 2024-03-08T06:04:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.657+0000 7f702d400640 1 -- 172.21.15.19:0/753458887 learned_addr learned my addr 172.21.15.19:0/753458887 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.657+0000 7f702ca00640 1 --2- 172.21.15.19:0/753458887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f702806f050 0x7f7028141d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.657+0000 7f7027e00640 1 --2- 172.21.15.19:0/753458887 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7028071940 0x7f70281e5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.657+0000 7f702d400640 1 -- 172.21.15.19:0/753458887 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7028071940 msgr2=0x7f70281e5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.657+0000 7f702d400640 1 --2- 172.21.15.19:0/753458887 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7028071940 0x7f70281e5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.657+0000 7f702d400640 1 -- 172.21.15.19:0/753458887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f702806f050 msgr2=0x7f7028141d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.657+0000 7f702d400640 1 --2- 172.21.15.19:0/753458887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f702806f050 0x7f7028141d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.657+0000 7f702d400640 1 -- 172.21.15.19:0/753458887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70280b2a30 con 0x7f70281451b0 2024-03-08T06:04:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.657+0000 7f702ca00640 1 --2- 172.21.15.19:0/753458887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f702806f050 0x7f7028141d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.657+0000 7f7027e00640 1 --2- 172.21.15.19:0/753458887 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7028071940 0x7f70281e5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.657+0000 7f702d400640 1 --2- 172.21.15.19:0/753458887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70281451b0 0x7f70280b34a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f702000c780 tx=0x7f702000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:09.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.658+0000 7f7024c00640 1 -- 172.21.15.19:0/753458887 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7020004b60 con 0x7f70281451b0 2024-03-08T06:04:09.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.658+0000 7f7024c00640 1 -- 172.21.15.19:0/753458887 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7020004d00 con 0x7f70281451b0 2024-03-08T06:04:09.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.658+0000 7f7024c00640 1 -- 172.21.15.19:0/753458887 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702000aa90 con 0x7f70281451b0 2024-03-08T06:04:09.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.658+0000 7f702de00640 1 -- 172.21.15.19:0/753458887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70280b2ca0 con 0x7f70281451b0 2024-03-08T06:04:09.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.658+0000 7f702de00640 1 -- 172.21.15.19:0/753458887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70281e60d0 con 0x7f70281451b0 2024-03-08T06:04:09.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.659+0000 7f702de00640 1 -- 172.21.15.19:0/753458887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7028075090 con 0x7f70281451b0 2024-03-08T06:04:09.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.660+0000 7f7024c00640 1 -- 172.21.15.19:0/753458887 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f702000ac30 con 0x7f70281451b0 2024-03-08T06:04:09.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.661+0000 7f7024c00640 1 --2- 172.21.15.19:0/753458887 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f700806b4d0 0x7f700806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:09.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.661+0000 7f7024c00640 1 -- 172.21.15.19:0/753458887 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f702008a670 con 0x7f70281451b0 2024-03-08T06:04:09.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.661+0000 7f702ca00640 1 --2- 172.21.15.19:0/753458887 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f700806b4d0 0x7f700806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:09.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.662+0000 7f702ca00640 1 --2- 172.21.15.19:0/753458887 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f700806b4d0 0x7f700806d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f701c036000 tx=0x7f701c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:09.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.666+0000 7f7024c00640 1 -- 172.21.15.19:0/753458887 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7020020070 con 0x7f70281451b0 2024-03-08T06:04:09.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.876+0000 7f702de00640 1 -- 172.21.15.19:0/753458887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7028143980 con 0x7f70281451b0 2024-03-08T06:04:09.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.877+0000 7f7024c00640 1 -- 172.21.15.19:0/753458887 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7020059340 con 0x7f70281451b0 2024-03-08T06:04:09.877 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-08T06:04:09.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.880+0000 7f702de00640 1 -- 172.21.15.19:0/753458887 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f700806b4d0 msgr2=0x7f700806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:09.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.880+0000 7f702de00640 1 --2- 172.21.15.19:0/753458887 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f700806b4d0 0x7f700806d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f701c036000 tx=0x7f701c03c040 comp rx=0 tx=0).stop 2024-03-08T06:04:09.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.880+0000 7f702de00640 1 -- 172.21.15.19:0/753458887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70281451b0 msgr2=0x7f70280b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:09.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.880+0000 7f702de00640 1 --2- 172.21.15.19:0/753458887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70281451b0 0x7f70280b34a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f702000c780 tx=0x7f702000cc40 comp rx=0 tx=0).stop 2024-03-08T06:04:09.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.880+0000 7f702de00640 1 -- 172.21.15.19:0/753458887 shutdown_connections 2024-03-08T06:04:09.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.880+0000 7f702de00640 1 --2- 172.21.15.19:0/753458887 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f700806b4d0 0x7f700806d990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.880+0000 7f702de00640 1 --2- 172.21.15.19:0/753458887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70281451b0 0x7f70280b34a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.880+0000 7f702de00640 1 --2- 172.21.15.19:0/753458887 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7028071940 0x7f70281e5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.880+0000 7f702de00640 1 --2- 172.21.15.19:0/753458887 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f702806f050 0x7f7028141d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:09.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.880+0000 7f702de00640 1 -- 172.21.15.19:0/753458887 >> 172.21.15.19:0/753458887 conn(0x7f70280b1590 msgr2=0x7f7028142ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:09.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.880+0000 7f702de00640 1 -- 172.21.15.19:0/753458887 shutdown_connections 2024-03-08T06:04:09.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:09.880+0000 7f702de00640 1 -- 172.21.15.19:0/753458887 wait complete. 2024-03-08T06:04:09.901 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-03-08T06:04:09.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:09.901 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-03-08T06:04:09.999 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-03-08T06:04:09.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:09.999 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-08T06:04:10.052 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:04:10.052 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:04:10.111 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:04:10.112 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:04:10.170 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:04:10.170 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:04:10.224 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:04:10.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.460+0000 7f9a0fe00640 1 Processor -- start 2024-03-08T06:04:10.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.460+0000 7f9a0fe00640 1 -- start start 2024-03-08T06:04:10.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.462+0000 7f9a0fe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9a10145520 0x7f9a1015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:10.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.462+0000 7f9a0fe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9a1015bea0 0x7f9a100716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:10.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.462+0000 7f9a0fe00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1015ceb0 con 0x7f9a100af040 2024-03-08T06:04:10.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.462+0000 7f9a0fe00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1015c330 con 0x7f9a10145520 2024-03-08T06:04:10.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.462+0000 7f9a0fe00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1015c610 con 0x7f9a1015bea0 2024-03-08T06:04:10.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.462+0000 7f9a0ea00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9a10145520 0x7f9a1015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:10.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.462+0000 7f9a0ea00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9a10145520 0x7f9a1015d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55890/0 (socket says 172.21.15.19:55890) 2024-03-08T06:04:10.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.462+0000 7f9a0ea00640 1 -- 172.21.15.19:0/2547044517 learned_addr learned my addr 172.21.15.19:0/2547044517 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:10.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.463+0000 7f9a06000640 1 --2- 172.21.15.19:0/2547044517 >> v2:172.21.15.42:3300/0 conn(0x7f9a1015bea0 0x7f9a100716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:10.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.463+0000 7f9a0ea00640 1 -- 172.21.15.19:0/2547044517 >> v2:172.21.15.42:3300/0 conn(0x7f9a1015bea0 msgr2=0x7f9a100716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:10.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.463+0000 7f9a0ea00640 1 --2- 172.21.15.19:0/2547044517 >> v2:172.21.15.42:3300/0 conn(0x7f9a1015bea0 0x7f9a100716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:10.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.463+0000 7f9a0ea00640 1 -- 172.21.15.19:0/2547044517 >> v1:172.21.15.42:6789/0 conn(0x7f9a100af040 legacy=0x7f9a1006d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:10.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.463+0000 7f9a0ea00640 1 -- 172.21.15.19:0/2547044517 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1015c8f0 con 0x7f9a10145520 2024-03-08T06:04:10.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.463+0000 7f9a06000640 1 --2- 172.21.15.19:0/2547044517 >> v2:172.21.15.42:3300/0 conn(0x7f9a1015bea0 0x7f9a100716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:10.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.464+0000 7f9a0ea00640 1 --2- 172.21.15.19:0/2547044517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a10145520 0x7f9a1015d0a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9a1006be10 tx=0x7f9a0002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e0ce377e856b57 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:10.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.464+0000 7f9a0e000640 1 -- 172.21.15.19:0/2547044517 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0002ca80 con 0x7f9a10145520 2024-03-08T06:04:10.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.464+0000 7f9a0e000640 1 -- 172.21.15.19:0/2547044517 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0002cc20 con 0x7f9a10145520 2024-03-08T06:04:10.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.464+0000 7f9a0e000640 1 -- 172.21.15.19:0/2547044517 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a000343f0 con 0x7f9a10145520 2024-03-08T06:04:10.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.465+0000 7f9a0fe00640 1 -- 172.21.15.19:0/2547044517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a10145520 msgr2=0x7f9a1015d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:10.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.465+0000 7f9a0fe00640 1 --2- 172.21.15.19:0/2547044517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a10145520 0x7f9a1015d0a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9a1006be10 tx=0x7f9a0002bee0 comp rx=0 tx=0).stop 2024-03-08T06:04:10.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.465+0000 7f9a0fe00640 1 -- 172.21.15.19:0/2547044517 shutdown_connections 2024-03-08T06:04:10.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.465+0000 7f9a0fe00640 1 --2- 172.21.15.19:0/2547044517 >> v2:172.21.15.42:3300/0 conn(0x7f9a1015bea0 0x7f9a100716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:10.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.465+0000 7f9a0fe00640 1 --2- 172.21.15.19:0/2547044517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a10145520 0x7f9a1015d0a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:10.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.465+0000 7f9a0fe00640 1 -- 172.21.15.19:0/2547044517 >> 172.21.15.19:0/2547044517 conn(0x7f9a100b1850 msgr2=0x7f9a100b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:10.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.465+0000 7f9a0fe00640 1 -- 172.21.15.19:0/2547044517 shutdown_connections 2024-03-08T06:04:10.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.465+0000 7f9a0fe00640 1 -- 172.21.15.19:0/2547044517 wait complete. 2024-03-08T06:04:10.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.467+0000 7f9a0fe00640 1 Processor -- start 2024-03-08T06:04:10.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.467+0000 7f9a0fe00640 1 -- start start 2024-03-08T06:04:10.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.468+0000 7f9a0fe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a100af040 0x7f9a1015abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:10.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.468+0000 7f9a0fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a10145520 0x7f9a1015fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:10.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.468+0000 7f9a0fe00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a10143a30 0x7f9a1013fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:10.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.468+0000 7f9a0fe00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1006e590 con 0x7f9a10145520 2024-03-08T06:04:10.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.468+0000 7f9a0fe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1006e410 con 0x7f9a100af040 2024-03-08T06:04:10.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.468+0000 7f9a0fe00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1006e710 con 0x7f9a10143a30 2024-03-08T06:04:10.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.468+0000 7f9a06000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a10145520 0x7f9a1015fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:10.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.468+0000 7f9a06000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a10145520 0x7f9a1015fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55898/0 (socket says 172.21.15.19:55898) 2024-03-08T06:04:10.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.468+0000 7f9a06000640 1 -- 172.21.15.19:0/1387407198 learned_addr learned my addr 172.21.15.19:0/1387407198 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:10.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.468+0000 7f9a0ea00640 1 --2- 172.21.15.19:0/1387407198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a100af040 0x7f9a1015abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:10.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.469+0000 7f9a06000640 1 -- 172.21.15.19:0/1387407198 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a10143a30 msgr2=0x7f9a1013fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:10.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.469+0000 7f9a0f400640 1 --2- 172.21.15.19:0/1387407198 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a10143a30 0x7f9a1013fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:10.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.469+0000 7f9a06000640 1 --2- 172.21.15.19:0/1387407198 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a10143a30 0x7f9a1013fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:10.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.469+0000 7f9a06000640 1 -- 172.21.15.19:0/1387407198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a100af040 msgr2=0x7f9a1015abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:10.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.469+0000 7f9a06000640 1 --2- 172.21.15.19:0/1387407198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a100af040 0x7f9a1015abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:10.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.469+0000 7f9a06000640 1 -- 172.21.15.19:0/1387407198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a101426b0 con 0x7f9a10145520 2024-03-08T06:04:10.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.469+0000 7f9a0f400640 1 --2- 172.21.15.19:0/1387407198 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a10143a30 0x7f9a1013fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:10.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.469+0000 7f9a06000640 1 --2- 172.21.15.19:0/1387407198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a10145520 0x7f9a1015fd40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f99f800c7f0 tx=0x7f99f800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:10.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.469+0000 7f9a07400640 1 -- 172.21.15.19:0/1387407198 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8015070 con 0x7f9a10145520 2024-03-08T06:04:10.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.469+0000 7f9a07400640 1 -- 172.21.15.19:0/1387407198 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f8007a30 con 0x7f9a10145520 2024-03-08T06:04:10.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.469+0000 7f9a07400640 1 -- 172.21.15.19:0/1387407198 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8007e00 con 0x7f9a10145520 2024-03-08T06:04:10.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.469+0000 7f9a0fe00640 1 -- 172.21.15.19:0/1387407198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a10142990 con 0x7f9a10145520 2024-03-08T06:04:10.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.470+0000 7f9a0fe00640 1 -- 172.21.15.19:0/1387407198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a10142f50 con 0x7f9a10145520 2024-03-08T06:04:10.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.471+0000 7f9a0fe00640 1 -- 172.21.15.19:0/1387407198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a10075100 con 0x7f9a10145520 2024-03-08T06:04:10.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.472+0000 7f9a07400640 1 -- 172.21.15.19:0/1387407198 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f99f8018070 con 0x7f9a10145520 2024-03-08T06:04:10.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.472+0000 7f9a07400640 1 --2- 172.21.15.19:0/1387407198 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f99ec06b500 0x7f99ec06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:10.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.473+0000 7f9a07400640 1 -- 172.21.15.19:0/1387407198 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f99f808a2b0 con 0x7f9a10145520 2024-03-08T06:04:10.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.473+0000 7f9a0ea00640 1 --2- 172.21.15.19:0/1387407198 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f99ec06b500 0x7f99ec06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:10.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.474+0000 7f9a0ea00640 1 --2- 172.21.15.19:0/1387407198 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f99ec06b500 0x7f99ec06d9c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9a00035000 tx=0x7f9a00030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:10.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.480+0000 7f9a07400640 1 -- 172.21.15.19:0/1387407198 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f99f8059010 con 0x7f9a10145520 2024-03-08T06:04:10.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.679+0000 7f9a0fe00640 1 -- 172.21.15.19:0/1387407198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a100af5f0 con 0x7f9a10145520 2024-03-08T06:04:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.681+0000 7f9a07400640 1 -- 172.21.15.19:0/1387407198 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16795 (secure 0 0 0) 0x7f99f8058910 con 0x7f9a10145520 2024-03-08T06:04:10.682 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:10.682 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":23,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:04:07.332571+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:03:18.392703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T06:03:19.537912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:04:10.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.684+0000 7f9a0fe00640 1 -- 172.21.15.19:0/1387407198 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f99ec06b500 msgr2=0x7f99ec06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:10.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.684+0000 7f9a0fe00640 1 --2- 172.21.15.19:0/1387407198 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f99ec06b500 0x7f99ec06d9c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9a00035000 tx=0x7f9a00030000 comp rx=0 tx=0).stop 2024-03-08T06:04:10.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.684+0000 7f9a0fe00640 1 -- 172.21.15.19:0/1387407198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a10145520 msgr2=0x7f9a1015fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.684+0000 7f9a0fe00640 1 --2- 172.21.15.19:0/1387407198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a10145520 0x7f9a1015fd40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f99f800c7f0 tx=0x7f99f800cbf0 comp rx=0 tx=0).stop 2024-03-08T06:04:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.684+0000 7f9a0fe00640 1 -- 172.21.15.19:0/1387407198 shutdown_connections 2024-03-08T06:04:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.684+0000 7f9a0fe00640 1 --2- 172.21.15.19:0/1387407198 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f99ec06b500 0x7f99ec06d9c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.684+0000 7f9a0fe00640 1 --2- 172.21.15.19:0/1387407198 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9a10143a30 0x7f9a1013fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.684+0000 7f9a0fe00640 1 --2- 172.21.15.19:0/1387407198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a10145520 0x7f9a1015fd40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.684+0000 7f9a0fe00640 1 --2- 172.21.15.19:0/1387407198 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a100af040 0x7f9a1015abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.684+0000 7f9a0fe00640 1 -- 172.21.15.19:0/1387407198 >> 172.21.15.19:0/1387407198 conn(0x7f9a100b1850 msgr2=0x7f9a100b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.684+0000 7f9a0fe00640 1 -- 172.21.15.19:0/1387407198 shutdown_connections 2024-03-08T06:04:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.685+0000 7f9a0fe00640 1 -- 172.21.15.19:0/1387407198 wait complete. 2024-03-08T06:04:10.705 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T06:03:14.149736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T06:03:18.392703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T06:03:19.537912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T06:04:10.705 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T06:04:10.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.927+0000 7f285d800640 1 Processor -- start 2024-03-08T06:04:10.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.927+0000 7f285d800640 1 -- start start 2024-03-08T06:04:10.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.928+0000 7f285d800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f285815dcd0 0x7f285806ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:10.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.929+0000 7f285d800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f285815e0b0 0x7f285806b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:10.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.929+0000 7f285d800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28580afce0 con 0x7f28580d0550 2024-03-08T06:04:10.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.929+0000 7f285d800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28580d16f0 con 0x7f285815e0b0 2024-03-08T06:04:10.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.929+0000 7f285d800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28580adbc0 con 0x7f285815dcd0 2024-03-08T06:04:10.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.929+0000 7f2857400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f285815e0b0 0x7f285806b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:10.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.929+0000 7f2857400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f285815e0b0 0x7f285806b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.19:49492/0 (socket says 172.21.15.19:49492) 2024-03-08T06:04:10.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.929+0000 7f2857400640 1 -- 172.21.15.19:0/552903243 learned_addr learned my addr 172.21.15.19:0/552903243 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:10.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.929+0000 7f2857e00640 1 --2- 172.21.15.19:0/552903243 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f285815dcd0 0x7f285806ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:10.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.930+0000 7f2857400640 1 -- 172.21.15.19:0/552903243 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f285815dcd0 msgr2=0x7f285806ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:10.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.930+0000 7f2857400640 1 --2- 172.21.15.19:0/552903243 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f285815dcd0 0x7f285806ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:10.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.930+0000 7f2857400640 1 -- 172.21.15.19:0/552903243 >> v1:172.21.15.42:6789/0 conn(0x7f28580d0550 legacy=0x7f28581619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:10.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.930+0000 7f2857400640 1 -- 172.21.15.19:0/552903243 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28580d1130 con 0x7f285815e0b0 2024-03-08T06:04:10.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.932+0000 7f2857400640 1 --2- 172.21.15.19:0/552903243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f285815e0b0 0x7f285806b190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2844009870 tx=0x7f284402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=369d62c9d30ca7b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:10.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.932+0000 7f2856a00640 1 -- 172.21.15.19:0/552903243 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844035020 con 0x7f285815e0b0 2024-03-08T06:04:10.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.932+0000 7f2856a00640 1 -- 172.21.15.19:0/552903243 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2844031640 con 0x7f285815e0b0 2024-03-08T06:04:10.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.932+0000 7f2856a00640 1 -- 172.21.15.19:0/552903243 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284402d040 con 0x7f285815e0b0 2024-03-08T06:04:10.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.933+0000 7f285d800640 1 -- 172.21.15.19:0/552903243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f285815e0b0 msgr2=0x7f285806b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:10.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.933+0000 7f285d800640 1 --2- 172.21.15.19:0/552903243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f285815e0b0 0x7f285806b190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2844009870 tx=0x7f284402b8f0 comp rx=0 tx=0).stop 2024-03-08T06:04:10.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.933+0000 7f285d800640 1 -- 172.21.15.19:0/552903243 shutdown_connections 2024-03-08T06:04:10.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.933+0000 7f285d800640 1 --2- 172.21.15.19:0/552903243 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f285815e0b0 0x7f285806b190 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:10.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.933+0000 7f285d800640 1 --2- 172.21.15.19:0/552903243 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f285815dcd0 0x7f285806ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:10.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.933+0000 7f285d800640 1 -- 172.21.15.19:0/552903243 >> 172.21.15.19:0/552903243 conn(0x7f2858099a70 msgr2=0x7f2858099e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:10.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.933+0000 7f285d800640 1 -- 172.21.15.19:0/552903243 shutdown_connections 2024-03-08T06:04:10.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.933+0000 7f285d800640 1 -- 172.21.15.19:0/552903243 wait complete. 2024-03-08T06:04:10.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.935+0000 7f285d800640 1 Processor -- start 2024-03-08T06:04:10.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.936+0000 7f285d800640 1 -- start start 2024-03-08T06:04:10.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.937+0000 7f285d800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f28580d0550 0x7f285815ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:10.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.937+0000 7f285d800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f285815dcd0 0x7f285815eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:10.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.937+0000 7f285d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f285815e0b0 0x7f285815f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:10.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.937+0000 7f285d800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28580af060 con 0x7f285815dcd0 2024-03-08T06:04:10.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.937+0000 7f285d800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28580ad850 con 0x7f285815e0b0 2024-03-08T06:04:10.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.937+0000 7f285d800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28580af1e0 con 0x7f28580d0550 2024-03-08T06:04:10.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.937+0000 7f2857400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f285815dcd0 0x7f285815eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:10.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.937+0000 7f2857400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f285815dcd0 0x7f285815eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55900/0 (socket says 172.21.15.19:55900) 2024-03-08T06:04:10.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.937+0000 7f2857400640 1 -- 172.21.15.19:0/2151063335 learned_addr learned my addr 172.21.15.19:0/2151063335 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:10.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.937+0000 7f2857e00640 1 --2- 172.21.15.19:0/2151063335 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f28580d0550 0x7f285815ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:10.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.937+0000 7f285ce00640 1 --2- 172.21.15.19:0/2151063335 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f285815e0b0 0x7f285815f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:10.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.938+0000 7f2857400640 1 -- 172.21.15.19:0/2151063335 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f28580d0550 msgr2=0x7f285815ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:10.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.938+0000 7f2857400640 1 --2- 172.21.15.19:0/2151063335 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f28580d0550 0x7f285815ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:10.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.938+0000 7f2857400640 1 -- 172.21.15.19:0/2151063335 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f285815e0b0 msgr2=0x7f285815f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:10.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.938+0000 7f2857400640 1 --2- 172.21.15.19:0/2151063335 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f285815e0b0 0x7f285815f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:10.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.938+0000 7f2857400640 1 -- 172.21.15.19:0/2151063335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28580c9b20 con 0x7f285815dcd0 2024-03-08T06:04:10.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.938+0000 7f2857400640 1 --2- 172.21.15.19:0/2151063335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f285815dcd0 0x7f285815eec0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f284402b930 tx=0x7f28440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:10.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.938+0000 7f284fe00640 1 -- 172.21.15.19:0/2151063335 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844040070 con 0x7f285815dcd0 2024-03-08T06:04:10.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.938+0000 7f284fe00640 1 -- 172.21.15.19:0/2151063335 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284403e070 con 0x7f285815dcd0 2024-03-08T06:04:10.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.938+0000 7f285d800640 1 -- 172.21.15.19:0/2151063335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285815faa0 con 0x7f285815dcd0 2024-03-08T06:04:10.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.938+0000 7f284fe00640 1 -- 172.21.15.19:0/2151063335 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844035040 con 0x7f285815dcd0 2024-03-08T06:04:10.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.939+0000 7f285d800640 1 -- 172.21.15.19:0/2151063335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2858160060 con 0x7f285815dcd0 2024-03-08T06:04:10.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.940+0000 7f285d800640 1 -- 172.21.15.19:0/2151063335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2858075090 con 0x7f285815dcd0 2024-03-08T06:04:10.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.941+0000 7f284fe00640 1 -- 172.21.15.19:0/2151063335 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2844038020 con 0x7f285815dcd0 2024-03-08T06:04:10.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.942+0000 7f284fe00640 1 --2- 172.21.15.19:0/2151063335 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f283806b500 0x7f283806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:10.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.942+0000 7f284fe00640 1 -- 172.21.15.19:0/2151063335 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f28440abb90 con 0x7f285815dcd0 2024-03-08T06:04:10.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.942+0000 7f2857e00640 1 --2- 172.21.15.19:0/2151063335 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f283806b500 0x7f283806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:10.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.943+0000 7f2857e00640 1 --2- 172.21.15.19:0/2151063335 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f283806b500 0x7f283806d9c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2848009ad0 tx=0x7f2848008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:10.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:10.949+0000 7f284fe00640 1 -- 172.21.15.19:0/2151063335 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f28580c9b20 con 0x7f285815dcd0 2024-03-08T06:04:11.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.150+0000 7f285d800640 1 -- 172.21.15.19:0/2151063335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28580cd4c0 con 0x7f285815dcd0 2024-03-08T06:04:11.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.151+0000 7f284fe00640 1 -- 172.21.15.19:0/2151063335 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f284407a900 con 0x7f285815dcd0 2024-03-08T06:04:11.151 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-08T06:04:11.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.154+0000 7f285d800640 1 -- 172.21.15.19:0/2151063335 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f283806b500 msgr2=0x7f283806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:11.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.154+0000 7f285d800640 1 --2- 172.21.15.19:0/2151063335 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f283806b500 0x7f283806d9c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2848009ad0 tx=0x7f2848008040 comp rx=0 tx=0).stop 2024-03-08T06:04:11.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.154+0000 7f285d800640 1 -- 172.21.15.19:0/2151063335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f285815dcd0 msgr2=0x7f285815eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:11.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.154+0000 7f285d800640 1 --2- 172.21.15.19:0/2151063335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f285815dcd0 0x7f285815eec0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f284402b930 tx=0x7f28440046c0 comp rx=0 tx=0).stop 2024-03-08T06:04:11.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.154+0000 7f285d800640 1 -- 172.21.15.19:0/2151063335 shutdown_connections 2024-03-08T06:04:11.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.154+0000 7f285d800640 1 --2- 172.21.15.19:0/2151063335 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f283806b500 0x7f283806d9c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:11.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.154+0000 7f285d800640 1 --2- 172.21.15.19:0/2151063335 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f285815e0b0 0x7f285815f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:11.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.154+0000 7f285d800640 1 --2- 172.21.15.19:0/2151063335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f285815dcd0 0x7f285815eec0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:11.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.154+0000 7f285d800640 1 --2- 172.21.15.19:0/2151063335 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f28580d0550 0x7f285815ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:11.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.154+0000 7f285d800640 1 -- 172.21.15.19:0/2151063335 >> 172.21.15.19:0/2151063335 conn(0x7f2858099a70 msgr2=0x7f285806ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:11.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.154+0000 7f285d800640 1 -- 172.21.15.19:0/2151063335 shutdown_connections 2024-03-08T06:04:11.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.154+0000 7f285d800640 1 -- 172.21.15.19:0/2151063335 wait complete. 2024-03-08T06:04:11.174 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T06:04:11.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.388+0000 7fb317600640 1 Processor -- start 2024-03-08T06:04:11.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.388+0000 7fb317600640 1 -- start start 2024-03-08T06:04:11.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.390+0000 7fb317600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb3101455b0 0x7fb31015c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:11.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.390+0000 7fb317600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb3101604f0 0x7fb3100cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:11.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.390+0000 7fb317600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3100cd5a0 con 0x7fb310071950 2024-03-08T06:04:11.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.390+0000 7fb317600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3100cdc20 con 0x7fb3101604f0 2024-03-08T06:04:11.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.390+0000 7fb317600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3100ccfe0 con 0x7fb3101455b0 2024-03-08T06:04:11.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.391+0000 7fb314c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb3101455b0 0x7fb31015c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:11.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.391+0000 7fb314c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb3101455b0 0x7fb31015c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.19:58652/0 (socket says 172.21.15.19:58652) 2024-03-08T06:04:11.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.391+0000 7fb314c00640 1 -- 172.21.15.19:0/757631471 learned_addr learned my addr 172.21.15.19:0/757631471 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:11.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.391+0000 7fb307e00640 1 --2- 172.21.15.19:0/757631471 >> v2:172.21.15.42:3300/0 conn(0x7fb3101604f0 0x7fb3100cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:11.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.392+0000 7fb314c00640 1 -- 172.21.15.19:0/757631471 >> v2:172.21.15.42:3300/0 conn(0x7fb3101604f0 msgr2=0x7fb3100cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:11.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.392+0000 7fb314c00640 1 --2- 172.21.15.19:0/757631471 >> v2:172.21.15.42:3300/0 conn(0x7fb3101604f0 0x7fb3100cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:11.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.392+0000 7fb314c00640 1 -- 172.21.15.19:0/757631471 >> v1:172.21.15.42:6789/0 conn(0x7fb310071950 legacy=0x7fb3100ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:11.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.392+0000 7fb314c00640 1 -- 172.21.15.19:0/757631471 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3100cd2c0 con 0x7fb3101455b0 2024-03-08T06:04:11.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.393+0000 7fb314c00640 1 --2- 172.21.15.19:0/757631471 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb3101455b0 0x7fb31015c1d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb3100cdda0 tx=0x7fb30002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db838963c3575490 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:11.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.393+0000 7fb30fe00640 1 -- 172.21.15.19:0/757631471 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb300035020 con 0x7fb3101455b0 2024-03-08T06:04:11.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.393+0000 7fb30fe00640 1 -- 172.21.15.19:0/757631471 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb300031640 con 0x7fb3101455b0 2024-03-08T06:04:11.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.393+0000 7fb30fe00640 1 -- 172.21.15.19:0/757631471 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30002d040 con 0x7fb3101455b0 2024-03-08T06:04:11.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.394+0000 7fb317600640 1 -- 172.21.15.19:0/757631471 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb3101455b0 msgr2=0x7fb31015c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:11.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.394+0000 7fb317600640 1 --2- 172.21.15.19:0/757631471 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb3101455b0 0x7fb31015c1d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb3100cdda0 tx=0x7fb30002b8f0 comp rx=0 tx=0).stop 2024-03-08T06:04:11.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.394+0000 7fb317600640 1 -- 172.21.15.19:0/757631471 shutdown_connections 2024-03-08T06:04:11.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.394+0000 7fb317600640 1 --2- 172.21.15.19:0/757631471 >> v2:172.21.15.42:3300/0 conn(0x7fb3101604f0 0x7fb3100cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:11.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.394+0000 7fb317600640 1 --2- 172.21.15.19:0/757631471 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb3101455b0 0x7fb31015c1d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:11.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.394+0000 7fb317600640 1 -- 172.21.15.19:0/757631471 >> 172.21.15.19:0/757631471 conn(0x7fb31006ae30 msgr2=0x7fb31006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:11.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.395+0000 7fb317600640 1 -- 172.21.15.19:0/757631471 shutdown_connections 2024-03-08T06:04:11.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.395+0000 7fb317600640 1 -- 172.21.15.19:0/757631471 wait complete. 2024-03-08T06:04:11.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.397+0000 7fb317600640 1 Processor -- start 2024-03-08T06:04:11.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.397+0000 7fb317600640 1 -- start start 2024-03-08T06:04:11.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.398+0000 7fb317600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb310071950 0x7fb310135210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:11.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.398+0000 7fb317600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3101455b0 0x7fb31013dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:11.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.398+0000 7fb317600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3101604f0 0x7fb31013e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:11.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.398+0000 7fb317600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb310145990 con 0x7fb3101604f0 2024-03-08T06:04:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.398+0000 7fb317600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31015c710 con 0x7fb3101455b0 2024-03-08T06:04:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.398+0000 7fb317600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3100ccbd0 con 0x7fb310071950 2024-03-08T06:04:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.399+0000 7fb315600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3101604f0 0x7fb31013e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.399+0000 7fb315600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3101604f0 0x7fb31013e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55916/0 (socket says 172.21.15.19:55916) 2024-03-08T06:04:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.399+0000 7fb315600640 1 -- 172.21.15.19:0/1383146398 learned_addr learned my addr 172.21.15.19:0/1383146398 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.399+0000 7fb314c00640 1 --2- 172.21.15.19:0/1383146398 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb310071950 0x7fb310135210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.399+0000 7fb307e00640 1 --2- 172.21.15.19:0/1383146398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3101455b0 0x7fb31013dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.399+0000 7fb315600640 1 -- 172.21.15.19:0/1383146398 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb310071950 msgr2=0x7fb310135210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.399+0000 7fb315600640 1 --2- 172.21.15.19:0/1383146398 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb310071950 0x7fb310135210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.399+0000 7fb315600640 1 -- 172.21.15.19:0/1383146398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3101455b0 msgr2=0x7fb31013dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.399+0000 7fb315600640 1 --2- 172.21.15.19:0/1383146398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3101455b0 0x7fb31013dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.399+0000 7fb315600640 1 -- 172.21.15.19:0/1383146398 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3100b0bc0 con 0x7fb3101604f0 2024-03-08T06:04:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.399+0000 7fb315600640 1 --2- 172.21.15.19:0/1383146398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3101604f0 0x7fb31013e530 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb30800c780 tx=0x7fb30800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:11.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.400+0000 7fb30d600640 1 -- 172.21.15.19:0/1383146398 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb308004b60 con 0x7fb3101604f0 2024-03-08T06:04:11.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.400+0000 7fb30d600640 1 -- 172.21.15.19:0/1383146398 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb308004d00 con 0x7fb3101604f0 2024-03-08T06:04:11.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.400+0000 7fb30d600640 1 -- 172.21.15.19:0/1383146398 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30800aa90 con 0x7fb3101604f0 2024-03-08T06:04:11.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.400+0000 7fb317600640 1 -- 172.21.15.19:0/1383146398 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3100b0ea0 con 0x7fb3101604f0 2024-03-08T06:04:11.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.400+0000 7fb317600640 1 -- 172.21.15.19:0/1383146398 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3100b1460 con 0x7fb3101604f0 2024-03-08T06:04:11.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.401+0000 7fb317600640 1 -- 172.21.15.19:0/1383146398 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3100af380 con 0x7fb3101604f0 2024-03-08T06:04:11.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.402+0000 7fb30d600640 1 -- 172.21.15.19:0/1383146398 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb30800ac30 con 0x7fb3101604f0 2024-03-08T06:04:11.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.403+0000 7fb30d600640 1 --2- 172.21.15.19:0/1383146398 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb2ec06b4d0 0x7fb2ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:11.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.403+0000 7fb30d600640 1 -- 172.21.15.19:0/1383146398 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb30808a600 con 0x7fb3101604f0 2024-03-08T06:04:11.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.403+0000 7fb314c00640 1 --2- 172.21.15.19:0/1383146398 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb2ec06b4d0 0x7fb2ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:11.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.404+0000 7fb314c00640 1 --2- 172.21.15.19:0/1383146398 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb2ec06b4d0 0x7fb2ec06d990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb300036000 tx=0x7fb30003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:11.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.409+0000 7fb30d600640 1 -- 172.21.15.19:0/1383146398 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb3100af380 con 0x7fb3101604f0 2024-03-08T06:04:11.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.608+0000 7fb317600640 1 -- 172.21.15.19:0/1383146398 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb310067cb0 con 0x7fb3101604f0 2024-03-08T06:04:11.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.609+0000 7fb30d600640 1 -- 172.21.15.19:0/1383146398 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb308020070 con 0x7fb3101604f0 2024-03-08T06:04:11.609 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-08T06:04:11.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.611+0000 7fb317600640 1 -- 172.21.15.19:0/1383146398 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb2ec06b4d0 msgr2=0x7fb2ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:11.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.611+0000 7fb317600640 1 --2- 172.21.15.19:0/1383146398 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb2ec06b4d0 0x7fb2ec06d990 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb300036000 tx=0x7fb30003c040 comp rx=0 tx=0).stop 2024-03-08T06:04:11.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.611+0000 7fb317600640 1 -- 172.21.15.19:0/1383146398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3101604f0 msgr2=0x7fb31013e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:11.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.611+0000 7fb317600640 1 --2- 172.21.15.19:0/1383146398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3101604f0 0x7fb31013e530 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb30800c780 tx=0x7fb30800cc40 comp rx=0 tx=0).stop 2024-03-08T06:04:11.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.612+0000 7fb317600640 1 -- 172.21.15.19:0/1383146398 shutdown_connections 2024-03-08T06:04:11.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.612+0000 7fb317600640 1 --2- 172.21.15.19:0/1383146398 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb2ec06b4d0 0x7fb2ec06d990 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:11.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.612+0000 7fb317600640 1 --2- 172.21.15.19:0/1383146398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3101604f0 0x7fb31013e530 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:11.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.612+0000 7fb317600640 1 --2- 172.21.15.19:0/1383146398 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb3101455b0 0x7fb31013dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:11.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.612+0000 7fb317600640 1 --2- 172.21.15.19:0/1383146398 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb310071950 0x7fb310135210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:11.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.612+0000 7fb317600640 1 -- 172.21.15.19:0/1383146398 >> 172.21.15.19:0/1383146398 conn(0x7fb31006ae30 msgr2=0x7fb31015e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:11.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.612+0000 7fb317600640 1 -- 172.21.15.19:0/1383146398 shutdown_connections 2024-03-08T06:04:11.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.612+0000 7fb317600640 1 -- 172.21.15.19:0/1383146398 wait complete. 2024-03-08T06:04:11.629 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T06:04:11.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.847+0000 7f7425000640 1 Processor -- start 2024-03-08T06:04:11.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.848+0000 7f7425000640 1 -- start start 2024-03-08T06:04:11.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.849+0000 7f7425000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74200b5c80 0x7f74200b7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:11.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.849+0000 7f7425000640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74200b6110 con 0x7f74200b57f0 2024-03-08T06:04:11.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.849+0000 7f7425000640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74200d2080 con 0x7f742015dff0 2024-03-08T06:04:11.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.849+0000 7f7425000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74200d2360 con 0x7f74200b5c80 2024-03-08T06:04:11.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.850+0000 7f741d400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f74200b57f0 0x7f74200b6e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53470/0 (socket says 172.21.15.19:53470) 2024-03-08T06:04:11.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.850+0000 7f741d400640 1 -- 172.21.15.19:0/1369425460 learned_addr learned my addr 172.21.15.19:0/1369425460 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:11.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.850+0000 7f741e800640 1 --2- 172.21.15.19:0/1369425460 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74200b5c80 0x7f74200b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:11.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.850+0000 7f741ca00640 1 -- 172.21.15.19:0/1369425460 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992368701 0 0) 0x7f74200b6110 con 0x7f74200b57f0 2024-03-08T06:04:11.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.850+0000 7f741ca00640 1 -- 172.21.15.19:0/1369425460 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7404003520 con 0x7f74200b57f0 2024-03-08T06:04:11.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.850+0000 7f741ca00640 1 -- 172.21.15.19:0/1369425460 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1739570649 0 0) 0x7f7404003520 con 0x7f74200b57f0 2024-03-08T06:04:11.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.850+0000 7f741ca00640 1 -- 172.21.15.19:0/1369425460 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74200b5c80 msgr2=0x7f74200b7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:11.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.850+0000 7f741ca00640 1 --2- 172.21.15.19:0/1369425460 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74200b5c80 0x7f74200b7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:11.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.850+0000 7f741ca00640 1 -- 172.21.15.19:0/1369425460 >> v1:172.21.15.42:6789/0 conn(0x7f742015dff0 legacy=0x7f74200d3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:11.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.851+0000 7f741ca00640 1 -- 172.21.15.19:0/1369425460 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74200d2640 con 0x7f74200b57f0 2024-03-08T06:04:11.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.851+0000 7f741ca00640 1 -- 172.21.15.19:0/1369425460 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f740c001670 con 0x7f74200b57f0 2024-03-08T06:04:11.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.851+0000 7f741ca00640 1 -- 172.21.15.19:0/1369425460 >> v1:172.21.15.19:6789/0 conn(0x7f74200b57f0 legacy=0x7f74200b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:11.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.851+0000 7f741ca00640 1 --2- 172.21.15.19:0/1369425460 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74040039e0 0x7f7404003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:11.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.851+0000 7f741ca00640 1 --2- 172.21.15.19:0/1369425460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7404004800 0x7f7404004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:11.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.851+0000 7f741ca00640 1 --2- 172.21.15.19:0/1369425460 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74200b5c80 0x7f74040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:11.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.851+0000 7f741ca00640 1 -- 172.21.15.19:0/1369425460 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74200d2360 con 0x7f7404004800 2024-03-08T06:04:11.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.851+0000 7f741ca00640 1 -- 172.21.15.19:0/1369425460 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740400baa0 con 0x7f74040039e0 2024-03-08T06:04:11.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.851+0000 7f741ca00640 1 -- 172.21.15.19:0/1369425460 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740400bca0 con 0x7f74200b5c80 2024-03-08T06:04:11.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.851+0000 7f741d400640 1 --2- 172.21.15.19:0/1369425460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7404004800 0x7f7404004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:11.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.851+0000 7f741de00640 1 --2- 172.21.15.19:0/1369425460 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74040039e0 0x7f7404003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:11.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.851+0000 7f741d400640 1 -- 172.21.15.19:0/1369425460 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74200b5c80 msgr2=0x7f74040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:11.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.851+0000 7f741d400640 1 --2- 172.21.15.19:0/1369425460 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f74200b5c80 0x7f74040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:11.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.851+0000 7f741d400640 1 -- 172.21.15.19:0/1369425460 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74040039e0 msgr2=0x7f7404003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:11.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.851+0000 7f741d400640 1 --2- 172.21.15.19:0/1369425460 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74040039e0 0x7f7404003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:11.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.851+0000 7f741d400640 1 -- 172.21.15.19:0/1369425460 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7404003520 con 0x7f7404004800 2024-03-08T06:04:11.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.851+0000 7f741de00640 1 --2- 172.21.15.19:0/1369425460 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f74040039e0 0x7f7404003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:11.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.852+0000 7f741d400640 1 --2- 172.21.15.19:0/1369425460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7404004800 0x7f7404004c80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f740c00c160 tx=0x7f7404005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d96ec7528d3908 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:11.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.853+0000 7f741ca00640 1 -- 172.21.15.19:0/1369425460 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c007c60 con 0x7f7404004800 2024-03-08T06:04:11.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.853+0000 7f741ca00640 1 -- 172.21.15.19:0/1369425460 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740c030070 con 0x7f7404004800 2024-03-08T06:04:11.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.853+0000 7f741ca00640 1 -- 172.21.15.19:0/1369425460 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c005d70 con 0x7f7404004800 2024-03-08T06:04:11.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.853+0000 7f7425000640 1 -- 172.21.15.19:0/1369425460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7404004800 msgr2=0x7f7404004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:11.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.853+0000 7f7425000640 1 --2- 172.21.15.19:0/1369425460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7404004800 0x7f7404004c80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f740c00c160 tx=0x7f7404005830 comp rx=0 tx=0).stop 2024-03-08T06:04:11.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.853+0000 7f741e800640 1 -- 172.21.15.19:0/1369425460 reap_dead start 2024-03-08T06:04:11.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.853+0000 7f7425000640 1 -- 172.21.15.19:0/1369425460 shutdown_connections 2024-03-08T06:04:11.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.853+0000 7f7425000640 1 -- 172.21.15.19:0/1369425460 >> 172.21.15.19:0/1369425460 conn(0x7f7420067270 msgr2=0x7f74200d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:11.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.853+0000 7f7425000640 1 -- 172.21.15.19:0/1369425460 shutdown_connections 2024-03-08T06:04:11.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.853+0000 7f7425000640 1 -- 172.21.15.19:0/1369425460 wait complete. 2024-03-08T06:04:11.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.855+0000 7f7425000640 1 Processor -- start 2024-03-08T06:04:11.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.855+0000 7f7425000640 1 -- start start 2024-03-08T06:04:11.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.856+0000 7f7425000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7404004800 0x7f74200cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:11.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.856+0000 7f7425000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7420153f00 0x7f7420154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:11.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.856+0000 7f7425000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74201548c0 0x7f74200cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:11.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.856+0000 7f7425000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74200b3340 con 0x7f74201548c0 2024-03-08T06:04:11.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.856+0000 7f7425000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74200d2c00 con 0x7f7420153f00 2024-03-08T06:04:11.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.856+0000 7f7425000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742015e3d0 con 0x7f7404004800 2024-03-08T06:04:11.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.856+0000 7f741e800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74201548c0 0x7f74200cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:11.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.856+0000 7f741e800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74201548c0 0x7f74200cbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55926/0 (socket says 172.21.15.19:55926) 2024-03-08T06:04:11.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.856+0000 7f741e800640 1 -- 172.21.15.19:0/2415776699 learned_addr learned my addr 172.21.15.19:0/2415776699 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:11.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.857+0000 7f741d400640 1 --2- 172.21.15.19:0/2415776699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7420153f00 0x7f7420154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:11.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.857+0000 7f741e800640 1 -- 172.21.15.19:0/2415776699 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7404004800 msgr2=0x7f74200cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:11.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.857+0000 7f741e800640 1 --2- 172.21.15.19:0/2415776699 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7404004800 0x7f74200cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:11.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.857+0000 7f741e800640 1 -- 172.21.15.19:0/2415776699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7420153f00 msgr2=0x7f7420154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:11.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.857+0000 7f741e800640 1 --2- 172.21.15.19:0/2415776699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7420153f00 0x7f7420154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:11.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.857+0000 7f741e800640 1 -- 172.21.15.19:0/2415776699 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7420154d40 con 0x7f74201548c0 2024-03-08T06:04:11.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.857+0000 7f741e800640 1 --2- 172.21.15.19:0/2415776699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74201548c0 0x7f74200cbd60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f74200b6450 tx=0x7f741800e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:11.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.857+0000 7f7416000640 1 -- 172.21.15.19:0/2415776699 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7418017070 con 0x7f74201548c0 2024-03-08T06:04:11.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.857+0000 7f7416000640 1 -- 172.21.15.19:0/2415776699 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7418013680 con 0x7f74201548c0 2024-03-08T06:04:11.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.857+0000 7f7416000640 1 -- 172.21.15.19:0/2415776699 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7418013a70 con 0x7f74201548c0 2024-03-08T06:04:11.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.857+0000 7f7425000640 1 -- 172.21.15.19:0/2415776699 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74200cafe0 con 0x7f74201548c0 2024-03-08T06:04:11.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.858+0000 7f7425000640 1 -- 172.21.15.19:0/2415776699 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74200cb560 con 0x7f74201548c0 2024-03-08T06:04:11.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.859+0000 7f7425000640 1 -- 172.21.15.19:0/2415776699 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7420067cb0 con 0x7f74201548c0 2024-03-08T06:04:11.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.859+0000 7f7416000640 1 -- 172.21.15.19:0/2415776699 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f741801a070 con 0x7f74201548c0 2024-03-08T06:04:11.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.860+0000 7f7416000640 1 --2- 172.21.15.19:0/2415776699 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f740006b4d0 0x7f740006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:11.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.860+0000 7f7416000640 1 -- 172.21.15.19:0/2415776699 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7418089e10 con 0x7f74201548c0 2024-03-08T06:04:11.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.861+0000 7f741de00640 1 --2- 172.21.15.19:0/2415776699 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f740006b4d0 0x7f740006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:11.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.861+0000 7f741de00640 1 --2- 172.21.15.19:0/2415776699 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f740006b4d0 0x7f740006d990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7410007fd0 tx=0x7f7410009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:11.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:11.865+0000 7f7416000640 1 -- 172.21.15.19:0/2415776699 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f741808d030 con 0x7f74201548c0 2024-03-08T06:04:12.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.060+0000 7f7425000640 1 -- 172.21.15.19:0/2415776699 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f74200b8d10 con 0x7f74201548c0 2024-03-08T06:04:12.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.061+0000 7f7416000640 1 -- 172.21.15.19:0/2415776699 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7418058c00 con 0x7f74201548c0 2024-03-08T06:04:12.061 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-08T06:04:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.064+0000 7f7425000640 1 -- 172.21.15.19:0/2415776699 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f740006b4d0 msgr2=0x7f740006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.064+0000 7f7425000640 1 --2- 172.21.15.19:0/2415776699 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f740006b4d0 0x7f740006d990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7410007fd0 tx=0x7f7410009040 comp rx=0 tx=0).stop 2024-03-08T06:04:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.064+0000 7f7425000640 1 -- 172.21.15.19:0/2415776699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74201548c0 msgr2=0x7f74200cbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.064+0000 7f7425000640 1 --2- 172.21.15.19:0/2415776699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74201548c0 0x7f74200cbd60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f74200b6450 tx=0x7f741800e9f0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.064+0000 7f7425000640 1 -- 172.21.15.19:0/2415776699 shutdown_connections 2024-03-08T06:04:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.064+0000 7f7425000640 1 --2- 172.21.15.19:0/2415776699 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f740006b4d0 0x7f740006d990 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.064+0000 7f7425000640 1 --2- 172.21.15.19:0/2415776699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74201548c0 0x7f74200cbd60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.064+0000 7f7425000640 1 --2- 172.21.15.19:0/2415776699 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7420153f00 0x7f7420154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.064+0000 7f7425000640 1 --2- 172.21.15.19:0/2415776699 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7404004800 0x7f74200cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.064+0000 7f7425000640 1 -- 172.21.15.19:0/2415776699 >> 172.21.15.19:0/2415776699 conn(0x7f7420067270 msgr2=0x7f74200b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.064+0000 7f7425000640 1 -- 172.21.15.19:0/2415776699 shutdown_connections 2024-03-08T06:04:12.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.064+0000 7f7425000640 1 -- 172.21.15.19:0/2415776699 wait complete. 2024-03-08T06:04:12.081 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-08T06:04:12.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.298+0000 7f5116a00640 1 Processor -- start 2024-03-08T06:04:12.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.298+0000 7f5116a00640 1 -- start start 2024-03-08T06:04:12.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.299+0000 7f5116a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5110145250 0x7f51100cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:12.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.299+0000 7f5116a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f51100cd730 0x7f511006eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:12.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.300+0000 7f5116a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f51100717d0 0x7f5110071c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:12.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.300+0000 7f5116a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5110072180 con 0x7f51100717d0 2024-03-08T06:04:12.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.300+0000 7f5116a00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f511006f410 con 0x7f51100cd730 2024-03-08T06:04:12.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.300+0000 7f5116a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51100cc690 con 0x7f5110145250 2024-03-08T06:04:12.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.300+0000 7f5114a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f51100717d0 0x7f5110071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:12.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.300+0000 7f5114a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f51100717d0 0x7f5110071c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46424/0 (socket says 172.21.15.19:46424) 2024-03-08T06:04:12.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.300+0000 7f5114a00640 1 -- 172.21.15.19:0/3054703798 learned_addr learned my addr 172.21.15.19:0/3054703798 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:12.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.300+0000 7f5107e00640 1 --2- 172.21.15.19:0/3054703798 >> v2:172.21.15.42:3300/0 conn(0x7f51100cd730 0x7f511006eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:12.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.300+0000 7f510fe00640 1 --2- 172.21.15.19:0/3054703798 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5110145250 0x7f51100cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:12.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.301+0000 7f5114a00640 1 -- 172.21.15.19:0/3054703798 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5110145250 msgr2=0x7f51100cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:12.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.301+0000 7f5114a00640 1 --2- 172.21.15.19:0/3054703798 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5110145250 0x7f51100cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.301+0000 7f5114a00640 1 -- 172.21.15.19:0/3054703798 >> v2:172.21.15.42:3300/0 conn(0x7f51100cd730 msgr2=0x7f511006eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:12.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.301+0000 7f5114a00640 1 --2- 172.21.15.19:0/3054703798 >> v2:172.21.15.42:3300/0 conn(0x7f51100cd730 0x7f511006eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.301+0000 7f5114a00640 1 -- 172.21.15.19:0/3054703798 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51100cc970 con 0x7f51100717d0 2024-03-08T06:04:12.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.302+0000 7f5114a00640 1 --2- 172.21.15.19:0/3054703798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51100717d0 0x7f5110071c40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f51100b4ee0 tx=0x7f510802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=287cc7e50e5ca406 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:12.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.302+0000 7f510f400640 1 -- 172.21.15.19:0/3054703798 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510802ca70 con 0x7f51100717d0 2024-03-08T06:04:12.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.302+0000 7f510f400640 1 -- 172.21.15.19:0/3054703798 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510802cc10 con 0x7f51100717d0 2024-03-08T06:04:12.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.302+0000 7f510f400640 1 -- 172.21.15.19:0/3054703798 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51080343f0 con 0x7f51100717d0 2024-03-08T06:04:12.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.303+0000 7f5116a00640 1 -- 172.21.15.19:0/3054703798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51100717d0 msgr2=0x7f5110071c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:12.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.303+0000 7f5116a00640 1 --2- 172.21.15.19:0/3054703798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51100717d0 0x7f5110071c40 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f51100b4ee0 tx=0x7f510802bed0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.303+0000 7f5116a00640 1 -- 172.21.15.19:0/3054703798 shutdown_connections 2024-03-08T06:04:12.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.303+0000 7f5116a00640 1 --2- 172.21.15.19:0/3054703798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51100717d0 0x7f5110071c40 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.303+0000 7f5116a00640 1 --2- 172.21.15.19:0/3054703798 >> v2:172.21.15.42:3300/0 conn(0x7f51100cd730 0x7f511006eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.303+0000 7f5116a00640 1 --2- 172.21.15.19:0/3054703798 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5110145250 0x7f51100cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.303+0000 7f5116a00640 1 -- 172.21.15.19:0/3054703798 >> 172.21.15.19:0/3054703798 conn(0x7f511006ae30 msgr2=0x7f511006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:12.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.303+0000 7f5116a00640 1 -- 172.21.15.19:0/3054703798 shutdown_connections 2024-03-08T06:04:12.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.303+0000 7f5116a00640 1 -- 172.21.15.19:0/3054703798 wait complete. 2024-03-08T06:04:12.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.305+0000 7f5116a00640 1 Processor -- start 2024-03-08T06:04:12.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.305+0000 7f5116a00640 1 -- start start 2024-03-08T06:04:12.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.306+0000 7f5116a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51100717d0 0x7f511013e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:12.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.306+0000 7f5116a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5110145250 0x7f511013bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:12.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.306+0000 7f5116a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f51101f7280 0x7f511015e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:12.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.306+0000 7f5116a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51100cd210 con 0x7f51100717d0 2024-03-08T06:04:12.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.306+0000 7f5116a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51100ccf30 con 0x7f5110145250 2024-03-08T06:04:12.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.306+0000 7f5116a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5110145630 con 0x7f51101f7280 2024-03-08T06:04:12.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.306+0000 7f510fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51100717d0 0x7f511013e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:12.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.306+0000 7f510fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51100717d0 0x7f511013e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46426/0 (socket says 172.21.15.19:46426) 2024-03-08T06:04:12.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.306+0000 7f510fe00640 1 -- 172.21.15.19:0/2533416876 learned_addr learned my addr 172.21.15.19:0/2533416876 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:12.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.306+0000 7f5107e00640 1 --2- 172.21.15.19:0/2533416876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5110145250 0x7f511013bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:12.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.306+0000 7f5114a00640 1 --2- 172.21.15.19:0/2533416876 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f51101f7280 0x7f511015e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:12.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.307+0000 7f510fe00640 1 -- 172.21.15.19:0/2533416876 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f51101f7280 msgr2=0x7f511015e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:12.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.307+0000 7f510fe00640 1 --2- 172.21.15.19:0/2533416876 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f51101f7280 0x7f511015e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.307+0000 7f510fe00640 1 -- 172.21.15.19:0/2533416876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5110145250 msgr2=0x7f511013bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:12.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.307+0000 7f510fe00640 1 --2- 172.21.15.19:0/2533416876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5110145250 0x7f511013bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.307+0000 7f510fe00640 1 -- 172.21.15.19:0/2533416876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511013e870 con 0x7f51100717d0 2024-03-08T06:04:12.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.307+0000 7f510fe00640 1 --2- 172.21.15.19:0/2533416876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51100717d0 0x7f511013e290 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f510000d830 tx=0x7f510000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:12.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.308+0000 7f510cc00640 1 -- 172.21.15.19:0/2533416876 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510000b6c0 con 0x7f51100717d0 2024-03-08T06:04:12.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.308+0000 7f5116a00640 1 -- 172.21.15.19:0/2533416876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511013eb50 con 0x7f51100717d0 2024-03-08T06:04:12.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.308+0000 7f510cc00640 1 -- 172.21.15.19:0/2533416876 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5100019070 con 0x7f51100717d0 2024-03-08T06:04:12.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.308+0000 7f5116a00640 1 -- 172.21.15.19:0/2533416876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51101426b0 con 0x7f51100717d0 2024-03-08T06:04:12.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.308+0000 7f510cc00640 1 -- 172.21.15.19:0/2533416876 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510000ba60 con 0x7f51100717d0 2024-03-08T06:04:12.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.309+0000 7f5116a00640 1 -- 172.21.15.19:0/2533416876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5110067cb0 con 0x7f51100717d0 2024-03-08T06:04:12.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.310+0000 7f510cc00640 1 -- 172.21.15.19:0/2533416876 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f510001e460 con 0x7f51100717d0 2024-03-08T06:04:12.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.311+0000 7f510cc00640 1 --2- 172.21.15.19:0/2533416876 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f50ec06b4d0 0x7f50ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:12.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.311+0000 7f510cc00640 1 -- 172.21.15.19:0/2533416876 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f510008a9b0 con 0x7f51100717d0 2024-03-08T06:04:12.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.311+0000 7f5107e00640 1 --2- 172.21.15.19:0/2533416876 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f50ec06b4d0 0x7f50ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:12.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.312+0000 7f5107e00640 1 --2- 172.21.15.19:0/2533416876 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f50ec06b4d0 0x7f50ec06d990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f511015c230 tx=0x7f50f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:12.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.316+0000 7f510cc00640 1 -- 172.21.15.19:0/2533416876 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5100059690 con 0x7f51100717d0 2024-03-08T06:04:12.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.526+0000 7f5116a00640 1 -- 172.21.15.19:0/2533416876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f511006d900 con 0x7f51100717d0 2024-03-08T06:04:12.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.527+0000 7f510cc00640 1 -- 172.21.15.19:0/2533416876 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5100058f90 con 0x7f51100717d0 2024-03-08T06:04:12.527 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-08T06:04:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.530+0000 7f5116a00640 1 -- 172.21.15.19:0/2533416876 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f50ec06b4d0 msgr2=0x7f50ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.530+0000 7f5116a00640 1 --2- 172.21.15.19:0/2533416876 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f50ec06b4d0 0x7f50ec06d990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f511015c230 tx=0x7f50f8008040 comp rx=0 tx=0).stop 2024-03-08T06:04:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.530+0000 7f5116a00640 1 -- 172.21.15.19:0/2533416876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51100717d0 msgr2=0x7f511013e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.530+0000 7f5116a00640 1 --2- 172.21.15.19:0/2533416876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51100717d0 0x7f511013e290 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f510000d830 tx=0x7f510000dcf0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.530+0000 7f5116a00640 1 -- 172.21.15.19:0/2533416876 shutdown_connections 2024-03-08T06:04:12.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.530+0000 7f5116a00640 1 --2- 172.21.15.19:0/2533416876 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f50ec06b4d0 0x7f50ec06d990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.530+0000 7f5116a00640 1 --2- 172.21.15.19:0/2533416876 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f51101f7280 0x7f511015e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.530+0000 7f5116a00640 1 --2- 172.21.15.19:0/2533416876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5110145250 0x7f511013bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.530+0000 7f5116a00640 1 --2- 172.21.15.19:0/2533416876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51100717d0 0x7f511013e290 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.530+0000 7f5116a00640 1 -- 172.21.15.19:0/2533416876 >> 172.21.15.19:0/2533416876 conn(0x7f511006ae30 msgr2=0x7f51100ae370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:12.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.530+0000 7f5116a00640 1 -- 172.21.15.19:0/2533416876 shutdown_connections 2024-03-08T06:04:12.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.530+0000 7f5116a00640 1 -- 172.21.15.19:0/2533416876 wait complete. 2024-03-08T06:04:12.547 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-03-08T06:04:12.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:12.548 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-03-08T06:04:12.656 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-03-08T06:04:12.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:12.656 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-08T06:04:12.706 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-08T06:04:12.706 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T06:04:12.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.936+0000 7fd1fe200640 1 Processor -- start 2024-03-08T06:04:12.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.936+0000 7fd1fe200640 1 -- start start 2024-03-08T06:04:12.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.937+0000 7fd1fe200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd1f8071d10 0x7fd1f80ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:12.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.937+0000 7fd1fe200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd1f8147580 0x7fd1f80ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:12.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.937+0000 7fd1fe200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f8161920 con 0x7fd1f81443f0 2024-03-08T06:04:12.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.937+0000 7fd1fe200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f8161c00 con 0x7fd1f8147580 2024-03-08T06:04:12.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.937+0000 7fd1fe200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f8161ee0 con 0x7fd1f8071d10 2024-03-08T06:04:12.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.938+0000 7fd1f7e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd1f8147580 0x7fd1f80ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:12.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.938+0000 7fd1f7e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd1f8147580 0x7fd1f80ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46432/0 (socket says 172.21.15.19:46432) 2024-03-08T06:04:12.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.938+0000 7fd1f7e00640 1 -- 172.21.15.19:0/2977774337 learned_addr learned my addr 172.21.15.19:0/2977774337 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:12.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.938+0000 7fd1eea00640 1 --2- 172.21.15.19:0/2977774337 >> v2:172.21.15.42:3300/0 conn(0x7fd1f8071d10 0x7fd1f80ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:12.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.938+0000 7fd1f7e00640 1 -- 172.21.15.19:0/2977774337 >> v2:172.21.15.42:3300/0 conn(0x7fd1f8071d10 msgr2=0x7fd1f80ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:12.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.938+0000 7fd1f7e00640 1 --2- 172.21.15.19:0/2977774337 >> v2:172.21.15.42:3300/0 conn(0x7fd1f8071d10 0x7fd1f80ae3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.938+0000 7fd1f7e00640 1 -- 172.21.15.19:0/2977774337 >> v1:172.21.15.42:6789/0 conn(0x7fd1f81443f0 legacy=0x7fd1f8071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:12.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.939+0000 7fd1f7e00640 1 -- 172.21.15.19:0/2977774337 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f81621c0 con 0x7fd1f8147580 2024-03-08T06:04:12.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.940+0000 7fd1f7e00640 1 --2- 172.21.15.19:0/2977774337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1f8147580 0x7fd1f80ae8e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80af4b0 tx=0x7fd1f002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9bb27a9b59271 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:12.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.940+0000 7fd1f6a00640 1 -- 172.21.15.19:0/2977774337 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f002ca80 con 0x7fd1f8147580 2024-03-08T06:04:12.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.940+0000 7fd1f6a00640 1 -- 172.21.15.19:0/2977774337 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f002cc20 con 0x7fd1f8147580 2024-03-08T06:04:12.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.940+0000 7fd1f6a00640 1 -- 172.21.15.19:0/2977774337 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f00343f0 con 0x7fd1f8147580 2024-03-08T06:04:12.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.941+0000 7fd1fe200640 1 -- 172.21.15.19:0/2977774337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1f8147580 msgr2=0x7fd1f80ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:12.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.941+0000 7fd1fe200640 1 --2- 172.21.15.19:0/2977774337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1f8147580 0x7fd1f80ae8e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80af4b0 tx=0x7fd1f002bee0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.941+0000 7fd1fe200640 1 -- 172.21.15.19:0/2977774337 shutdown_connections 2024-03-08T06:04:12.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.941+0000 7fd1fe200640 1 --2- 172.21.15.19:0/2977774337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1f8147580 0x7fd1f80ae8e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.941+0000 7fd1fe200640 1 --2- 172.21.15.19:0/2977774337 >> v2:172.21.15.42:3300/0 conn(0x7fd1f8071d10 0x7fd1f80ae3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.941+0000 7fd1fe200640 1 -- 172.21.15.19:0/2977774337 >> 172.21.15.19:0/2977774337 conn(0x7fd1f806ac50 msgr2=0x7fd1f806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:12.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.941+0000 7fd1fe200640 1 -- 172.21.15.19:0/2977774337 shutdown_connections 2024-03-08T06:04:12.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.941+0000 7fd1fe200640 1 -- 172.21.15.19:0/2977774337 wait complete. 2024-03-08T06:04:12.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.943+0000 7fd1fe200640 1 Processor -- start 2024-03-08T06:04:12.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.943+0000 7fd1fe200640 1 -- start start 2024-03-08T06:04:12.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.944+0000 7fd1fe200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd1f8071d10 0x7fd1f80b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.944+0000 7fd1fe200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1f81443f0 0x7fd1f80ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.944+0000 7fd1fe200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1f8147580 0x7fd1f8141c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.944+0000 7fd1fe200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f80b2970 con 0x7fd1f8147580 2024-03-08T06:04:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.944+0000 7fd1fe200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f8162780 con 0x7fd1f81443f0 2024-03-08T06:04:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.944+0000 7fd1fe200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f815f320 con 0x7fd1f8071d10 2024-03-08T06:04:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.944+0000 7fd1f7e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1f8147580 0x7fd1f8141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.944+0000 7fd1f7e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1f8147580 0x7fd1f8141c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46442/0 (socket says 172.21.15.19:46442) 2024-03-08T06:04:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.944+0000 7fd1f7e00640 1 -- 172.21.15.19:0/1716600761 learned_addr learned my addr 172.21.15.19:0/1716600761 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.944+0000 7fd1f7400640 1 --2- 172.21.15.19:0/1716600761 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd1f8071d10 0x7fd1f80b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.944+0000 7fd1eea00640 1 --2- 172.21.15.19:0/1716600761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1f81443f0 0x7fd1f80ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.945+0000 7fd1f7e00640 1 -- 172.21.15.19:0/1716600761 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd1f8071d10 msgr2=0x7fd1f80b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.945+0000 7fd1f7e00640 1 --2- 172.21.15.19:0/1716600761 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd1f8071d10 0x7fd1f80b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.945+0000 7fd1f7e00640 1 -- 172.21.15.19:0/1716600761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1f81443f0 msgr2=0x7fd1f80ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:12.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.945+0000 7fd1f7e00640 1 --2- 172.21.15.19:0/1716600761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1f81443f0 0x7fd1f80ae2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:12.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.945+0000 7fd1f7e00640 1 -- 172.21.15.19:0/1716600761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f81f7190 con 0x7fd1f8147580 2024-03-08T06:04:12.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.945+0000 7fd1eea00640 1 --2- 172.21.15.19:0/1716600761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1f81443f0 0x7fd1f80ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:12.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.945+0000 7fd1f7e00640 1 --2- 172.21.15.19:0/1716600761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1f8147580 0x7fd1f8141c50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0036040 tx=0x7fd1f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.945+0000 7fd1efe00640 1 -- 172.21.15.19:0/1716600761 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0043020 con 0x7fd1f8147580 2024-03-08T06:04:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.945+0000 7fd1efe00640 1 -- 172.21.15.19:0/1716600761 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f003e450 con 0x7fd1f8147580 2024-03-08T06:04:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.945+0000 7fd1efe00640 1 -- 172.21.15.19:0/1716600761 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0009510 con 0x7fd1f8147580 2024-03-08T06:04:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.945+0000 7fd1fe200640 1 -- 172.21.15.19:0/1716600761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f81f7470 con 0x7fd1f8147580 2024-03-08T06:04:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.946+0000 7fd1fe200640 1 -- 172.21.15.19:0/1716600761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f81f7a30 con 0x7fd1f8147580 2024-03-08T06:04:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.947+0000 7fd1fe200640 1 -- 172.21.15.19:0/1716600761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f8067cb0 con 0x7fd1f8147580 2024-03-08T06:04:12.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.948+0000 7fd1efe00640 1 -- 172.21.15.19:0/1716600761 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd1f0046020 con 0x7fd1f8147580 2024-03-08T06:04:12.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.948+0000 7fd1efe00640 1 --2- 172.21.15.19:0/1716600761 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd1d406b4d0 0x7fd1d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:12.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.949+0000 7fd1efe00640 1 -- 172.21.15.19:0/1716600761 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd1f00ace10 con 0x7fd1f8147580 2024-03-08T06:04:12.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.949+0000 7fd1f7400640 1 --2- 172.21.15.19:0/1716600761 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd1d406b4d0 0x7fd1d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:12.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.949+0000 7fd1f7400640 1 --2- 172.21.15.19:0/1716600761 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd1d406b4d0 0x7fd1d406d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8004ea0 tx=0x7fd1e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:12.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:12.953+0000 7fd1efe00640 1 -- 172.21.15.19:0/1716600761 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd1f00b0030 con 0x7fd1f8147580 2024-03-08T06:04:13.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.195+0000 7fd1fe200640 1 -- 172.21.15.19:0/1716600761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1f806eaf0 con 0x7fd1f8147580 2024-03-08T06:04:13.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.197+0000 7fd1efe00640 1 -- 172.21.15.19:0/1716600761 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7fd1f004d020 con 0x7fd1f8147580 2024-03-08T06:04:13.196 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:13.196 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1494509643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6835","nonce":1494509643},{"type":"v1","addr":"172.21.15.19:6837","nonce":1494509643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/2031610239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2031610239},{"type":"v1","addr":"172.21.15.42:6834","nonce":2031610239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6836/1964979810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1964979810},{"type":"v1","addr":"172.21.15.19:6836","nonce":1964979810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T06:03:20.532032+0000","modified":"2024-03-08T06:03:23.604391+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1462224228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1462224228},{"type":"v1","addr":"172.21.15.42:6835","nonce":1462224228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T06:04:13.197 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2024-03-08T06:04:13.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.199+0000 7fd1fe200640 1 -- 172.21.15.19:0/1716600761 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd1d406b4d0 msgr2=0x7fd1d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:13.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.199+0000 7fd1fe200640 1 --2- 172.21.15.19:0/1716600761 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd1d406b4d0 0x7fd1d406d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd1e8004ea0 tx=0x7fd1e8009040 comp rx=0 tx=0).stop 2024-03-08T06:04:13.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.199+0000 7fd1fe200640 1 -- 172.21.15.19:0/1716600761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1f8147580 msgr2=0x7fd1f8141c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:13.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.199+0000 7fd1fe200640 1 --2- 172.21.15.19:0/1716600761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1f8147580 0x7fd1f8141c50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0036040 tx=0x7fd1f0004a40 comp rx=0 tx=0).stop 2024-03-08T06:04:13.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.199+0000 7fd1fe200640 1 -- 172.21.15.19:0/1716600761 shutdown_connections 2024-03-08T06:04:13.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.199+0000 7fd1fe200640 1 --2- 172.21.15.19:0/1716600761 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd1d406b4d0 0x7fd1d406d990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.199+0000 7fd1fe200640 1 --2- 172.21.15.19:0/1716600761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1f8147580 0x7fd1f8141c50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.199+0000 7fd1fe200640 1 --2- 172.21.15.19:0/1716600761 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd1f81443f0 0x7fd1f80ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.199+0000 7fd1fe200640 1 --2- 172.21.15.19:0/1716600761 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd1f8071d10 0x7fd1f80b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.199+0000 7fd1fe200640 1 -- 172.21.15.19:0/1716600761 >> 172.21.15.19:0/1716600761 conn(0x7fd1f806ac50 msgr2=0x7fd1f806b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:13.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.199+0000 7fd1fe200640 1 -- 172.21.15.19:0/1716600761 shutdown_connections 2024-03-08T06:04:13.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.200+0000 7fd1fe200640 1 -- 172.21.15.19:0/1716600761 wait complete. 2024-03-08T06:04:13.218 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:04:13.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.439+0000 7f89f7200640 1 Processor -- start 2024-03-08T06:04:13.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.440+0000 7f89f7200640 1 -- start start 2024-03-08T06:04:13.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.441+0000 7f89f7200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f89f81445d0 0x7f89f806deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:13.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.441+0000 7f89f7200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f89f8144d50 0x7f89f8071470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:13.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.441+0000 7f89f7200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f8071dc0 con 0x7f89f80719b0 2024-03-08T06:04:13.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.441+0000 7f89f7200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f806e3f0 con 0x7f89f8144d50 2024-03-08T06:04:13.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.441+0000 7f89f7200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f806ebf0 con 0x7f89f81445d0 2024-03-08T06:04:13.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.442+0000 7f89efe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f89f8144d50 0x7f89f8071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:13.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.442+0000 7f89f6800640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f89f80719b0 0x7f89f815f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43830/0 (socket says 172.21.15.19:43830) 2024-03-08T06:04:13.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.442+0000 7f89f6800640 1 -- 172.21.15.19:0/1426186365 learned_addr learned my addr 172.21.15.19:0/1426186365 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:13.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.442+0000 7f89f5e00640 1 --2- 172.21.15.19:0/1426186365 >> v2:172.21.15.42:3300/0 conn(0x7f89f81445d0 0x7f89f806deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:13.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.442+0000 7f89efe00640 1 -- 172.21.15.19:0/1426186365 >> v2:172.21.15.42:3300/0 conn(0x7f89f81445d0 msgr2=0x7f89f806deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:13.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.442+0000 7f89efe00640 1 --2- 172.21.15.19:0/1426186365 >> v2:172.21.15.42:3300/0 conn(0x7f89f81445d0 0x7f89f806deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.442+0000 7f89efe00640 1 -- 172.21.15.19:0/1426186365 >> v1:172.21.15.19:6789/0 conn(0x7f89f80719b0 legacy=0x7f89f815f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:13.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.443+0000 7f89efe00640 1 -- 172.21.15.19:0/1426186365 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f806eed0 con 0x7f89f8144d50 2024-03-08T06:04:13.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.443+0000 7f89f5400640 1 -- 172.21.15.19:0/1426186365 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190032740 0 0) 0x7f89f0001490 con 0x7f89f80719b0 2024-03-08T06:04:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.444+0000 7f89efe00640 1 --2- 172.21.15.19:0/1426186365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f8144d50 0x7f89f8071470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f89f8072600 tx=0x7f89e002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d63bc0b080f6292 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.444+0000 7f89f5400640 1 -- 172.21.15.19:0/1426186365 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0035020 con 0x7f89f8144d50 2024-03-08T06:04:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.444+0000 7f89f5400640 1 -- 172.21.15.19:0/1426186365 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e0031830 con 0x7f89f8144d50 2024-03-08T06:04:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.444+0000 7f89f5400640 1 -- 172.21.15.19:0/1426186365 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0031c00 con 0x7f89f8144d50 2024-03-08T06:04:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.445+0000 7f89f7200640 1 -- 172.21.15.19:0/1426186365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f8144d50 msgr2=0x7f89f8071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.445+0000 7f89f7200640 1 --2- 172.21.15.19:0/1426186365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f8144d50 0x7f89f8071470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f89f8072600 tx=0x7f89e002b8d0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.445+0000 7f89f7200640 1 -- 172.21.15.19:0/1426186365 shutdown_connections 2024-03-08T06:04:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.445+0000 7f89f7200640 1 --2- 172.21.15.19:0/1426186365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f8144d50 0x7f89f8071470 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.445+0000 7f89f7200640 1 --2- 172.21.15.19:0/1426186365 >> v2:172.21.15.42:3300/0 conn(0x7f89f81445d0 0x7f89f806deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.445+0000 7f89f7200640 1 -- 172.21.15.19:0/1426186365 >> 172.21.15.19:0/1426186365 conn(0x7f89f80b1600 msgr2=0x7f89f80b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.445+0000 7f89f7200640 1 -- 172.21.15.19:0/1426186365 shutdown_connections 2024-03-08T06:04:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.445+0000 7f89f7200640 1 -- 172.21.15.19:0/1426186365 wait complete. 2024-03-08T06:04:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.447+0000 7f89f7200640 1 Processor -- start 2024-03-08T06:04:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.447+0000 7f89f7200640 1 -- start start 2024-03-08T06:04:13.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.448+0000 7f89f7200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89f80719b0 0x7f89f8143a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:13.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.448+0000 7f89f7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89f81445d0 0x7f89f8141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:13.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.448+0000 7f89f7200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f8144d50 0x7f89f813c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:13.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.448+0000 7f89f7200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f80cc340 con 0x7f89f8144d50 2024-03-08T06:04:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.448+0000 7f89f7200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f80cc060 con 0x7f89f81445d0 2024-03-08T06:04:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.448+0000 7f89f7200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f81449b0 con 0x7f89f80719b0 2024-03-08T06:04:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.448+0000 7f89f6800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f8144d50 0x7f89f813c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.448+0000 7f89f6800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f8144d50 0x7f89f813c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46458/0 (socket says 172.21.15.19:46458) 2024-03-08T06:04:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.448+0000 7f89f6800640 1 -- 172.21.15.19:0/28172999 learned_addr learned my addr 172.21.15.19:0/28172999 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.449+0000 7f89f5e00640 1 --2- 172.21.15.19:0/28172999 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89f80719b0 0x7f89f8143a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.449+0000 7f89efe00640 1 --2- 172.21.15.19:0/28172999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89f81445d0 0x7f89f8141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.449+0000 7f89f6800640 1 -- 172.21.15.19:0/28172999 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89f80719b0 msgr2=0x7f89f8143a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.449+0000 7f89f6800640 1 --2- 172.21.15.19:0/28172999 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89f80719b0 0x7f89f8143a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.449+0000 7f89f6800640 1 -- 172.21.15.19:0/28172999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89f81445d0 msgr2=0x7f89f8141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.449+0000 7f89f6800640 1 --2- 172.21.15.19:0/28172999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89f81445d0 0x7f89f8141bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.449+0000 7f89f6800640 1 -- 172.21.15.19:0/28172999 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f8142280 con 0x7f89f8144d50 2024-03-08T06:04:13.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.449+0000 7f89f6800640 1 --2- 172.21.15.19:0/28172999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f8144d50 0x7f89f813c3f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f89f000c700 tx=0x7f89f000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:13.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.449+0000 7f89ee000640 1 -- 172.21.15.19:0/28172999 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f0018070 con 0x7f89f8144d50 2024-03-08T06:04:13.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.449+0000 7f89ee000640 1 -- 172.21.15.19:0/28172999 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f000ce10 con 0x7f89f8144d50 2024-03-08T06:04:13.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.449+0000 7f89ee000640 1 -- 172.21.15.19:0/28172999 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f000a860 con 0x7f89f8144d50 2024-03-08T06:04:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.449+0000 7f89f7200640 1 -- 172.21.15.19:0/28172999 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f8142560 con 0x7f89f8144d50 2024-03-08T06:04:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.450+0000 7f89f7200640 1 -- 172.21.15.19:0/28172999 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f8142b20 con 0x7f89f8144d50 2024-03-08T06:04:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.451+0000 7f89f7200640 1 -- 172.21.15.19:0/28172999 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f8075100 con 0x7f89f8144d50 2024-03-08T06:04:13.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.452+0000 7f89ee000640 1 -- 172.21.15.19:0/28172999 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f89f000aa00 con 0x7f89f8144d50 2024-03-08T06:04:13.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.453+0000 7f89ee000640 1 --2- 172.21.15.19:0/28172999 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f89d406b4d0 0x7f89d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:13.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.453+0000 7f89ee000640 1 -- 172.21.15.19:0/28172999 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f89f0089870 con 0x7f89f8144d50 2024-03-08T06:04:13.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.453+0000 7f89f5e00640 1 --2- 172.21.15.19:0/28172999 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f89d406b4d0 0x7f89d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:13.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.454+0000 7f89f5e00640 1 --2- 172.21.15.19:0/28172999 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f89d406b4d0 0x7f89d406d990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f89e8006fd0 tx=0x7f89e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:13.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.458+0000 7f89ee000640 1 -- 172.21.15.19:0/28172999 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f89f8071dc0 con 0x7f89f8144d50 2024-03-08T06:04:13.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.663+0000 7f89f7200640 1 -- 172.21.15.19:0/28172999 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89f80af350 con 0x7f89f8144d50 2024-03-08T06:04:13.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.665+0000 7f89ee000640 1 -- 172.21.15.19:0/28172999 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16795 (secure 0 0 0) 0x7f89f0058670 con 0x7f89f8144d50 2024-03-08T06:04:13.665 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:13.665 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":23,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:04:07.332571+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:03:18.392703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T06:03:19.537912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:04:13.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.667+0000 7f89f7200640 1 -- 172.21.15.19:0/28172999 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f89d406b4d0 msgr2=0x7f89d406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:13.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.667+0000 7f89f7200640 1 --2- 172.21.15.19:0/28172999 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f89d406b4d0 0x7f89d406d990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f89e8006fd0 tx=0x7f89e8008040 comp rx=0 tx=0).stop 2024-03-08T06:04:13.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.667+0000 7f89f7200640 1 -- 172.21.15.19:0/28172999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f8144d50 msgr2=0x7f89f813c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:13.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.667+0000 7f89f7200640 1 --2- 172.21.15.19:0/28172999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f8144d50 0x7f89f813c3f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f89f000c700 tx=0x7f89f000cbc0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.668+0000 7f89f7200640 1 -- 172.21.15.19:0/28172999 shutdown_connections 2024-03-08T06:04:13.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.668+0000 7f89f7200640 1 --2- 172.21.15.19:0/28172999 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f89d406b4d0 0x7f89d406d990 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.668+0000 7f89f7200640 1 --2- 172.21.15.19:0/28172999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f8144d50 0x7f89f813c3f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.668+0000 7f89f7200640 1 --2- 172.21.15.19:0/28172999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89f81445d0 0x7f89f8141bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.668+0000 7f89f7200640 1 --2- 172.21.15.19:0/28172999 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89f80719b0 0x7f89f8143a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.668+0000 7f89f7200640 1 -- 172.21.15.19:0/28172999 >> 172.21.15.19:0/28172999 conn(0x7f89f80b1600 msgr2=0x7f89f80b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:13.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.668+0000 7f89f7200640 1 -- 172.21.15.19:0/28172999 shutdown_connections 2024-03-08T06:04:13.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.668+0000 7f89f7200640 1 -- 172.21.15.19:0/28172999 wait complete. 2024-03-08T06:04:13.687 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T06:03:14.149736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T06:03:18.392703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T06:03:19.537912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T06:04:13.687 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T06:04:13.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.912+0000 7f4f13600640 1 Processor -- start 2024-03-08T06:04:13.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.913+0000 7f4f13600640 1 -- start start 2024-03-08T06:04:13.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.914+0000 7f4f13600640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4f0c1455b0 0x7f4f0c15c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:13.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.914+0000 7f4f13600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4f0c1604f0 0x7f4f0c0cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:13.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.914+0000 7f4f13600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0c0cd5a0 con 0x7f4f0c071950 2024-03-08T06:04:13.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.914+0000 7f4f13600640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0c0cdc20 con 0x7f4f0c1455b0 2024-03-08T06:04:13.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.914+0000 7f4f13600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0c0ccfe0 con 0x7f4f0c1604f0 2024-03-08T06:04:13.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.915+0000 7f4f10c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4f0c1455b0 0x7f4f0c15c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:13.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.915+0000 7f4f10c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4f0c1455b0 0x7f4f0c15c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46468/0 (socket says 172.21.15.19:46468) 2024-03-08T06:04:13.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.915+0000 7f4f10c00640 1 -- 172.21.15.19:0/2020509023 learned_addr learned my addr 172.21.15.19:0/2020509023 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:13.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.915+0000 7f4f0be00640 1 --2- 172.21.15.19:0/2020509023 >> v2:172.21.15.42:3300/0 conn(0x7f4f0c1604f0 0x7f4f0c0cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:13.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.915+0000 7f4f10c00640 1 -- 172.21.15.19:0/2020509023 >> v2:172.21.15.42:3300/0 conn(0x7f4f0c1604f0 msgr2=0x7f4f0c0cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:13.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.915+0000 7f4f10c00640 1 --2- 172.21.15.19:0/2020509023 >> v2:172.21.15.42:3300/0 conn(0x7f4f0c1604f0 0x7f4f0c0cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.915+0000 7f4f10c00640 1 -- 172.21.15.19:0/2020509023 >> v1:172.21.15.42:6789/0 conn(0x7f4f0c071950 legacy=0x7f4f0c0ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:13.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.915+0000 7f4f10c00640 1 -- 172.21.15.19:0/2020509023 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c0cd2c0 con 0x7f4f0c1455b0 2024-03-08T06:04:13.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.915+0000 7f4f0be00640 1 --2- 172.21.15.19:0/2020509023 >> v2:172.21.15.42:3300/0 conn(0x7f4f0c1604f0 0x7f4f0c0cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:13.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.916+0000 7f4f10c00640 1 --2- 172.21.15.19:0/2020509023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f0c1455b0 0x7f4f0c15c1d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c15f730 tx=0x7f4efc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2550424fdb22830d server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:13.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.917+0000 7f4f0b400640 1 -- 172.21.15.19:0/2020509023 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc02ca80 con 0x7f4f0c1455b0 2024-03-08T06:04:13.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.917+0000 7f4f0b400640 1 -- 172.21.15.19:0/2020509023 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc02cc20 con 0x7f4f0c1455b0 2024-03-08T06:04:13.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.917+0000 7f4f0b400640 1 -- 172.21.15.19:0/2020509023 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc0343f0 con 0x7f4f0c1455b0 2024-03-08T06:04:13.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.917+0000 7f4f13600640 1 -- 172.21.15.19:0/2020509023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f0c1455b0 msgr2=0x7f4f0c15c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:13.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.917+0000 7f4f13600640 1 --2- 172.21.15.19:0/2020509023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f0c1455b0 0x7f4f0c15c1d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c15f730 tx=0x7f4efc02bee0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.917+0000 7f4f13600640 1 -- 172.21.15.19:0/2020509023 shutdown_connections 2024-03-08T06:04:13.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.917+0000 7f4f13600640 1 --2- 172.21.15.19:0/2020509023 >> v2:172.21.15.42:3300/0 conn(0x7f4f0c1604f0 0x7f4f0c0cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.917+0000 7f4f13600640 1 --2- 172.21.15.19:0/2020509023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f0c1455b0 0x7f4f0c15c1d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.917+0000 7f4f13600640 1 -- 172.21.15.19:0/2020509023 >> 172.21.15.19:0/2020509023 conn(0x7f4f0c06ae30 msgr2=0x7f4f0c06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:13.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.918+0000 7f4f13600640 1 -- 172.21.15.19:0/2020509023 shutdown_connections 2024-03-08T06:04:13.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.918+0000 7f4f13600640 1 -- 172.21.15.19:0/2020509023 wait complete. 2024-03-08T06:04:13.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.919+0000 7f4f13600640 1 Processor -- start 2024-03-08T06:04:13.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.919+0000 7f4f13600640 1 -- start start 2024-03-08T06:04:13.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.920+0000 7f4f13600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4f0c071950 0x7f4f0c15bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:13.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.920+0000 7f4f13600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f0c1455b0 0x7f4f0c137f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:13.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.920+0000 7f4f13600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f0c1604f0 0x7f4f0c1f7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:13.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.920+0000 7f4f13600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c145990 con 0x7f4f0c1455b0 2024-03-08T06:04:13.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.920+0000 7f4f13600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c15c710 con 0x7f4f0c1604f0 2024-03-08T06:04:13.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.920+0000 7f4f13600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c0ccbd0 con 0x7f4f0c071950 2024-03-08T06:04:13.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.921+0000 7f4f0be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f0c1455b0 0x7f4f0c137f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:13.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.921+0000 7f4f0be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f0c1455b0 0x7f4f0c137f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46484/0 (socket says 172.21.15.19:46484) 2024-03-08T06:04:13.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.921+0000 7f4f0be00640 1 -- 172.21.15.19:0/3888397444 learned_addr learned my addr 172.21.15.19:0/3888397444 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:13.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.921+0000 7f4f10c00640 1 --2- 172.21.15.19:0/3888397444 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4f0c071950 0x7f4f0c15bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:13.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.921+0000 7f4f11600640 1 --2- 172.21.15.19:0/3888397444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f0c1604f0 0x7f4f0c1f7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:13.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.921+0000 7f4f0be00640 1 -- 172.21.15.19:0/3888397444 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4f0c071950 msgr2=0x7f4f0c15bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:13.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.921+0000 7f4f0be00640 1 --2- 172.21.15.19:0/3888397444 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4f0c071950 0x7f4f0c15bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.921+0000 7f4f0be00640 1 -- 172.21.15.19:0/3888397444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f0c1604f0 msgr2=0x7f4f0c1f7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:13.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.921+0000 7f4f0be00640 1 --2- 172.21.15.19:0/3888397444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f0c1604f0 0x7f4f0c1f7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:13.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.921+0000 7f4f0be00640 1 -- 172.21.15.19:0/3888397444 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c1f8360 con 0x7f4f0c1455b0 2024-03-08T06:04:13.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.921+0000 7f4f0be00640 1 --2- 172.21.15.19:0/3888397444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f0c1455b0 0x7f4f0c137f60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800c820 tx=0x7f4ef800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.922+0000 7f4f08c00640 1 -- 172.21.15.19:0/3888397444 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8015070 con 0x7f4f0c1455b0 2024-03-08T06:04:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.922+0000 7f4f08c00640 1 -- 172.21.15.19:0/3888397444 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef8007a30 con 0x7f4f0c1455b0 2024-03-08T06:04:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.922+0000 7f4f08c00640 1 -- 172.21.15.19:0/3888397444 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8007e00 con 0x7f4f0c1455b0 2024-03-08T06:04:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.922+0000 7f4f13600640 1 -- 172.21.15.19:0/3888397444 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0c0cc270 con 0x7f4f0c1455b0 2024-03-08T06:04:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.922+0000 7f4f13600640 1 -- 172.21.15.19:0/3888397444 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0c137760 con 0x7f4f0c1455b0 2024-03-08T06:04:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.923+0000 7f4f13600640 1 -- 172.21.15.19:0/3888397444 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0c067cb0 con 0x7f4f0c1455b0 2024-03-08T06:04:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.924+0000 7f4f08c00640 1 -- 172.21.15.19:0/3888397444 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4ef8018070 con 0x7f4f0c1455b0 2024-03-08T06:04:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.925+0000 7f4f08c00640 1 --2- 172.21.15.19:0/3888397444 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f4eec06b4d0 0x7f4eec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.926+0000 7f4f08c00640 1 -- 172.21.15.19:0/3888397444 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4ef808a200 con 0x7f4f0c1455b0 2024-03-08T06:04:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.926+0000 7f4f10c00640 1 --2- 172.21.15.19:0/3888397444 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f4eec06b4d0 0x7f4eec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.926+0000 7f4f10c00640 1 --2- 172.21.15.19:0/3888397444 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f4eec06b4d0 0x7f4eec06d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4efc035000 tx=0x7f4efc030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:13.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:13.930+0000 7f4f08c00640 1 -- 172.21.15.19:0/3888397444 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4ef8058ff0 con 0x7f4f0c1455b0 2024-03-08T06:04:14.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.131+0000 7f4f13600640 1 -- 172.21.15.19:0/3888397444 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f0c0c73c0 con 0x7f4f0c1455b0 2024-03-08T06:04:14.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.132+0000 7f4f08c00640 1 -- 172.21.15.19:0/3888397444 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ef80588f0 con 0x7f4f0c1455b0 2024-03-08T06:04:14.132 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-08T06:04:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.135+0000 7f4f13600640 1 -- 172.21.15.19:0/3888397444 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f4eec06b4d0 msgr2=0x7f4eec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.135+0000 7f4f13600640 1 --2- 172.21.15.19:0/3888397444 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f4eec06b4d0 0x7f4eec06d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4efc035000 tx=0x7f4efc030000 comp rx=0 tx=0).stop 2024-03-08T06:04:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.135+0000 7f4f13600640 1 -- 172.21.15.19:0/3888397444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f0c1455b0 msgr2=0x7f4f0c137f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.135+0000 7f4f13600640 1 --2- 172.21.15.19:0/3888397444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f0c1455b0 0x7f4f0c137f60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800c820 tx=0x7f4ef800cce0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.135+0000 7f4f13600640 1 -- 172.21.15.19:0/3888397444 shutdown_connections 2024-03-08T06:04:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.135+0000 7f4f13600640 1 --2- 172.21.15.19:0/3888397444 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f4eec06b4d0 0x7f4eec06d990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.135+0000 7f4f13600640 1 --2- 172.21.15.19:0/3888397444 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f0c1604f0 0x7f4f0c1f7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.135+0000 7f4f13600640 1 --2- 172.21.15.19:0/3888397444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f0c1455b0 0x7f4f0c137f60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.135+0000 7f4f13600640 1 --2- 172.21.15.19:0/3888397444 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4f0c071950 0x7f4f0c15bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.135+0000 7f4f13600640 1 -- 172.21.15.19:0/3888397444 >> 172.21.15.19:0/3888397444 conn(0x7f4f0c06ae30 msgr2=0x7f4f0c15e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:14.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.135+0000 7f4f13600640 1 -- 172.21.15.19:0/3888397444 shutdown_connections 2024-03-08T06:04:14.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.135+0000 7f4f13600640 1 -- 172.21.15.19:0/3888397444 wait complete. 2024-03-08T06:04:14.155 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T06:04:14.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.383+0000 7f8f87e00640 1 Processor -- start 2024-03-08T06:04:14.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.383+0000 7f8f87e00640 1 -- start start 2024-03-08T06:04:14.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.385+0000 7f8f87e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f880cf030 0x7f8f88161930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:14.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.385+0000 7f8f87e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8f880b9630 0x7f8f880d25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:14.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.385+0000 7f8f87e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f8815e240 con 0x7f8f8815de60 2024-03-08T06:04:14.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.385+0000 7f8f87e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f880b9ac0 con 0x7f8f880cf030 2024-03-08T06:04:14.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.385+0000 7f8f87e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f88162030 con 0x7f8f880b9630 2024-03-08T06:04:14.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.385+0000 7f8f86000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f880cf030 0x7f8f88161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:14.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.385+0000 7f8f86000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f880cf030 0x7f8f88161930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46498/0 (socket says 172.21.15.19:46498) 2024-03-08T06:04:14.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.385+0000 7f8f86000640 1 -- 172.21.15.19:0/1653961459 learned_addr learned my addr 172.21.15.19:0/1653961459 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:14.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.385+0000 7f8f87400640 1 --2- 172.21.15.19:0/1653961459 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8f880b9630 0x7f8f880d25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:14.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.386+0000 7f8f86000640 1 -- 172.21.15.19:0/1653961459 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8f880b9630 msgr2=0x7f8f880d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:14.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.386+0000 7f8f86000640 1 --2- 172.21.15.19:0/1653961459 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8f880b9630 0x7f8f880d25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.386+0000 7f8f86000640 1 -- 172.21.15.19:0/1653961459 >> v1:172.21.15.42:6789/0 conn(0x7f8f8815de60 legacy=0x7f8f880ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:14.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.386+0000 7f8f86000640 1 -- 172.21.15.19:0/1653961459 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f88162310 con 0x7f8f880cf030 2024-03-08T06:04:14.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.387+0000 7f8f86000640 1 --2- 172.21.15.19:0/1653961459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f880cf030 0x7f8f88161930 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009870 tx=0x7f8f7402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ede37256274e520 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:14.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.387+0000 7f8f85600640 1 -- 172.21.15.19:0/1653961459 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74035020 con 0x7f8f880cf030 2024-03-08T06:04:14.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.387+0000 7f8f85600640 1 -- 172.21.15.19:0/1653961459 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f74031640 con 0x7f8f880cf030 2024-03-08T06:04:14.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.387+0000 7f8f85600640 1 -- 172.21.15.19:0/1653961459 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7402d040 con 0x7f8f880cf030 2024-03-08T06:04:14.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.388+0000 7f8f87e00640 1 -- 172.21.15.19:0/1653961459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f880cf030 msgr2=0x7f8f88161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:14.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.388+0000 7f8f87e00640 1 --2- 172.21.15.19:0/1653961459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f880cf030 0x7f8f88161930 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009870 tx=0x7f8f7402b8f0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.388+0000 7f8f87e00640 1 -- 172.21.15.19:0/1653961459 shutdown_connections 2024-03-08T06:04:14.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.388+0000 7f8f87e00640 1 --2- 172.21.15.19:0/1653961459 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8f880b9630 0x7f8f880d25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.388+0000 7f8f87e00640 1 --2- 172.21.15.19:0/1653961459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f880cf030 0x7f8f88161930 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.388+0000 7f8f87e00640 1 -- 172.21.15.19:0/1653961459 >> 172.21.15.19:0/1653961459 conn(0x7f8f8806c500 msgr2=0x7f8f8806c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:14.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.388+0000 7f8f87e00640 1 -- 172.21.15.19:0/1653961459 shutdown_connections 2024-03-08T06:04:14.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.388+0000 7f8f87e00640 1 -- 172.21.15.19:0/1653961459 wait complete. 2024-03-08T06:04:14.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.390+0000 7f8f87e00640 1 Processor -- start 2024-03-08T06:04:14.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.390+0000 7f8f87e00640 1 -- start start 2024-03-08T06:04:14.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.391+0000 7f8f87e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f880b9630 0x7f8f880b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:14.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.391+0000 7f8f87e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f880cf030 0x7f8f880b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:14.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.391+0000 7f8f87e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8f8815de60 0x7f8f88158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:14.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.391+0000 7f8f87e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880d2b20 con 0x7f8f880b9630 2024-03-08T06:04:14.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.391+0000 7f8f87e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880d20c0 con 0x7f8f880cf030 2024-03-08T06:04:14.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.391+0000 7f8f87e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f880d2ca0 con 0x7f8f8815de60 2024-03-08T06:04:14.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.391+0000 7f8f86a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f880b9630 0x7f8f880b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:14.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.391+0000 7f8f86a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f880b9630 0x7f8f880b5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46500/0 (socket says 172.21.15.19:46500) 2024-03-08T06:04:14.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.391+0000 7f8f86a00640 1 -- 172.21.15.19:0/3895972771 learned_addr learned my addr 172.21.15.19:0/3895972771 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:14.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.392+0000 7f8f86000640 1 --2- 172.21.15.19:0/3895972771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f880cf030 0x7f8f880b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:14.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.392+0000 7f8f86a00640 1 -- 172.21.15.19:0/3895972771 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8f8815de60 msgr2=0x7f8f88158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:14.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.392+0000 7f8f86a00640 1 --2- 172.21.15.19:0/3895972771 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8f8815de60 0x7f8f88158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.392+0000 7f8f86a00640 1 -- 172.21.15.19:0/3895972771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f880cf030 msgr2=0x7f8f880b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:14.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.392+0000 7f8f86a00640 1 --2- 172.21.15.19:0/3895972771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f880cf030 0x7f8f880b3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.392+0000 7f8f86a00640 1 -- 172.21.15.19:0/3895972771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8815a6c0 con 0x7f8f880b9630 2024-03-08T06:04:14.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.392+0000 7f8f86a00640 1 --2- 172.21.15.19:0/3895972771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f880b9630 0x7f8f880b5ff0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800b420 tx=0x7f8f7800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:14.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.393+0000 7f8f7ea00640 1 -- 172.21.15.19:0/3895972771 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78011830 con 0x7f8f880b9630 2024-03-08T06:04:14.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.393+0000 7f8f7ea00640 1 -- 172.21.15.19:0/3895972771 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f78016070 con 0x7f8f880b9630 2024-03-08T06:04:14.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.393+0000 7f8f7ea00640 1 -- 172.21.15.19:0/3895972771 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78011c10 con 0x7f8f880b9630 2024-03-08T06:04:14.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.393+0000 7f8f87e00640 1 -- 172.21.15.19:0/3895972771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f88159010 con 0x7f8f880b9630 2024-03-08T06:04:14.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.393+0000 7f8f87e00640 1 -- 172.21.15.19:0/3895972771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f880b4a10 con 0x7f8f880b9630 2024-03-08T06:04:14.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.395+0000 7f8f87e00640 1 -- 172.21.15.19:0/3895972771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f88075090 con 0x7f8f880b9630 2024-03-08T06:04:14.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.395+0000 7f8f7ea00640 1 -- 172.21.15.19:0/3895972771 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f8f7801b460 con 0x7f8f880b9630 2024-03-08T06:04:14.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.396+0000 7f8f7ea00640 1 --2- 172.21.15.19:0/3895972771 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f8f6806b4d0 0x7f8f6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:14.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.397+0000 7f8f7ea00640 1 -- 172.21.15.19:0/3895972771 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8f78089d20 con 0x7f8f880b9630 2024-03-08T06:04:14.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.397+0000 7f8f86000640 1 --2- 172.21.15.19:0/3895972771 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f8f6806b4d0 0x7f8f6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:14.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.397+0000 7f8f86000640 1 --2- 172.21.15.19:0/3895972771 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f8f6806b4d0 0x7f8f6806d990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8f74036000 tx=0x7f8f74008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:14.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.401+0000 7f8f7ea00640 1 -- 172.21.15.19:0/3895972771 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8f78020020 con 0x7f8f880b9630 2024-03-08T06:04:14.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.600+0000 7f8f87e00640 1 -- 172.21.15.19:0/3895972771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8f880d2710 con 0x7f8f880b9630 2024-03-08T06:04:14.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.601+0000 7f8f7ea00640 1 -- 172.21.15.19:0/3895972771 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8f78058b20 con 0x7f8f880b9630 2024-03-08T06:04:14.601 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-08T06:04:14.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.604+0000 7f8f87e00640 1 -- 172.21.15.19:0/3895972771 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f8f6806b4d0 msgr2=0x7f8f6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:14.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.604+0000 7f8f87e00640 1 --2- 172.21.15.19:0/3895972771 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f8f6806b4d0 0x7f8f6806d990 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8f74036000 tx=0x7f8f74008030 comp rx=0 tx=0).stop 2024-03-08T06:04:14.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.604+0000 7f8f87e00640 1 -- 172.21.15.19:0/3895972771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f880b9630 msgr2=0x7f8f880b5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:14.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.604+0000 7f8f87e00640 1 --2- 172.21.15.19:0/3895972771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f880b9630 0x7f8f880b5ff0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8f7800b420 tx=0x7f8f7800b8e0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.604+0000 7f8f87e00640 1 -- 172.21.15.19:0/3895972771 shutdown_connections 2024-03-08T06:04:14.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.604+0000 7f8f87e00640 1 --2- 172.21.15.19:0/3895972771 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f8f6806b4d0 0x7f8f6806d990 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.604+0000 7f8f87e00640 1 --2- 172.21.15.19:0/3895972771 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f8f8815de60 0x7f8f88158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.604+0000 7f8f87e00640 1 --2- 172.21.15.19:0/3895972771 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8f880cf030 0x7f8f880b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.604+0000 7f8f87e00640 1 --2- 172.21.15.19:0/3895972771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f880b9630 0x7f8f880b5ff0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.604+0000 7f8f87e00640 1 -- 172.21.15.19:0/3895972771 >> 172.21.15.19:0/3895972771 conn(0x7f8f8806c500 msgr2=0x7f8f8806c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:14.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.604+0000 7f8f87e00640 1 -- 172.21.15.19:0/3895972771 shutdown_connections 2024-03-08T06:04:14.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.604+0000 7f8f87e00640 1 -- 172.21.15.19:0/3895972771 wait complete. 2024-03-08T06:04:14.625 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T06:04:14.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.854+0000 7fccda800640 1 Processor -- start 2024-03-08T06:04:14.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.855+0000 7fccda800640 1 -- start start 2024-03-08T06:04:14.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.856+0000 7fccda800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fccd415e030 0x7fccd40b95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:14.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.856+0000 7fccda800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fccd40b31a0 0x7fccd40b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:14.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.856+0000 7fccda800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fccd40b5810 0x7fccd40b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:14.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.856+0000 7fccda800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd40d20e0 con 0x7fccd40b5810 2024-03-08T06:04:14.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.856+0000 7fccda800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd40b35e0 con 0x7fccd40b31a0 2024-03-08T06:04:14.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.856+0000 7fccda800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40b72b0 con 0x7fccd415e030 2024-03-08T06:04:14.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.856+0000 7fccd3e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fccd40b5810 0x7fccd40b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:14.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.857+0000 7fccd3e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fccd40b5810 0x7fccd40b5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46506/0 (socket says 172.21.15.19:46506) 2024-03-08T06:04:14.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.857+0000 7fccd3e00640 1 -- 172.21.15.19:0/3029097210 learned_addr learned my addr 172.21.15.19:0/3029097210 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:14.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.857+0000 7fccd3400640 1 --2- 172.21.15.19:0/3029097210 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fccd415e030 0x7fccd40b95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:14.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.857+0000 7fcccbe00640 1 --2- 172.21.15.19:0/3029097210 >> v2:172.21.15.42:3300/0 conn(0x7fccd40b31a0 0x7fccd40b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:14.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.857+0000 7fccd3e00640 1 -- 172.21.15.19:0/3029097210 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fccd415e030 msgr2=0x7fccd40b95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:14.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.857+0000 7fccd3e00640 1 --2- 172.21.15.19:0/3029097210 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fccd415e030 0x7fccd40b95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.857+0000 7fccd3e00640 1 -- 172.21.15.19:0/3029097210 >> v2:172.21.15.42:3300/0 conn(0x7fccd40b31a0 msgr2=0x7fccd40b6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:14.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.857+0000 7fccd3e00640 1 --2- 172.21.15.19:0/3029097210 >> v2:172.21.15.42:3300/0 conn(0x7fccd40b31a0 0x7fccd40b6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.857+0000 7fccd3e00640 1 -- 172.21.15.19:0/3029097210 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd40d2380 con 0x7fccd40b5810 2024-03-08T06:04:14.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.858+0000 7fccd3e00640 1 --2- 172.21.15.19:0/3029097210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccd40b5810 0x7fccd40b5ca0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fccd40d4e90 tx=0x7fcccc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e2281f61ea816a server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:14.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.858+0000 7fccd2a00640 1 -- 172.21.15.19:0/3029097210 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc02cb00 con 0x7fccd40b5810 2024-03-08T06:04:14.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.859+0000 7fccd2a00640 1 -- 172.21.15.19:0/3029097210 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcccc02cca0 con 0x7fccd40b5810 2024-03-08T06:04:14.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.859+0000 7fccd2a00640 1 -- 172.21.15.19:0/3029097210 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc034610 con 0x7fccd40b5810 2024-03-08T06:04:14.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.859+0000 7fccda800640 1 -- 172.21.15.19:0/3029097210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccd40b5810 msgr2=0x7fccd40b5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:14.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.859+0000 7fccda800640 1 --2- 172.21.15.19:0/3029097210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccd40b5810 0x7fccd40b5ca0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fccd40d4e90 tx=0x7fcccc02bf60 comp rx=0 tx=0).stop 2024-03-08T06:04:14.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.859+0000 7fccda800640 1 -- 172.21.15.19:0/3029097210 shutdown_connections 2024-03-08T06:04:14.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.859+0000 7fccda800640 1 --2- 172.21.15.19:0/3029097210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccd40b5810 0x7fccd40b5ca0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.859+0000 7fccda800640 1 --2- 172.21.15.19:0/3029097210 >> v2:172.21.15.42:3300/0 conn(0x7fccd40b31a0 0x7fccd40b6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.859+0000 7fccda800640 1 --2- 172.21.15.19:0/3029097210 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fccd415e030 0x7fccd40b95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.859+0000 7fccda800640 1 -- 172.21.15.19:0/3029097210 >> 172.21.15.19:0/3029097210 conn(0x7fccd4067270 msgr2=0x7fccd40d0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:14.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.860+0000 7fccda800640 1 -- 172.21.15.19:0/3029097210 shutdown_connections 2024-03-08T06:04:14.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.860+0000 7fccda800640 1 -- 172.21.15.19:0/3029097210 wait complete. 2024-03-08T06:04:14.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.862+0000 7fccda800640 1 Processor -- start 2024-03-08T06:04:14.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.862+0000 7fccda800640 1 -- start start 2024-03-08T06:04:14.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.863+0000 7fccda800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fccd40b31a0 0x7fccd41f4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:14.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.864+0000 7fccda800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccd40b5810 0x7fccd4158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:14.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.864+0000 7fccda800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccd415e030 0x7fccd4160c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:14.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.864+0000 7fccda800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40b9cb0 con 0x7fccd40b5810 2024-03-08T06:04:14.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.864+0000 7fccda800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40d2940 con 0x7fccd415e030 2024-03-08T06:04:14.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.864+0000 7fccda800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40d2e60 con 0x7fccd40b31a0 2024-03-08T06:04:14.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.864+0000 7fcccbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccd40b5810 0x7fccd4158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:14.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.864+0000 7fcccbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccd40b5810 0x7fccd4158490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46522/0 (socket says 172.21.15.19:46522) 2024-03-08T06:04:14.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.864+0000 7fcccbe00640 1 -- 172.21.15.19:0/547312756 learned_addr learned my addr 172.21.15.19:0/547312756 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:14.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.864+0000 7fcccbe00640 1 -- 172.21.15.19:0/547312756 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fccd40b31a0 msgr2=0x7fccd41f4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:14.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.864+0000 7fcccbe00640 1 --2- 172.21.15.19:0/547312756 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fccd40b31a0 0x7fccd41f4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.864+0000 7fcccbe00640 1 -- 172.21.15.19:0/547312756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccd415e030 msgr2=0x7fccd4160c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:14.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.864+0000 7fcccbe00640 1 --2- 172.21.15.19:0/547312756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccd415e030 0x7fccd4160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:14.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.864+0000 7fcccbe00640 1 -- 172.21.15.19:0/547312756 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd4158c50 con 0x7fccd40b5810 2024-03-08T06:04:14.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.865+0000 7fcccbe00640 1 --2- 172.21.15.19:0/547312756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccd40b5810 0x7fccd4158490 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fccbc00d800 tx=0x7fccbc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:14.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.865+0000 7fcccb400640 1 -- 172.21.15.19:0/547312756 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc018020 con 0x7fccd40b5810 2024-03-08T06:04:14.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.865+0000 7fcccb400640 1 -- 172.21.15.19:0/547312756 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc0096a0 con 0x7fccd40b5810 2024-03-08T06:04:14.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.865+0000 7fcccb400640 1 -- 172.21.15.19:0/547312756 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc009a70 con 0x7fccd40b5810 2024-03-08T06:04:14.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.865+0000 7fccda800640 1 -- 172.21.15.19:0/547312756 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd4158f30 con 0x7fccd40b5810 2024-03-08T06:04:14.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.865+0000 7fccda800640 1 -- 172.21.15.19:0/547312756 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd4159a10 con 0x7fccd40b5810 2024-03-08T06:04:14.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.866+0000 7fccda800640 1 -- 172.21.15.19:0/547312756 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd4067cb0 con 0x7fccd40b5810 2024-03-08T06:04:14.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.867+0000 7fcccb400640 1 -- 172.21.15.19:0/547312756 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fccbc01b020 con 0x7fccd40b5810 2024-03-08T06:04:14.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.869+0000 7fcccb400640 1 --2- 172.21.15.19:0/547312756 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fccb006b4d0 0x7fccb006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:14.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.869+0000 7fcccb400640 1 -- 172.21.15.19:0/547312756 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fccbc08a730 con 0x7fccd40b5810 2024-03-08T06:04:14.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.869+0000 7fccd3400640 1 --2- 172.21.15.19:0/547312756 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fccb006b4d0 0x7fccb006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:14.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.870+0000 7fccd3400640 1 --2- 172.21.15.19:0/547312756 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fccb006b4d0 0x7fccb006d990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fccc4006fd0 tx=0x7fccc4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:14.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:14.873+0000 7fcccb400640 1 -- 172.21.15.19:0/547312756 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fccbc022020 con 0x7fccd40b5810 2024-03-08T06:04:15.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.072+0000 7fccda800640 1 -- 172.21.15.19:0/547312756 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fccd40b96a0 con 0x7fccd40b5810 2024-03-08T06:04:15.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.072+0000 7fcccb400640 1 -- 172.21.15.19:0/547312756 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fccbc058f70 con 0x7fccd40b5810 2024-03-08T06:04:15.072 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-08T06:04:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.075+0000 7fccda800640 1 -- 172.21.15.19:0/547312756 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fccb006b4d0 msgr2=0x7fccb006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.075+0000 7fccda800640 1 --2- 172.21.15.19:0/547312756 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fccb006b4d0 0x7fccb006d990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fccc4006fd0 tx=0x7fccc4008040 comp rx=0 tx=0).stop 2024-03-08T06:04:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.075+0000 7fccda800640 1 -- 172.21.15.19:0/547312756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccd40b5810 msgr2=0x7fccd4158490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.075+0000 7fccda800640 1 --2- 172.21.15.19:0/547312756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccd40b5810 0x7fccd4158490 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fccbc00d800 tx=0x7fccbc00dcc0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.075+0000 7fccda800640 1 -- 172.21.15.19:0/547312756 shutdown_connections 2024-03-08T06:04:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.075+0000 7fccda800640 1 --2- 172.21.15.19:0/547312756 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fccb006b4d0 0x7fccb006d990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.075+0000 7fccda800640 1 --2- 172.21.15.19:0/547312756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccd415e030 0x7fccd4160c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.075+0000 7fccda800640 1 --2- 172.21.15.19:0/547312756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccd40b5810 0x7fccd4158490 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.075+0000 7fccda800640 1 --2- 172.21.15.19:0/547312756 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fccd40b31a0 0x7fccd41f4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.075+0000 7fccda800640 1 -- 172.21.15.19:0/547312756 >> 172.21.15.19:0/547312756 conn(0x7fccd4067270 msgr2=0x7fccd40d4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:15.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.075+0000 7fccda800640 1 -- 172.21.15.19:0/547312756 shutdown_connections 2024-03-08T06:04:15.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.075+0000 7fccda800640 1 -- 172.21.15.19:0/547312756 wait complete. 2024-03-08T06:04:15.094 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T06:04:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.320+0000 7f307aa00640 1 Processor -- start 2024-03-08T06:04:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.320+0000 7f307aa00640 1 -- start start 2024-03-08T06:04:15.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.322+0000 7f307aa00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3074071ab0 0x7f307415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.322+0000 7f307aa00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f307415d0c0 con 0x7f3074071e90 2024-03-08T06:04:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.322+0000 7f307aa00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f307406da80 con 0x7f307406d600 2024-03-08T06:04:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.322+0000 7f307aa00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f307406ef40 con 0x7f3074071ab0 2024-03-08T06:04:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.322+0000 7f3078a00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3074071e90 0x7f307415d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43832/0 (socket says 172.21.15.19:43832) 2024-03-08T06:04:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.323+0000 7f3078a00640 1 -- 172.21.15.19:0/134648281 learned_addr learned my addr 172.21.15.19:0/134648281 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.323+0000 7f3073e00640 1 --2- 172.21.15.19:0/134648281 >> v2:172.21.15.42:3300/0 conn(0x7f3074071ab0 0x7f307415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.323+0000 7f3073400640 1 -- 172.21.15.19:0/134648281 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2443033747 0 0) 0x7f306c001490 con 0x7f3074071e90 2024-03-08T06:04:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.323+0000 7f3073400640 1 -- 172.21.15.19:0/134648281 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3058003520 con 0x7f3074071e90 2024-03-08T06:04:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.323+0000 7f3073400640 1 -- 172.21.15.19:0/134648281 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3036831194 0 0) 0x7f3058003520 con 0x7f3074071e90 2024-03-08T06:04:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.323+0000 7f3073400640 1 -- 172.21.15.19:0/134648281 >> v2:172.21.15.42:3300/0 conn(0x7f3074071ab0 msgr2=0x7f307415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.323+0000 7f3073400640 1 --2- 172.21.15.19:0/134648281 >> v2:172.21.15.42:3300/0 conn(0x7f3074071ab0 0x7f307415cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.323+0000 7f3073400640 1 -- 172.21.15.19:0/134648281 >> v1:172.21.15.42:6789/0 conn(0x7f307406d600 legacy=0x7f3074144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.323+0000 7f3073400640 1 -- 172.21.15.19:0/134648281 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307406dd60 con 0x7f3074071e90 2024-03-08T06:04:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.323+0000 7f3073400640 1 -- 172.21.15.19:0/134648281 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f306c001bc0 con 0x7f3074071e90 2024-03-08T06:04:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.323+0000 7f3073400640 1 -- 172.21.15.19:0/134648281 >> v1:172.21.15.19:6789/0 conn(0x7f3074071e90 legacy=0x7f307415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.324+0000 7f3073400640 1 --2- 172.21.15.19:0/134648281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3058003a00 0x7f3058003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.324+0000 7f3073400640 1 --2- 172.21.15.19:0/134648281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3058004800 0x7f3058004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:15.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.324+0000 7f3073400640 1 --2- 172.21.15.19:0/134648281 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f30580051c0 0x7f305800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.324+0000 7f3073400640 1 -- 172.21.15.19:0/134648281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305800c090 con 0x7f3058004800 2024-03-08T06:04:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.324+0000 7f3073400640 1 -- 172.21.15.19:0/134648281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305800c210 con 0x7f3058003a00 2024-03-08T06:04:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.324+0000 7f3073400640 1 -- 172.21.15.19:0/134648281 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305800c410 con 0x7f30580051c0 2024-03-08T06:04:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.324+0000 7f306b400640 1 --2- 172.21.15.19:0/134648281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3058004800 0x7f3058004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.324+0000 7f3073e00640 1 --2- 172.21.15.19:0/134648281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3058003a00 0x7f3058003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.324+0000 7f306b400640 1 -- 172.21.15.19:0/134648281 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f30580051c0 msgr2=0x7f305800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.324+0000 7f306b400640 1 --2- 172.21.15.19:0/134648281 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f30580051c0 0x7f305800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.324+0000 7f306b400640 1 -- 172.21.15.19:0/134648281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3058003a00 msgr2=0x7f3058003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.324+0000 7f306b400640 1 --2- 172.21.15.19:0/134648281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3058003a00 0x7f3058003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.324+0000 7f306b400640 1 -- 172.21.15.19:0/134648281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3058003520 con 0x7f3058004800 2024-03-08T06:04:15.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.324+0000 7f3078a00640 1 -- 172.21.15.19:0/134648281 reap_dead start 2024-03-08T06:04:15.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.325+0000 7f306b400640 1 --2- 172.21.15.19:0/134648281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3058004800 0x7f3058004c80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3074072760 tx=0x7f3058005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7818ced56904cda6 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:15.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.326+0000 7f3073400640 1 -- 172.21.15.19:0/134648281 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c037070 con 0x7f3058004800 2024-03-08T06:04:15.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.326+0000 7f3073400640 1 -- 172.21.15.19:0/134648281 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c032600 con 0x7f3058004800 2024-03-08T06:04:15.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.326+0000 7f3073400640 1 -- 172.21.15.19:0/134648281 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c0039a0 con 0x7f3058004800 2024-03-08T06:04:15.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.326+0000 7f307aa00640 1 -- 172.21.15.19:0/134648281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3058004800 msgr2=0x7f3058004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:15.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.326+0000 7f307aa00640 1 --2- 172.21.15.19:0/134648281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3058004800 0x7f3058004c80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3074072760 tx=0x7f3058005830 comp rx=0 tx=0).stop 2024-03-08T06:04:15.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.326+0000 7f307aa00640 1 -- 172.21.15.19:0/134648281 shutdown_connections 2024-03-08T06:04:15.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.326+0000 7f307aa00640 1 --2- 172.21.15.19:0/134648281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3058004800 0x7f3058004c80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.326+0000 7f307aa00640 1 -- 172.21.15.19:0/134648281 >> 172.21.15.19:0/134648281 conn(0x7f307406ae30 msgr2=0x7f307406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:15.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.327+0000 7f307aa00640 1 -- 172.21.15.19:0/134648281 shutdown_connections 2024-03-08T06:04:15.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.327+0000 7f307aa00640 1 -- 172.21.15.19:0/134648281 wait complete. 2024-03-08T06:04:15.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.328+0000 7f307aa00640 1 Processor -- start 2024-03-08T06:04:15.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.328+0000 7f307aa00640 1 -- start start 2024-03-08T06:04:15.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.329+0000 7f307aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3058004800 0x7f307415ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:15.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.329+0000 7f307aa00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30740c7420 0x7f30740c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:15.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.329+0000 7f307aa00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f30740c8950 0x7f30740b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:15.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.329+0000 7f307aa00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307406e600 con 0x7f30740c7420 2024-03-08T06:04:15.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.329+0000 7f307aa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307406e320 con 0x7f3058004800 2024-03-08T06:04:15.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.329+0000 7f307aa00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307415cb80 con 0x7f30740c8950 2024-03-08T06:04:15.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.330+0000 7f306b400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30740c7420 0x7f30740c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:15.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.330+0000 7f306b400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30740c7420 0x7f30740c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46538/0 (socket says 172.21.15.19:46538) 2024-03-08T06:04:15.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.330+0000 7f306b400640 1 -- 172.21.15.19:0/2547118561 learned_addr learned my addr 172.21.15.19:0/2547118561 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:15.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.330+0000 7f3078a00640 1 --2- 172.21.15.19:0/2547118561 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f30740c8950 0x7f30740b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:15.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.330+0000 7f3073e00640 1 --2- 172.21.15.19:0/2547118561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3058004800 0x7f307415ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:15.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.330+0000 7f306b400640 1 -- 172.21.15.19:0/2547118561 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f30740c8950 msgr2=0x7f30740b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:15.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.330+0000 7f306b400640 1 --2- 172.21.15.19:0/2547118561 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f30740c8950 0x7f30740b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.330+0000 7f306b400640 1 -- 172.21.15.19:0/2547118561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3058004800 msgr2=0x7f307415ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:15.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.330+0000 7f306b400640 1 --2- 172.21.15.19:0/2547118561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3058004800 0x7f307415ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.330+0000 7f306b400640 1 -- 172.21.15.19:0/2547118561 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30740c78b0 con 0x7f30740c7420 2024-03-08T06:04:15.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.330+0000 7f3078a00640 1 --2- 172.21.15.19:0/2547118561 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f30740c8950 0x7f30740b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:15.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.331+0000 7f306b400640 1 --2- 172.21.15.19:0/2547118561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30740c7420 0x7f30740c9750 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f305c035040 tx=0x7f305c0036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:15.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.331+0000 7f3070c00640 1 -- 172.21.15.19:0/2547118561 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c041070 con 0x7f30740c7420 2024-03-08T06:04:15.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.331+0000 7f3070c00640 1 -- 172.21.15.19:0/2547118561 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c03c670 con 0x7f30740c7420 2024-03-08T06:04:15.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.331+0000 7f307aa00640 1 -- 172.21.15.19:0/2547118561 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30740c7e70 con 0x7f30740c7420 2024-03-08T06:04:15.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.331+0000 7f3070c00640 1 -- 172.21.15.19:0/2547118561 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c037040 con 0x7f30740c7420 2024-03-08T06:04:15.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.331+0000 7f307aa00640 1 -- 172.21.15.19:0/2547118561 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30740c8430 con 0x7f30740c7420 2024-03-08T06:04:15.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.332+0000 7f307aa00640 1 -- 172.21.15.19:0/2547118561 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30740c7b90 con 0x7f30740c7420 2024-03-08T06:04:15.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.333+0000 7f3070c00640 1 -- 172.21.15.19:0/2547118561 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f305c03a070 con 0x7f30740c7420 2024-03-08T06:04:15.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.334+0000 7f3070c00640 1 --2- 172.21.15.19:0/2547118561 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f305006b4d0 0x7f305006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:15.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.334+0000 7f3070c00640 1 -- 172.21.15.19:0/2547118561 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f305c0ab970 con 0x7f30740c7420 2024-03-08T06:04:15.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.334+0000 7f3073e00640 1 --2- 172.21.15.19:0/2547118561 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f305006b4d0 0x7f305006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:15.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.335+0000 7f3073e00640 1 --2- 172.21.15.19:0/2547118561 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f305006b4d0 0x7f305006d990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f307406a6b0 tx=0x7f3064008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:15.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.339+0000 7f3070c00640 1 -- 172.21.15.19:0/2547118561 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f305c07a1b0 con 0x7f30740c7420 2024-03-08T06:04:15.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.579+0000 7f307aa00640 1 -- 172.21.15.19:0/2547118561 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f307406e970 con 0x7f30740c7420 2024-03-08T06:04:15.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.581+0000 7f3070c00640 1 -- 172.21.15.19:0/2547118561 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7f305c07e250 con 0x7f30740c7420 2024-03-08T06:04:15.581 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:15.581 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1494509643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6835","nonce":1494509643},{"type":"v1","addr":"172.21.15.19:6837","nonce":1494509643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/2031610239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2031610239},{"type":"v1","addr":"172.21.15.42:6834","nonce":2031610239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6836/1964979810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1964979810},{"type":"v1","addr":"172.21.15.19:6836","nonce":1964979810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T06:03:20.532032+0000","modified":"2024-03-08T06:03:23.604391+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1462224228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1462224228},{"type":"v1","addr":"172.21.15.42:6835","nonce":1462224228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T06:04:15.581 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2024-03-08T06:04:15.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.583+0000 7f307aa00640 1 -- 172.21.15.19:0/2547118561 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f305006b4d0 msgr2=0x7f305006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:15.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.583+0000 7f307aa00640 1 --2- 172.21.15.19:0/2547118561 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f305006b4d0 0x7f305006d990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f307406a6b0 tx=0x7f3064008040 comp rx=0 tx=0).stop 2024-03-08T06:04:15.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.583+0000 7f307aa00640 1 -- 172.21.15.19:0/2547118561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30740c7420 msgr2=0x7f30740c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:15.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.583+0000 7f307aa00640 1 --2- 172.21.15.19:0/2547118561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30740c7420 0x7f30740c9750 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f305c035040 tx=0x7f305c0036f0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.584+0000 7f307aa00640 1 -- 172.21.15.19:0/2547118561 shutdown_connections 2024-03-08T06:04:15.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.584+0000 7f307aa00640 1 --2- 172.21.15.19:0/2547118561 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f305006b4d0 0x7f305006d990 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.584+0000 7f307aa00640 1 --2- 172.21.15.19:0/2547118561 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f30740c8950 0x7f30740b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.584+0000 7f307aa00640 1 --2- 172.21.15.19:0/2547118561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30740c7420 0x7f30740c9750 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.584+0000 7f307aa00640 1 --2- 172.21.15.19:0/2547118561 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3058004800 0x7f307415ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.584+0000 7f307aa00640 1 -- 172.21.15.19:0/2547118561 >> 172.21.15.19:0/2547118561 conn(0x7f307406ae30 msgr2=0x7f30740ae700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:15.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.584+0000 7f307aa00640 1 -- 172.21.15.19:0/2547118561 shutdown_connections 2024-03-08T06:04:15.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.584+0000 7f307aa00640 1 -- 172.21.15.19:0/2547118561 wait complete. 2024-03-08T06:04:15.603 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:04:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.816+0000 7fb6d0c00640 1 Processor -- start 2024-03-08T06:04:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.816+0000 7fb6d0c00640 1 -- start start 2024-03-08T06:04:15.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.818+0000 7fb6d0c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb6cc15ed80 0x7fb6cc06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:15.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.818+0000 7fb6d0c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb6cc06e870 0x7fb6cc15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:15.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.818+0000 7fb6d0c00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6cc06ec90 con 0x7fb6cc15a770 2024-03-08T06:04:15.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.818+0000 7fb6d0c00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6cc0ccdd0 con 0x7fb6cc06e870 2024-03-08T06:04:15.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.818+0000 7fb6d0c00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6cc15e8f0 con 0x7fb6cc15ed80 2024-03-08T06:04:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.818+0000 7fb6cbe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb6cc06e870 0x7fb6cc15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.819+0000 7fb6cbe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb6cc06e870 0x7fb6cc15ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46542/0 (socket says 172.21.15.19:46542) 2024-03-08T06:04:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.819+0000 7fb6cbe00640 1 -- 172.21.15.19:0/3448373874 learned_addr learned my addr 172.21.15.19:0/3448373874 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.819+0000 7fb6caa00640 1 --2- 172.21.15.19:0/3448373874 >> v2:172.21.15.42:3300/0 conn(0x7fb6cc15ed80 0x7fb6cc06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.819+0000 7fb6cbe00640 1 -- 172.21.15.19:0/3448373874 >> v2:172.21.15.42:3300/0 conn(0x7fb6cc15ed80 msgr2=0x7fb6cc06e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.819+0000 7fb6cbe00640 1 --2- 172.21.15.19:0/3448373874 >> v2:172.21.15.42:3300/0 conn(0x7fb6cc15ed80 0x7fb6cc06e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.819+0000 7fb6cbe00640 1 -- 172.21.15.19:0/3448373874 >> v1:172.21.15.42:6789/0 conn(0x7fb6cc15a770 legacy=0x7fb6cc0cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.819+0000 7fb6cbe00640 1 -- 172.21.15.19:0/3448373874 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc0cd020 con 0x7fb6cc06e870 2024-03-08T06:04:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.820+0000 7fb6cbe00640 1 --2- 172.21.15.19:0/3448373874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6cc06e870 0x7fb6cc15ab50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0cf890 tx=0x7fb6c402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91eaf8676b0b25a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.821+0000 7fb6ca000640 1 -- 172.21.15.19:0/3448373874 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4035020 con 0x7fb6cc06e870 2024-03-08T06:04:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.821+0000 7fb6ca000640 1 -- 172.21.15.19:0/3448373874 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c4031870 con 0x7fb6cc06e870 2024-03-08T06:04:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.821+0000 7fb6ca000640 1 -- 172.21.15.19:0/3448373874 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4031c40 con 0x7fb6cc06e870 2024-03-08T06:04:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.821+0000 7fb6d0c00640 1 -- 172.21.15.19:0/3448373874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6cc06e870 msgr2=0x7fb6cc15ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.821+0000 7fb6d0c00640 1 --2- 172.21.15.19:0/3448373874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6cc06e870 0x7fb6cc15ab50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0cf890 tx=0x7fb6c402b910 comp rx=0 tx=0).stop 2024-03-08T06:04:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.822+0000 7fb6d0c00640 1 -- 172.21.15.19:0/3448373874 shutdown_connections 2024-03-08T06:04:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.822+0000 7fb6d0c00640 1 --2- 172.21.15.19:0/3448373874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6cc06e870 0x7fb6cc15ab50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.822+0000 7fb6d0c00640 1 --2- 172.21.15.19:0/3448373874 >> v2:172.21.15.42:3300/0 conn(0x7fb6cc15ed80 0x7fb6cc06e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.822+0000 7fb6d0c00640 1 -- 172.21.15.19:0/3448373874 >> 172.21.15.19:0/3448373874 conn(0x7fb6cc0b1850 msgr2=0x7fb6cc0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.822+0000 7fb6d0c00640 1 -- 172.21.15.19:0/3448373874 shutdown_connections 2024-03-08T06:04:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.822+0000 7fb6d0c00640 1 -- 172.21.15.19:0/3448373874 wait complete. 2024-03-08T06:04:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.823+0000 7fb6d0c00640 1 Processor -- start 2024-03-08T06:04:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.824+0000 7fb6d0c00640 1 -- start start 2024-03-08T06:04:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.824+0000 7fb6d0c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6cc06e870 0x7fb6cc1500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.824+0000 7fb6d0c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb6cc15a770 0x7fb6cc14be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.824+0000 7fb6d0c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6cc15ed80 0x7fb6cc1f7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.824+0000 7fb6d0c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc15f200 con 0x7fb6cc15ed80 2024-03-08T06:04:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.824+0000 7fb6d0c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc15e580 con 0x7fb6cc06e870 2024-03-08T06:04:15.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.824+0000 7fb6d0c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc0b4e00 con 0x7fb6cc15a770 2024-03-08T06:04:15.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.825+0000 7fb6cbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6cc15ed80 0x7fb6cc1f7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:15.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.825+0000 7fb6cbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6cc15ed80 0x7fb6cc1f7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46548/0 (socket says 172.21.15.19:46548) 2024-03-08T06:04:15.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.825+0000 7fb6cbe00640 1 -- 172.21.15.19:0/3057525262 learned_addr learned my addr 172.21.15.19:0/3057525262 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:15.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.825+0000 7fb6cb400640 1 --2- 172.21.15.19:0/3057525262 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6cc06e870 0x7fb6cc1500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:15.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.825+0000 7fb6caa00640 1 --2- 172.21.15.19:0/3057525262 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb6cc15a770 0x7fb6cc14be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:15.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.825+0000 7fb6cbe00640 1 -- 172.21.15.19:0/3057525262 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb6cc15a770 msgr2=0x7fb6cc14be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:15.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.825+0000 7fb6cbe00640 1 --2- 172.21.15.19:0/3057525262 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb6cc15a770 0x7fb6cc14be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.825+0000 7fb6cbe00640 1 -- 172.21.15.19:0/3057525262 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6cc06e870 msgr2=0x7fb6cc1500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:15.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.825+0000 7fb6cbe00640 1 --2- 172.21.15.19:0/3057525262 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6cc06e870 0x7fb6cc1500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:15.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.825+0000 7fb6cbe00640 1 -- 172.21.15.19:0/3057525262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc14cbe0 con 0x7fb6cc15ed80 2024-03-08T06:04:15.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.826+0000 7fb6cbe00640 1 --2- 172.21.15.19:0/3057525262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6cc15ed80 0x7fb6cc1f7020 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40090b0 tx=0x7fb6c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:15.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.826+0000 7fb6c3400640 1 -- 172.21.15.19:0/3057525262 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4040070 con 0x7fb6cc15ed80 2024-03-08T06:04:15.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.826+0000 7fb6c3400640 1 -- 172.21.15.19:0/3057525262 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c4030d00 con 0x7fb6cc15ed80 2024-03-08T06:04:15.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.826+0000 7fb6c3400640 1 -- 172.21.15.19:0/3057525262 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4035040 con 0x7fb6cc15ed80 2024-03-08T06:04:15.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.826+0000 7fb6d0c00640 1 -- 172.21.15.19:0/3057525262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6cc1506f0 con 0x7fb6cc15ed80 2024-03-08T06:04:15.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.826+0000 7fb6d0c00640 1 -- 172.21.15.19:0/3057525262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6cc14ce80 con 0x7fb6cc15ed80 2024-03-08T06:04:15.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.827+0000 7fb6d0c00640 1 -- 172.21.15.19:0/3057525262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6cc075100 con 0x7fb6cc15ed80 2024-03-08T06:04:15.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.828+0000 7fb6c3400640 1 -- 172.21.15.19:0/3057525262 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb6c404b060 con 0x7fb6cc15ed80 2024-03-08T06:04:15.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.829+0000 7fb6c3400640 1 --2- 172.21.15.19:0/3057525262 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb6a806b4d0 0x7fb6a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:15.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.829+0000 7fb6c3400640 1 -- 172.21.15.19:0/3057525262 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb6c40ac070 con 0x7fb6cc15ed80 2024-03-08T06:04:15.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.830+0000 7fb6cb400640 1 --2- 172.21.15.19:0/3057525262 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb6a806b4d0 0x7fb6a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:15.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.830+0000 7fb6cb400640 1 --2- 172.21.15.19:0/3057525262 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb6a806b4d0 0x7fb6a806d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4007fd0 tx=0x7fb6b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:15.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:15.835+0000 7fb6c3400640 1 -- 172.21.15.19:0/3057525262 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb6c407add0 con 0x7fb6cc15ed80 2024-03-08T06:04:16.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.034+0000 7fb6d0c00640 1 -- 172.21.15.19:0/3057525262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6cc0b2f50 con 0x7fb6cc15ed80 2024-03-08T06:04:16.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.037+0000 7fb6c3400640 1 -- 172.21.15.19:0/3057525262 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16795 (secure 0 0 0) 0x7fb6c407a6d0 con 0x7fb6cc15ed80 2024-03-08T06:04:16.038 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:16.038 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":23,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:04:07.332571+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:03:18.392703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T06:03:19.537912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:04:16.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.040+0000 7fb6d0c00640 1 -- 172.21.15.19:0/3057525262 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb6a806b4d0 msgr2=0x7fb6a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:16.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.040+0000 7fb6d0c00640 1 --2- 172.21.15.19:0/3057525262 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb6a806b4d0 0x7fb6a806d990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4007fd0 tx=0x7fb6b4009040 comp rx=0 tx=0).stop 2024-03-08T06:04:16.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.040+0000 7fb6d0c00640 1 -- 172.21.15.19:0/3057525262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6cc15ed80 msgr2=0x7fb6cc1f7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:16.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.040+0000 7fb6d0c00640 1 --2- 172.21.15.19:0/3057525262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6cc15ed80 0x7fb6cc1f7020 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40090b0 tx=0x7fb6c40046c0 comp rx=0 tx=0).stop 2024-03-08T06:04:16.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.040+0000 7fb6d0c00640 1 -- 172.21.15.19:0/3057525262 shutdown_connections 2024-03-08T06:04:16.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.040+0000 7fb6d0c00640 1 --2- 172.21.15.19:0/3057525262 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb6a806b4d0 0x7fb6a806d990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:16.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.040+0000 7fb6d0c00640 1 --2- 172.21.15.19:0/3057525262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6cc15ed80 0x7fb6cc1f7020 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:16.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.040+0000 7fb6d0c00640 1 --2- 172.21.15.19:0/3057525262 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb6cc15a770 0x7fb6cc14be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:16.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.040+0000 7fb6d0c00640 1 --2- 172.21.15.19:0/3057525262 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb6cc06e870 0x7fb6cc1500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:16.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.040+0000 7fb6d0c00640 1 -- 172.21.15.19:0/3057525262 >> 172.21.15.19:0/3057525262 conn(0x7fb6cc0b1850 msgr2=0x7fb6cc15b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:16.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.040+0000 7fb6d0c00640 1 -- 172.21.15.19:0/3057525262 shutdown_connections 2024-03-08T06:04:16.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.040+0000 7fb6d0c00640 1 -- 172.21.15.19:0/3057525262 wait complete. 2024-03-08T06:04:16.059 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-08T06:04:16.060 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T06:04:16.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.285+0000 7ff0fe200640 1 Processor -- start 2024-03-08T06:04:16.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.285+0000 7ff0fe200640 1 -- start start 2024-03-08T06:04:16.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.286+0000 7ff0fe200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff0f8144840 0x7ff0f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:16.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.286+0000 7ff0fe200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0f8071600 0x7ff0f8071a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:16.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.286+0000 7ff0fe200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f80720a0 con 0x7ff0f806eb30 2024-03-08T06:04:16.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.287+0000 7ff0fe200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f8144c20 con 0x7ff0f8144840 2024-03-08T06:04:16.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.287+0000 7ff0fe200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f806d810 con 0x7ff0f8071600 2024-03-08T06:04:16.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.287+0000 7ff0f7400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff0f8144840 0x7ff0f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:16.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.287+0000 7ff0f7400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff0f8144840 0x7ff0f806e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46556/0 (socket says 172.21.15.19:46556) 2024-03-08T06:04:16.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.287+0000 7ff0f7400640 1 -- 172.21.15.19:0/691833457 learned_addr learned my addr 172.21.15.19:0/691833457 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:16.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.287+0000 7ff0f6a00640 1 --2- 172.21.15.19:0/691833457 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0f8071600 0x7ff0f8071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:16.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.287+0000 7ff0f7400640 1 -- 172.21.15.19:0/691833457 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0f8071600 msgr2=0x7ff0f8071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:16.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.287+0000 7ff0f7400640 1 --2- 172.21.15.19:0/691833457 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0f8071600 0x7ff0f8071a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:16.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.287+0000 7ff0f7400640 1 -- 172.21.15.19:0/691833457 >> v1:172.21.15.42:6789/0 conn(0x7ff0f806eb30 legacy=0x7ff0f80cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:16.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.287+0000 7ff0f7400640 1 -- 172.21.15.19:0/691833457 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f806daf0 con 0x7ff0f8144840 2024-03-08T06:04:16.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.287+0000 7ff0f6a00640 1 --2- 172.21.15.19:0/691833457 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0f8071600 0x7ff0f8071a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:16.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.289+0000 7ff0f7400640 1 --2- 172.21.15.19:0/691833457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0f8144840 0x7ff0f806e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009e50 tx=0x7ff0e802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2a49d81e059d33 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:16.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.289+0000 7ff0f6000640 1 -- 172.21.15.19:0/691833457 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e802ca80 con 0x7ff0f8144840 2024-03-08T06:04:16.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.289+0000 7ff0f6000640 1 -- 172.21.15.19:0/691833457 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e802cc20 con 0x7ff0f8144840 2024-03-08T06:04:16.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.289+0000 7ff0f6000640 1 -- 172.21.15.19:0/691833457 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e80343f0 con 0x7ff0f8144840 2024-03-08T06:04:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.290+0000 7ff0fe200640 1 -- 172.21.15.19:0/691833457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0f8144840 msgr2=0x7ff0f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.290+0000 7ff0fe200640 1 --2- 172.21.15.19:0/691833457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0f8144840 0x7ff0f806e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009e50 tx=0x7ff0e802bee0 comp rx=0 tx=0).stop 2024-03-08T06:04:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.290+0000 7ff0fe200640 1 -- 172.21.15.19:0/691833457 shutdown_connections 2024-03-08T06:04:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.290+0000 7ff0fe200640 1 --2- 172.21.15.19:0/691833457 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0f8071600 0x7ff0f8071a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.290+0000 7ff0fe200640 1 --2- 172.21.15.19:0/691833457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0f8144840 0x7ff0f806e2f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.290+0000 7ff0fe200640 1 -- 172.21.15.19:0/691833457 >> 172.21.15.19:0/691833457 conn(0x7ff0f806ac50 msgr2=0x7ff0f806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.290+0000 7ff0fe200640 1 -- 172.21.15.19:0/691833457 shutdown_connections 2024-03-08T06:04:16.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.290+0000 7ff0fe200640 1 -- 172.21.15.19:0/691833457 wait complete. 2024-03-08T06:04:16.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.292+0000 7ff0fe200640 1 Processor -- start 2024-03-08T06:04:16.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.292+0000 7ff0fe200640 1 -- start start 2024-03-08T06:04:16.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.294+0000 7ff0fe200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0f806eb30 0x7ff0f815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:16.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.294+0000 7ff0fe200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0f8071600 0x7ff0f81384c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:16.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.294+0000 7ff0fe200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0f8144840 0x7ff0f81f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:16.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.294+0000 7ff0fe200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f806ef80 con 0x7ff0f806eb30 2024-03-08T06:04:16.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.294+0000 7ff0fe200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f8145010 con 0x7ff0f8071600 2024-03-08T06:04:16.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.294+0000 7ff0fe200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f806f100 con 0x7ff0f8144840 2024-03-08T06:04:16.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.294+0000 7ff0f7400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0f806eb30 0x7ff0f815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:16.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.294+0000 7ff0f7400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0f806eb30 0x7ff0f815bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46560/0 (socket says 172.21.15.19:46560) 2024-03-08T06:04:16.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.294+0000 7ff0f7400640 1 -- 172.21.15.19:0/2526427415 learned_addr learned my addr 172.21.15.19:0/2526427415 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:16.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.294+0000 7ff0f7e00640 1 --2- 172.21.15.19:0/2526427415 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0f8144840 0x7ff0f81f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:16.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.294+0000 7ff0f6a00640 1 --2- 172.21.15.19:0/2526427415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0f8071600 0x7ff0f81384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:16.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.294+0000 7ff0f7400640 1 -- 172.21.15.19:0/2526427415 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0f8144840 msgr2=0x7ff0f81f3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:16.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.294+0000 7ff0f7400640 1 --2- 172.21.15.19:0/2526427415 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0f8144840 0x7ff0f81f3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.294+0000 7ff0f7400640 1 -- 172.21.15.19:0/2526427415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0f8071600 msgr2=0x7ff0f81384c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.294+0000 7ff0f7400640 1 --2- 172.21.15.19:0/2526427415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0f8071600 0x7ff0f81384c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.294+0000 7ff0f7400640 1 -- 172.21.15.19:0/2526427415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f815c760 con 0x7ff0f806eb30 2024-03-08T06:04:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.294+0000 7ff0f7e00640 1 --2- 172.21.15.19:0/2526427415 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0f8144840 0x7ff0f81f3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.295+0000 7ff0f7400640 1 --2- 172.21.15.19:0/2526427415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0f806eb30 0x7ff0f815bf30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009e50 tx=0x7ff0e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.295+0000 7ff0ef400640 1 -- 172.21.15.19:0/2526427415 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8043020 con 0x7ff0f806eb30 2024-03-08T06:04:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.295+0000 7ff0ef400640 1 -- 172.21.15.19:0/2526427415 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e803e450 con 0x7ff0f806eb30 2024-03-08T06:04:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.295+0000 7ff0ef400640 1 -- 172.21.15.19:0/2526427415 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e803e840 con 0x7ff0f806eb30 2024-03-08T06:04:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.295+0000 7ff0fe200640 1 -- 172.21.15.19:0/2526427415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f815ca40 con 0x7ff0f806eb30 2024-03-08T06:04:16.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.295+0000 7ff0fe200640 1 -- 172.21.15.19:0/2526427415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f815d000 con 0x7ff0f806eb30 2024-03-08T06:04:16.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.297+0000 7ff0fe200640 1 -- 172.21.15.19:0/2526427415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f80674c0 con 0x7ff0f806eb30 2024-03-08T06:04:16.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.297+0000 7ff0ef400640 1 -- 172.21.15.19:0/2526427415 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff0e8046020 con 0x7ff0f806eb30 2024-03-08T06:04:16.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.299+0000 7ff0ef400640 1 --2- 172.21.15.19:0/2526427415 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff0d806b500 0x7ff0d806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:16.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.299+0000 7ff0ef400640 1 -- 172.21.15.19:0/2526427415 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff0e80ac890 con 0x7ff0f806eb30 2024-03-08T06:04:16.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.299+0000 7ff0f6a00640 1 --2- 172.21.15.19:0/2526427415 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff0d806b500 0x7ff0d806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:16.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.300+0000 7ff0f6a00640 1 --2- 172.21.15.19:0/2526427415 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff0d806b500 0x7ff0d806d9c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff0f815ad10 tx=0x7ff0e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:16.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.303+0000 7ff0ef400640 1 -- 172.21.15.19:0/2526427415 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff0f80674c0 con 0x7ff0f806eb30 2024-03-08T06:04:16.360 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T06:04:16.368 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T06:04:16.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.546+0000 7ff0fe200640 1 -- 172.21.15.19:0/2526427415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0f8067cb0 con 0x7ff0f806eb30 2024-03-08T06:04:16.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.547+0000 7ff0ef400640 1 -- 172.21.15.19:0/2526427415 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7ff0e804d070 con 0x7ff0f806eb30 2024-03-08T06:04:16.547 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:16.547 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1494509643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6835","nonce":1494509643},{"type":"v1","addr":"172.21.15.19:6837","nonce":1494509643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/2031610239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2031610239},{"type":"v1","addr":"172.21.15.42:6834","nonce":2031610239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6836/1964979810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1964979810},{"type":"v1","addr":"172.21.15.19:6836","nonce":1964979810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T06:03:20.532032+0000","modified":"2024-03-08T06:03:23.604391+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1462224228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1462224228},{"type":"v1","addr":"172.21.15.42:6835","nonce":1462224228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T06:04:16.548 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2024-03-08T06:04:16.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.550+0000 7ff0fe200640 1 -- 172.21.15.19:0/2526427415 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff0d806b500 msgr2=0x7ff0d806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:16.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.550+0000 7ff0fe200640 1 --2- 172.21.15.19:0/2526427415 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff0d806b500 0x7ff0d806d9c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff0f815ad10 tx=0x7ff0e4008040 comp rx=0 tx=0).stop 2024-03-08T06:04:16.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.550+0000 7ff0fe200640 1 -- 172.21.15.19:0/2526427415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0f806eb30 msgr2=0x7ff0f815bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:16.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.550+0000 7ff0fe200640 1 --2- 172.21.15.19:0/2526427415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0f806eb30 0x7ff0f815bf30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009e50 tx=0x7ff0e8004a40 comp rx=0 tx=0).stop 2024-03-08T06:04:16.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.550+0000 7ff0fe200640 1 -- 172.21.15.19:0/2526427415 shutdown_connections 2024-03-08T06:04:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.550+0000 7ff0fe200640 1 --2- 172.21.15.19:0/2526427415 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff0d806b500 0x7ff0d806d9c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.550+0000 7ff0fe200640 1 --2- 172.21.15.19:0/2526427415 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0f8144840 0x7ff0f81f3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.550+0000 7ff0fe200640 1 --2- 172.21.15.19:0/2526427415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0f8071600 0x7ff0f81384c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.550+0000 7ff0fe200640 1 --2- 172.21.15.19:0/2526427415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0f806eb30 0x7ff0f815bf30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.550+0000 7ff0fe200640 1 -- 172.21.15.19:0/2526427415 >> 172.21.15.19:0/2526427415 conn(0x7ff0f806ac50 msgr2=0x7ff0f80afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.550+0000 7ff0fe200640 1 -- 172.21.15.19:0/2526427415 shutdown_connections 2024-03-08T06:04:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.550+0000 7ff0fe200640 1 -- 172.21.15.19:0/2526427415 wait complete. 2024-03-08T06:04:16.570 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T06:04:16.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.793+0000 7f83fca00640 1 Processor -- start 2024-03-08T06:04:16.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.793+0000 7f83fca00640 1 -- start start 2024-03-08T06:04:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.795+0000 7f83fca00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f83f81445d0 0x7f83f806deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.795+0000 7f83fca00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f806e3f0 con 0x7f83f8071b80 2024-03-08T06:04:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.795+0000 7f83fca00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f806ebf0 con 0x7f83f8144d50 2024-03-08T06:04:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.795+0000 7f83fca00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f806eed0 con 0x7f83f81445d0 2024-03-08T06:04:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.795+0000 7f83f7200640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f83f8071b80 0x7f83f80cc860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43840/0 (socket says 172.21.15.19:43840) 2024-03-08T06:04:16.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.795+0000 7f83f7200640 1 -- 172.21.15.19:0/2532548913 learned_addr learned my addr 172.21.15.19:0/2532548913 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:16.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.796+0000 7f83f6800640 1 --2- 172.21.15.19:0/2532548913 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f83f81445d0 0x7f83f806deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:16.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.796+0000 7f83f5e00640 1 -- 172.21.15.19:0/2532548913 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796798200 0 0) 0x7f83f806e3f0 con 0x7f83f8071b80 2024-03-08T06:04:16.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.796+0000 7f83f5e00640 1 -- 172.21.15.19:0/2532548913 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83dc003520 con 0x7f83f8071b80 2024-03-08T06:04:16.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.796+0000 7f83f5e00640 1 -- 172.21.15.19:0/2532548913 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2148487274 0 0) 0x7f83dc003520 con 0x7f83f8071b80 2024-03-08T06:04:16.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.796+0000 7f83f5e00640 1 -- 172.21.15.19:0/2532548913 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f83f81445d0 msgr2=0x7f83f806deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:16.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.796+0000 7f83f5e00640 1 --2- 172.21.15.19:0/2532548913 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f83f81445d0 0x7f83f806deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:16.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.796+0000 7f83f5e00640 1 -- 172.21.15.19:0/2532548913 >> v1:172.21.15.42:6789/0 conn(0x7f83f8144d50 legacy=0x7f83f8071470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:16.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.796+0000 7f83f5e00640 1 -- 172.21.15.19:0/2532548913 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f806f1b0 con 0x7f83f8071b80 2024-03-08T06:04:16.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.796+0000 7f83f5e00640 1 -- 172.21.15.19:0/2532548913 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f83f0001a10 con 0x7f83f8071b80 2024-03-08T06:04:16.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.796+0000 7f83f5e00640 1 -- 172.21.15.19:0/2532548913 >> v1:172.21.15.19:6789/0 conn(0x7f83f8071b80 legacy=0x7f83f80cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:16.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.796+0000 7f83f5e00640 1 --2- 172.21.15.19:0/2532548913 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f83f81445d0 0x7f83dc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:16.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.796+0000 7f83f5e00640 1 --2- 172.21.15.19:0/2532548913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83dc004060 0x7f83dc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:16.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.796+0000 7f83f5e00640 1 --2- 172.21.15.19:0/2532548913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83dc004d40 0x7f83dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:16.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.796+0000 7f83f5e00640 1 -- 172.21.15.19:0/2532548913 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f806eed0 con 0x7f83dc004d40 2024-03-08T06:04:16.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.796+0000 7f83f5e00640 1 -- 172.21.15.19:0/2532548913 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc00bc00 con 0x7f83dc004060 2024-03-08T06:04:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.796+0000 7f83f5e00640 1 -- 172.21.15.19:0/2532548913 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc00be00 con 0x7f83f81445d0 2024-03-08T06:04:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.797+0000 7f83f7200640 1 --2- 172.21.15.19:0/2532548913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83dc004d40 0x7f83dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.797+0000 7f83efe00640 1 --2- 172.21.15.19:0/2532548913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83dc004060 0x7f83dc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.797+0000 7f83f6800640 1 --2- 172.21.15.19:0/2532548913 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f83f81445d0 0x7f83dc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.797+0000 7f83f7200640 1 -- 172.21.15.19:0/2532548913 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f83f81445d0 msgr2=0x7f83dc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.797+0000 7f83f7200640 1 --2- 172.21.15.19:0/2532548913 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f83f81445d0 0x7f83dc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.797+0000 7f83f7200640 1 -- 172.21.15.19:0/2532548913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83dc004060 msgr2=0x7f83dc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.797+0000 7f83f7200640 1 --2- 172.21.15.19:0/2532548913 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83dc004060 0x7f83dc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.797+0000 7f83f7200640 1 -- 172.21.15.19:0/2532548913 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc003520 con 0x7f83dc004d40 2024-03-08T06:04:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.798+0000 7f83f7200640 1 --2- 172.21.15.19:0/2532548913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83dc004d40 0x7f83dc0051c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f83f806eb40 tx=0x7f83dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a67b227fa241ef50 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.798+0000 7f83f5e00640 1 -- 172.21.15.19:0/2532548913 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f000a3b0 con 0x7f83dc004d40 2024-03-08T06:04:16.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.798+0000 7f83f5e00640 1 -- 172.21.15.19:0/2532548913 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f0034630 con 0x7f83dc004d40 2024-03-08T06:04:16.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.798+0000 7f83f5e00640 1 -- 172.21.15.19:0/2532548913 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0034a60 con 0x7f83dc004d40 2024-03-08T06:04:16.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.799+0000 7f83fca00640 1 -- 172.21.15.19:0/2532548913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83dc004d40 msgr2=0x7f83dc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:16.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.799+0000 7f83fca00640 1 --2- 172.21.15.19:0/2532548913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83dc004d40 0x7f83dc0051c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f83f806eb40 tx=0x7f83dc005830 comp rx=0 tx=0).stop 2024-03-08T06:04:16.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.799+0000 7f83f7200640 1 -- 172.21.15.19:0/2532548913 reap_dead start 2024-03-08T06:04:16.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.799+0000 7f83fca00640 1 -- 172.21.15.19:0/2532548913 shutdown_connections 2024-03-08T06:04:16.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.799+0000 7f83fca00640 1 -- 172.21.15.19:0/2532548913 >> 172.21.15.19:0/2532548913 conn(0x7f83f80b1600 msgr2=0x7f83f80b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:16.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.799+0000 7f83fca00640 1 -- 172.21.15.19:0/2532548913 shutdown_connections 2024-03-08T06:04:16.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.799+0000 7f83fca00640 1 -- 172.21.15.19:0/2532548913 wait complete. 2024-03-08T06:04:16.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.801+0000 7f83fca00640 1 Processor -- start 2024-03-08T06:04:16.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.801+0000 7f83fca00640 1 -- start start 2024-03-08T06:04:16.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.802+0000 7f83fca00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f83dc004d40 0x7f83f815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:16.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.802+0000 7f83fca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83f815c700 0x7f83f815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:16.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.802+0000 7f83fca00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83f80b2a70 0x7f83f80b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:16.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.802+0000 7f83fca00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f81449b0 con 0x7f83f80b2a70 2024-03-08T06:04:16.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.802+0000 7f83fca00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f80cc340 con 0x7f83f815c700 2024-03-08T06:04:16.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.802+0000 7f83fca00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f8144b30 con 0x7f83dc004d40 2024-03-08T06:04:16.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.802+0000 7f83f7200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83f80b2a70 0x7f83f80b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:16.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.802+0000 7f83f7200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83f80b2a70 0x7f83f80b2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46570/0 (socket says 172.21.15.19:46570) 2024-03-08T06:04:16.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.802+0000 7f83f7200640 1 -- 172.21.15.19:0/1821955712 learned_addr learned my addr 172.21.15.19:0/1821955712 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:16.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.802+0000 7f83efe00640 1 --2- 172.21.15.19:0/1821955712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83f815c700 0x7f83f815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:16.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.803+0000 7f83f6800640 1 --2- 172.21.15.19:0/1821955712 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f83dc004d40 0x7f83f815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:16.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.803+0000 7f83f7200640 1 -- 172.21.15.19:0/1821955712 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f83dc004d40 msgr2=0x7f83f815aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:16.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.803+0000 7f83f7200640 1 --2- 172.21.15.19:0/1821955712 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f83dc004d40 0x7f83f815aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:16.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.803+0000 7f83f7200640 1 -- 172.21.15.19:0/1821955712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83f815c700 msgr2=0x7f83f815cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:16.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.803+0000 7f83f7200640 1 --2- 172.21.15.19:0/1821955712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83f815c700 0x7f83f815cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:16.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.803+0000 7f83f7200640 1 -- 172.21.15.19:0/1821955712 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f80b37c0 con 0x7f83f80b2a70 2024-03-08T06:04:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.803+0000 7f83efe00640 1 --2- 172.21.15.19:0/1821955712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83f815c700 0x7f83f815cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:04:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.803+0000 7f83f7200640 1 --2- 172.21.15.19:0/1821955712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83f80b2a70 0x7f83f80b2ef0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f83f000a850 tx=0x7f83f806edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.803+0000 7f83eea00640 1 -- 172.21.15.19:0/1821955712 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0001250 con 0x7f83f80b2a70 2024-03-08T06:04:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.804+0000 7f83eea00640 1 -- 172.21.15.19:0/1821955712 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f0044070 con 0x7f83f80b2a70 2024-03-08T06:04:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.804+0000 7f83fca00640 1 -- 172.21.15.19:0/1821955712 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f80b3aa0 con 0x7f83f80b2a70 2024-03-08T06:04:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.804+0000 7f83eea00640 1 -- 172.21.15.19:0/1821955712 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f00349f0 con 0x7f83f80b2a70 2024-03-08T06:04:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.804+0000 7f83fca00640 1 -- 172.21.15.19:0/1821955712 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f80b4060 con 0x7f83f80b2a70 2024-03-08T06:04:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.805+0000 7f83fca00640 1 -- 172.21.15.19:0/1821955712 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f8075100 con 0x7f83f80b2a70 2024-03-08T06:04:16.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.806+0000 7f83eea00640 1 -- 172.21.15.19:0/1821955712 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f83f0034b90 con 0x7f83f80b2a70 2024-03-08T06:04:16.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.807+0000 7f83eea00640 1 --2- 172.21.15.19:0/1821955712 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f83d406b6a0 0x7f83d406db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:16.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.807+0000 7f83eea00640 1 -- 172.21.15.19:0/1821955712 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f83f00ac7a0 con 0x7f83f80b2a70 2024-03-08T06:04:16.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.807+0000 7f83f6800640 1 --2- 172.21.15.19:0/1821955712 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f83d406b6a0 0x7f83d406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:16.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.808+0000 7f83f6800640 1 --2- 172.21.15.19:0/1821955712 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f83d406b6a0 0x7f83d406db60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f83f80aece0 tx=0x7f83e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:16.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:16.812+0000 7f83eea00640 1 -- 172.21.15.19:0/1821955712 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f83f003e350 con 0x7f83f80b2a70 2024-03-08T06:04:17.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.043+0000 7f83fca00640 1 -- 172.21.15.19:0/1821955712 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83f80b27e0 con 0x7f83f80b2a70 2024-03-08T06:04:17.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.044+0000 7f83eea00640 1 -- 172.21.15.19:0/1821955712 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4932 (secure 0 0 0) 0x7f83f007b500 con 0x7f83f80b2a70 2024-03-08T06:04:17.044 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:17.044 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4228,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1494509643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6835","nonce":1494509643},{"type":"v1","addr":"172.21.15.19:6837","nonce":1494509643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6834/2031610239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":2031610239},{"type":"v1","addr":"172.21.15.42:6834","nonce":2031610239}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6836/1964979810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":1964979810},{"type":"v1","addr":"172.21.15.19:6836","nonce":1964979810}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T06:03:20.532032+0000","modified":"2024-03-08T06:03:23.604391+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.42:6835/1462224228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6833","nonce":1462224228},{"type":"v1","addr":"172.21.15.42:6835","nonce":1462224228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-08T06:04:17.044 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2024-03-08T06:04:17.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.047+0000 7f83fca00640 1 -- 172.21.15.19:0/1821955712 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f83d406b6a0 msgr2=0x7f83d406db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:17.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.047+0000 7f83fca00640 1 --2- 172.21.15.19:0/1821955712 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f83d406b6a0 0x7f83d406db60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f83f80aece0 tx=0x7f83e8008040 comp rx=0 tx=0).stop 2024-03-08T06:04:17.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.047+0000 7f83fca00640 1 -- 172.21.15.19:0/1821955712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83f80b2a70 msgr2=0x7f83f80b2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:17.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.047+0000 7f83fca00640 1 --2- 172.21.15.19:0/1821955712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83f80b2a70 0x7f83f80b2ef0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f83f000a850 tx=0x7f83f806edc0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.047+0000 7f83fca00640 1 -- 172.21.15.19:0/1821955712 shutdown_connections 2024-03-08T06:04:17.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.047+0000 7f83fca00640 1 --2- 172.21.15.19:0/1821955712 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f83d406b6a0 0x7f83d406db60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.047+0000 7f83fca00640 1 --2- 172.21.15.19:0/1821955712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83f80b2a70 0x7f83f80b2ef0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.047+0000 7f83fca00640 1 --2- 172.21.15.19:0/1821955712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83f815c700 0x7f83f815cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.047+0000 7f83fca00640 1 --2- 172.21.15.19:0/1821955712 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f83dc004d40 0x7f83f815aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.047+0000 7f83fca00640 1 -- 172.21.15.19:0/1821955712 >> 172.21.15.19:0/1821955712 conn(0x7f83f80b1600 msgr2=0x7f83f8071470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:17.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.047+0000 7f83fca00640 1 -- 172.21.15.19:0/1821955712 shutdown_connections 2024-03-08T06:04:17.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.047+0000 7f83fca00640 1 -- 172.21.15.19:0/1821955712 wait complete. 2024-03-08T06:04:17.065 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:04:17.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.263+0000 7f5b0e000640 1 Processor -- start 2024-03-08T06:04:17.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.263+0000 7f5b0e000640 1 -- start start 2024-03-08T06:04:17.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.265+0000 7f5b0e000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5b08145520 0x7f5b0815d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:17.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.265+0000 7f5b0e000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5b0815bea0 0x7f5b080716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:17.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.265+0000 7f5b0e000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b080af040 0x7f5b08071c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:17.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.265+0000 7f5b0e000640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0815ceb0 con 0x7f5b08145520 2024-03-08T06:04:17.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.265+0000 7f5b0e000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0815c330 con 0x7f5b0815bea0 2024-03-08T06:04:17.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.265+0000 7f5b0e000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0815c610 con 0x7f5b080af040 2024-03-08T06:04:17.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.265+0000 7f5b0cc00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5b08145520 0x7f5b0815d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:17.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.265+0000 7f5b07e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5b0815bea0 0x7f5b080716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:17.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.265+0000 7f5b0cc00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5b08145520 0x7f5b0815d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46586/0 (socket says 172.21.15.19:46586) 2024-03-08T06:04:17.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.265+0000 7f5b0cc00640 1 -- 172.21.15.19:0/902319574 learned_addr learned my addr 172.21.15.19:0/902319574 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:17.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.265+0000 7f5b0d600640 1 --2- 172.21.15.19:0/902319574 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b080af040 0x7f5b08071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:17.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.266+0000 7f5b0cc00640 1 -- 172.21.15.19:0/902319574 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b080af040 msgr2=0x7f5b08071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:17.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.266+0000 7f5b0cc00640 1 --2- 172.21.15.19:0/902319574 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b080af040 0x7f5b08071c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.266+0000 7f5b0cc00640 1 -- 172.21.15.19:0/902319574 >> v2:172.21.15.42:3300/0 conn(0x7f5b0815bea0 msgr2=0x7f5b080716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:17.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.266+0000 7f5b0cc00640 1 --2- 172.21.15.19:0/902319574 >> v2:172.21.15.42:3300/0 conn(0x7f5b0815bea0 0x7f5b080716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.266+0000 7f5b0cc00640 1 -- 172.21.15.19:0/902319574 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0815c8f0 con 0x7f5b08145520 2024-03-08T06:04:17.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.267+0000 7f5b0cc00640 1 --2- 172.21.15.19:0/902319574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b08145520 0x7f5b0815d0a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5b0806be10 tx=0x7f5afc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc584c5ce0a657c server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:17.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.268+0000 7f5b07400640 1 -- 172.21.15.19:0/902319574 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc035020 con 0x7f5b08145520 2024-03-08T06:04:17.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.268+0000 7f5b07400640 1 -- 172.21.15.19:0/902319574 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc031870 con 0x7f5b08145520 2024-03-08T06:04:17.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.268+0000 7f5b07400640 1 -- 172.21.15.19:0/902319574 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc031c40 con 0x7f5b08145520 2024-03-08T06:04:17.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.268+0000 7f5b0e000640 1 -- 172.21.15.19:0/902319574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b08145520 msgr2=0x7f5b0815d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:17.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.268+0000 7f5b0e000640 1 --2- 172.21.15.19:0/902319574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b08145520 0x7f5b0815d0a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5b0806be10 tx=0x7f5afc02b910 comp rx=0 tx=0).stop 2024-03-08T06:04:17.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.269+0000 7f5b0e000640 1 -- 172.21.15.19:0/902319574 shutdown_connections 2024-03-08T06:04:17.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.269+0000 7f5b0e000640 1 --2- 172.21.15.19:0/902319574 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b080af040 0x7f5b08071c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.269+0000 7f5b0e000640 1 --2- 172.21.15.19:0/902319574 >> v2:172.21.15.42:3300/0 conn(0x7f5b0815bea0 0x7f5b080716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.269+0000 7f5b0e000640 1 --2- 172.21.15.19:0/902319574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b08145520 0x7f5b0815d0a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.269+0000 7f5b0e000640 1 -- 172.21.15.19:0/902319574 >> 172.21.15.19:0/902319574 conn(0x7f5b080b1850 msgr2=0x7f5b080b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:17.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.269+0000 7f5b0e000640 1 -- 172.21.15.19:0/902319574 shutdown_connections 2024-03-08T06:04:17.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.269+0000 7f5b0e000640 1 -- 172.21.15.19:0/902319574 wait complete. 2024-03-08T06:04:17.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.271+0000 7f5b0e000640 1 Processor -- start 2024-03-08T06:04:17.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.271+0000 7f5b0e000640 1 -- start start 2024-03-08T06:04:17.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.272+0000 7f5b0e000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b080af040 0x7f5b081e5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:17.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.272+0000 7f5b0e000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b08145520 0x7f5b08144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:17.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.272+0000 7f5b0e000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b0815b2f0 0x7f5b08130f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:17.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.272+0000 7f5b0e000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0806e590 con 0x7f5b080af040 2024-03-08T06:04:17.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.272+0000 7f5b0e000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0806e410 con 0x7f5b08145520 2024-03-08T06:04:17.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.272+0000 7f5b0e000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0806e710 con 0x7f5b0815b2f0 2024-03-08T06:04:17.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.273+0000 7f5b0cc00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b080af040 0x7f5b081e5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:17.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.273+0000 7f5b0cc00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b080af040 0x7f5b081e5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46600/0 (socket says 172.21.15.19:46600) 2024-03-08T06:04:17.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.273+0000 7f5b0cc00640 1 -- 172.21.15.19:0/3462357694 learned_addr learned my addr 172.21.15.19:0/3462357694 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:17.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.273+0000 7f5b0d600640 1 --2- 172.21.15.19:0/3462357694 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b0815b2f0 0x7f5b08130f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:17.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.273+0000 7f5b07e00640 1 --2- 172.21.15.19:0/3462357694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b08145520 0x7f5b08144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:17.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.273+0000 7f5b0cc00640 1 -- 172.21.15.19:0/3462357694 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b0815b2f0 msgr2=0x7f5b08130f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:17.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.273+0000 7f5b0cc00640 1 --2- 172.21.15.19:0/3462357694 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b0815b2f0 0x7f5b08130f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.273+0000 7f5b0cc00640 1 -- 172.21.15.19:0/3462357694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b08145520 msgr2=0x7f5b08144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:17.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.273+0000 7f5b0cc00640 1 --2- 172.21.15.19:0/3462357694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b08145520 0x7f5b08144740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.273+0000 7f5b0cc00640 1 -- 172.21.15.19:0/3462357694 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b08144c80 con 0x7f5b080af040 2024-03-08T06:04:17.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.274+0000 7f5b0cc00640 1 --2- 172.21.15.19:0/3462357694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b080af040 0x7f5b081e5310 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5afc000c00 tx=0x7f5afc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:17.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.274+0000 7f5b04c00640 1 -- 172.21.15.19:0/3462357694 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc035040 con 0x7f5b080af040 2024-03-08T06:04:17.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.274+0000 7f5b04c00640 1 -- 172.21.15.19:0/3462357694 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc030d00 con 0x7f5b080af040 2024-03-08T06:04:17.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.274+0000 7f5b04c00640 1 -- 172.21.15.19:0/3462357694 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0456a0 con 0x7f5b080af040 2024-03-08T06:04:17.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.274+0000 7f5b0e000640 1 -- 172.21.15.19:0/3462357694 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b081e58f0 con 0x7f5b080af040 2024-03-08T06:04:17.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.274+0000 7f5b0e000640 1 -- 172.21.15.19:0/3462357694 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b081e5eb0 con 0x7f5b080af040 2024-03-08T06:04:17.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.275+0000 7f5b0e000640 1 -- 172.21.15.19:0/3462357694 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b08075100 con 0x7f5b080af040 2024-03-08T06:04:17.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.276+0000 7f5b04c00640 1 -- 172.21.15.19:0/3462357694 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5afc038020 con 0x7f5b080af040 2024-03-08T06:04:17.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.278+0000 7f5b04c00640 1 --2- 172.21.15.19:0/3462357694 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5ae806b500 0x7f5ae806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:17.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.278+0000 7f5b04c00640 1 -- 172.21.15.19:0/3462357694 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5afc0ac690 con 0x7f5b080af040 2024-03-08T06:04:17.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.278+0000 7f5b07e00640 1 --2- 172.21.15.19:0/3462357694 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5ae806b500 0x7f5ae806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:17.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.279+0000 7f5b07e00640 1 --2- 172.21.15.19:0/3462357694 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5ae806b500 0x7f5ae806d9c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5b08074870 tx=0x7f5af4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:17.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.282+0000 7f5b04c00640 1 -- 172.21.15.19:0/3462357694 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5afc07b360 con 0x7f5b080af040 2024-03-08T06:04:17.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.474+0000 7f5b0e000640 1 -- 172.21.15.19:0/3462357694 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b080ad120 con 0x7f5b080af040 2024-03-08T06:04:17.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.476+0000 7f5b04c00640 1 -- 172.21.15.19:0/3462357694 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16795 (secure 0 0 0) 0x7f5afc07ac60 con 0x7f5b080af040 2024-03-08T06:04:17.477 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:17.477 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":23,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:04:07.332571+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:03:18.392703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-08T06:03:19.537912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:04:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.479+0000 7f5b0e000640 1 -- 172.21.15.19:0/3462357694 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5ae806b500 msgr2=0x7f5ae806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.479+0000 7f5b0e000640 1 --2- 172.21.15.19:0/3462357694 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5ae806b500 0x7f5ae806d9c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5b08074870 tx=0x7f5af4008040 comp rx=0 tx=0).stop 2024-03-08T06:04:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.479+0000 7f5b0e000640 1 -- 172.21.15.19:0/3462357694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b080af040 msgr2=0x7f5b081e5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.479+0000 7f5b0e000640 1 --2- 172.21.15.19:0/3462357694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b080af040 0x7f5b081e5310 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5afc000c00 tx=0x7f5afc0046c0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.479+0000 7f5b0e000640 1 -- 172.21.15.19:0/3462357694 shutdown_connections 2024-03-08T06:04:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.479+0000 7f5b0e000640 1 --2- 172.21.15.19:0/3462357694 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5ae806b500 0x7f5ae806d9c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.479+0000 7f5b0e000640 1 --2- 172.21.15.19:0/3462357694 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b0815b2f0 0x7f5b08130f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.479+0000 7f5b0e000640 1 --2- 172.21.15.19:0/3462357694 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b08145520 0x7f5b08144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.479+0000 7f5b0e000640 1 --2- 172.21.15.19:0/3462357694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b080af040 0x7f5b081e5310 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.479+0000 7f5b0e000640 1 -- 172.21.15.19:0/3462357694 >> 172.21.15.19:0/3462357694 conn(0x7f5b080b1850 msgr2=0x7f5b0806ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.480+0000 7f5b0e000640 1 -- 172.21.15.19:0/3462357694 shutdown_connections 2024-03-08T06:04:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.480+0000 7f5b0e000640 1 -- 172.21.15.19:0/3462357694 wait complete. 2024-03-08T06:04:17.499 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-08T06:04:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.708+0000 7f5b23200640 1 Processor -- start 2024-03-08T06:04:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.709+0000 7f5b23200640 1 -- start start 2024-03-08T06:04:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.710+0000 7f5b23200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b24071b10 0x7f5b24166750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.710+0000 7f5b23200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2406d600 con 0x7f5b2406f050 2024-03-08T06:04:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.710+0000 7f5b23200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2406d8e0 con 0x7f5b241451b0 2024-03-08T06:04:17.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.710+0000 7f5b23200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2406dbc0 con 0x7f5b24071b10 2024-03-08T06:04:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.711+0000 7f5b19400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5b2406f050 0x7f5b24071400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43850/0 (socket says 172.21.15.19:43850) 2024-03-08T06:04:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.711+0000 7f5b19400640 1 -- 172.21.15.19:0/966791860 learned_addr learned my addr 172.21.15.19:0/966791860 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.711+0000 7f5b22800640 1 --2- 172.21.15.19:0/966791860 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b24071b10 0x7f5b24166750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.711+0000 7f5b21400640 1 -- 172.21.15.19:0/966791860 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2472464256 0 0) 0x7f5b2406d600 con 0x7f5b2406f050 2024-03-08T06:04:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.711+0000 7f5b21400640 1 -- 172.21.15.19:0/966791860 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b08003520 con 0x7f5b2406f050 2024-03-08T06:04:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.711+0000 7f5b21400640 1 -- 172.21.15.19:0/966791860 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1558662181 0 0) 0x7f5b08003520 con 0x7f5b2406f050 2024-03-08T06:04:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.712+0000 7f5b21400640 1 -- 172.21.15.19:0/966791860 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b24071b10 msgr2=0x7f5b24166750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.712+0000 7f5b21400640 1 --2- 172.21.15.19:0/966791860 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b24071b10 0x7f5b24166750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.712+0000 7f5b21400640 1 -- 172.21.15.19:0/966791860 >> v1:172.21.15.42:6789/0 conn(0x7f5b241451b0 legacy=0x7f5b2415ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:17.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.712+0000 7f5b21400640 1 -- 172.21.15.19:0/966791860 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2406dea0 con 0x7f5b2406f050 2024-03-08T06:04:17.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.712+0000 7f5b21400640 1 -- 172.21.15.19:0/966791860 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f5b0c001670 con 0x7f5b2406f050 2024-03-08T06:04:17.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.712+0000 7f5b21400640 1 -- 172.21.15.19:0/966791860 >> v1:172.21.15.19:6789/0 conn(0x7f5b2406f050 legacy=0x7f5b24071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:17.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.712+0000 7f5b21400640 1 --2- 172.21.15.19:0/966791860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b08003ac0 0x7f5b08003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:17.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.712+0000 7f5b21400640 1 --2- 172.21.15.19:0/966791860 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b08004800 0x7f5b08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:17.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.712+0000 7f5b21400640 1 --2- 172.21.15.19:0/966791860 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b24071b10 0x7f5b08005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:17.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.712+0000 7f5b21400640 1 -- 172.21.15.19:0/966791860 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2406dbc0 con 0x7f5b08003ac0 2024-03-08T06:04:17.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.712+0000 7f5b21400640 1 -- 172.21.15.19:0/966791860 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0800bb20 con 0x7f5b08004800 2024-03-08T06:04:17.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.712+0000 7f5b21400640 1 -- 172.21.15.19:0/966791860 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0800bd20 con 0x7f5b24071b10 2024-03-08T06:04:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.712+0000 7f5b21e00640 1 --2- 172.21.15.19:0/966791860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b08003ac0 0x7f5b08003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.712+0000 7f5b19400640 1 --2- 172.21.15.19:0/966791860 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b08004800 0x7f5b08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.712+0000 7f5b21e00640 1 -- 172.21.15.19:0/966791860 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b24071b10 msgr2=0x7f5b08005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.712+0000 7f5b21e00640 1 --2- 172.21.15.19:0/966791860 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b24071b10 0x7f5b08005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.712+0000 7f5b21e00640 1 -- 172.21.15.19:0/966791860 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b08004800 msgr2=0x7f5b08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.712+0000 7f5b21e00640 1 --2- 172.21.15.19:0/966791860 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b08004800 0x7f5b08004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.712+0000 7f5b21e00640 1 -- 172.21.15.19:0/966791860 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b08003520 con 0x7f5b08003ac0 2024-03-08T06:04:17.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.713+0000 7f5b21e00640 1 --2- 172.21.15.19:0/966791860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b08003ac0 0x7f5b08003ea0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5b14001860 tx=0x7f5b08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2b0e23aaaffb09 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:17.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.714+0000 7f5b21400640 1 -- 172.21.15.19:0/966791860 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1402f050 con 0x7f5b08003ac0 2024-03-08T06:04:17.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.714+0000 7f5b21400640 1 -- 172.21.15.19:0/966791860 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b14033650 con 0x7f5b08003ac0 2024-03-08T06:04:17.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.714+0000 7f5b21400640 1 -- 172.21.15.19:0/966791860 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b14001430 con 0x7f5b08003ac0 2024-03-08T06:04:17.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.714+0000 7f5b23200640 1 -- 172.21.15.19:0/966791860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b08003ac0 msgr2=0x7f5b08003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:17.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.714+0000 7f5b23200640 1 --2- 172.21.15.19:0/966791860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b08003ac0 0x7f5b08003ea0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5b14001860 tx=0x7f5b08005830 comp rx=0 tx=0).stop 2024-03-08T06:04:17.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.714+0000 7f5b22800640 1 -- 172.21.15.19:0/966791860 reap_dead start 2024-03-08T06:04:17.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.714+0000 7f5b23200640 1 -- 172.21.15.19:0/966791860 shutdown_connections 2024-03-08T06:04:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.714+0000 7f5b23200640 1 -- 172.21.15.19:0/966791860 >> 172.21.15.19:0/966791860 conn(0x7f5b240b1590 msgr2=0x7f5b240b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.715+0000 7f5b23200640 1 -- 172.21.15.19:0/966791860 shutdown_connections 2024-03-08T06:04:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.715+0000 7f5b23200640 1 -- 172.21.15.19:0/966791860 wait complete. 2024-03-08T06:04:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.716+0000 7f5b23200640 1 Processor -- start 2024-03-08T06:04:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.716+0000 7f5b23200640 1 -- start start 2024-03-08T06:04:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.717+0000 7f5b23200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b08003ac0 0x7f5b2415a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.717+0000 7f5b23200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b2413cd30 0x7f5b2413acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.717+0000 7f5b23200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b2413b230 0x7f5b240ad340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.717+0000 7f5b23200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2415e330 con 0x7f5b2413b230 2024-03-08T06:04:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.717+0000 7f5b23200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2415e1b0 con 0x7f5b2413cd30 2024-03-08T06:04:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.717+0000 7f5b23200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2415e4b0 con 0x7f5b08003ac0 2024-03-08T06:04:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.718+0000 7f5b22800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b2413b230 0x7f5b240ad340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.718+0000 7f5b22800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b2413b230 0x7f5b240ad340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46616/0 (socket says 172.21.15.19:46616) 2024-03-08T06:04:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.718+0000 7f5b22800640 1 -- 172.21.15.19:0/772288405 learned_addr learned my addr 172.21.15.19:0/772288405 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.718+0000 7f5b19400640 1 --2- 172.21.15.19:0/772288405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b2413cd30 0x7f5b2413acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.718+0000 7f5b22800640 1 -- 172.21.15.19:0/772288405 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b08003ac0 msgr2=0x7f5b2415a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.718+0000 7f5b22800640 1 --2- 172.21.15.19:0/772288405 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b08003ac0 0x7f5b2415a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.718+0000 7f5b22800640 1 -- 172.21.15.19:0/772288405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b2413cd30 msgr2=0x7f5b2413acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.718+0000 7f5b22800640 1 --2- 172.21.15.19:0/772288405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b2413cd30 0x7f5b2413acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.718+0000 7f5b22800640 1 -- 172.21.15.19:0/772288405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2413b720 con 0x7f5b2413b230 2024-03-08T06:04:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.718+0000 7f5b22800640 1 --2- 172.21.15.19:0/772288405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b2413b230 0x7f5b240ad340 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5b240b2940 tx=0x7f5b1c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:17.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.719+0000 7f5b1aa00640 1 -- 172.21.15.19:0/772288405 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c00bce0 con 0x7f5b2413b230 2024-03-08T06:04:17.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.719+0000 7f5b1aa00640 1 -- 172.21.15.19:0/772288405 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c01a070 con 0x7f5b2413b230 2024-03-08T06:04:17.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.719+0000 7f5b1aa00640 1 -- 172.21.15.19:0/772288405 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c014640 con 0x7f5b2413b230 2024-03-08T06:04:17.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.719+0000 7f5b23200640 1 -- 172.21.15.19:0/772288405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2413ba00 con 0x7f5b2413b230 2024-03-08T06:04:17.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.719+0000 7f5b23200640 1 -- 172.21.15.19:0/772288405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2413bfc0 con 0x7f5b2413b230 2024-03-08T06:04:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.720+0000 7f5b23200640 1 -- 172.21.15.19:0/772288405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b24075090 con 0x7f5b2413b230 2024-03-08T06:04:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.721+0000 7f5b1aa00640 1 -- 172.21.15.19:0/772288405 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5b1c005d10 con 0x7f5b2413b230 2024-03-08T06:04:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.722+0000 7f5b1aa00640 1 --2- 172.21.15.19:0/772288405 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5b0006b500 0x7f5b0006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:17.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.722+0000 7f5b1aa00640 1 -- 172.21.15.19:0/772288405 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5b1c08a5e0 con 0x7f5b2413b230 2024-03-08T06:04:17.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.722+0000 7f5b21e00640 1 --2- 172.21.15.19:0/772288405 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5b0006b500 0x7f5b0006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:17.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.723+0000 7f5b21e00640 1 --2- 172.21.15.19:0/772288405 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5b0006b500 0x7f5b0006d9c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5b14036000 tx=0x7f5b14009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.727+0000 7f5b1aa00640 1 -- 172.21.15.19:0/772288405 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5b1c024020 con 0x7f5b2413b230 2024-03-08T06:04:17.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.970+0000 7f5b23200640 1 -- 172.21.15.19:0/772288405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5b24071610 con 0x7f5b2413b230 2024-03-08T06:04:17.971 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-03-08T06:04:17.971+0000 7f6070c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-08T06:04:17.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.975+0000 7f5b1aa00640 1 -- 172.21.15.19:0/772288405 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5b1c059340 con 0x7f5b2413b230 2024-03-08T06:04:17.975 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-08T06:04:17.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.979+0000 7f5b23200640 1 -- 172.21.15.19:0/772288405 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5b0006b500 msgr2=0x7f5b0006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:17.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.979+0000 7f5b23200640 1 --2- 172.21.15.19:0/772288405 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5b0006b500 0x7f5b0006d9c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5b14036000 tx=0x7f5b14009030 comp rx=0 tx=0).stop 2024-03-08T06:04:17.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.979+0000 7f5b23200640 1 -- 172.21.15.19:0/772288405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b2413b230 msgr2=0x7f5b240ad340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:17.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.979+0000 7f5b23200640 1 --2- 172.21.15.19:0/772288405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b2413b230 0x7f5b240ad340 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5b240b2940 tx=0x7f5b1c00b480 comp rx=0 tx=0).stop 2024-03-08T06:04:17.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.979+0000 7f5b23200640 1 -- 172.21.15.19:0/772288405 shutdown_connections 2024-03-08T06:04:17.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.979+0000 7f5b23200640 1 --2- 172.21.15.19:0/772288405 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5b0006b500 0x7f5b0006d9c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.979+0000 7f5b23200640 1 --2- 172.21.15.19:0/772288405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b2413b230 0x7f5b240ad340 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.979+0000 7f5b23200640 1 --2- 172.21.15.19:0/772288405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5b2413cd30 0x7f5b2413acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.979+0000 7f5b23200640 1 --2- 172.21.15.19:0/772288405 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5b08003ac0 0x7f5b2415a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:17.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.979+0000 7f5b23200640 1 -- 172.21.15.19:0/772288405 >> 172.21.15.19:0/772288405 conn(0x7f5b240b1590 msgr2=0x7f5b2415d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:17.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.979+0000 7f5b23200640 1 -- 172.21.15.19:0/772288405 shutdown_connections 2024-03-08T06:04:17.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:17.979+0000 7f5b23200640 1 -- 172.21.15.19:0/772288405 wait complete. 2024-03-08T06:04:17.997 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-08T06:04:18.017 INFO:tasks.ceph.mds.d.smithi042.stderr: -7799> 2024-03-08T06:03:24.231+0000 7f538b200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-08T06:04:18.107 INFO:tasks.ceph.mds.d.smithi042.stdout:starting mds.d at 2024-03-08T06:04:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.205+0000 7fed22e00640 1 Processor -- start 2024-03-08T06:04:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.205+0000 7fed22e00640 1 -- start start 2024-03-08T06:04:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.206+0000 7fed22e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fed1c145500 0x7fed1c06ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.207+0000 7fed22e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fed1c15bfb0 0x7fed1c0716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.207+0000 7fed22e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed1c15c460 con 0x7fed1c071c20 2024-03-08T06:04:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.207+0000 7fed22e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed1c072050 con 0x7fed1c15bfb0 2024-03-08T06:04:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.207+0000 7fed22e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed1c15c740 con 0x7fed1c145500 2024-03-08T06:04:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.207+0000 7fed21000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fed1c15bfb0 0x7fed1c0716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.207+0000 7fed21000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fed1c15bfb0 0x7fed1c0716e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46622/0 (socket says 172.21.15.19:46622) 2024-03-08T06:04:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.207+0000 7fed21000640 1 -- 172.21.15.19:0/2750924561 learned_addr learned my addr 172.21.15.19:0/2750924561 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.207+0000 7fed21a00640 1 --2- 172.21.15.19:0/2750924561 >> v2:172.21.15.42:3300/0 conn(0x7fed1c145500 0x7fed1c06ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.207+0000 7fed21000640 1 -- 172.21.15.19:0/2750924561 >> v2:172.21.15.42:3300/0 conn(0x7fed1c145500 msgr2=0x7fed1c06ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.207+0000 7fed21000640 1 --2- 172.21.15.19:0/2750924561 >> v2:172.21.15.42:3300/0 conn(0x7fed1c145500 0x7fed1c06ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.207+0000 7fed21000640 1 -- 172.21.15.19:0/2750924561 >> v1:172.21.15.42:6789/0 conn(0x7fed1c071c20 legacy=0x7fed1c06d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.207+0000 7fed21000640 1 -- 172.21.15.19:0/2750924561 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c15ca20 con 0x7fed1c15bfb0 2024-03-08T06:04:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.208+0000 7fed21000640 1 --2- 172.21.15.19:0/2750924561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed1c15bfb0 0x7fed1c0716e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fed1c0cf820 tx=0x7fed0802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1af7eac2ab65fc server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.209+0000 7fed1be00640 1 -- 172.21.15.19:0/2750924561 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0802e070 con 0x7fed1c15bfb0 2024-03-08T06:04:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.209+0000 7fed1be00640 1 -- 172.21.15.19:0/2750924561 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed08037070 con 0x7fed1c15bfb0 2024-03-08T06:04:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.209+0000 7fed1be00640 1 -- 172.21.15.19:0/2750924561 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed08031a00 con 0x7fed1c15bfb0 2024-03-08T06:04:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.209+0000 7fed22e00640 1 -- 172.21.15.19:0/2750924561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed1c15bfb0 msgr2=0x7fed1c0716e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.209+0000 7fed22e00640 1 --2- 172.21.15.19:0/2750924561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed1c15bfb0 0x7fed1c0716e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fed1c0cf820 tx=0x7fed0802b880 comp rx=0 tx=0).stop 2024-03-08T06:04:18.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.209+0000 7fed22e00640 1 -- 172.21.15.19:0/2750924561 shutdown_connections 2024-03-08T06:04:18.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.209+0000 7fed22e00640 1 --2- 172.21.15.19:0/2750924561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed1c15bfb0 0x7fed1c0716e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:18.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.209+0000 7fed22e00640 1 --2- 172.21.15.19:0/2750924561 >> v2:172.21.15.42:3300/0 conn(0x7fed1c145500 0x7fed1c06ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:18.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.210+0000 7fed22e00640 1 -- 172.21.15.19:0/2750924561 >> 172.21.15.19:0/2750924561 conn(0x7fed1c0b1850 msgr2=0x7fed1c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:18.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.210+0000 7fed22e00640 1 -- 172.21.15.19:0/2750924561 shutdown_connections 2024-03-08T06:04:18.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.210+0000 7fed22e00640 1 -- 172.21.15.19:0/2750924561 wait complete. 2024-03-08T06:04:18.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.212+0000 7fed22e00640 1 Processor -- start 2024-03-08T06:04:18.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.212+0000 7fed22e00640 1 -- start start 2024-03-08T06:04:18.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.213+0000 7fed22e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed1c071c20 0x7fed1c158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:18.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.213+0000 7fed22e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fed1c145500 0x7fed1c156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:18.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.213+0000 7fed22e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed1c15bfb0 0x7fed1c1f1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:18.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.213+0000 7fed22e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c06f370 con 0x7fed1c071c20 2024-03-08T06:04:18.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.213+0000 7fed22e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c06f1f0 con 0x7fed1c15bfb0 2024-03-08T06:04:18.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.213+0000 7fed22e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1c0cd510 con 0x7fed1c145500 2024-03-08T06:04:18.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.214+0000 7fed21a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed1c071c20 0x7fed1c158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:18.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.214+0000 7fed21a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed1c071c20 0x7fed1c158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46634/0 (socket says 172.21.15.19:46634) 2024-03-08T06:04:18.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.214+0000 7fed21a00640 1 -- 172.21.15.19:0/4111476644 learned_addr learned my addr 172.21.15.19:0/4111476644 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:18.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.214+0000 7fed21000640 1 --2- 172.21.15.19:0/4111476644 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fed1c145500 0x7fed1c156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:18.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.214+0000 7fed21a00640 1 -- 172.21.15.19:0/4111476644 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fed1c145500 msgr2=0x7fed1c156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:18.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.214+0000 7fed21a00640 1 --2- 172.21.15.19:0/4111476644 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fed1c145500 0x7fed1c156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:18.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.214+0000 7fed21a00640 1 -- 172.21.15.19:0/4111476644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed1c15bfb0 msgr2=0x7fed1c1f1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:18.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.214+0000 7fed22400640 1 --2- 172.21.15.19:0/4111476644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed1c15bfb0 0x7fed1c1f1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:18.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.214+0000 7fed21a00640 1 --2- 172.21.15.19:0/4111476644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed1c15bfb0 0x7fed1c1f1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:18.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.214+0000 7fed21a00640 1 -- 172.21.15.19:0/4111476644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c1f1db0 con 0x7fed1c071c20 2024-03-08T06:04:18.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.214+0000 7fed21000640 1 --2- 172.21.15.19:0/4111476644 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fed1c145500 0x7fed1c156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:18.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.214+0000 7fed22400640 1 --2- 172.21.15.19:0/4111476644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed1c15bfb0 0x7fed1c1f1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:18.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.215+0000 7fed21a00640 1 --2- 172.21.15.19:0/4111476644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed1c071c20 0x7fed1c158a20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fed1000c7f0 tx=0x7fed1000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:18.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.215+0000 7fed19600640 1 -- 172.21.15.19:0/4111476644 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed10015070 con 0x7fed1c071c20 2024-03-08T06:04:18.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.215+0000 7fed19600640 1 -- 172.21.15.19:0/4111476644 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed10004240 con 0x7fed1c071c20 2024-03-08T06:04:18.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.215+0000 7fed19600640 1 -- 172.21.15.19:0/4111476644 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed10007620 con 0x7fed1c071c20 2024-03-08T06:04:18.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.215+0000 7fed22e00640 1 -- 172.21.15.19:0/4111476644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1c1f2090 con 0x7fed1c071c20 2024-03-08T06:04:18.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.215+0000 7fed22e00640 1 -- 172.21.15.19:0/4111476644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1c158f60 con 0x7fed1c071c20 2024-03-08T06:04:18.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.216+0000 7fed22e00640 1 -- 172.21.15.19:0/4111476644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed1c075090 con 0x7fed1c071c20 2024-03-08T06:04:18.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.217+0000 7fed19600640 1 -- 172.21.15.19:0/4111476644 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fed100079d0 con 0x7fed1c071c20 2024-03-08T06:04:18.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.218+0000 7fed19600640 1 --2- 172.21.15.19:0/4111476644 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fecfc06b4d0 0x7fecfc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:18.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.218+0000 7fed19600640 1 -- 172.21.15.19:0/4111476644 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fed1008a3e0 con 0x7fed1c071c20 2024-03-08T06:04:18.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.218+0000 7fed21000640 1 --2- 172.21.15.19:0/4111476644 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fecfc06b4d0 0x7fecfc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:18.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.219+0000 7fed21000640 1 --2- 172.21.15.19:0/4111476644 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fecfc06b4d0 0x7fecfc06d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fed08036000 tx=0x7fed08008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:18.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.222+0000 7fed19600640 1 -- 172.21.15.19:0/4111476644 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fed10059180 con 0x7fed1c071c20 2024-03-08T06:04:18.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.458+0000 7fed22e00640 1 -- 172.21.15.19:0/4111476644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fed1c0b1cd0 con 0x7fed1c071c20 2024-03-08T06:04:18.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.985+0000 7fed19600640 1 -- 172.21.15.19:0/4111476644 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fed10058a80 con 0x7fed1c071c20 2024-03-08T06:04:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.989+0000 7fed22e00640 1 -- 172.21.15.19:0/4111476644 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fecfc06b4d0 msgr2=0x7fecfc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.989+0000 7fed22e00640 1 --2- 172.21.15.19:0/4111476644 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fecfc06b4d0 0x7fecfc06d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fed08036000 tx=0x7fed08008030 comp rx=0 tx=0).stop 2024-03-08T06:04:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.989+0000 7fed22e00640 1 -- 172.21.15.19:0/4111476644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed1c071c20 msgr2=0x7fed1c158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.989+0000 7fed22e00640 1 --2- 172.21.15.19:0/4111476644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed1c071c20 0x7fed1c158a20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fed1000c7f0 tx=0x7fed1000ccb0 comp rx=0 tx=0).stop 2024-03-08T06:04:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.989+0000 7fed22e00640 1 -- 172.21.15.19:0/4111476644 shutdown_connections 2024-03-08T06:04:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.989+0000 7fed22e00640 1 --2- 172.21.15.19:0/4111476644 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fecfc06b4d0 0x7fecfc06d990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.989+0000 7fed22e00640 1 --2- 172.21.15.19:0/4111476644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fed1c15bfb0 0x7fed1c1f1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.989+0000 7fed22e00640 1 --2- 172.21.15.19:0/4111476644 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fed1c145500 0x7fed1c156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.989+0000 7fed22e00640 1 --2- 172.21.15.19:0/4111476644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed1c071c20 0x7fed1c158a20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:18.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.989+0000 7fed22e00640 1 -- 172.21.15.19:0/4111476644 >> 172.21.15.19:0/4111476644 conn(0x7fed1c0b1850 msgr2=0x7fed1c143d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:18.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.989+0000 7fed22e00640 1 -- 172.21.15.19:0/4111476644 shutdown_connections 2024-03-08T06:04:18.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:18.989+0000 7fed22e00640 1 -- 172.21.15.19:0/4111476644 wait complete. 2024-03-08T06:04:19.009 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-08T06:04:19.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.235+0000 7f40a4800640 1 Processor -- start 2024-03-08T06:04:19.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.236+0000 7f40a4800640 1 -- start start 2024-03-08T06:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.237+0000 7f40a4800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f409c06c460 0x7f409c06c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.237+0000 7f40a4800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f409c0b95d0 0x7f409c0d20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.237+0000 7f40a4800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f409c06cd80 con 0x7f409c0b5770 2024-03-08T06:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.237+0000 7f40a4800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f409c0d2940 con 0x7f409c06c460 2024-03-08T06:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.237+0000 7f40a4800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409c0d2c20 con 0x7f409c0b95d0 2024-03-08T06:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.237+0000 7f40a1e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f409c06c460 0x7f409c06c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.237+0000 7f40a2800640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f409c0b5770 0x7f409c0b5c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43864/0 (socket says 172.21.15.19:43864) 2024-03-08T06:04:19.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.237+0000 7f40a2800640 1 -- 172.21.15.19:0/560304855 learned_addr learned my addr 172.21.15.19:0/560304855 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:19.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.238+0000 7f40a1400640 1 --2- 172.21.15.19:0/560304855 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f409c0b95d0 0x7f409c0d20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:19.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.238+0000 7f40a1e00640 1 -- 172.21.15.19:0/560304855 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f409c0b95d0 msgr2=0x7f409c0d20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:19.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.238+0000 7f40a1e00640 1 --2- 172.21.15.19:0/560304855 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f409c0b95d0 0x7f409c0d20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:19.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.238+0000 7f40a1e00640 1 -- 172.21.15.19:0/560304855 >> v1:172.21.15.19:6789/0 conn(0x7f409c0b5770 legacy=0x7f409c0b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:19.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.238+0000 7f40a1e00640 1 -- 172.21.15.19:0/560304855 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c0d2f00 con 0x7f409c06c460 2024-03-08T06:04:19.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.238+0000 7f40a1400640 1 --2- 172.21.15.19:0/560304855 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f409c0b95d0 0x7f409c0d20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:19.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.239+0000 7f40a1e00640 1 --2- 172.21.15.19:0/560304855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f409c06c460 0x7f409c06c840 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f40900097a0 tx=0x7f409002b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c94d381ab75381 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:19.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.240+0000 7f40a0a00640 1 -- 172.21.15.19:0/560304855 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090034070 con 0x7f409c06c460 2024-03-08T06:04:19.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.240+0000 7f40a0a00640 1 -- 172.21.15.19:0/560304855 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4090030800 con 0x7f409c06c460 2024-03-08T06:04:19.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.240+0000 7f40a0a00640 1 -- 172.21.15.19:0/560304855 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090030bd0 con 0x7f409c06c460 2024-03-08T06:04:19.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.240+0000 7f40a4800640 1 -- 172.21.15.19:0/560304855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f409c06c460 msgr2=0x7f409c06c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:19.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.240+0000 7f40a4800640 1 --2- 172.21.15.19:0/560304855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f409c06c460 0x7f409c06c840 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f40900097a0 tx=0x7f409002b940 comp rx=0 tx=0).stop 2024-03-08T06:04:19.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.241+0000 7f40a4800640 1 -- 172.21.15.19:0/560304855 shutdown_connections 2024-03-08T06:04:19.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.241+0000 7f40a4800640 1 --2- 172.21.15.19:0/560304855 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f409c0b95d0 0x7f409c0d20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:19.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.241+0000 7f40a4800640 1 --2- 172.21.15.19:0/560304855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f409c06c460 0x7f409c06c840 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:19.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.241+0000 7f40a4800640 1 -- 172.21.15.19:0/560304855 >> 172.21.15.19:0/560304855 conn(0x7f409c066fc0 msgr2=0x7f409c0d3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:19.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.241+0000 7f40a4800640 1 -- 172.21.15.19:0/560304855 shutdown_connections 2024-03-08T06:04:19.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.241+0000 7f40a4800640 1 -- 172.21.15.19:0/560304855 wait complete. 2024-03-08T06:04:19.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.242+0000 7f40a4800640 1 Processor -- start 2024-03-08T06:04:19.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.243+0000 7f40a4800640 1 -- start start 2024-03-08T06:04:19.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.243+0000 7f40a4800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f409c06c460 0x7f409c0cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:19.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.244+0000 7f40a4800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f409c0b5770 0x7f409c0c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:19.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.244+0000 7f40a4800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f409c0b95d0 0x7f409c15f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:19.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.244+0000 7f40a4800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409c0d2630 con 0x7f409c06c460 2024-03-08T06:04:19.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.244+0000 7f40a4800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409c0d34c0 con 0x7f409c0b5770 2024-03-08T06:04:19.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.244+0000 7f40a4800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409c0d39e0 con 0x7f409c0b95d0 2024-03-08T06:04:19.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.244+0000 7f40a1e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f409c06c460 0x7f409c0cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:19.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.244+0000 7f40a1e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f409c06c460 0x7f409c0cda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46650/0 (socket says 172.21.15.19:46650) 2024-03-08T06:04:19.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.244+0000 7f40a1e00640 1 -- 172.21.15.19:0/1528342139 learned_addr learned my addr 172.21.15.19:0/1528342139 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:19.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.244+0000 7f40a1e00640 1 -- 172.21.15.19:0/1528342139 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f409c0b95d0 msgr2=0x7f409c15f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:19.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.244+0000 7f40a1e00640 1 --2- 172.21.15.19:0/1528342139 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f409c0b95d0 0x7f409c15f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:19.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.244+0000 7f40a1e00640 1 -- 172.21.15.19:0/1528342139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f409c0b5770 msgr2=0x7f409c0c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:19.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.244+0000 7f40a1e00640 1 --2- 172.21.15.19:0/1528342139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f409c0b5770 0x7f409c0c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:19.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.244+0000 7f40a1e00640 1 -- 172.21.15.19:0/1528342139 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c0cdfd0 con 0x7f409c06c460 2024-03-08T06:04:19.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.245+0000 7f40a1e00640 1 --2- 172.21.15.19:0/1528342139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f409c06c460 0x7f409c0cda90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f409002bf50 tx=0x7f40900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:19.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.245+0000 7f4096000640 1 -- 172.21.15.19:0/1528342139 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090034040 con 0x7f409c06c460 2024-03-08T06:04:19.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.245+0000 7f4096000640 1 -- 172.21.15.19:0/1528342139 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409003ada0 con 0x7f409c06c460 2024-03-08T06:04:19.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.245+0000 7f4096000640 1 -- 172.21.15.19:0/1528342139 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4090044610 con 0x7f409c06c460 2024-03-08T06:04:19.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.245+0000 7f40a4800640 1 -- 172.21.15.19:0/1528342139 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f409c15e340 con 0x7f409c06c460 2024-03-08T06:04:19.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.245+0000 7f40a4800640 1 -- 172.21.15.19:0/1528342139 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f409c15e900 con 0x7f409c06c460 2024-03-08T06:04:19.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.246+0000 7f40a4800640 1 -- 172.21.15.19:0/1528342139 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f409c067cb0 con 0x7f409c06c460 2024-03-08T06:04:19.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.247+0000 7f4096000640 1 -- 172.21.15.19:0/1528342139 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f409004b060 con 0x7f409c06c460 2024-03-08T06:04:19.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.248+0000 7f4096000640 1 --2- 172.21.15.19:0/1528342139 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f408006b500 0x7f408006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:19.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.248+0000 7f4096000640 1 -- 172.21.15.19:0/1528342139 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f40900ac3e0 con 0x7f409c06c460 2024-03-08T06:04:19.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.249+0000 7f40a1400640 1 --2- 172.21.15.19:0/1528342139 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f408006b500 0x7f408006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:19.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.249+0000 7f40a1400640 1 --2- 172.21.15.19:0/1528342139 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f408006b500 0x7f408006d9c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f408c006fd0 tx=0x7f408c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:19.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.253+0000 7f4096000640 1 -- 172.21.15.19:0/1528342139 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f409003f070 con 0x7f409c06c460 2024-03-08T06:04:19.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:19.453+0000 7f40a4800640 1 -- 172.21.15.19:0/1528342139 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f409c0c9d20 con 0x7f409c06c460 2024-03-08T06:04:20.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.431+0000 7f4096000640 1 -- 172.21.15.19:0/1528342139 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4090037e40 con 0x7f409c06c460 2024-03-08T06:04:20.431 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2024-03-08T06:04:20.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.435+0000 7f40a4800640 1 -- 172.21.15.19:0/1528342139 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f408006b500 msgr2=0x7f408006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:20.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.435+0000 7f40a4800640 1 --2- 172.21.15.19:0/1528342139 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f408006b500 0x7f408006d9c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f408c006fd0 tx=0x7f408c008040 comp rx=0 tx=0).stop 2024-03-08T06:04:20.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.435+0000 7f40a4800640 1 -- 172.21.15.19:0/1528342139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f409c06c460 msgr2=0x7f409c0cda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:20.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.435+0000 7f40a4800640 1 --2- 172.21.15.19:0/1528342139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f409c06c460 0x7f409c0cda90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f409002bf50 tx=0x7f40900046c0 comp rx=0 tx=0).stop 2024-03-08T06:04:20.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.435+0000 7f40a4800640 1 -- 172.21.15.19:0/1528342139 shutdown_connections 2024-03-08T06:04:20.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.435+0000 7f40a4800640 1 --2- 172.21.15.19:0/1528342139 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f408006b500 0x7f408006d9c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:20.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.435+0000 7f40a4800640 1 --2- 172.21.15.19:0/1528342139 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f409c0b95d0 0x7f409c15f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:20.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.435+0000 7f40a4800640 1 --2- 172.21.15.19:0/1528342139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f409c0b5770 0x7f409c0c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:20.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.435+0000 7f40a4800640 1 --2- 172.21.15.19:0/1528342139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f409c06c460 0x7f409c0cda90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:20.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.435+0000 7f40a4800640 1 -- 172.21.15.19:0/1528342139 >> 172.21.15.19:0/1528342139 conn(0x7f409c066fc0 msgr2=0x7f409c0b5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:20.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.435+0000 7f40a4800640 1 -- 172.21.15.19:0/1528342139 shutdown_connections 2024-03-08T06:04:20.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.436+0000 7f40a4800640 1 -- 172.21.15.19:0/1528342139 wait complete. 2024-03-08T06:04:20.465 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-08T06:04:20.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.685+0000 7fd0efc00640 1 Processor -- start 2024-03-08T06:04:20.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.685+0000 7fd0efc00640 1 -- start start 2024-03-08T06:04:20.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.687+0000 7fd0efc00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0e815ed20 0x7fd0e8168e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:20.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.687+0000 7fd0efc00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e815f390 con 0x7fd0e81584a0 2024-03-08T06:04:20.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.687+0000 7fd0efc00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e806d820 con 0x7fd0e8072060 2024-03-08T06:04:20.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.687+0000 7fd0efc00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e806db00 con 0x7fd0e815ed20 2024-03-08T06:04:20.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.687+0000 7fd0ed200640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd0e81584a0 0x7fd0e8071950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43880/0 (socket says 172.21.15.19:43880) 2024-03-08T06:04:20.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.687+0000 7fd0ed200640 1 -- 172.21.15.19:0/3031999449 learned_addr learned my addr 172.21.15.19:0/3031999449 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:20.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.687+0000 7fd0edc00640 1 --2- 172.21.15.19:0/3031999449 >> v2:172.21.15.19:3300/0 conn(0x7fd0e815ed20 0x7fd0e8168e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:20.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.688+0000 7fd0e7400640 1 -- 172.21.15.19:0/3031999449 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999863633 0 0) 0x7fd0e815f390 con 0x7fd0e81584a0 2024-03-08T06:04:20.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.688+0000 7fd0e7400640 1 -- 172.21.15.19:0/3031999449 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0d0003520 con 0x7fd0e81584a0 2024-03-08T06:04:20.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.688+0000 7fd0edc00640 1 -- 172.21.15.19:0/3031999449 >> v1:172.21.15.42:6789/0 conn(0x7fd0e8072060 legacy=0x7fd0e815e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:20.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.688+0000 7fd0edc00640 1 -- 172.21.15.19:0/3031999449 >> v1:172.21.15.19:6789/0 conn(0x7fd0e81584a0 legacy=0x7fd0e8071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:20.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.688+0000 7fd0edc00640 1 -- 172.21.15.19:0/3031999449 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e806dde0 con 0x7fd0e815ed20 2024-03-08T06:04:20.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.689+0000 7fd0edc00640 1 --2- 172.21.15.19:0/3031999449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0e815ed20 0x7fd0e8168e20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009d90 tx=0x7fd0e002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317350304d5eb58b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:20.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.689+0000 7fd0e7400640 1 -- 172.21.15.19:0/3031999449 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0039070 con 0x7fd0e815ed20 2024-03-08T06:04:20.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.689+0000 7fd0e7400640 1 -- 172.21.15.19:0/3031999449 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e002cbd0 con 0x7fd0e815ed20 2024-03-08T06:04:20.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.689+0000 7fd0e7400640 1 -- 172.21.15.19:0/3031999449 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0034440 con 0x7fd0e815ed20 2024-03-08T06:04:20.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.690+0000 7fd0efc00640 1 -- 172.21.15.19:0/3031999449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0e815ed20 msgr2=0x7fd0e8168e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:20.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.690+0000 7fd0efc00640 1 --2- 172.21.15.19:0/3031999449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0e815ed20 0x7fd0e8168e20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009d90 tx=0x7fd0e002be20 comp rx=0 tx=0).stop 2024-03-08T06:04:20.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.690+0000 7fd0efc00640 1 -- 172.21.15.19:0/3031999449 shutdown_connections 2024-03-08T06:04:20.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.690+0000 7fd0efc00640 1 --2- 172.21.15.19:0/3031999449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0e815ed20 0x7fd0e8168e20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:20.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.690+0000 7fd0efc00640 1 -- 172.21.15.19:0/3031999449 >> 172.21.15.19:0/3031999449 conn(0x7fd0e806ae30 msgr2=0x7fd0e806b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:20.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.690+0000 7fd0efc00640 1 -- 172.21.15.19:0/3031999449 shutdown_connections 2024-03-08T06:04:20.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.690+0000 7fd0efc00640 1 -- 172.21.15.19:0/3031999449 wait complete. 2024-03-08T06:04:20.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.692+0000 7fd0efc00640 1 Processor -- start 2024-03-08T06:04:20.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.692+0000 7fd0efc00640 1 -- start start 2024-03-08T06:04:20.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.693+0000 7fd0efc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0e8072060 0x7fd0e8145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:20.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.693+0000 7fd0efc00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd0e81584a0 0x7fd0e81f7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:20.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.693+0000 7fd0efc00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0e815ed20 0x7fd0e81f39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:20.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.693+0000 7fd0efc00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e806e5e0 con 0x7fd0e815ed20 2024-03-08T06:04:20.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.693+0000 7fd0efc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e8158880 con 0x7fd0e8072060 2024-03-08T06:04:20.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.693+0000 7fd0efc00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e81f7e90 con 0x7fd0e81584a0 2024-03-08T06:04:20.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.693+0000 7fd0edc00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0e815ed20 0x7fd0e81f39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:20.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.693+0000 7fd0edc00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0e815ed20 0x7fd0e81f39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46668/0 (socket says 172.21.15.19:46668) 2024-03-08T06:04:20.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.693+0000 7fd0edc00640 1 -- 172.21.15.19:0/1099437849 learned_addr learned my addr 172.21.15.19:0/1099437849 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:20.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.694+0000 7fd0ed200640 1 --2- 172.21.15.19:0/1099437849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0e8072060 0x7fd0e8145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:20.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.694+0000 7fd0e7e00640 1 --2- 172.21.15.19:0/1099437849 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd0e81584a0 0x7fd0e81f7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:20.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.694+0000 7fd0edc00640 1 -- 172.21.15.19:0/1099437849 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd0e81584a0 msgr2=0x7fd0e81f7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:20.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.694+0000 7fd0edc00640 1 --2- 172.21.15.19:0/1099437849 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd0e81584a0 0x7fd0e81f7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:20.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.694+0000 7fd0edc00640 1 -- 172.21.15.19:0/1099437849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0e8072060 msgr2=0x7fd0e8145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:20.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.694+0000 7fd0edc00640 1 --2- 172.21.15.19:0/1099437849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0e8072060 0x7fd0e8145760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:20.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.694+0000 7fd0edc00640 1 -- 172.21.15.19:0/1099437849 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e81f43a0 con 0x7fd0e815ed20 2024-03-08T06:04:20.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.694+0000 7fd0edc00640 1 --2- 172.21.15.19:0/1099437849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0e815ed20 0x7fd0e81f39c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0037040 tx=0x7fd0e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:20.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.694+0000 7fd0e4c00640 1 -- 172.21.15.19:0/1099437849 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0044020 con 0x7fd0e815ed20 2024-03-08T06:04:20.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.694+0000 7fd0e4c00640 1 -- 172.21.15.19:0/1099437849 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e003f470 con 0x7fd0e815ed20 2024-03-08T06:04:20.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.694+0000 7fd0e4c00640 1 -- 172.21.15.19:0/1099437849 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0039040 con 0x7fd0e815ed20 2024-03-08T06:04:20.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.694+0000 7fd0efc00640 1 -- 172.21.15.19:0/1099437849 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e81f4680 con 0x7fd0e815ed20 2024-03-08T06:04:20.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.695+0000 7fd0efc00640 1 -- 172.21.15.19:0/1099437849 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e81f7430 con 0x7fd0e815ed20 2024-03-08T06:04:20.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.696+0000 7fd0efc00640 1 -- 172.21.15.19:0/1099437849 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e8067cb0 con 0x7fd0e815ed20 2024-03-08T06:04:20.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.697+0000 7fd0e4c00640 1 -- 172.21.15.19:0/1099437849 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd0e0047020 con 0x7fd0e815ed20 2024-03-08T06:04:20.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.698+0000 7fd0e4c00640 1 --2- 172.21.15.19:0/1099437849 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd0c806b4d0 0x7fd0c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:20.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.698+0000 7fd0e4c00640 1 -- 172.21.15.19:0/1099437849 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5473+0+0 (secure 0 0 0) 0x7fd0e00acc10 con 0x7fd0e815ed20 2024-03-08T06:04:20.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.698+0000 7fd0ed200640 1 --2- 172.21.15.19:0/1099437849 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd0c806b4d0 0x7fd0c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:20.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.699+0000 7fd0ed200640 1 --2- 172.21.15.19:0/1099437849 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd0c806b4d0 0x7fd0c806d990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc005880 tx=0x7fd0dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:20.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.703+0000 7fd0e4c00640 1 -- 172.21.15.19:0/1099437849 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd0e004e030 con 0x7fd0e815ed20 2024-03-08T06:04:20.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:20.913+0000 7fd0efc00640 1 -- 172.21.15.19:0/1099437849 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd0e8157f10 con 0x7fd0e815ed20 2024-03-08T06:04:21.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.435+0000 7fd0e4c00640 1 -- 172.21.15.19:0/1099437849 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd0e007bb90 con 0x7fd0e815ed20 2024-03-08T06:04:21.435 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2024-03-08T06:04:21.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.438+0000 7fd0efc00640 1 -- 172.21.15.19:0/1099437849 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd0c806b4d0 msgr2=0x7fd0c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:21.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.438+0000 7fd0efc00640 1 --2- 172.21.15.19:0/1099437849 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd0c806b4d0 0x7fd0c806d990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc005880 tx=0x7fd0dc009040 comp rx=0 tx=0).stop 2024-03-08T06:04:21.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.438+0000 7fd0efc00640 1 -- 172.21.15.19:0/1099437849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0e815ed20 msgr2=0x7fd0e81f39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:21.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.439+0000 7fd0efc00640 1 --2- 172.21.15.19:0/1099437849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0e815ed20 0x7fd0e81f39c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0037040 tx=0x7fd0e0004a40 comp rx=0 tx=0).stop 2024-03-08T06:04:21.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.439+0000 7fd0efc00640 1 -- 172.21.15.19:0/1099437849 shutdown_connections 2024-03-08T06:04:21.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.439+0000 7fd0efc00640 1 --2- 172.21.15.19:0/1099437849 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd0c806b4d0 0x7fd0c806d990 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:21.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.439+0000 7fd0efc00640 1 --2- 172.21.15.19:0/1099437849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0e815ed20 0x7fd0e81f39c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:21.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.439+0000 7fd0efc00640 1 --2- 172.21.15.19:0/1099437849 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd0e81584a0 0x7fd0e81f7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:21.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.439+0000 7fd0efc00640 1 --2- 172.21.15.19:0/1099437849 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0e8072060 0x7fd0e8145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:21.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.439+0000 7fd0efc00640 1 -- 172.21.15.19:0/1099437849 >> 172.21.15.19:0/1099437849 conn(0x7fd0e806ae30 msgr2=0x7fd0e8146890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:21.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.439+0000 7fd0efc00640 1 -- 172.21.15.19:0/1099437849 shutdown_connections 2024-03-08T06:04:21.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.439+0000 7fd0efc00640 1 -- 172.21.15.19:0/1099437849 wait complete. 2024-03-08T06:04:21.468 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-08T06:04:21.468 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-08T06:04:21.468 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-08T06:04:21.468 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:04:21.469 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-08T06:04:21.469 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-08T06:04:21.469 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-08T06:04:21.469 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:04:21.469 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-08T06:04:21.469 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-08T06:04:21.470 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-08T06:04:21.470 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:04:21.470 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-08T06:04:21.470 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-08T06:04:21.470 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-08T06:04:21.470 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:04:21.489 INFO:tasks.ceph.mds.a:Stopped 2024-03-08T06:04:21.490 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-08T06:04:21.491 INFO:tasks.ceph.mds.d:Stopped 2024-03-08T06:04:21.491 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-08T06:04:21.492 INFO:tasks.ceph.mds.b:Stopped 2024-03-08T06:04:21.492 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-08T06:04:21.495 INFO:tasks.ceph.mds.c:Stopped 2024-03-08T06:04:21.495 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-08T06:04:21.540 INFO:tasks.ceph.mds.d:Started 2024-03-08T06:04:21.541 DEBUG:teuthology.parallel:result is None 2024-03-08T06:04:21.542 INFO:tasks.ceph.mds.a:Started 2024-03-08T06:04:21.543 DEBUG:teuthology.parallel:result is None 2024-03-08T06:04:21.547 INFO:tasks.ceph.mds.b:Started 2024-03-08T06:04:21.547 DEBUG:teuthology.parallel:result is None 2024-03-08T06:04:21.549 INFO:tasks.ceph.mds.c:Started 2024-03-08T06:04:21.549 DEBUG:teuthology.parallel:result is None 2024-03-08T06:04:21.550 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-08T06:04:21.700 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2024-03-08T06:04:21.703 INFO:tasks.ceph.mds.b.smithi042.stdout:starting mds.b at 2024-03-08T06:04:21.704 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-03-08T06:04:21.708 INFO:tasks.ceph.mds.d.smithi042.stdout:starting mds.d at 2024-03-08T06:04:21.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.742+0000 7fc192000640 1 Processor -- start 2024-03-08T06:04:21.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.742+0000 7fc192000640 1 -- start start 2024-03-08T06:04:21.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.743+0000 7fc192000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc18c0cd2c0 0x7fc18c06e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:21.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.743+0000 7fc192000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc18c0cd6a0 0x7fc18c06e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:21.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.744+0000 7fc192000640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc18c15b290 con 0x7fc18c0b3880 2024-03-08T06:04:21.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.744+0000 7fc192000640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc18c15b570 con 0x7fc18c0cd6a0 2024-03-08T06:04:21.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.744+0000 7fc192000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c15b850 con 0x7fc18c0cd2c0 2024-03-08T06:04:21.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.744+0000 7fc183e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc18c0cd6a0 0x7fc18c06e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:21.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.744+0000 7fc18be00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc18c0b3880 0x7fc18c0ced20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43894/0 (socket says 172.21.15.19:43894) 2024-03-08T06:04:21.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.744+0000 7fc18be00640 1 -- 172.21.15.19:0/2733057065 learned_addr learned my addr 172.21.15.19:0/2733057065 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:21.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.744+0000 7fc18b400640 1 --2- 172.21.15.19:0/2733057065 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc18c0cd2c0 0x7fc18c06e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:21.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.744+0000 7fc183e00640 1 -- 172.21.15.19:0/2733057065 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc18c0cd2c0 msgr2=0x7fc18c06e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:21.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.744+0000 7fc183e00640 1 --2- 172.21.15.19:0/2733057065 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc18c0cd2c0 0x7fc18c06e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:21.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.744+0000 7fc183e00640 1 -- 172.21.15.19:0/2733057065 >> v1:172.21.15.19:6789/0 conn(0x7fc18c0b3880 legacy=0x7fc18c0ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:21.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.744+0000 7fc183e00640 1 -- 172.21.15.19:0/2733057065 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c15bb30 con 0x7fc18c0cd6a0 2024-03-08T06:04:21.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.745+0000 7fc183e00640 1 --2- 172.21.15.19:0/2733057065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc18c0cd6a0 0x7fc18c06e990 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc1740097a0 tx=0x7fc17402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970a82bc09f264d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:21.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.746+0000 7fc18aa00640 1 -- 172.21.15.19:0/2733057065 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc174035020 con 0x7fc18c0cd6a0 2024-03-08T06:04:21.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.746+0000 7fc18aa00640 1 -- 172.21.15.19:0/2733057065 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc174031810 con 0x7fc18c0cd6a0 2024-03-08T06:04:21.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.746+0000 7fc18aa00640 1 -- 172.21.15.19:0/2733057065 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc174031be0 con 0x7fc18c0cd6a0 2024-03-08T06:04:21.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.746+0000 7fc192000640 1 -- 172.21.15.19:0/2733057065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc18c0cd6a0 msgr2=0x7fc18c06e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:21.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.746+0000 7fc192000640 1 --2- 172.21.15.19:0/2733057065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc18c0cd6a0 0x7fc18c06e990 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc1740097a0 tx=0x7fc17402b8b0 comp rx=0 tx=0).stop 2024-03-08T06:04:21.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.746+0000 7fc192000640 1 -- 172.21.15.19:0/2733057065 shutdown_connections 2024-03-08T06:04:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.746+0000 7fc192000640 1 --2- 172.21.15.19:0/2733057065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc18c0cd6a0 0x7fc18c06e990 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.746+0000 7fc192000640 1 --2- 172.21.15.19:0/2733057065 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc18c0cd2c0 0x7fc18c06e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.746+0000 7fc192000640 1 -- 172.21.15.19:0/2733057065 >> 172.21.15.19:0/2733057065 conn(0x7fc18c06ae30 msgr2=0x7fc18c06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.746+0000 7fc192000640 1 -- 172.21.15.19:0/2733057065 shutdown_connections 2024-03-08T06:04:21.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.746+0000 7fc192000640 1 -- 172.21.15.19:0/2733057065 wait complete. 2024-03-08T06:04:21.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.748+0000 7fc192000640 1 Processor -- start 2024-03-08T06:04:21.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.748+0000 7fc192000640 1 -- start start 2024-03-08T06:04:21.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.749+0000 7fc192000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc18c0b3880 0x7fc18c143550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:21.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.749+0000 7fc192000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc18c0cd2c0 0x7fc18c1e5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.749+0000 7fc192000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc18c0cd6a0 0x7fc18c1e5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.749+0000 7fc192000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c0cf5b0 con 0x7fc18c0b3880 2024-03-08T06:04:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.749+0000 7fc192000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c0cf430 con 0x7fc18c0cd2c0 2024-03-08T06:04:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.749+0000 7fc192000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18c0cf730 con 0x7fc18c0cd6a0 2024-03-08T06:04:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.749+0000 7fc18b400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc18c0b3880 0x7fc18c143550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.749+0000 7fc18b400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc18c0b3880 0x7fc18c143550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46724/0 (socket says 172.21.15.19:46724) 2024-03-08T06:04:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.749+0000 7fc18b400640 1 -- 172.21.15.19:0/1284758647 learned_addr learned my addr 172.21.15.19:0/1284758647 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.750+0000 7fc183e00640 1 --2- 172.21.15.19:0/1284758647 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc18c0cd2c0 0x7fc18c1e5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.750+0000 7fc18be00640 1 --2- 172.21.15.19:0/1284758647 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc18c0cd6a0 0x7fc18c1e5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.750+0000 7fc18b400640 1 -- 172.21.15.19:0/1284758647 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc18c0cd6a0 msgr2=0x7fc18c1e5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.750+0000 7fc18b400640 1 --2- 172.21.15.19:0/1284758647 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc18c0cd6a0 0x7fc18c1e5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.750+0000 7fc18b400640 1 -- 172.21.15.19:0/1284758647 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc18c0cd2c0 msgr2=0x7fc18c1e5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.750+0000 7fc18b400640 1 --2- 172.21.15.19:0/1284758647 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc18c0cd2c0 0x7fc18c1e5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:21.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.750+0000 7fc18b400640 1 -- 172.21.15.19:0/1284758647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18c0b1030 con 0x7fc18c0b3880 2024-03-08T06:04:21.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.750+0000 7fc18b400640 1 --2- 172.21.15.19:0/1284758647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc18c0b3880 0x7fc18c143550 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00e9e0 tx=0x7fc17c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:21.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.750+0000 7fc183400640 1 -- 172.21.15.19:0/1284758647 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c017070 con 0x7fc18c0b3880 2024-03-08T06:04:21.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.750+0000 7fc183400640 1 -- 172.21.15.19:0/1284758647 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c00c9d0 con 0x7fc18c0b3880 2024-03-08T06:04:21.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.750+0000 7fc183400640 1 -- 172.21.15.19:0/1284758647 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c00cdc0 con 0x7fc18c0b3880 2024-03-08T06:04:21.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.750+0000 7fc192000640 1 -- 172.21.15.19:0/1284758647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc18c0b04b0 con 0x7fc18c0b3880 2024-03-08T06:04:21.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.751+0000 7fc192000640 1 -- 172.21.15.19:0/1284758647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc18c0b0a70 con 0x7fc18c0b3880 2024-03-08T06:04:21.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.752+0000 7fc192000640 1 -- 172.21.15.19:0/1284758647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc18c067cb0 con 0x7fc18c0b3880 2024-03-08T06:04:21.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.753+0000 7fc183400640 1 -- 172.21.15.19:0/1284758647 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fc17c01a070 con 0x7fc18c0b3880 2024-03-08T06:04:21.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.753+0000 7fc183400640 1 --2- 172.21.15.19:0/1284758647 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc16806b4d0 0x7fc16806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:21.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.754+0000 7fc183400640 1 -- 172.21.15.19:0/1284758647 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc17c089f00 con 0x7fc18c0b3880 2024-03-08T06:04:21.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.754+0000 7fc183e00640 1 --2- 172.21.15.19:0/1284758647 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc16806b4d0 0x7fc16806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:21.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.754+0000 7fc183e00640 1 --2- 172.21.15.19:0/1284758647 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc16806b4d0 0x7fc16806d990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc174036000 tx=0x7fc174008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:21.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.758+0000 7fc183400640 1 -- 172.21.15.19:0/1284758647 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc17c059070 con 0x7fc18c0b3880 2024-03-08T06:04:21.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:21.968+0000 7fc192000640 1 -- 172.21.15.19:0/1284758647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc18c0b0e10 con 0x7fc18c0b3880 2024-03-08T06:04:22.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.472+0000 7fc183400640 1 -- 172.21.15.19:0/1284758647 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc17c058970 con 0x7fc18c0b3880 2024-03-08T06:04:22.474 INFO:teuthology.orchestra.run.smithi019.stderr: removed all blocklist entries 2024-03-08T06:04:22.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.476+0000 7fc192000640 1 -- 172.21.15.19:0/1284758647 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc16806b4d0 msgr2=0x7fc16806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:22.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.476+0000 7fc192000640 1 --2- 172.21.15.19:0/1284758647 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc16806b4d0 0x7fc16806d990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc174036000 tx=0x7fc174008030 comp rx=0 tx=0).stop 2024-03-08T06:04:22.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.476+0000 7fc192000640 1 -- 172.21.15.19:0/1284758647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc18c0b3880 msgr2=0x7fc18c143550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:22.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.476+0000 7fc192000640 1 --2- 172.21.15.19:0/1284758647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc18c0b3880 0x7fc18c143550 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00e9e0 tx=0x7fc17c00eea0 comp rx=0 tx=0).stop 2024-03-08T06:04:22.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.476+0000 7fc192000640 1 -- 172.21.15.19:0/1284758647 shutdown_connections 2024-03-08T06:04:22.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.476+0000 7fc192000640 1 --2- 172.21.15.19:0/1284758647 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fc16806b4d0 0x7fc16806d990 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:22.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.476+0000 7fc192000640 1 --2- 172.21.15.19:0/1284758647 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fc18c0cd6a0 0x7fc18c1e5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:22.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.476+0000 7fc192000640 1 --2- 172.21.15.19:0/1284758647 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc18c0cd2c0 0x7fc18c1e5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:22.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.476+0000 7fc192000640 1 --2- 172.21.15.19:0/1284758647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc18c0b3880 0x7fc18c143550 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:22.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.476+0000 7fc192000640 1 -- 172.21.15.19:0/1284758647 >> 172.21.15.19:0/1284758647 conn(0x7fc18c06ae30 msgr2=0x7fc18c154270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:22.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.476+0000 7fc192000640 1 -- 172.21.15.19:0/1284758647 shutdown_connections 2024-03-08T06:04:22.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.476+0000 7fc192000640 1 -- 172.21.15.19:0/1284758647 wait complete. 2024-03-08T06:04:22.498 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-08T06:04:22.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.710+0000 7f9d78c00640 1 Processor -- start 2024-03-08T06:04:22.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.710+0000 7f9d78c00640 1 -- start start 2024-03-08T06:04:22.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.712+0000 7f9d78c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9d74071ab0 0x7f9d7415cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:22.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.712+0000 7f9d78c00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7415d0c0 con 0x7f9d74071e90 2024-03-08T06:04:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.712+0000 7f9d78c00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7406da80 con 0x7f9d7406d600 2024-03-08T06:04:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.712+0000 7f9d78c00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7406ef40 con 0x7f9d74071ab0 2024-03-08T06:04:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.712+0000 7f9d72800640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9d74071e90 0x7f9d7415d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37304/0 (socket says 172.21.15.19:37304) 2024-03-08T06:04:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.712+0000 7f9d72800640 1 -- 172.21.15.19:0/338255311 learned_addr learned my addr 172.21.15.19:0/338255311 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.712+0000 7f9d71e00640 1 --2- 172.21.15.19:0/338255311 >> v2:172.21.15.42:3300/0 conn(0x7f9d74071ab0 0x7f9d7415cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.712+0000 7f9d70a00640 1 -- 172.21.15.19:0/338255311 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331992313 0 0) 0x7f9d6c001490 con 0x7f9d74071e90 2024-03-08T06:04:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.713+0000 7f9d70a00640 1 -- 172.21.15.19:0/338255311 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d58003520 con 0x7f9d74071e90 2024-03-08T06:04:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.713+0000 7f9d70a00640 1 -- 172.21.15.19:0/338255311 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4279352484 0 0) 0x7f9d58003520 con 0x7f9d74071e90 2024-03-08T06:04:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.713+0000 7f9d70a00640 1 -- 172.21.15.19:0/338255311 >> v2:172.21.15.42:3300/0 conn(0x7f9d74071ab0 msgr2=0x7f9d7415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.713+0000 7f9d70a00640 1 --2- 172.21.15.19:0/338255311 >> v2:172.21.15.42:3300/0 conn(0x7f9d74071ab0 0x7f9d7415cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.713+0000 7f9d70a00640 1 -- 172.21.15.19:0/338255311 >> v1:172.21.15.42:6789/0 conn(0x7f9d7406d600 legacy=0x7f9d74144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.713+0000 7f9d70a00640 1 -- 172.21.15.19:0/338255311 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7406dd60 con 0x7f9d74071e90 2024-03-08T06:04:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.713+0000 7f9d70a00640 1 -- 172.21.15.19:0/338255311 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f9d6c001bc0 con 0x7f9d74071e90 2024-03-08T06:04:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.713+0000 7f9d70a00640 1 -- 172.21.15.19:0/338255311 >> v1:172.21.15.19:6789/0 conn(0x7f9d74071e90 legacy=0x7f9d7415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.713+0000 7f9d70a00640 1 --2- 172.21.15.19:0/338255311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d580039b0 0x7f9d58003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.713+0000 7f9d70a00640 1 --2- 172.21.15.19:0/338255311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d58004800 0x7f9d58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.713+0000 7f9d70a00640 1 --2- 172.21.15.19:0/338255311 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9d580051c0 0x7f9d5800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.713+0000 7f9d70a00640 1 -- 172.21.15.19:0/338255311 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5800c030 con 0x7f9d58004800 2024-03-08T06:04:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.713+0000 7f9d70a00640 1 -- 172.21.15.19:0/338255311 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5800c1e0 con 0x7f9d580039b0 2024-03-08T06:04:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.713+0000 7f9d70a00640 1 -- 172.21.15.19:0/338255311 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5800c3e0 con 0x7f9d580051c0 2024-03-08T06:04:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.713+0000 7f9d71400640 1 --2- 172.21.15.19:0/338255311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d58004800 0x7f9d58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.714+0000 7f9d71e00640 1 --2- 172.21.15.19:0/338255311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d580039b0 0x7f9d58003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.714+0000 7f9d71400640 1 -- 172.21.15.19:0/338255311 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9d580051c0 msgr2=0x7f9d5800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.714+0000 7f9d71400640 1 --2- 172.21.15.19:0/338255311 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9d580051c0 0x7f9d5800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.714+0000 7f9d71400640 1 -- 172.21.15.19:0/338255311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d580039b0 msgr2=0x7f9d58003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.714+0000 7f9d71400640 1 --2- 172.21.15.19:0/338255311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d580039b0 0x7f9d58003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.714+0000 7f9d71400640 1 -- 172.21.15.19:0/338255311 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d58003520 con 0x7f9d58004800 2024-03-08T06:04:22.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.714+0000 7f9d72800640 1 -- 172.21.15.19:0/338255311 reap_dead start 2024-03-08T06:04:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.715+0000 7f9d71400640 1 --2- 172.21.15.19:0/338255311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d58004800 0x7f9d58004c80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9d74072760 tx=0x7f9d58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8010141abef1ae10 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.715+0000 7f9d70a00640 1 -- 172.21.15.19:0/338255311 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d60001370 con 0x7f9d58004800 2024-03-08T06:04:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.715+0000 7f9d70a00640 1 -- 172.21.15.19:0/338255311 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d600052d0 con 0x7f9d58004800 2024-03-08T06:04:22.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.715+0000 7f9d70a00640 1 -- 172.21.15.19:0/338255311 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d60003830 con 0x7f9d58004800 2024-03-08T06:04:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.716+0000 7f9d78c00640 1 -- 172.21.15.19:0/338255311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d58004800 msgr2=0x7f9d58004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.716+0000 7f9d78c00640 1 --2- 172.21.15.19:0/338255311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d58004800 0x7f9d58004c80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9d74072760 tx=0x7f9d58005830 comp rx=0 tx=0).stop 2024-03-08T06:04:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.716+0000 7f9d78c00640 1 -- 172.21.15.19:0/338255311 shutdown_connections 2024-03-08T06:04:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.716+0000 7f9d78c00640 1 --2- 172.21.15.19:0/338255311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d58004800 0x7f9d58004c80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.716+0000 7f9d78c00640 1 -- 172.21.15.19:0/338255311 >> 172.21.15.19:0/338255311 conn(0x7f9d7406ae30 msgr2=0x7f9d7406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.716+0000 7f9d78c00640 1 -- 172.21.15.19:0/338255311 shutdown_connections 2024-03-08T06:04:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.716+0000 7f9d78c00640 1 -- 172.21.15.19:0/338255311 wait complete. 2024-03-08T06:04:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.718+0000 7f9d78c00640 1 Processor -- start 2024-03-08T06:04:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.718+0000 7f9d78c00640 1 -- start start 2024-03-08T06:04:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.719+0000 7f9d78c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9d58004800 0x7f9d74143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.719+0000 7f9d78c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d740c48e0 0x7f9d741f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.719+0000 7f9d78c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d740c4d60 0x7f9d741f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.719+0000 7f9d78c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7406e600 con 0x7f9d740c48e0 2024-03-08T06:04:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.719+0000 7f9d78c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7406e320 con 0x7f9d740c4d60 2024-03-08T06:04:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.719+0000 7f9d78c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7415cb80 con 0x7f9d58004800 2024-03-08T06:04:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.719+0000 7f9d71400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d740c48e0 0x7f9d741f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.719+0000 7f9d71400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d740c48e0 0x7f9d741f3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35610/0 (socket says 172.21.15.19:35610) 2024-03-08T06:04:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.719+0000 7f9d71400640 1 -- 172.21.15.19:0/3690889252 learned_addr learned my addr 172.21.15.19:0/3690889252 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.720+0000 7f9d71e00640 1 --2- 172.21.15.19:0/3690889252 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9d58004800 0x7f9d74143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.720+0000 7f9d72800640 1 --2- 172.21.15.19:0/3690889252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d740c4d60 0x7f9d741f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.720+0000 7f9d71400640 1 -- 172.21.15.19:0/3690889252 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9d58004800 msgr2=0x7f9d74143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.720+0000 7f9d71400640 1 --2- 172.21.15.19:0/3690889252 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9d58004800 0x7f9d74143950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.720+0000 7f9d71400640 1 -- 172.21.15.19:0/3690889252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d740c4d60 msgr2=0x7f9d741f4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.720+0000 7f9d71400640 1 --2- 172.21.15.19:0/3690889252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d740c4d60 0x7f9d741f4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.720+0000 7f9d71400640 1 -- 172.21.15.19:0/3690889252 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d740b30d0 con 0x7f9d740c48e0 2024-03-08T06:04:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.720+0000 7f9d71e00640 1 --2- 172.21.15.19:0/3690889252 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9d58004800 0x7f9d74143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.720+0000 7f9d72800640 1 --2- 172.21.15.19:0/3690889252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d740c4d60 0x7f9d741f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.720+0000 7f9d71400640 1 --2- 172.21.15.19:0/3690889252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d740c48e0 0x7f9d741f3ae0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9d60005040 tx=0x7f9d60001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.720+0000 7f9d6a000640 1 -- 172.21.15.19:0/3690889252 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d60041020 con 0x7f9d740c48e0 2024-03-08T06:04:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.720+0000 7f9d6a000640 1 -- 172.21.15.19:0/3690889252 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d60005480 con 0x7f9d740c48e0 2024-03-08T06:04:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.720+0000 7f9d6a000640 1 -- 172.21.15.19:0/3690889252 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d60007a30 con 0x7f9d740c48e0 2024-03-08T06:04:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.721+0000 7f9d78c00640 1 -- 172.21.15.19:0/3690889252 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d740b33b0 con 0x7f9d740c48e0 2024-03-08T06:04:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.721+0000 7f9d78c00640 1 -- 172.21.15.19:0/3690889252 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d740b3970 con 0x7f9d740c48e0 2024-03-08T06:04:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.722+0000 7f9d78c00640 1 -- 172.21.15.19:0/3690889252 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7415c8c0 con 0x7f9d740c48e0 2024-03-08T06:04:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.723+0000 7f9d6a000640 1 -- 172.21.15.19:0/3690889252 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9d60044020 con 0x7f9d740c48e0 2024-03-08T06:04:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.724+0000 7f9d6a000640 1 --2- 172.21.15.19:0/3690889252 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9d5406b550 0x7f9d5406da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.724+0000 7f9d6a000640 1 -- 172.21.15.19:0/3690889252 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9d600ab7a0 con 0x7f9d740c48e0 2024-03-08T06:04:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.724+0000 7f9d71e00640 1 --2- 172.21.15.19:0/3690889252 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9d5406b550 0x7f9d5406da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.725+0000 7f9d71e00640 1 --2- 172.21.15.19:0/3690889252 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9d5406b550 0x7f9d5406da10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9d7415f7d0 tx=0x7f9d64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:22.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.728+0000 7f9d6a000640 1 -- 172.21.15.19:0/3690889252 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9d7415c8c0 con 0x7f9d740c48e0 2024-03-08T06:04:22.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.996+0000 7f9d78c00640 1 -- 172.21.15.19:0/3690889252 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f9d7415f0f0 con 0x7f9d740c48e0 2024-03-08T06:04:22.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:22.998+0000 7f9d6a000640 1 -- 172.21.15.19:0/3690889252 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f9d6004b030 con 0x7f9d740c48e0 2024-03-08T06:04:22.999 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:22.999 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-08T06:04:22.999 INFO:teuthology.orchestra.run.smithi019.stdout: "auth_dump": [ 2024-03-08T06:04:22.999 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:22.999 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.a", 2024-03-08T06:04:22.999 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDsqeplKkCoBhAAWAHNLMLkOgmZmUQ5UebQyQ==", 2024-03-08T06:04:22.999 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:22.999 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-08T06:04:23.000 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-03-08T06:04:23.000 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-03-08T06:04:23.000 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-08T06:04:23.000 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.000 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.000 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.000 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.b", 2024-03-08T06:04:23.000 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDsqeplLbFRKxAASPAxedYvCTCVFSq1wJ9cDQ==", 2024-03-08T06:04:23.000 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.000 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-08T06:04:23.000 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-03-08T06:04:23.000 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-03-08T06:04:23.000 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-08T06:04:23.000 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.001 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.001 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.001 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.c", 2024-03-08T06:04:23.001 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDsqeplW4Y0GRAAA2Y7mS6G/TNtF0VeYH1Pbw==", 2024-03-08T06:04:23.001 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.001 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-08T06:04:23.001 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-03-08T06:04:23.001 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-03-08T06:04:23.001 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-08T06:04:23.001 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.001 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.001 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.001 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mds.d", 2024-03-08T06:04:23.001 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDtqeplkfy1ARAASyTwWF5gP2Ii2MS6VMIzsg==", 2024-03-08T06:04:23.001 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.001 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-08T06:04:23.001 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-03-08T06:04:23.002 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-03-08T06:04:23.002 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-08T06:04:23.002 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.002 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.002 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.002 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.0", 2024-03-08T06:04:23.002 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDyqeplsbpyAhAASWXUKkoo3ofYJgxs0VJBwA==", 2024-03-08T06:04:23.002 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.002 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-08T06:04:23.002 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-08T06:04:23.002 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-08T06:04:23.002 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.002 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.002 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.003 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.1", 2024-03-08T06:04:23.003 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD1qepl0O15HBAAJLTI/lhb1OLK4nSucYdLTw==", 2024-03-08T06:04:23.003 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.003 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-08T06:04:23.003 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-08T06:04:23.003 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-08T06:04:23.003 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.003 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.003 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.003 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.2", 2024-03-08T06:04:23.003 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD4qeplcmn5NRAA2uStK5nHy0M0oJaTtiQnIQ==", 2024-03-08T06:04:23.003 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.003 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-08T06:04:23.003 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-08T06:04:23.003 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-08T06:04:23.003 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.004 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.004 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.3", 2024-03-08T06:04:23.004 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQD8qeplaxEfFBAAIqmIYDTw1RwTuYm9S4U6+A==", 2024-03-08T06:04:23.004 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.004 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-08T06:04:23.004 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-08T06:04:23.004 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-08T06:04:23.004 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.004 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.004 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.4", 2024-03-08T06:04:23.004 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQABqupl/84VIBAAlKEAn3insYJCsfOdBzMpDg==", 2024-03-08T06:04:23.004 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.004 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-08T06:04:23.004 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-08T06:04:23.004 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-08T06:04:23.005 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.005 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.005 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.5", 2024-03-08T06:04:23.005 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAEquplJC2yORAADO2Ns5v10pVd1URxrrXXTQ==", 2024-03-08T06:04:23.005 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.005 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-08T06:04:23.005 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-08T06:04:23.005 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-08T06:04:23.005 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.005 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.005 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.6", 2024-03-08T06:04:23.005 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAIqupl2in8FhAAO0CvJlSoeBd2P5FZMEwnEw==", 2024-03-08T06:04:23.005 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.005 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-08T06:04:23.006 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-08T06:04:23.006 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-08T06:04:23.006 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.006 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.006 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "osd.7", 2024-03-08T06:04:23.006 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQALquplb7ThIRAA1UAjvaXdx98vtrkDMNwyPQ==", 2024-03-08T06:04:23.006 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.006 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow profile osd", 2024-03-08T06:04:23.006 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile osd", 2024-03-08T06:04:23.006 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-08T06:04:23.006 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.006 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.007 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.0", 2024-03-08T06:04:23.007 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDtqeplzcxPEBAABnbNLSY0GpjUgDT5bL7o6Q==", 2024-03-08T06:04:23.007 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.007 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-08T06:04:23.007 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-03-08T06:04:23.007 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-03-08T06:04:23.007 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-03-08T06:04:23.007 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.007 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.007 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.1", 2024-03-08T06:04:23.007 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDtqeplk60ZJxAAk7o4/2EY7GuHmcQ169jw1g==", 2024-03-08T06:04:23.007 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.007 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-08T06:04:23.007 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-03-08T06:04:23.007 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-03-08T06:04:23.008 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-03-08T06:04:23.008 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.008 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.008 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.2", 2024-03-08T06:04:23.008 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDtqeplwziUGxAAe2xdJV24WAgJHVuQiZs3FQ==", 2024-03-08T06:04:23.008 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.008 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-08T06:04:23.008 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-03-08T06:04:23.008 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-03-08T06:04:23.008 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-03-08T06:04:23.008 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.008 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.008 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.3", 2024-03-08T06:04:23.008 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDtqeplxb3HMhAARfd2LQh6/j7gQxkx4NnmYA==", 2024-03-08T06:04:23.009 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.009 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow", 2024-03-08T06:04:23.009 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow r", 2024-03-08T06:04:23.009 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow rw", 2024-03-08T06:04:23.009 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow rwx" 2024-03-08T06:04:23.009 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.009 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.009 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.admin", 2024-03-08T06:04:23.009 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDqqeplYtKdMxAADYZYjUvchoxCbVlOsSt2zA==", 2024-03-08T06:04:23.009 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.009 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-03-08T06:04:23.009 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": "allow *", 2024-03-08T06:04:23.009 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow *", 2024-03-08T06:04:23.009 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-08T06:04:23.009 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.010 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.010 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-mds", 2024-03-08T06:04:23.010 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAUquplz8PgMRAATT1iY77p94JyuvBuj6Sdsg==", 2024-03-08T06:04:23.010 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.010 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-mds" 2024-03-08T06:04:23.010 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.010 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.010 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.010 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-mgr", 2024-03-08T06:04:23.010 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAUquplCc/gMRAAGQZ/X7vzPGwpqEPgpxTN9Q==", 2024-03-08T06:04:23.010 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.010 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-08T06:04:23.010 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.010 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.011 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-osd", 2024-03-08T06:04:23.011 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAUquplldfgMRAAbKo6YUWk/jifhL/VMYqmew==", 2024-03-08T06:04:23.011 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.011 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-osd" 2024-03-08T06:04:23.011 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.011 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-rbd", 2024-03-08T06:04:23.011 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAUquplT+DgMRAAbDnI70oed6aYKeDzo5NrRg==", 2024-03-08T06:04:23.011 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.011 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-08T06:04:23.011 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.011 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.011 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-08T06:04:23.012 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAUqupl7OjgMRAAQmRO/zWir+B0nWxPOp0lRA==", 2024-03-08T06:04:23.012 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.012 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-08T06:04:23.012 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.012 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.012 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "client.bootstrap-rgw", 2024-03-08T06:04:23.012 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQAUqupltvHgMRAAB2khtGx25+xdBrhG1Yhl6w==", 2024-03-08T06:04:23.012 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.012 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-08T06:04:23.012 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.012 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.012 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.x", 2024-03-08T06:04:23.012 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDrqepl91zZNRAAPpk79q/hQlHVlBAlRkfMqw==", 2024-03-08T06:04:23.012 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.013 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-03-08T06:04:23.013 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2024-03-08T06:04:23.013 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-08T06:04:23.013 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.013 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:23.013 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:23.013 INFO:teuthology.orchestra.run.smithi019.stdout: "entity": "mgr.y", 2024-03-08T06:04:23.013 INFO:teuthology.orchestra.run.smithi019.stdout: "key": "AQDrqeplO6tRKRAADpUxnXO4aOI46p3Nj+IoYA==", 2024-03-08T06:04:23.013 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": { 2024-03-08T06:04:23.013 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": "allow *", 2024-03-08T06:04:23.013 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": "allow profile mgr", 2024-03-08T06:04:23.013 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": "allow *" 2024-03-08T06:04:23.013 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.013 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:23.013 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-03-08T06:04:23.013 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-08T06:04:23.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.000+0000 7f9d78c00640 1 -- 172.21.15.19:0/3690889252 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9d5406b550 msgr2=0x7f9d5406da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:23.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.000+0000 7f9d78c00640 1 --2- 172.21.15.19:0/3690889252 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9d5406b550 0x7f9d5406da10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9d7415f7d0 tx=0x7f9d64008040 comp rx=0 tx=0).stop 2024-03-08T06:04:23.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.000+0000 7f9d78c00640 1 -- 172.21.15.19:0/3690889252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d740c48e0 msgr2=0x7f9d741f3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:23.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.000+0000 7f9d78c00640 1 --2- 172.21.15.19:0/3690889252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d740c48e0 0x7f9d741f3ae0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9d60005040 tx=0x7f9d60001120 comp rx=0 tx=0).stop 2024-03-08T06:04:23.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.000+0000 7f9d78c00640 1 -- 172.21.15.19:0/3690889252 shutdown_connections 2024-03-08T06:04:23.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.000+0000 7f9d78c00640 1 --2- 172.21.15.19:0/3690889252 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9d5406b550 0x7f9d5406da10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:23.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.000+0000 7f9d78c00640 1 --2- 172.21.15.19:0/3690889252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d740c4d60 0x7f9d741f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:23.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.000+0000 7f9d78c00640 1 --2- 172.21.15.19:0/3690889252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d740c48e0 0x7f9d741f3ae0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:23.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.000+0000 7f9d78c00640 1 --2- 172.21.15.19:0/3690889252 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9d58004800 0x7f9d74143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:23.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.000+0000 7f9d78c00640 1 -- 172.21.15.19:0/3690889252 >> 172.21.15.19:0/3690889252 conn(0x7f9d7406ae30 msgr2=0x7f9d740cc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:23.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.001+0000 7f9d78c00640 1 -- 172.21.15.19:0/3690889252 shutdown_connections 2024-03-08T06:04:23.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.001+0000 7f9d78c00640 1 -- 172.21.15.19:0/3690889252 wait complete. 2024-03-08T06:04:23.022 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-08T06:04:23.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.238+0000 7fb52e600640 1 Processor -- start 2024-03-08T06:04:23.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.238+0000 7fb52e600640 1 -- start start 2024-03-08T06:04:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.240+0000 7fb52e600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5280b4420 0x7fb5280b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:23.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.240+0000 7fb52e600640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb52806ed10 con 0x7fb5280ae1a0 2024-03-08T06:04:23.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.240+0000 7fb52e600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb528161950 con 0x7fb5281442a0 2024-03-08T06:04:23.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.240+0000 7fb52e600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5280b4dc0 con 0x7fb5280b4420 2024-03-08T06:04:23.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.240+0000 7fb52dc00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb5280ae1a0 0x7fb5280ae630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37306/0 (socket says 172.21.15.19:37306) 2024-03-08T06:04:23.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.240+0000 7fb52dc00640 1 -- 172.21.15.19:0/3475329675 learned_addr learned my addr 172.21.15.19:0/3475329675 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:23.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.240+0000 7fb51fe00640 1 --2- 172.21.15.19:0/3475329675 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5280b4420 0x7fb5280b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:23.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.240+0000 7fb527e00640 1 -- 172.21.15.19:0/3475329675 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074436940 0 0) 0x7fb52806ed10 con 0x7fb5280ae1a0 2024-03-08T06:04:23.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.241+0000 7fb527e00640 1 -- 172.21.15.19:0/3475329675 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb508003520 con 0x7fb5280ae1a0 2024-03-08T06:04:23.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.241+0000 7fb527e00640 1 -- 172.21.15.19:0/3475329675 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2290404659 0 0) 0x7fb508003520 con 0x7fb5280ae1a0 2024-03-08T06:04:23.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.241+0000 7fb527e00640 1 -- 172.21.15.19:0/3475329675 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5280b4420 msgr2=0x7fb5280b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:23.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.241+0000 7fb527e00640 1 --2- 172.21.15.19:0/3475329675 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5280b4420 0x7fb5280b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:23.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.241+0000 7fb527e00640 1 -- 172.21.15.19:0/3475329675 >> v1:172.21.15.42:6789/0 conn(0x7fb5281442a0 legacy=0x7fb52806e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:23.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.241+0000 7fb527e00640 1 -- 172.21.15.19:0/3475329675 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb528161c30 con 0x7fb5280ae1a0 2024-03-08T06:04:23.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.241+0000 7fb527e00640 1 -- 172.21.15.19:0/3475329675 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7fb5200019f0 con 0x7fb5280ae1a0 2024-03-08T06:04:23.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.241+0000 7fb527e00640 1 -- 172.21.15.19:0/3475329675 >> v1:172.21.15.19:6789/0 conn(0x7fb5280ae1a0 legacy=0x7fb5280ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:23.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.241+0000 7fb527e00640 1 --2- 172.21.15.19:0/3475329675 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5280b4420 0x7fb508003ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:23.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.241+0000 7fb527e00640 1 --2- 172.21.15.19:0/3475329675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb508004090 0x7fb508004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:23.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.241+0000 7fb527e00640 1 --2- 172.21.15.19:0/3475329675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb508004d90 0x7fb508005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:23.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.241+0000 7fb527e00640 1 -- 172.21.15.19:0/3475329675 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50800bbd0 con 0x7fb508004d90 2024-03-08T06:04:23.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.241+0000 7fb527e00640 1 -- 172.21.15.19:0/3475329675 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50800bd80 con 0x7fb508004090 2024-03-08T06:04:23.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.241+0000 7fb527e00640 1 -- 172.21.15.19:0/3475329675 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50800bf80 con 0x7fb5280b4420 2024-03-08T06:04:23.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.242+0000 7fb52dc00640 1 --2- 172.21.15.19:0/3475329675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb508004d90 0x7fb508005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:23.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.242+0000 7fb51fe00640 1 --2- 172.21.15.19:0/3475329675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb508004090 0x7fb508004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:23.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.242+0000 7fb52dc00640 1 -- 172.21.15.19:0/3475329675 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5280b4420 msgr2=0x7fb508003ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:23.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.242+0000 7fb52dc00640 1 --2- 172.21.15.19:0/3475329675 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5280b4420 0x7fb508003ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:23.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.242+0000 7fb52dc00640 1 -- 172.21.15.19:0/3475329675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb508004090 msgr2=0x7fb508004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:23.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.242+0000 7fb52dc00640 1 --2- 172.21.15.19:0/3475329675 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb508004090 0x7fb508004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:23.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.242+0000 7fb52dc00640 1 -- 172.21.15.19:0/3475329675 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb508003520 con 0x7fb508004d90 2024-03-08T06:04:23.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.243+0000 7fb52dc00640 1 --2- 172.21.15.19:0/3475329675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb508004d90 0x7fb508005210 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb52000a790 tx=0x7fb508005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96d61199251efdb server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:23.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.243+0000 7fb527e00640 1 -- 172.21.15.19:0/3475329675 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52000a3b0 con 0x7fb508004d90 2024-03-08T06:04:23.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.243+0000 7fb527e00640 1 -- 172.21.15.19:0/3475329675 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb520034650 con 0x7fb508004d90 2024-03-08T06:04:23.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.243+0000 7fb527e00640 1 -- 172.21.15.19:0/3475329675 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb520034a80 con 0x7fb508004d90 2024-03-08T06:04:23.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.244+0000 7fb52e600640 1 -- 172.21.15.19:0/3475329675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb508004d90 msgr2=0x7fb508005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:23.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.244+0000 7fb52e600640 1 --2- 172.21.15.19:0/3475329675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb508004d90 0x7fb508005210 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb52000a790 tx=0x7fb508005830 comp rx=0 tx=0).stop 2024-03-08T06:04:23.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.244+0000 7fb52dc00640 1 -- 172.21.15.19:0/3475329675 reap_dead start 2024-03-08T06:04:23.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.244+0000 7fb52e600640 1 -- 172.21.15.19:0/3475329675 shutdown_connections 2024-03-08T06:04:23.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.244+0000 7fb52e600640 1 -- 172.21.15.19:0/3475329675 >> 172.21.15.19:0/3475329675 conn(0x7fb5280b1590 msgr2=0x7fb5280b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:23.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.244+0000 7fb52e600640 1 -- 172.21.15.19:0/3475329675 shutdown_connections 2024-03-08T06:04:23.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.244+0000 7fb52e600640 1 -- 172.21.15.19:0/3475329675 wait complete. 2024-03-08T06:04:23.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.247+0000 7fb52e600640 1 Processor -- start 2024-03-08T06:04:23.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.247+0000 7fb52e600640 1 -- start start 2024-03-08T06:04:23.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.248+0000 7fb52e600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb508004d90 0x7fb5280c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:23.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.248+0000 7fb52e600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5280c4800 0x7fb5280c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:23.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.248+0000 7fb52e600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5280ce470 0x7fb5280ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:23.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.248+0000 7fb52e600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5281621f0 con 0x7fb508004d90 2024-03-08T06:04:23.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.248+0000 7fb52e600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb528144680 con 0x7fb5280ce470 2024-03-08T06:04:23.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.248+0000 7fb52e600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5281624d0 con 0x7fb5280c4800 2024-03-08T06:04:23.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.248+0000 7fb52d200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb508004d90 0x7fb5280c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:23.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.248+0000 7fb52d200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb508004d90 0x7fb5280c7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35634/0 (socket says 172.21.15.19:35634) 2024-03-08T06:04:23.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.249+0000 7fb52d200640 1 -- 172.21.15.19:0/1600028322 learned_addr learned my addr 172.21.15.19:0/1600028322 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:23.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.249+0000 7fb52dc00640 1 --2- 172.21.15.19:0/1600028322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5280ce470 0x7fb5280ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:23.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.249+0000 7fb52d200640 1 -- 172.21.15.19:0/1600028322 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5280c4800 msgr2=0x7fb5280c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:23.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.249+0000 7fb52d200640 1 --2- 172.21.15.19:0/1600028322 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5280c4800 0x7fb5280c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:23.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.249+0000 7fb52d200640 1 -- 172.21.15.19:0/1600028322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5280ce470 msgr2=0x7fb5280ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:23.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.249+0000 7fb52d200640 1 --2- 172.21.15.19:0/1600028322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5280ce470 0x7fb5280ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:23.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.249+0000 7fb52d200640 1 -- 172.21.15.19:0/1600028322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5280cee30 con 0x7fb508004d90 2024-03-08T06:04:23.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.249+0000 7fb52dc00640 1 --2- 172.21.15.19:0/1600028322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5280ce470 0x7fb5280ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:23.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.249+0000 7fb52d200640 1 --2- 172.21.15.19:0/1600028322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb508004d90 0x7fb5280c7000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb51000c400 tx=0x7fb51000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:23.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.250+0000 7fb525600640 1 -- 172.21.15.19:0/1600028322 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb510017070 con 0x7fb508004d90 2024-03-08T06:04:23.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.250+0000 7fb525600640 1 -- 172.21.15.19:0/1600028322 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5100052f0 con 0x7fb508004d90 2024-03-08T06:04:23.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.250+0000 7fb525600640 1 -- 172.21.15.19:0/1600028322 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb510003830 con 0x7fb508004d90 2024-03-08T06:04:23.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.250+0000 7fb52e600640 1 -- 172.21.15.19:0/1600028322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5280c52c0 con 0x7fb508004d90 2024-03-08T06:04:23.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.250+0000 7fb52e600640 1 -- 172.21.15.19:0/1600028322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5280c5880 con 0x7fb508004d90 2024-03-08T06:04:23.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.251+0000 7fb52e600640 1 -- 172.21.15.19:0/1600028322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb528075090 con 0x7fb508004d90 2024-03-08T06:04:23.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.252+0000 7fb525600640 1 -- 172.21.15.19:0/1600028322 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb51001a070 con 0x7fb508004d90 2024-03-08T06:04:23.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.253+0000 7fb525600640 1 --2- 172.21.15.19:0/1600028322 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb50406b500 0x7fb50406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:23.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.253+0000 7fb525600640 1 -- 172.21.15.19:0/1600028322 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb5100892c0 con 0x7fb508004d90 2024-03-08T06:04:23.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.253+0000 7fb51fe00640 1 --2- 172.21.15.19:0/1600028322 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb50406b500 0x7fb50406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:23.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.254+0000 7fb51fe00640 1 --2- 172.21.15.19:0/1600028322 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb50406b500 0x7fb50406d9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb528072bb0 tx=0x7fb518008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:23.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.257+0000 7fb525600640 1 -- 172.21.15.19:0/1600028322 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb5100584b0 con 0x7fb508004d90 2024-03-08T06:04:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.528+0000 7fb52e600640 1 -- 172.21.15.19:0/1600028322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fb528142550 con 0x7fb508004d90 2024-03-08T06:04:23.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.533+0000 7fb525600640 1 -- 172.21.15.19:0/1600028322 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb51005ce20 con 0x7fb508004d90 2024-03-08T06:04:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.535+0000 7fb52e600640 1 -- 172.21.15.19:0/1600028322 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb50406b500 msgr2=0x7fb50406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.535+0000 7fb52e600640 1 --2- 172.21.15.19:0/1600028322 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb50406b500 0x7fb50406d9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb528072bb0 tx=0x7fb518008040 comp rx=0 tx=0).stop 2024-03-08T06:04:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.535+0000 7fb52e600640 1 -- 172.21.15.19:0/1600028322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb508004d90 msgr2=0x7fb5280c7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.535+0000 7fb52e600640 1 --2- 172.21.15.19:0/1600028322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb508004d90 0x7fb5280c7000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb51000c400 tx=0x7fb51000c8c0 comp rx=0 tx=0).stop 2024-03-08T06:04:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.535+0000 7fb52e600640 1 -- 172.21.15.19:0/1600028322 shutdown_connections 2024-03-08T06:04:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.535+0000 7fb52e600640 1 --2- 172.21.15.19:0/1600028322 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb50406b500 0x7fb50406d9c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.535+0000 7fb52e600640 1 --2- 172.21.15.19:0/1600028322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb5280ce470 0x7fb5280ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.535+0000 7fb52e600640 1 --2- 172.21.15.19:0/1600028322 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb5280c4800 0x7fb5280c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.535+0000 7fb52e600640 1 --2- 172.21.15.19:0/1600028322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb508004d90 0x7fb5280c7000 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.536+0000 7fb52e600640 1 -- 172.21.15.19:0/1600028322 >> 172.21.15.19:0/1600028322 conn(0x7fb5280b1590 msgr2=0x7fb5281465f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.536+0000 7fb52e600640 1 -- 172.21.15.19:0/1600028322 shutdown_connections 2024-03-08T06:04:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.536+0000 7fb52e600640 1 -- 172.21.15.19:0/1600028322 wait complete. 2024-03-08T06:04:23.553 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-08T06:04:23.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.752+0000 7ff657e00640 1 Processor -- start 2024-03-08T06:04:23.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.753+0000 7ff657e00640 1 -- start start 2024-03-08T06:04:23.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.754+0000 7ff657e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff6580aedf0 0x7ff6580b3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:23.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.754+0000 7ff657e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6580b3a80 con 0x7ff658166680 2024-03-08T06:04:23.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.754+0000 7ff657e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6580b3d60 con 0x7ff658071b10 2024-03-08T06:04:23.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.754+0000 7ff657e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65806d460 con 0x7ff6580aedf0 2024-03-08T06:04:23.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.754+0000 7ff64e000640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff658166680 0x7ff658071400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37318/0 (socket says 172.21.15.19:37318) 2024-03-08T06:04:23.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.754+0000 7ff64e000640 1 -- 172.21.15.19:0/375834774 learned_addr learned my addr 172.21.15.19:0/375834774 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:23.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.754+0000 7ff656a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff6580aedf0 0x7ff6580b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:23.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.755+0000 7ff656000640 1 -- 172.21.15.19:0/375834774 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752502728 0 0) 0x7ff6580b3a80 con 0x7ff658166680 2024-03-08T06:04:23.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.755+0000 7ff656a00640 1 -- 172.21.15.19:0/375834774 >> v1:172.21.15.42:6789/0 conn(0x7ff658071b10 legacy=0x7ff65806deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:23.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.755+0000 7ff656a00640 1 -- 172.21.15.19:0/375834774 >> v1:172.21.15.19:6789/0 conn(0x7ff658166680 legacy=0x7ff658071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:23.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.755+0000 7ff656a00640 1 -- 172.21.15.19:0/375834774 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65806d6b0 con 0x7ff6580aedf0 2024-03-08T06:04:23.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.756+0000 7ff656a00640 1 --2- 172.21.15.19:0/375834774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6580aedf0 0x7ff6580b3380 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff6480097a0 tx=0x7ff64802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd00939d0db76527 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:23.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.756+0000 7ff656000640 1 -- 172.21.15.19:0/375834774 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff648035020 con 0x7ff6580aedf0 2024-03-08T06:04:23.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.756+0000 7ff656000640 1 -- 172.21.15.19:0/375834774 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff648031830 con 0x7ff6580aedf0 2024-03-08T06:04:23.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.756+0000 7ff656000640 1 -- 172.21.15.19:0/375834774 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff648031c00 con 0x7ff6580aedf0 2024-03-08T06:04:23.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.757+0000 7ff657e00640 1 -- 172.21.15.19:0/375834774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6580aedf0 msgr2=0x7ff6580b3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:23.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.757+0000 7ff657e00640 1 --2- 172.21.15.19:0/375834774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6580aedf0 0x7ff6580b3380 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff6480097a0 tx=0x7ff64802b8d0 comp rx=0 tx=0).stop 2024-03-08T06:04:23.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.757+0000 7ff657e00640 1 -- 172.21.15.19:0/375834774 shutdown_connections 2024-03-08T06:04:23.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.757+0000 7ff657e00640 1 --2- 172.21.15.19:0/375834774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6580aedf0 0x7ff6580b3380 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:23.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.757+0000 7ff657e00640 1 -- 172.21.15.19:0/375834774 >> 172.21.15.19:0/375834774 conn(0x7ff6580b1590 msgr2=0x7ff6580b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:23.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.757+0000 7ff657e00640 1 -- 172.21.15.19:0/375834774 shutdown_connections 2024-03-08T06:04:23.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.757+0000 7ff657e00640 1 -- 172.21.15.19:0/375834774 wait complete. 2024-03-08T06:04:23.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.759+0000 7ff657e00640 1 Processor -- start 2024-03-08T06:04:23.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.759+0000 7ff657e00640 1 -- start start 2024-03-08T06:04:23.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.760+0000 7ff657e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff658071b10 0x7ff6580ab730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:23.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.760+0000 7ff657e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6580aedf0 0x7ff65815b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:23.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.760+0000 7ff657e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff658166680 0x7ff658161020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:23.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.760+0000 7ff657e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6580af1d0 con 0x7ff6580aedf0 2024-03-08T06:04:23.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.760+0000 7ff657e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65806e5c0 con 0x7ff658166680 2024-03-08T06:04:23.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.760+0000 7ff657e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65815e510 con 0x7ff658071b10 2024-03-08T06:04:23.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.760+0000 7ff64e000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6580aedf0 0x7ff65815b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:23.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.760+0000 7ff64e000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6580aedf0 0x7ff65815b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35656/0 (socket says 172.21.15.19:35656) 2024-03-08T06:04:23.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.760+0000 7ff64e000640 1 -- 172.21.15.19:0/1599364597 learned_addr learned my addr 172.21.15.19:0/1599364597 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:23.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.761+0000 7ff656a00640 1 --2- 172.21.15.19:0/1599364597 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff658071b10 0x7ff6580ab730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:23.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.761+0000 7ff657400640 1 --2- 172.21.15.19:0/1599364597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff658166680 0x7ff658161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:23.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.761+0000 7ff64e000640 1 -- 172.21.15.19:0/1599364597 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff658071b10 msgr2=0x7ff6580ab730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:23.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.761+0000 7ff64e000640 1 --2- 172.21.15.19:0/1599364597 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff658071b10 0x7ff6580ab730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:23.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.761+0000 7ff64e000640 1 -- 172.21.15.19:0/1599364597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff658166680 msgr2=0x7ff658161020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:23.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.761+0000 7ff64e000640 1 --2- 172.21.15.19:0/1599364597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff658166680 0x7ff658161020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:23.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.761+0000 7ff64e000640 1 -- 172.21.15.19:0/1599364597 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65815e7f0 con 0x7ff6580aedf0 2024-03-08T06:04:23.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.761+0000 7ff657400640 1 --2- 172.21.15.19:0/1599364597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff658166680 0x7ff658161020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:23.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.761+0000 7ff64e000640 1 --2- 172.21.15.19:0/1599364597 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6580aedf0 0x7ff65815b5a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff64000c460 tx=0x7ff64000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:23.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.761+0000 7ff64f400640 1 -- 172.21.15.19:0/1599364597 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640018070 con 0x7ff6580aedf0 2024-03-08T06:04:23.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.761+0000 7ff64f400640 1 -- 172.21.15.19:0/1599364597 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff640007500 con 0x7ff6580aedf0 2024-03-08T06:04:23.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.761+0000 7ff64f400640 1 -- 172.21.15.19:0/1599364597 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff640004a20 con 0x7ff6580aedf0 2024-03-08T06:04:23.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.761+0000 7ff657e00640 1 -- 172.21.15.19:0/1599364597 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65815ead0 con 0x7ff6580aedf0 2024-03-08T06:04:23.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.761+0000 7ff657e00640 1 -- 172.21.15.19:0/1599364597 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65815f090 con 0x7ff6580aedf0 2024-03-08T06:04:23.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.763+0000 7ff657e00640 1 -- 172.21.15.19:0/1599364597 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff658075090 con 0x7ff6580aedf0 2024-03-08T06:04:23.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.763+0000 7ff64f400640 1 -- 172.21.15.19:0/1599364597 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff640004bc0 con 0x7ff6580aedf0 2024-03-08T06:04:23.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.765+0000 7ff64f400640 1 --2- 172.21.15.19:0/1599364597 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff63406b500 0x7ff63406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:23.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.765+0000 7ff64f400640 1 -- 172.21.15.19:0/1599364597 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff640089190 con 0x7ff6580aedf0 2024-03-08T06:04:23.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.765+0000 7ff656a00640 1 --2- 172.21.15.19:0/1599364597 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff63406b500 0x7ff63406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:23.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.766+0000 7ff656a00640 1 --2- 172.21.15.19:0/1599364597 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff63406b500 0x7ff63406d9c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff648036000 tx=0x7ff648008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:23.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:23.769+0000 7ff64f400640 1 -- 172.21.15.19:0/1599364597 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff640058350 con 0x7ff6580aedf0 2024-03-08T06:04:24.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.030+0000 7ff657e00640 1 -- 172.21.15.19:0/1599364597 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7ff65806f610 con 0x7ff6580aedf0 2024-03-08T06:04:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.035+0000 7ff64f400640 1 -- 172.21.15.19:0/1599364597 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff640057c50 con 0x7ff6580aedf0 2024-03-08T06:04:24.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.038+0000 7ff657e00640 1 -- 172.21.15.19:0/1599364597 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff63406b500 msgr2=0x7ff63406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:24.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.038+0000 7ff657e00640 1 --2- 172.21.15.19:0/1599364597 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff63406b500 0x7ff63406d9c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff648036000 tx=0x7ff648008030 comp rx=0 tx=0).stop 2024-03-08T06:04:24.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.038+0000 7ff657e00640 1 -- 172.21.15.19:0/1599364597 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6580aedf0 msgr2=0x7ff65815b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:24.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.038+0000 7ff657e00640 1 --2- 172.21.15.19:0/1599364597 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6580aedf0 0x7ff65815b5a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff64000c460 tx=0x7ff64000c920 comp rx=0 tx=0).stop 2024-03-08T06:04:24.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.038+0000 7ff657e00640 1 -- 172.21.15.19:0/1599364597 shutdown_connections 2024-03-08T06:04:24.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.038+0000 7ff657e00640 1 --2- 172.21.15.19:0/1599364597 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff63406b500 0x7ff63406d9c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:24.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.038+0000 7ff657e00640 1 --2- 172.21.15.19:0/1599364597 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff658166680 0x7ff658161020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:24.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.038+0000 7ff657e00640 1 --2- 172.21.15.19:0/1599364597 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6580aedf0 0x7ff65815b5a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:24.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.038+0000 7ff657e00640 1 --2- 172.21.15.19:0/1599364597 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff658071b10 0x7ff6580ab730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:24.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.038+0000 7ff657e00640 1 -- 172.21.15.19:0/1599364597 >> 172.21.15.19:0/1599364597 conn(0x7ff6580b1590 msgr2=0x7ff6581638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:24.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.038+0000 7ff657e00640 1 -- 172.21.15.19:0/1599364597 shutdown_connections 2024-03-08T06:04:24.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.038+0000 7ff657e00640 1 -- 172.21.15.19:0/1599364597 wait complete. 2024-03-08T06:04:24.056 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-08T06:04:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.257+0000 7fb9eb200640 1 Processor -- start 2024-03-08T06:04:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.257+0000 7fb9eb200640 1 -- start start 2024-03-08T06:04:24.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.259+0000 7fb9eb200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb9ec0b5bf0 0x7fb9ec0b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:24.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.259+0000 7fb9eb200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb9ec0d0ff0 0x7fb9ec0d1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:24.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.259+0000 7fb9eb200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ec0d1400 con 0x7fb9ec1611f0 2024-03-08T06:04:24.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.259+0000 7fb9eb200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ec0ceac0 con 0x7fb9ec0b5bf0 2024-03-08T06:04:24.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.259+0000 7fb9eb200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ec0cf080 con 0x7fb9ec0d0ff0 2024-03-08T06:04:24.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.259+0000 7fb9e9400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb9ec0b5bf0 0x7fb9ec0b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:24.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.259+0000 7fb9e9e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb9ec1611f0 0x7fb9ec0b54e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37320/0 (socket says 172.21.15.19:37320) 2024-03-08T06:04:24.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.259+0000 7fb9e9e00640 1 -- 172.21.15.19:0/3317691800 learned_addr learned my addr 172.21.15.19:0/3317691800 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:24.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.260+0000 7fb9ea800640 1 --2- 172.21.15.19:0/3317691800 >> v2:172.21.15.42:3300/0 conn(0x7fb9ec0d0ff0 0x7fb9ec0d1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:24.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.260+0000 7fb9e9400640 1 -- 172.21.15.19:0/3317691800 >> v2:172.21.15.42:3300/0 conn(0x7fb9ec0d0ff0 msgr2=0x7fb9ec0d1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:24.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.260+0000 7fb9e9400640 1 --2- 172.21.15.19:0/3317691800 >> v2:172.21.15.42:3300/0 conn(0x7fb9ec0d0ff0 0x7fb9ec0d1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:24.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.260+0000 7fb9e9400640 1 -- 172.21.15.19:0/3317691800 >> v1:172.21.15.19:6789/0 conn(0x7fb9ec1611f0 legacy=0x7fb9ec0b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:24.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.260+0000 7fb9e9400640 1 -- 172.21.15.19:0/3317691800 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec0d3410 con 0x7fb9ec0b5bf0 2024-03-08T06:04:24.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.260+0000 7fb9ea800640 1 --2- 172.21.15.19:0/3317691800 >> v2:172.21.15.42:3300/0 conn(0x7fb9ec0d0ff0 0x7fb9ec0d1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:24.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.261+0000 7fb9e9400640 1 --2- 172.21.15.19:0/3317691800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9ec0b5bf0 0x7fb9ec0b27a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0caac0 tx=0x7fb9d802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=116c73cf889cfc1 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:24.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.261+0000 7fb9e8a00640 1 -- 172.21.15.19:0/3317691800 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8038070 con 0x7fb9ec0b5bf0 2024-03-08T06:04:24.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.262+0000 7fb9e8a00640 1 -- 172.21.15.19:0/3317691800 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d8031710 con 0x7fb9ec0b5bf0 2024-03-08T06:04:24.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.262+0000 7fb9e8a00640 1 -- 172.21.15.19:0/3317691800 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8031ae0 con 0x7fb9ec0b5bf0 2024-03-08T06:04:24.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.262+0000 7fb9eb200640 1 -- 172.21.15.19:0/3317691800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9ec0b5bf0 msgr2=0x7fb9ec0b27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:24.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.262+0000 7fb9eb200640 1 --2- 172.21.15.19:0/3317691800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9ec0b5bf0 0x7fb9ec0b27a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0caac0 tx=0x7fb9d802b7b0 comp rx=0 tx=0).stop 2024-03-08T06:04:24.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.262+0000 7fb9eb200640 1 -- 172.21.15.19:0/3317691800 shutdown_connections 2024-03-08T06:04:24.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.262+0000 7fb9eb200640 1 --2- 172.21.15.19:0/3317691800 >> v2:172.21.15.42:3300/0 conn(0x7fb9ec0d0ff0 0x7fb9ec0d1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:24.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.262+0000 7fb9eb200640 1 --2- 172.21.15.19:0/3317691800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9ec0b5bf0 0x7fb9ec0b27a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:24.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.262+0000 7fb9eb200640 1 -- 172.21.15.19:0/3317691800 >> 172.21.15.19:0/3317691800 conn(0x7fb9ec06c700 msgr2=0x7fb9ec06cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:24.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.262+0000 7fb9eb200640 1 -- 172.21.15.19:0/3317691800 shutdown_connections 2024-03-08T06:04:24.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.262+0000 7fb9eb200640 1 -- 172.21.15.19:0/3317691800 wait complete. 2024-03-08T06:04:24.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.264+0000 7fb9eb200640 1 Processor -- start 2024-03-08T06:04:24.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.264+0000 7fb9eb200640 1 -- start start 2024-03-08T06:04:24.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.265+0000 7fb9eb200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9ec0b5bf0 0x7fb9ec1f3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:24.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.265+0000 7fb9eb200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9ec0d0ff0 0x7fb9ec0c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:24.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.265+0000 7fb9eb200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb9ec1611f0 0x7fb9ec0c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:24.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.265+0000 7fb9eb200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec1615d0 con 0x7fb9ec0d0ff0 2024-03-08T06:04:24.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.265+0000 7fb9eb200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec0ced10 con 0x7fb9ec0b5bf0 2024-03-08T06:04:24.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.265+0000 7fb9eb200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ec161750 con 0x7fb9ec1611f0 2024-03-08T06:04:24.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.266+0000 7fb9e9400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9ec0d0ff0 0x7fb9ec0c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:24.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.266+0000 7fb9e9400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9ec0d0ff0 0x7fb9ec0c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35674/0 (socket says 172.21.15.19:35674) 2024-03-08T06:04:24.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.266+0000 7fb9e9400640 1 -- 172.21.15.19:0/2611348231 learned_addr learned my addr 172.21.15.19:0/2611348231 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:24.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.266+0000 7fb9e9e00640 1 --2- 172.21.15.19:0/2611348231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9ec0b5bf0 0x7fb9ec1f3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:24.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.266+0000 7fb9e9400640 1 -- 172.21.15.19:0/2611348231 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb9ec1611f0 msgr2=0x7fb9ec0c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:24.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.266+0000 7fb9e9400640 1 --2- 172.21.15.19:0/2611348231 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb9ec1611f0 0x7fb9ec0c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:24.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.266+0000 7fb9e9400640 1 -- 172.21.15.19:0/2611348231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9ec0b5bf0 msgr2=0x7fb9ec1f3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:24.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.266+0000 7fb9e9400640 1 --2- 172.21.15.19:0/2611348231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9ec0b5bf0 0x7fb9ec1f3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:24.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.266+0000 7fb9e9400640 1 -- 172.21.15.19:0/2611348231 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec1e9020 con 0x7fb9ec0d0ff0 2024-03-08T06:04:24.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.266+0000 7fb9e9400640 1 --2- 172.21.15.19:0/2611348231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9ec0d0ff0 0x7fb9ec0c9140 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8000c00 tx=0x7fb9d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:24.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.267+0000 7fb9e2000640 1 -- 172.21.15.19:0/2611348231 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8042070 con 0x7fb9ec0d0ff0 2024-03-08T06:04:24.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.267+0000 7fb9e2000640 1 -- 172.21.15.19:0/2611348231 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d8033a40 con 0x7fb9ec0d0ff0 2024-03-08T06:04:24.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.267+0000 7fb9e2000640 1 -- 172.21.15.19:0/2611348231 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8038040 con 0x7fb9ec0d0ff0 2024-03-08T06:04:24.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.267+0000 7fb9eb200640 1 -- 172.21.15.19:0/2611348231 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ec0cb670 con 0x7fb9ec0d0ff0 2024-03-08T06:04:24.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.267+0000 7fb9eb200640 1 -- 172.21.15.19:0/2611348231 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ec0cbc30 con 0x7fb9ec0d0ff0 2024-03-08T06:04:24.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.268+0000 7fb9eb200640 1 -- 172.21.15.19:0/2611348231 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ec075090 con 0x7fb9ec0d0ff0 2024-03-08T06:04:24.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.269+0000 7fb9e2000640 1 -- 172.21.15.19:0/2611348231 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb9d8045070 con 0x7fb9ec0d0ff0 2024-03-08T06:04:24.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.270+0000 7fb9e2000640 1 --2- 172.21.15.19:0/2611348231 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb9cc06b4d0 0x7fb9cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:24.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.270+0000 7fb9e2000640 1 -- 172.21.15.19:0/2611348231 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb9d80aba50 con 0x7fb9ec0d0ff0 2024-03-08T06:04:24.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.270+0000 7fb9e9e00640 1 --2- 172.21.15.19:0/2611348231 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb9cc06b4d0 0x7fb9cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:24.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.271+0000 7fb9e9e00640 1 --2- 172.21.15.19:0/2611348231 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb9cc06b4d0 0x7fb9cc06d990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc000f60 tx=0x7fb9dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:24.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.275+0000 7fb9e2000640 1 -- 172.21.15.19:0/2611348231 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb9d807aca0 con 0x7fb9ec0d0ff0 2024-03-08T06:04:24.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.549+0000 7fb9eb200640 1 -- 172.21.15.19:0/2611348231 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fb9ec1f39c0 con 0x7fb9ec0d0ff0 2024-03-08T06:04:24.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.553+0000 7fb9e2000640 1 -- 172.21.15.19:0/2611348231 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb9d807a5a0 con 0x7fb9ec0d0ff0 2024-03-08T06:04:24.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.556+0000 7fb9eb200640 1 -- 172.21.15.19:0/2611348231 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb9cc06b4d0 msgr2=0x7fb9cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:24.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.556+0000 7fb9eb200640 1 --2- 172.21.15.19:0/2611348231 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb9cc06b4d0 0x7fb9cc06d990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc000f60 tx=0x7fb9dc009040 comp rx=0 tx=0).stop 2024-03-08T06:04:24.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.556+0000 7fb9eb200640 1 -- 172.21.15.19:0/2611348231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9ec0d0ff0 msgr2=0x7fb9ec0c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:24.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.556+0000 7fb9eb200640 1 --2- 172.21.15.19:0/2611348231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9ec0d0ff0 0x7fb9ec0c9140 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8000c00 tx=0x7fb9d80046c0 comp rx=0 tx=0).stop 2024-03-08T06:04:24.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.556+0000 7fb9eb200640 1 -- 172.21.15.19:0/2611348231 shutdown_connections 2024-03-08T06:04:24.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.556+0000 7fb9eb200640 1 --2- 172.21.15.19:0/2611348231 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb9cc06b4d0 0x7fb9cc06d990 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:24.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.556+0000 7fb9eb200640 1 --2- 172.21.15.19:0/2611348231 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb9ec1611f0 0x7fb9ec0c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:24.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.556+0000 7fb9eb200640 1 --2- 172.21.15.19:0/2611348231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9ec0d0ff0 0x7fb9ec0c9140 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:24.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.556+0000 7fb9eb200640 1 --2- 172.21.15.19:0/2611348231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9ec0b5bf0 0x7fb9ec1f3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:24.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.556+0000 7fb9eb200640 1 -- 172.21.15.19:0/2611348231 >> 172.21.15.19:0/2611348231 conn(0x7fb9ec06c700 msgr2=0x7fb9ec0b7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:24.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.556+0000 7fb9eb200640 1 -- 172.21.15.19:0/2611348231 shutdown_connections 2024-03-08T06:04:24.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.556+0000 7fb9eb200640 1 -- 172.21.15.19:0/2611348231 wait complete. 2024-03-08T06:04:24.574 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-08T06:04:24.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.782+0000 7f239b200640 1 Processor -- start 2024-03-08T06:04:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.783+0000 7f239b200640 1 -- start start 2024-03-08T06:04:24.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.784+0000 7f239b200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f239c0b27a0 0x7f239c0d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:24.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.784+0000 7f239b200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239c0d3410 con 0x7f239c1611f0 2024-03-08T06:04:24.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.784+0000 7f239b200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239c0d36f0 con 0x7f239c0b5bf0 2024-03-08T06:04:24.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.784+0000 7f239b200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f239c0ceac0 con 0x7f239c0b27a0 2024-03-08T06:04:24.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.785+0000 7f2399e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f239c1611f0 0x7f239c0b54e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37332/0 (socket says 172.21.15.19:37332) 2024-03-08T06:04:24.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.785+0000 7f2399e00640 1 -- 172.21.15.19:0/1765700131 learned_addr learned my addr 172.21.15.19:0/1765700131 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:24.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.785+0000 7f239a800640 1 --2- 172.21.15.19:0/1765700131 >> v2:172.21.15.19:3300/0 conn(0x7f239c0b27a0 0x7f239c0d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:24.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.785+0000 7f2398a00640 1 -- 172.21.15.19:0/1765700131 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855722830 0 0) 0x7f239c0d3410 con 0x7f239c1611f0 2024-03-08T06:04:24.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.785+0000 7f2398a00640 1 -- 172.21.15.19:0/1765700131 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2380003520 con 0x7f239c1611f0 2024-03-08T06:04:24.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.785+0000 7f239a800640 1 -- 172.21.15.19:0/1765700131 >> v1:172.21.15.42:6789/0 conn(0x7f239c0b5bf0 legacy=0x7f239c0d1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:24.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.785+0000 7f239a800640 1 -- 172.21.15.19:0/1765700131 >> v1:172.21.15.19:6789/0 conn(0x7f239c1611f0 legacy=0x7f239c0b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:24.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.785+0000 7f239a800640 1 -- 172.21.15.19:0/1765700131 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239c0ced10 con 0x7f239c0b27a0 2024-03-08T06:04:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.787+0000 7f239a800640 1 --2- 172.21.15.19:0/1765700131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239c0b27a0 0x7f239c0d0ff0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2394009d90 tx=0x7f239402bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7325cb0e1fd69a67 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.787+0000 7f2398a00640 1 -- 172.21.15.19:0/1765700131 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2394039070 con 0x7f239c0b27a0 2024-03-08T06:04:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.787+0000 7f2398a00640 1 -- 172.21.15.19:0/1765700131 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239402cb40 con 0x7f239c0b27a0 2024-03-08T06:04:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.787+0000 7f2398a00640 1 -- 172.21.15.19:0/1765700131 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2394034440 con 0x7f239c0b27a0 2024-03-08T06:04:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.788+0000 7f239b200640 1 -- 172.21.15.19:0/1765700131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239c0b27a0 msgr2=0x7f239c0d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.788+0000 7f239b200640 1 --2- 172.21.15.19:0/1765700131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239c0b27a0 0x7f239c0d0ff0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2394009d90 tx=0x7f239402bd90 comp rx=0 tx=0).stop 2024-03-08T06:04:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.788+0000 7f239b200640 1 -- 172.21.15.19:0/1765700131 shutdown_connections 2024-03-08T06:04:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.788+0000 7f239b200640 1 --2- 172.21.15.19:0/1765700131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239c0b27a0 0x7f239c0d0ff0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.788+0000 7f239b200640 1 -- 172.21.15.19:0/1765700131 >> 172.21.15.19:0/1765700131 conn(0x7f239c06c700 msgr2=0x7f239c06cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.788+0000 7f239b200640 1 -- 172.21.15.19:0/1765700131 shutdown_connections 2024-03-08T06:04:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.788+0000 7f239b200640 1 -- 172.21.15.19:0/1765700131 wait complete. 2024-03-08T06:04:24.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.790+0000 7f239b200640 1 Processor -- start 2024-03-08T06:04:24.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.790+0000 7f239b200640 1 -- start start 2024-03-08T06:04:24.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.791+0000 7f239b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f239c0b27a0 0x7f239c0c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:24.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.791+0000 7f239b200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f239c0b5bf0 0x7f239c15aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:24.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.791+0000 7f239b200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239c1611f0 0x7f239c15a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:24.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.791+0000 7f239b200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239c0d1e40 con 0x7f239c1611f0 2024-03-08T06:04:24.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.791+0000 7f239b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239c0cf080 con 0x7f239c0b27a0 2024-03-08T06:04:24.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.791+0000 7f239b200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239c0d1fc0 con 0x7f239c0b5bf0 2024-03-08T06:04:24.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.791+0000 7f239a800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239c1611f0 0x7f239c15a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:24.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.791+0000 7f239a800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239c1611f0 0x7f239c15a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35688/0 (socket says 172.21.15.19:35688) 2024-03-08T06:04:24.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.791+0000 7f239a800640 1 -- 172.21.15.19:0/1210113315 learned_addr learned my addr 172.21.15.19:0/1210113315 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:24.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.791+0000 7f2399e00640 1 --2- 172.21.15.19:0/1210113315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f239c0b27a0 0x7f239c0c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:24.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.791+0000 7f239a800640 1 -- 172.21.15.19:0/1210113315 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f239c0b5bf0 msgr2=0x7f239c15aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:24.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.792+0000 7f2399400640 1 --2- 172.21.15.19:0/1210113315 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f239c0b5bf0 0x7f239c15aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:24.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.792+0000 7f239a800640 1 --2- 172.21.15.19:0/1210113315 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f239c0b5bf0 0x7f239c15aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:24.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.792+0000 7f239a800640 1 -- 172.21.15.19:0/1210113315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f239c0b27a0 msgr2=0x7f239c0c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:24.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.792+0000 7f239a800640 1 --2- 172.21.15.19:0/1210113315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f239c0b27a0 0x7f239c0c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:24.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.792+0000 7f239a800640 1 -- 172.21.15.19:0/1210113315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239c0c84b0 con 0x7f239c1611f0 2024-03-08T06:04:24.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.792+0000 7f2399400640 1 --2- 172.21.15.19:0/1210113315 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f239c0b5bf0 0x7f239c15aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:24.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.792+0000 7f239a800640 1 --2- 172.21.15.19:0/1210113315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239c1611f0 0x7f239c15a040 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2394009d90 tx=0x7f2394004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:24.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.792+0000 7f2392000640 1 -- 172.21.15.19:0/1210113315 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2394039050 con 0x7f239c1611f0 2024-03-08T06:04:24.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.792+0000 7f2392000640 1 -- 172.21.15.19:0/1210113315 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2394045070 con 0x7f239c1611f0 2024-03-08T06:04:24.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.792+0000 7f2392000640 1 -- 172.21.15.19:0/1210113315 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239403e850 con 0x7f239c1611f0 2024-03-08T06:04:24.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.792+0000 7f239b200640 1 -- 172.21.15.19:0/1210113315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239c0c8790 con 0x7f239c1611f0 2024-03-08T06:04:24.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.793+0000 7f239b200640 1 -- 172.21.15.19:0/1210113315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239c0c8d50 con 0x7f239c1611f0 2024-03-08T06:04:24.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.794+0000 7f239b200640 1 -- 172.21.15.19:0/1210113315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239c075090 con 0x7f239c1611f0 2024-03-08T06:04:24.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.795+0000 7f2392000640 1 -- 172.21.15.19:0/1210113315 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f239403e9f0 con 0x7f239c1611f0 2024-03-08T06:04:24.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.795+0000 7f2392000640 1 --2- 172.21.15.19:0/1210113315 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f237806b4d0 0x7f237806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:24.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.796+0000 7f2392000640 1 -- 172.21.15.19:0/1210113315 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f23940acc20 con 0x7f239c1611f0 2024-03-08T06:04:24.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.796+0000 7f2399e00640 1 --2- 172.21.15.19:0/1210113315 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f237806b4d0 0x7f237806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:24.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.796+0000 7f2399e00640 1 --2- 172.21.15.19:0/1210113315 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f237806b4d0 0x7f237806d990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f238c007fd0 tx=0x7f238c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:24.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:24.800+0000 7f2392000640 1 -- 172.21.15.19:0/1210113315 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2394032e20 con 0x7f239c1611f0 2024-03-08T06:04:25.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.074+0000 7f239b200640 1 -- 172.21.15.19:0/1210113315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f239c0b5500 con 0x7f239c1611f0 2024-03-08T06:04:25.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.079+0000 7f2392000640 1 -- 172.21.15.19:0/1210113315 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f239407bfc0 con 0x7f239c1611f0 2024-03-08T06:04:25.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.082+0000 7f239b200640 1 -- 172.21.15.19:0/1210113315 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f237806b4d0 msgr2=0x7f237806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:25.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.082+0000 7f239b200640 1 --2- 172.21.15.19:0/1210113315 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f237806b4d0 0x7f237806d990 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f238c007fd0 tx=0x7f238c009040 comp rx=0 tx=0).stop 2024-03-08T06:04:25.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.082+0000 7f239b200640 1 -- 172.21.15.19:0/1210113315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239c1611f0 msgr2=0x7f239c15a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:25.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.082+0000 7f239b200640 1 --2- 172.21.15.19:0/1210113315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239c1611f0 0x7f239c15a040 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2394009d90 tx=0x7f2394004a40 comp rx=0 tx=0).stop 2024-03-08T06:04:25.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.082+0000 7f239b200640 1 -- 172.21.15.19:0/1210113315 shutdown_connections 2024-03-08T06:04:25.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.082+0000 7f239b200640 1 --2- 172.21.15.19:0/1210113315 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f237806b4d0 0x7f237806d990 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:25.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.082+0000 7f239b200640 1 --2- 172.21.15.19:0/1210113315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f239c1611f0 0x7f239c15a040 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:25.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.082+0000 7f239b200640 1 --2- 172.21.15.19:0/1210113315 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f239c0b5bf0 0x7f239c15aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:25.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.082+0000 7f239b200640 1 --2- 172.21.15.19:0/1210113315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f239c0b27a0 0x7f239c0c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:25.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.082+0000 7f239b200640 1 -- 172.21.15.19:0/1210113315 >> 172.21.15.19:0/1210113315 conn(0x7f239c06c700 msgr2=0x7f239c1620f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:25.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.082+0000 7f239b200640 1 -- 172.21.15.19:0/1210113315 shutdown_connections 2024-03-08T06:04:25.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.082+0000 7f239b200640 1 -- 172.21.15.19:0/1210113315 wait complete. 2024-03-08T06:04:25.103 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-08T06:04:25.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.324+0000 7f00ea600640 1 Processor -- start 2024-03-08T06:04:25.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.325+0000 7f00ea600640 1 -- start start 2024-03-08T06:04:25.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.326+0000 7f00ea600640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f00e415e480 0x7f00e406e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:25.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.326+0000 7f00ea600640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e406eec0 con 0x7f00e406eab0 2024-03-08T06:04:25.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.327+0000 7f00ea600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e415e980 con 0x7f00e4144330 2024-03-08T06:04:25.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.327+0000 7f00ea600640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00e415ec60 con 0x7f00e415e480 2024-03-08T06:04:25.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.327+0000 7f00e3e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f00e415e480 0x7f00e406e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:25.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.327+0000 7f00e3e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f00e415e480 0x7f00e406e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35692/0 (socket says 172.21.15.19:35692) 2024-03-08T06:04:25.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.327+0000 7f00e3e00640 1 -- 172.21.15.19:0/419820639 learned_addr learned my addr 172.21.15.19:0/419820639 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:25.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.327+0000 7f00e9c00640 1 --1- 172.21.15.19:0/419820639 >> v1:172.21.15.19:6789/0 conn(0x7f00e406eab0 0x7f00e40b37b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37336/0 (socket says 172.21.15.19:37336) 2024-03-08T06:04:25.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.327+0000 7f00e3e00640 1 -- 172.21.15.19:0/419820639 >> v1:172.21.15.42:6789/0 conn(0x7f00e4144330 legacy=0x7f00e40cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:25.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.327+0000 7f00e3e00640 1 -- 172.21.15.19:0/419820639 >> v1:172.21.15.19:6789/0 conn(0x7f00e406eab0 legacy=0x7f00e40b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:25.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.327+0000 7f00e3e00640 1 -- 172.21.15.19:0/419820639 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e415ef40 con 0x7f00e415e480 2024-03-08T06:04:25.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.327+0000 7f00e3400640 1 -- 172.21.15.19:0/419820639 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512045021 0 0) 0x7f00dc001110 con 0x7f00e406eab0 2024-03-08T06:04:25.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.329+0000 7f00e3e00640 1 --2- 172.21.15.19:0/419820639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e415e480 0x7f00e406e570 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f00cc009870 tx=0x7f00cc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac639b97cd6c3e4f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:25.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.329+0000 7f00e3400640 1 -- 172.21.15.19:0/419820639 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc02e070 con 0x7f00e415e480 2024-03-08T06:04:25.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.329+0000 7f00e3400640 1 -- 172.21.15.19:0/419820639 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc037070 con 0x7f00e415e480 2024-03-08T06:04:25.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.329+0000 7f00e3400640 1 -- 172.21.15.19:0/419820639 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc031a00 con 0x7f00e415e480 2024-03-08T06:04:25.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.329+0000 7f00ea600640 1 -- 172.21.15.19:0/419820639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e415e480 msgr2=0x7f00e406e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:25.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.329+0000 7f00ea600640 1 --2- 172.21.15.19:0/419820639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e415e480 0x7f00e406e570 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f00cc009870 tx=0x7f00cc02b880 comp rx=0 tx=0).stop 2024-03-08T06:04:25.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.330+0000 7f00ea600640 1 -- 172.21.15.19:0/419820639 shutdown_connections 2024-03-08T06:04:25.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.330+0000 7f00ea600640 1 --2- 172.21.15.19:0/419820639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e415e480 0x7f00e406e570 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:25.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.330+0000 7f00ea600640 1 -- 172.21.15.19:0/419820639 >> 172.21.15.19:0/419820639 conn(0x7f00e40b1590 msgr2=0x7f00e40b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:25.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.330+0000 7f00ea600640 1 -- 172.21.15.19:0/419820639 shutdown_connections 2024-03-08T06:04:25.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.330+0000 7f00ea600640 1 -- 172.21.15.19:0/419820639 wait complete. 2024-03-08T06:04:25.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.331+0000 7f00ea600640 1 Processor -- start 2024-03-08T06:04:25.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.332+0000 7f00ea600640 1 -- start start 2024-03-08T06:04:25.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.333+0000 7f00ea600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00e406eab0 0x7f00e412dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:25.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.333+0000 7f00ea600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f00e4144330 0x7f00e415a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:25.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.333+0000 7f00ea600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e415e480 0x7f00e40aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:25.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.333+0000 7f00ea600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e40b4040 con 0x7f00e415e480 2024-03-08T06:04:25.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.333+0000 7f00ea600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e40b3ec0 con 0x7f00e406eab0 2024-03-08T06:04:25.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.333+0000 7f00ea600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e40b41c0 con 0x7f00e4144330 2024-03-08T06:04:25.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.333+0000 7f00e9c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e415e480 0x7f00e40aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:25.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.333+0000 7f00e9c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e415e480 0x7f00e40aad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35708/0 (socket says 172.21.15.19:35708) 2024-03-08T06:04:25.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.333+0000 7f00e9c00640 1 -- 172.21.15.19:0/848839810 learned_addr learned my addr 172.21.15.19:0/848839810 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:25.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.333+0000 7f00e9200640 1 --2- 172.21.15.19:0/848839810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00e406eab0 0x7f00e412dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:25.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.333+0000 7f00e3e00640 1 --2- 172.21.15.19:0/848839810 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f00e4144330 0x7f00e415a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:25.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.333+0000 7f00e9c00640 1 -- 172.21.15.19:0/848839810 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f00e4144330 msgr2=0x7f00e415a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:25.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.333+0000 7f00e9c00640 1 --2- 172.21.15.19:0/848839810 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f00e4144330 0x7f00e415a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:25.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.333+0000 7f00e9c00640 1 -- 172.21.15.19:0/848839810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00e406eab0 msgr2=0x7f00e412dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:25.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.333+0000 7f00e9c00640 1 --2- 172.21.15.19:0/848839810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00e406eab0 0x7f00e412dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:25.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.333+0000 7f00e9c00640 1 -- 172.21.15.19:0/848839810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e40acfd0 con 0x7f00e415e480 2024-03-08T06:04:25.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.333+0000 7f00e9200640 1 --2- 172.21.15.19:0/848839810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00e406eab0 0x7f00e412dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:25.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.334+0000 7f00e9c00640 1 --2- 172.21.15.19:0/848839810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e415e480 0x7f00e40aad50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00c780 tx=0x7f00dc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:25.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.334+0000 7f00e0c00640 1 -- 172.21.15.19:0/848839810 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc018070 con 0x7f00e415e480 2024-03-08T06:04:25.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.334+0000 7f00e0c00640 1 -- 172.21.15.19:0/848839810 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc0070d0 con 0x7f00e415e480 2024-03-08T06:04:25.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.334+0000 7f00e0c00640 1 -- 172.21.15.19:0/848839810 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc007500 con 0x7f00e415e480 2024-03-08T06:04:25.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.334+0000 7f00ea600640 1 -- 172.21.15.19:0/848839810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e40ad270 con 0x7f00e415e480 2024-03-08T06:04:25.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.334+0000 7f00ea600640 1 -- 172.21.15.19:0/848839810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e40ad830 con 0x7f00e415e480 2024-03-08T06:04:25.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.335+0000 7f00ea600640 1 -- 172.21.15.19:0/848839810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e4075090 con 0x7f00e415e480 2024-03-08T06:04:25.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.337+0000 7f00e0c00640 1 -- 172.21.15.19:0/848839810 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f00dc01b070 con 0x7f00e415e480 2024-03-08T06:04:25.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.338+0000 7f00e0c00640 1 --2- 172.21.15.19:0/848839810 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f00c006b4d0 0x7f00c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:25.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.338+0000 7f00e0c00640 1 -- 172.21.15.19:0/848839810 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f00dc089190 con 0x7f00e415e480 2024-03-08T06:04:25.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.338+0000 7f00e9200640 1 --2- 172.21.15.19:0/848839810 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f00c006b4d0 0x7f00c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:25.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.339+0000 7f00e9200640 1 --2- 172.21.15.19:0/848839810 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f00c006b4d0 0x7f00c006d990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f00d4004520 tx=0x7f00d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:25.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.343+0000 7f00e0c00640 1 -- 172.21.15.19:0/848839810 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f00e406eec0 con 0x7f00e415e480 2024-03-08T06:04:25.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.619+0000 7f00ea600640 1 -- 172.21.15.19:0/848839810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f00e40b3140 con 0x7f00e415e480 2024-03-08T06:04:25.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.624+0000 7f00e0c00640 1 -- 172.21.15.19:0/848839810 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f00dc058360 con 0x7f00e415e480 2024-03-08T06:04:25.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.626+0000 7f00ea600640 1 -- 172.21.15.19:0/848839810 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f00c006b4d0 msgr2=0x7f00c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:25.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.626+0000 7f00ea600640 1 --2- 172.21.15.19:0/848839810 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f00c006b4d0 0x7f00c006d990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f00d4004520 tx=0x7f00d4009040 comp rx=0 tx=0).stop 2024-03-08T06:04:25.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.626+0000 7f00ea600640 1 -- 172.21.15.19:0/848839810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e415e480 msgr2=0x7f00e40aad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.626+0000 7f00ea600640 1 --2- 172.21.15.19:0/848839810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e415e480 0x7f00e40aad50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00c780 tx=0x7f00dc00cc40 comp rx=0 tx=0).stop 2024-03-08T06:04:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.626+0000 7f00ea600640 1 -- 172.21.15.19:0/848839810 shutdown_connections 2024-03-08T06:04:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.626+0000 7f00ea600640 1 --2- 172.21.15.19:0/848839810 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f00c006b4d0 0x7f00c006d990 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.626+0000 7f00ea600640 1 --2- 172.21.15.19:0/848839810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00e415e480 0x7f00e40aad50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.627+0000 7f00ea600640 1 --2- 172.21.15.19:0/848839810 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f00e4144330 0x7f00e415a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.627+0000 7f00ea600640 1 --2- 172.21.15.19:0/848839810 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00e406eab0 0x7f00e412dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.627+0000 7f00ea600640 1 -- 172.21.15.19:0/848839810 >> 172.21.15.19:0/848839810 conn(0x7f00e40b1590 msgr2=0x7f00e40cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.627+0000 7f00ea600640 1 -- 172.21.15.19:0/848839810 shutdown_connections 2024-03-08T06:04:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.627+0000 7f00ea600640 1 -- 172.21.15.19:0/848839810 wait complete. 2024-03-08T06:04:25.648 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-08T06:04:25.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.874+0000 7fcf60600640 1 Processor -- start 2024-03-08T06:04:25.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.874+0000 7fcf60600640 1 -- start start 2024-03-08T06:04:25.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.876+0000 7fcf60600640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcf58161840 0x7fcf580b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:25.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.876+0000 7fcf60600640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf58162330 con 0x7fcf58147480 2024-03-08T06:04:25.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.876+0000 7fcf60600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf581625c0 con 0x7fcf58146f30 2024-03-08T06:04:25.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.876+0000 7fcf60600640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf580b3520 con 0x7fcf58161840 2024-03-08T06:04:25.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.877+0000 7fcf5dc00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcf58161840 0x7fcf580b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:25.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.877+0000 7fcf5e600640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcf58147480 0x7fcf5806d440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37346/0 (socket says 172.21.15.19:37346) 2024-03-08T06:04:25.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.877+0000 7fcf5e600640 1 -- 172.21.15.19:0/4014871985 learned_addr learned my addr 172.21.15.19:0/4014871985 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:25.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.877+0000 7fcf5dc00640 1 -- 172.21.15.19:0/4014871985 >> v1:172.21.15.42:6789/0 conn(0x7fcf58146f30 legacy=0x7fcf58161c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:25.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.877+0000 7fcf5dc00640 1 -- 172.21.15.19:0/4014871985 >> v1:172.21.15.19:6789/0 conn(0x7fcf58147480 legacy=0x7fcf5806d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:25.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.877+0000 7fcf5dc00640 1 -- 172.21.15.19:0/4014871985 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf580b4960 con 0x7fcf58161840 2024-03-08T06:04:25.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.877+0000 7fcf57e00640 1 -- 172.21.15.19:0/4014871985 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409557466 0 0) 0x7fcf58162330 con 0x7fcf58147480 2024-03-08T06:04:25.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.878+0000 7fcf5dc00640 1 --2- 172.21.15.19:0/4014871985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf58161840 0x7fcf580b39b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0097a0 tx=0x7fcf4c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5ecd89ca987c7a server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:25.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.879+0000 7fcf57e00640 1 -- 172.21.15.19:0/4014871985 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c035020 con 0x7fcf58161840 2024-03-08T06:04:25.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.879+0000 7fcf57e00640 1 -- 172.21.15.19:0/4014871985 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c031830 con 0x7fcf58161840 2024-03-08T06:04:25.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.879+0000 7fcf57e00640 1 -- 172.21.15.19:0/4014871985 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c031c00 con 0x7fcf58161840 2024-03-08T06:04:25.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.879+0000 7fcf60600640 1 -- 172.21.15.19:0/4014871985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf58161840 msgr2=0x7fcf580b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:25.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.879+0000 7fcf60600640 1 --2- 172.21.15.19:0/4014871985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf58161840 0x7fcf580b39b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0097a0 tx=0x7fcf4c02b8d0 comp rx=0 tx=0).stop 2024-03-08T06:04:25.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.879+0000 7fcf60600640 1 -- 172.21.15.19:0/4014871985 shutdown_connections 2024-03-08T06:04:25.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.879+0000 7fcf60600640 1 --2- 172.21.15.19:0/4014871985 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf58161840 0x7fcf580b39b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:25.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.879+0000 7fcf60600640 1 -- 172.21.15.19:0/4014871985 >> 172.21.15.19:0/4014871985 conn(0x7fcf580b16e0 msgr2=0x7fcf580b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:25.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.880+0000 7fcf60600640 1 -- 172.21.15.19:0/4014871985 shutdown_connections 2024-03-08T06:04:25.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.880+0000 7fcf60600640 1 -- 172.21.15.19:0/4014871985 wait complete. 2024-03-08T06:04:25.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.881+0000 7fcf60600640 1 Processor -- start 2024-03-08T06:04:25.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.881+0000 7fcf60600640 1 -- start start 2024-03-08T06:04:25.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.882+0000 7fcf60600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf58146f30 0x7fcf5815d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:25.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.882+0000 7fcf60600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcf58147480 0x7fcf581603e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:25.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.882+0000 7fcf60600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf58161840 0x7fcf58160920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:25.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.882+0000 7fcf60600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580b3ef0 con 0x7fcf58146f30 2024-03-08T06:04:25.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.882+0000 7fcf60600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf580b4c40 con 0x7fcf58161840 2024-03-08T06:04:25.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.882+0000 7fcf60600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5806db50 con 0x7fcf58147480 2024-03-08T06:04:25.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.883+0000 7fcf5dc00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf58146f30 0x7fcf5815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:25.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.883+0000 7fcf5dc00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf58146f30 0x7fcf5815d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35716/0 (socket says 172.21.15.19:35716) 2024-03-08T06:04:25.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.883+0000 7fcf5dc00640 1 -- 172.21.15.19:0/3239479855 learned_addr learned my addr 172.21.15.19:0/3239479855 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:25.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.883+0000 7fcf5dc00640 1 -- 172.21.15.19:0/3239479855 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcf58147480 msgr2=0x7fcf581603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:25.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.883+0000 7fcf5dc00640 1 --2- 172.21.15.19:0/3239479855 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcf58147480 0x7fcf581603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:25.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.883+0000 7fcf5dc00640 1 -- 172.21.15.19:0/3239479855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf58161840 msgr2=0x7fcf58160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:25.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.883+0000 7fcf5dc00640 1 --2- 172.21.15.19:0/3239479855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf58161840 0x7fcf58160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:25.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.883+0000 7fcf5dc00640 1 -- 172.21.15.19:0/3239479855 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5815d970 con 0x7fcf58146f30 2024-03-08T06:04:25.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.884+0000 7fcf5dc00640 1 --2- 172.21.15.19:0/3239479855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf58146f30 0x7fcf5815d430 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c000c00 tx=0x7fcf4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:25.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.884+0000 7fcf55600640 1 -- 172.21.15.19:0/3239479855 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c041070 con 0x7fcf58146f30 2024-03-08T06:04:25.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.884+0000 7fcf55600640 1 -- 172.21.15.19:0/3239479855 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c004230 con 0x7fcf58146f30 2024-03-08T06:04:25.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.884+0000 7fcf55600640 1 -- 172.21.15.19:0/3239479855 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c035040 con 0x7fcf58146f30 2024-03-08T06:04:25.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.884+0000 7fcf60600640 1 -- 172.21.15.19:0/3239479855 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf580c5960 con 0x7fcf58146f30 2024-03-08T06:04:25.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.884+0000 7fcf60600640 1 -- 172.21.15.19:0/3239479855 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf58133cd0 con 0x7fcf58146f30 2024-03-08T06:04:25.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.885+0000 7fcf60600640 1 -- 172.21.15.19:0/3239479855 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf58067cb0 con 0x7fcf58146f30 2024-03-08T06:04:25.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.886+0000 7fcf55600640 1 -- 172.21.15.19:0/3239479855 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcf4c038020 con 0x7fcf58146f30 2024-03-08T06:04:25.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.887+0000 7fcf55600640 1 --2- 172.21.15.19:0/3239479855 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fcf3806b4d0 0x7fcf3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:25.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.887+0000 7fcf55600640 1 -- 172.21.15.19:0/3239479855 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcf4c0aba50 con 0x7fcf58146f30 2024-03-08T06:04:25.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.887+0000 7fcf5d200640 1 --2- 172.21.15.19:0/3239479855 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fcf3806b4d0 0x7fcf3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:25.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.888+0000 7fcf5d200640 1 --2- 172.21.15.19:0/3239479855 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fcf3806b4d0 0x7fcf3806d990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcf5806e830 tx=0x7fcf440079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:25.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:25.892+0000 7fcf55600640 1 -- 172.21.15.19:0/3239479855 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcf4c07ab80 con 0x7fcf58146f30 2024-03-08T06:04:26.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.165+0000 7fcf60600640 1 -- 172.21.15.19:0/3239479855 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fcf580b22d0 con 0x7fcf58146f30 2024-03-08T06:04:26.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.169+0000 7fcf55600640 1 -- 172.21.15.19:0/3239479855 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcf4c07a480 con 0x7fcf58146f30 2024-03-08T06:04:26.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.173+0000 7fcf60600640 1 -- 172.21.15.19:0/3239479855 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fcf3806b4d0 msgr2=0x7fcf3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:26.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.173+0000 7fcf60600640 1 --2- 172.21.15.19:0/3239479855 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fcf3806b4d0 0x7fcf3806d990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcf5806e830 tx=0x7fcf440079b0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.173+0000 7fcf60600640 1 -- 172.21.15.19:0/3239479855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf58146f30 msgr2=0x7fcf5815d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:26.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.173+0000 7fcf60600640 1 --2- 172.21.15.19:0/3239479855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf58146f30 0x7fcf5815d430 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c000c00 tx=0x7fcf4c0046c0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.173+0000 7fcf60600640 1 -- 172.21.15.19:0/3239479855 shutdown_connections 2024-03-08T06:04:26.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.173+0000 7fcf60600640 1 --2- 172.21.15.19:0/3239479855 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fcf3806b4d0 0x7fcf3806d990 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.173+0000 7fcf60600640 1 --2- 172.21.15.19:0/3239479855 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcf58161840 0x7fcf58160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.173+0000 7fcf60600640 1 --2- 172.21.15.19:0/3239479855 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcf58147480 0x7fcf581603e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.173+0000 7fcf60600640 1 --2- 172.21.15.19:0/3239479855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf58146f30 0x7fcf5815d430 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.173+0000 7fcf60600640 1 -- 172.21.15.19:0/3239479855 >> 172.21.15.19:0/3239479855 conn(0x7fcf580b16e0 msgr2=0x7fcf580b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:26.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.173+0000 7fcf60600640 1 -- 172.21.15.19:0/3239479855 shutdown_connections 2024-03-08T06:04:26.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.173+0000 7fcf60600640 1 -- 172.21.15.19:0/3239479855 wait complete. 2024-03-08T06:04:26.194 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:04:26.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.418+0000 7f3f01200640 1 Processor -- start 2024-03-08T06:04:26.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.418+0000 7f3f01200640 1 -- start start 2024-03-08T06:04:26.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.419+0000 7f3f01200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3efc071ab0 0x7f3efc15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:26.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.419+0000 7f3f01200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3efc06d600 0x7f3efc144d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:26.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.419+0000 7f3f01200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3efc15d0c0 con 0x7f3efc071e90 2024-03-08T06:04:26.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.420+0000 7f3f01200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3efc06ef40 con 0x7f3efc071ab0 2024-03-08T06:04:26.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.420+0000 7f3f01200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc06da80 con 0x7f3efc06d600 2024-03-08T06:04:26.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.420+0000 7f3efa800640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3efc071e90 0x7f3efc15f6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37356/0 (socket says 172.21.15.19:37356) 2024-03-08T06:04:26.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.420+0000 7f3efa800640 1 -- 172.21.15.19:0/1053386602 learned_addr learned my addr 172.21.15.19:0/1053386602 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:26.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.420+0000 7f3ef9e00640 1 --2- 172.21.15.19:0/1053386602 >> v2:172.21.15.42:3300/0 conn(0x7f3efc071ab0 0x7f3efc15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:26.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.420+0000 7f3ef1400640 1 --2- 172.21.15.19:0/1053386602 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3efc06d600 0x7f3efc144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:26.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.420+0000 7f3ef9400640 1 -- 172.21.15.19:0/1053386602 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049509605 0 0) 0x7f3ef4001110 con 0x7f3efc071e90 2024-03-08T06:04:26.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.420+0000 7f3ef9400640 1 -- 172.21.15.19:0/1053386602 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ee0003520 con 0x7f3efc071e90 2024-03-08T06:04:26.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.421+0000 7f3ef9400640 1 -- 172.21.15.19:0/1053386602 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4127966188 0 0) 0x7f3ee0003520 con 0x7f3efc071e90 2024-03-08T06:04:26.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.421+0000 7f3ef9400640 1 -- 172.21.15.19:0/1053386602 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3efc06d600 msgr2=0x7f3efc144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:26.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.421+0000 7f3ef9400640 1 --2- 172.21.15.19:0/1053386602 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3efc06d600 0x7f3efc144d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.421+0000 7f3ef9400640 1 -- 172.21.15.19:0/1053386602 >> v2:172.21.15.42:3300/0 conn(0x7f3efc071ab0 msgr2=0x7f3efc15cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:26.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.421+0000 7f3ef9400640 1 --2- 172.21.15.19:0/1053386602 >> v2:172.21.15.42:3300/0 conn(0x7f3efc071ab0 0x7f3efc15cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.421+0000 7f3ef9400640 1 -- 172.21.15.19:0/1053386602 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc06dd60 con 0x7f3efc071e90 2024-03-08T06:04:26.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.421+0000 7f3ef9400640 1 -- 172.21.15.19:0/1053386602 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f3ef4001840 con 0x7f3efc071e90 2024-03-08T06:04:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.421+0000 7f3ef9400640 1 -- 172.21.15.19:0/1053386602 >> v1:172.21.15.19:6789/0 conn(0x7f3efc071e90 legacy=0x7f3efc15f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.421+0000 7f3ef9400640 1 --2- 172.21.15.19:0/1053386602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ee00039b0 0x7f3ee0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.421+0000 7f3ef9400640 1 --2- 172.21.15.19:0/1053386602 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3efc06d600 0x7f3ee0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.421+0000 7f3ef9400640 1 --2- 172.21.15.19:0/1053386602 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ee0004d40 0x7f3ee00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.421+0000 7f3ef9400640 1 -- 172.21.15.19:0/1053386602 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc06da80 con 0x7f3ee0004d40 2024-03-08T06:04:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.421+0000 7f3ef9400640 1 -- 172.21.15.19:0/1053386602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee000b9c0 con 0x7f3ee00039b0 2024-03-08T06:04:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.421+0000 7f3ef9400640 1 -- 172.21.15.19:0/1053386602 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee000bb40 con 0x7f3efc06d600 2024-03-08T06:04:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.421+0000 7f3efa800640 1 --2- 172.21.15.19:0/1053386602 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ee0004d40 0x7f3ee00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.422+0000 7f3ef9e00640 1 --2- 172.21.15.19:0/1053386602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ee00039b0 0x7f3ee0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.422+0000 7f3ef1400640 1 --2- 172.21.15.19:0/1053386602 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3efc06d600 0x7f3ee0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.422+0000 7f3efa800640 1 -- 172.21.15.19:0/1053386602 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3efc06d600 msgr2=0x7f3ee0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.422+0000 7f3efa800640 1 --2- 172.21.15.19:0/1053386602 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3efc06d600 0x7f3ee0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.422+0000 7f3efa800640 1 -- 172.21.15.19:0/1053386602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ee00039b0 msgr2=0x7f3ee0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.422+0000 7f3efa800640 1 --2- 172.21.15.19:0/1053386602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ee00039b0 0x7f3ee0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.422+0000 7f3efa800640 1 -- 172.21.15.19:0/1053386602 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee0003520 con 0x7f3ee0004d40 2024-03-08T06:04:26.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.422+0000 7f3ef1400640 1 --2- 172.21.15.19:0/1053386602 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3efc06d600 0x7f3ee0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:26.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.423+0000 7f3efa800640 1 --2- 172.21.15.19:0/1053386602 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ee0004d40 0x7f3ee00051c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400c320 tx=0x7f3ee0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf88f021f079a17c server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:26.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.424+0000 7f3ef9400640 1 -- 172.21.15.19:0/1053386602 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef402cc00 con 0x7f3ee0004d40 2024-03-08T06:04:26.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.424+0000 7f3ef9400640 1 -- 172.21.15.19:0/1053386602 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef4030070 con 0x7f3ee0004d40 2024-03-08T06:04:26.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.424+0000 7f3ef9400640 1 -- 172.21.15.19:0/1053386602 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40058d0 con 0x7f3ee0004d40 2024-03-08T06:04:26.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.424+0000 7f3f01200640 1 -- 172.21.15.19:0/1053386602 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ee0004d40 msgr2=0x7f3ee00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:26.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.424+0000 7f3f01200640 1 --2- 172.21.15.19:0/1053386602 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ee0004d40 0x7f3ee00051c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400c320 tx=0x7f3ee0005830 comp rx=0 tx=0).stop 2024-03-08T06:04:26.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.424+0000 7f3efa800640 1 -- 172.21.15.19:0/1053386602 reap_dead start 2024-03-08T06:04:26.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.424+0000 7f3f01200640 1 -- 172.21.15.19:0/1053386602 shutdown_connections 2024-03-08T06:04:26.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.424+0000 7f3f01200640 1 -- 172.21.15.19:0/1053386602 >> 172.21.15.19:0/1053386602 conn(0x7f3efc06ae30 msgr2=0x7f3efc06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:26.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.424+0000 7f3f01200640 1 -- 172.21.15.19:0/1053386602 shutdown_connections 2024-03-08T06:04:26.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.425+0000 7f3f01200640 1 -- 172.21.15.19:0/1053386602 wait complete. 2024-03-08T06:04:26.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.426+0000 7f3f01200640 1 Processor -- start 2024-03-08T06:04:26.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.426+0000 7f3f01200640 1 -- start start 2024-03-08T06:04:26.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.427+0000 7f3f01200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ee0004d40 0x7f3efc13f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:26.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.427+0000 7f3f01200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3efc13d3a0 0x7f3efc0cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:26.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.427+0000 7f3f01200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3efc13d820 0x7f3efc0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:26.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.427+0000 7f3f01200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc06e600 con 0x7f3efc13d820 2024-03-08T06:04:26.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.427+0000 7f3f01200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc06e320 con 0x7f3efc13d3a0 2024-03-08T06:04:26.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.427+0000 7f3f01200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc15e3b0 con 0x7f3ee0004d40 2024-03-08T06:04:26.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.428+0000 7f3efa800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3efc13d820 0x7f3efc0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:26.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.428+0000 7f3efa800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3efc13d820 0x7f3efc0cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35746/0 (socket says 172.21.15.19:35746) 2024-03-08T06:04:26.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.428+0000 7f3efa800640 1 -- 172.21.15.19:0/892904139 learned_addr learned my addr 172.21.15.19:0/892904139 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:26.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.428+0000 7f3ef9e00640 1 --2- 172.21.15.19:0/892904139 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ee0004d40 0x7f3efc13f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:26.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.428+0000 7f3efa800640 1 -- 172.21.15.19:0/892904139 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ee0004d40 msgr2=0x7f3efc13f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:26.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.428+0000 7f3ef1400640 1 --2- 172.21.15.19:0/892904139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3efc13d3a0 0x7f3efc0cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:26.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.428+0000 7f3efa800640 1 --2- 172.21.15.19:0/892904139 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ee0004d40 0x7f3efc13f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.428+0000 7f3efa800640 1 -- 172.21.15.19:0/892904139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3efc13d3a0 msgr2=0x7f3efc0cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:26.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.428+0000 7f3efa800640 1 --2- 172.21.15.19:0/892904139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3efc13d3a0 0x7f3efc0cd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.428+0000 7f3efa800640 1 -- 172.21.15.19:0/892904139 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc15bb50 con 0x7f3efc13d820 2024-03-08T06:04:26.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.428+0000 7f3ef9e00640 1 --2- 172.21.15.19:0/892904139 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ee0004d40 0x7f3efc13f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:26.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.429+0000 7f3efa800640 1 --2- 172.21.15.19:0/892904139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3efc13d820 0x7f3efc0cd8c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3ef402c670 tx=0x7f3ef4001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:26.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.429+0000 7f3ef2a00640 1 -- 172.21.15.19:0/892904139 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40049e0 con 0x7f3efc13d820 2024-03-08T06:04:26.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.429+0000 7f3ef2a00640 1 -- 172.21.15.19:0/892904139 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef4007e50 con 0x7f3efc13d820 2024-03-08T06:04:26.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.429+0000 7f3ef2a00640 1 -- 172.21.15.19:0/892904139 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4004d80 con 0x7f3efc13d820 2024-03-08T06:04:26.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.429+0000 7f3f01200640 1 -- 172.21.15.19:0/892904139 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc13cd00 con 0x7f3efc13d820 2024-03-08T06:04:26.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.429+0000 7f3f01200640 1 -- 172.21.15.19:0/892904139 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3efc1412b0 con 0x7f3efc13d820 2024-03-08T06:04:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.430+0000 7f3f01200640 1 -- 172.21.15.19:0/892904139 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3efc067cb0 con 0x7f3efc13d820 2024-03-08T06:04:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.431+0000 7f3ef2a00640 1 -- 172.21.15.19:0/892904139 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3ef4007070 con 0x7f3efc13d820 2024-03-08T06:04:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.432+0000 7f3ef2a00640 1 --2- 172.21.15.19:0/892904139 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3ed806b4d0 0x7f3ed806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.432+0000 7f3ef2a00640 1 -- 172.21.15.19:0/892904139 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3ef40aa930 con 0x7f3efc13d820 2024-03-08T06:04:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.432+0000 7f3ef9e00640 1 --2- 172.21.15.19:0/892904139 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3ed806b4d0 0x7f3ed806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.433+0000 7f3ef9e00640 1 --2- 172.21.15.19:0/892904139 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3ed806b4d0 0x7f3ed806d990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3eec007440 tx=0x7f3eec00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:26.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.437+0000 7f3ef2a00640 1 -- 172.21.15.19:0/892904139 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3ef4048070 con 0x7f3efc13d820 2024-03-08T06:04:26.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.642+0000 7f3f01200640 1 -- 172.21.15.19:0/892904139 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3efc0ae560 con 0x7f3efc13d820 2024-03-08T06:04:26.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.644+0000 7f3ef2a00640 1 -- 172.21.15.19:0/892904139 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12831 (secure 0 0 0) 0x7f3efc15d0c0 con 0x7f3efc13d820 2024-03-08T06:04:26.644 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:26.645 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":30,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:04:22.490371+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:04:26.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.646+0000 7f3f01200640 1 -- 172.21.15.19:0/892904139 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3ed806b4d0 msgr2=0x7f3ed806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:26.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.646+0000 7f3f01200640 1 --2- 172.21.15.19:0/892904139 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3ed806b4d0 0x7f3ed806d990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3eec007440 tx=0x7f3eec00b040 comp rx=0 tx=0).stop 2024-03-08T06:04:26.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.646+0000 7f3f01200640 1 -- 172.21.15.19:0/892904139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3efc13d820 msgr2=0x7f3efc0cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:26.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.646+0000 7f3f01200640 1 --2- 172.21.15.19:0/892904139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3efc13d820 0x7f3efc0cd8c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3ef402c670 tx=0x7f3ef4001b40 comp rx=0 tx=0).stop 2024-03-08T06:04:26.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.647+0000 7f3f01200640 1 -- 172.21.15.19:0/892904139 shutdown_connections 2024-03-08T06:04:26.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.647+0000 7f3f01200640 1 --2- 172.21.15.19:0/892904139 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3ed806b4d0 0x7f3ed806d990 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.647+0000 7f3f01200640 1 --2- 172.21.15.19:0/892904139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3efc13d820 0x7f3efc0cd8c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.647+0000 7f3f01200640 1 --2- 172.21.15.19:0/892904139 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3efc13d3a0 0x7f3efc0cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.647+0000 7f3f01200640 1 --2- 172.21.15.19:0/892904139 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3ee0004d40 0x7f3efc13f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.647+0000 7f3f01200640 1 -- 172.21.15.19:0/892904139 >> 172.21.15.19:0/892904139 conn(0x7f3efc06ae30 msgr2=0x7f3efc0ad9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:26.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.647+0000 7f3f01200640 1 -- 172.21.15.19:0/892904139 shutdown_connections 2024-03-08T06:04:26.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.647+0000 7f3f01200640 1 -- 172.21.15.19:0/892904139 wait complete. 2024-03-08T06:04:26.667 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T06:03:14.149736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T06:04:26.667 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T06:04:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.892+0000 7ff8fbe00640 1 Processor -- start 2024-03-08T06:04:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.892+0000 7ff8fbe00640 1 -- start start 2024-03-08T06:04:26.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.894+0000 7ff8fbe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8fc145500 0x7ff8fc06ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:26.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.894+0000 7ff8fbe00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff8fc15bfb0 0x7ff8fc0716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.894+0000 7ff8fbe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff8fc071c20 0x7ff8fc06d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.894+0000 7ff8fbe00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8fc072050 con 0x7ff8fc145500 2024-03-08T06:04:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.894+0000 7ff8fbe00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8fc15c460 con 0x7ff8fc071c20 2024-03-08T06:04:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.894+0000 7ff8fbe00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc15c740 con 0x7ff8fc15bfb0 2024-03-08T06:04:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.894+0000 7ff8faa00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8fc145500 0x7ff8fc06ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.894+0000 7ff8faa00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8fc145500 0x7ff8fc06ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35754/0 (socket says 172.21.15.19:35754) 2024-03-08T06:04:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.894+0000 7ff8faa00640 1 -- 172.21.15.19:0/2619736761 learned_addr learned my addr 172.21.15.19:0/2619736761 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.895+0000 7ff8fb400640 1 --2- 172.21.15.19:0/2619736761 >> v2:172.21.15.42:3300/0 conn(0x7ff8fc071c20 0x7ff8fc06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.895+0000 7ff8f2000640 1 --2- 172.21.15.19:0/2619736761 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff8fc15bfb0 0x7ff8fc0716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.895+0000 7ff8faa00640 1 -- 172.21.15.19:0/2619736761 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff8fc15bfb0 msgr2=0x7ff8fc0716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.895+0000 7ff8faa00640 1 --2- 172.21.15.19:0/2619736761 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff8fc15bfb0 0x7ff8fc0716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.895+0000 7ff8faa00640 1 -- 172.21.15.19:0/2619736761 >> v2:172.21.15.42:3300/0 conn(0x7ff8fc071c20 msgr2=0x7ff8fc06d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.895+0000 7ff8faa00640 1 --2- 172.21.15.19:0/2619736761 >> v2:172.21.15.42:3300/0 conn(0x7ff8fc071c20 0x7ff8fc06d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.895+0000 7ff8faa00640 1 -- 172.21.15.19:0/2619736761 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc15ca20 con 0x7ff8fc145500 2024-03-08T06:04:26.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.896+0000 7ff8faa00640 1 --2- 172.21.15.19:0/2619736761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8fc145500 0x7ff8fc06ecb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc06e730 tx=0x7ff8ec02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ae1dd31d9958f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:26.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.896+0000 7ff8fa000640 1 -- 172.21.15.19:0/2619736761 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec02e070 con 0x7ff8fc145500 2024-03-08T06:04:26.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.896+0000 7ff8fa000640 1 -- 172.21.15.19:0/2619736761 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec037070 con 0x7ff8fc145500 2024-03-08T06:04:26.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.896+0000 7ff8fa000640 1 -- 172.21.15.19:0/2619736761 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec031a00 con 0x7ff8fc145500 2024-03-08T06:04:26.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.897+0000 7ff8fbe00640 1 -- 172.21.15.19:0/2619736761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8fc145500 msgr2=0x7ff8fc06ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:26.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.897+0000 7ff8fbe00640 1 --2- 172.21.15.19:0/2619736761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8fc145500 0x7ff8fc06ecb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc06e730 tx=0x7ff8ec02b880 comp rx=0 tx=0).stop 2024-03-08T06:04:26.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.897+0000 7ff8fbe00640 1 -- 172.21.15.19:0/2619736761 shutdown_connections 2024-03-08T06:04:26.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.897+0000 7ff8fbe00640 1 --2- 172.21.15.19:0/2619736761 >> v2:172.21.15.42:3300/0 conn(0x7ff8fc071c20 0x7ff8fc06d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.897+0000 7ff8fbe00640 1 --2- 172.21.15.19:0/2619736761 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff8fc15bfb0 0x7ff8fc0716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.897+0000 7ff8fbe00640 1 --2- 172.21.15.19:0/2619736761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8fc145500 0x7ff8fc06ecb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.897+0000 7ff8fbe00640 1 -- 172.21.15.19:0/2619736761 >> 172.21.15.19:0/2619736761 conn(0x7ff8fc0b1850 msgr2=0x7ff8fc0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:26.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.897+0000 7ff8fbe00640 1 -- 172.21.15.19:0/2619736761 shutdown_connections 2024-03-08T06:04:26.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.897+0000 7ff8fbe00640 1 -- 172.21.15.19:0/2619736761 wait complete. 2024-03-08T06:04:26.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.899+0000 7ff8fbe00640 1 Processor -- start 2024-03-08T06:04:26.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.899+0000 7ff8fbe00640 1 -- start start 2024-03-08T06:04:26.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.900+0000 7ff8fbe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8fc071c20 0x7ff8fc1374e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:26.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.900+0000 7ff8fbe00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff8fc145500 0x7ff8fc158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:26.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.900+0000 7ff8fbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8fc15bfb0 0x7ff8fc15aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:26.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.900+0000 7ff8fbe00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc06f370 con 0x7ff8fc15bfb0 2024-03-08T06:04:26.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.900+0000 7ff8fbe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc06f1f0 con 0x7ff8fc071c20 2024-03-08T06:04:26.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.900+0000 7ff8fbe00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8fc06d760 con 0x7ff8fc145500 2024-03-08T06:04:26.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.901+0000 7ff8fb400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8fc15bfb0 0x7ff8fc15aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:26.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.901+0000 7ff8fb400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8fc15bfb0 0x7ff8fc15aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35760/0 (socket says 172.21.15.19:35760) 2024-03-08T06:04:26.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.901+0000 7ff8fb400640 1 -- 172.21.15.19:0/1826149471 learned_addr learned my addr 172.21.15.19:0/1826149471 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:26.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.901+0000 7ff8faa00640 1 --2- 172.21.15.19:0/1826149471 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8fc071c20 0x7ff8fc1374e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:26.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.901+0000 7ff8f2000640 1 --2- 172.21.15.19:0/1826149471 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff8fc145500 0x7ff8fc158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:26.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.901+0000 7ff8fb400640 1 -- 172.21.15.19:0/1826149471 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff8fc145500 msgr2=0x7ff8fc158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:26.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.901+0000 7ff8fb400640 1 --2- 172.21.15.19:0/1826149471 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff8fc145500 0x7ff8fc158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.901+0000 7ff8fb400640 1 -- 172.21.15.19:0/1826149471 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8fc071c20 msgr2=0x7ff8fc1374e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:26.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.901+0000 7ff8fb400640 1 --2- 172.21.15.19:0/1826149471 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8fc071c20 0x7ff8fc1374e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:26.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.901+0000 7ff8fb400640 1 -- 172.21.15.19:0/1826149471 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc1f3c90 con 0x7ff8fc15bfb0 2024-03-08T06:04:26.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.902+0000 7ff8fb400640 1 --2- 172.21.15.19:0/1826149471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8fc15bfb0 0x7ff8fc15aef0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4007e60 tx=0x7ff8f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:26.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.902+0000 7ff8f3e00640 1 -- 172.21.15.19:0/1826149471 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4014620 con 0x7ff8fc15bfb0 2024-03-08T06:04:26.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.902+0000 7ff8f3e00640 1 -- 172.21.15.19:0/1826149471 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f4019070 con 0x7ff8fc15bfb0 2024-03-08T06:04:26.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.902+0000 7ff8f3e00640 1 -- 172.21.15.19:0/1826149471 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4014a20 con 0x7ff8fc15bfb0 2024-03-08T06:04:26.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.902+0000 7ff8fbe00640 1 -- 172.21.15.19:0/1826149471 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8fc1f3f70 con 0x7ff8fc15bfb0 2024-03-08T06:04:26.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.902+0000 7ff8fbe00640 1 -- 172.21.15.19:0/1826149471 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8fc1f4530 con 0x7ff8fc15bfb0 2024-03-08T06:04:26.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.903+0000 7ff8fbe00640 1 -- 172.21.15.19:0/1826149471 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8fc075090 con 0x7ff8fc15bfb0 2024-03-08T06:04:26.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.904+0000 7ff8f3e00640 1 -- 172.21.15.19:0/1826149471 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff8f4014bc0 con 0x7ff8fc15bfb0 2024-03-08T06:04:26.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.905+0000 7ff8f3e00640 1 --2- 172.21.15.19:0/1826149471 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff8d806b4d0 0x7ff8d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:26.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.905+0000 7ff8f3e00640 1 -- 172.21.15.19:0/1826149471 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff8f408a810 con 0x7ff8fc15bfb0 2024-03-08T06:04:26.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.906+0000 7ff8faa00640 1 --2- 172.21.15.19:0/1826149471 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff8d806b4d0 0x7ff8d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.906+0000 7ff8faa00640 1 --2- 172.21.15.19:0/1826149471 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff8d806b4d0 0x7ff8d806d990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec036000 tx=0x7ff8ec03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:26.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:26.911+0000 7ff8f3e00640 1 -- 172.21.15.19:0/1826149471 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff8f4059940 con 0x7ff8fc15bfb0 2024-03-08T06:04:27.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.112+0000 7ff8fbe00640 1 -- 172.21.15.19:0/1826149471 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff8fc071850 con 0x7ff8fc15bfb0 2024-03-08T06:04:27.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.113+0000 7ff8f3e00640 1 -- 172.21.15.19:0/1826149471 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff8f4059240 con 0x7ff8fc15bfb0 2024-03-08T06:04:27.114 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-08T06:04:27.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.115+0000 7ff8fbe00640 1 -- 172.21.15.19:0/1826149471 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff8d806b4d0 msgr2=0x7ff8d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:27.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.115+0000 7ff8fbe00640 1 --2- 172.21.15.19:0/1826149471 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff8d806b4d0 0x7ff8d806d990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec036000 tx=0x7ff8ec03d040 comp rx=0 tx=0).stop 2024-03-08T06:04:27.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.115+0000 7ff8fbe00640 1 -- 172.21.15.19:0/1826149471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8fc15bfb0 msgr2=0x7ff8fc15aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:27.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.115+0000 7ff8fbe00640 1 --2- 172.21.15.19:0/1826149471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8fc15bfb0 0x7ff8fc15aef0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4007e60 tx=0x7ff8f400e4b0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.115+0000 7ff8fbe00640 1 -- 172.21.15.19:0/1826149471 shutdown_connections 2024-03-08T06:04:27.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.115+0000 7ff8fbe00640 1 --2- 172.21.15.19:0/1826149471 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff8d806b4d0 0x7ff8d806d990 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.115+0000 7ff8fbe00640 1 --2- 172.21.15.19:0/1826149471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8fc15bfb0 0x7ff8fc15aef0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.115+0000 7ff8fbe00640 1 --2- 172.21.15.19:0/1826149471 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff8fc145500 0x7ff8fc158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.115+0000 7ff8fbe00640 1 --2- 172.21.15.19:0/1826149471 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8fc071c20 0x7ff8fc1374e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.115+0000 7ff8fbe00640 1 -- 172.21.15.19:0/1826149471 >> 172.21.15.19:0/1826149471 conn(0x7ff8fc0b1850 msgr2=0x7ff8fc0b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:27.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.116+0000 7ff8fbe00640 1 -- 172.21.15.19:0/1826149471 shutdown_connections 2024-03-08T06:04:27.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.116+0000 7ff8fbe00640 1 -- 172.21.15.19:0/1826149471 wait complete. 2024-03-08T06:04:27.135 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-08T06:04:27.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.349+0000 7fa772400640 1 Processor -- start 2024-03-08T06:04:27.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.350+0000 7fa772400640 1 -- start start 2024-03-08T06:04:27.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.351+0000 7fa772400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa76c0b6bd0 0x7fa76c0ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:27.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.351+0000 7fa772400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76c15e300 con 0x7fa76c0d11b0 2024-03-08T06:04:27.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.351+0000 7fa772400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76c0cf030 con 0x7fa76c15df20 2024-03-08T06:04:27.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.351+0000 7fa772400640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76c0d1bc0 con 0x7fa76c0b6bd0 2024-03-08T06:04:27.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.351+0000 7fa76be00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa76c0d11b0 0x7fa76c0d2980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37368/0 (socket says 172.21.15.19:37368) 2024-03-08T06:04:27.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.351+0000 7fa76be00640 1 -- 172.21.15.19:0/3177893332 learned_addr learned my addr 172.21.15.19:0/3177893332 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:27.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.352+0000 7fa771a00640 1 --2- 172.21.15.19:0/3177893332 >> v2:172.21.15.42:3300/0 conn(0x7fa76c0b6bd0 0x7fa76c0ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:27.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.352+0000 7fa76b400640 1 -- 172.21.15.19:0/3177893332 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492163096 0 0) 0x7fa76c15e300 con 0x7fa76c0d11b0 2024-03-08T06:04:27.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.352+0000 7fa76b400640 1 -- 172.21.15.19:0/3177893332 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa750003520 con 0x7fa76c0d11b0 2024-03-08T06:04:27.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.352+0000 7fa76b400640 1 -- 172.21.15.19:0/3177893332 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3473921604 0 0) 0x7fa750003520 con 0x7fa76c0d11b0 2024-03-08T06:04:27.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.352+0000 7fa76b400640 1 -- 172.21.15.19:0/3177893332 >> v2:172.21.15.42:3300/0 conn(0x7fa76c0b6bd0 msgr2=0x7fa76c0ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.352+0000 7fa76b400640 1 --2- 172.21.15.19:0/3177893332 >> v2:172.21.15.42:3300/0 conn(0x7fa76c0b6bd0 0x7fa76c0ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.352+0000 7fa76b400640 1 -- 172.21.15.19:0/3177893332 >> v1:172.21.15.42:6789/0 conn(0x7fa76c15df20 legacy=0x7fa76c0d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.352+0000 7fa76b400640 1 -- 172.21.15.19:0/3177893332 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c0d1ea0 con 0x7fa76c0d11b0 2024-03-08T06:04:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.352+0000 7fa76b400640 1 -- 172.21.15.19:0/3177893332 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7fa754001670 con 0x7fa76c0d11b0 2024-03-08T06:04:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.352+0000 7fa76b400640 1 -- 172.21.15.19:0/3177893332 >> v1:172.21.15.19:6789/0 conn(0x7fa76c0d11b0 legacy=0x7fa76c0d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.352+0000 7fa76b400640 1 --2- 172.21.15.19:0/3177893332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa750003a00 0x7fa750003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.352+0000 7fa76b400640 1 --2- 172.21.15.19:0/3177893332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa750004800 0x7fa750004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.352+0000 7fa76b400640 1 --2- 172.21.15.19:0/3177893332 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa7500051c0 0x7fa75000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.352+0000 7fa76b400640 1 -- 172.21.15.19:0/3177893332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0d1bc0 con 0x7fa750003a00 2024-03-08T06:04:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.352+0000 7fa76b400640 1 -- 172.21.15.19:0/3177893332 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75000c0a0 con 0x7fa750004800 2024-03-08T06:04:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.352+0000 7fa76b400640 1 -- 172.21.15.19:0/3177893332 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75000c2a0 con 0x7fa7500051c0 2024-03-08T06:04:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.353+0000 7fa771000640 1 --2- 172.21.15.19:0/3177893332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa750003a00 0x7fa750003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.353+0000 7fa76be00640 1 --2- 172.21.15.19:0/3177893332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa750004800 0x7fa750004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.353+0000 7fa771a00640 1 --2- 172.21.15.19:0/3177893332 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa7500051c0 0x7fa75000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.353+0000 7fa771000640 1 -- 172.21.15.19:0/3177893332 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa7500051c0 msgr2=0x7fa75000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:27.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.353+0000 7fa771000640 1 --2- 172.21.15.19:0/3177893332 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa7500051c0 0x7fa75000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.353+0000 7fa771000640 1 -- 172.21.15.19:0/3177893332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa750004800 msgr2=0x7fa750004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:27.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.353+0000 7fa771000640 1 --2- 172.21.15.19:0/3177893332 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa750004800 0x7fa750004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.353+0000 7fa771000640 1 -- 172.21.15.19:0/3177893332 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa750003520 con 0x7fa750003a00 2024-03-08T06:04:27.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.353+0000 7fa771a00640 1 --2- 172.21.15.19:0/3177893332 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa7500051c0 0x7fa75000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:27.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.353+0000 7fa771a00640 1 -- 172.21.15.19:0/3177893332 reap_dead start 2024-03-08T06:04:27.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.354+0000 7fa771000640 1 --2- 172.21.15.19:0/3177893332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa750003a00 0x7fa750003e20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa75c001750 tx=0x7fa750005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad52ed4e096a4186 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:27.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.355+0000 7fa76b400640 1 -- 172.21.15.19:0/3177893332 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c001370 con 0x7fa750003a00 2024-03-08T06:04:27.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.355+0000 7fa76b400640 1 -- 172.21.15.19:0/3177893332 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c0052d0 con 0x7fa750003a00 2024-03-08T06:04:27.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.355+0000 7fa76b400640 1 -- 172.21.15.19:0/3177893332 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c003830 con 0x7fa750003a00 2024-03-08T06:04:27.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.355+0000 7fa772400640 1 -- 172.21.15.19:0/3177893332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa750003a00 msgr2=0x7fa750003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:27.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.355+0000 7fa772400640 1 --2- 172.21.15.19:0/3177893332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa750003a00 0x7fa750003e20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa75c001750 tx=0x7fa750005830 comp rx=0 tx=0).stop 2024-03-08T06:04:27.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.355+0000 7fa772400640 1 -- 172.21.15.19:0/3177893332 shutdown_connections 2024-03-08T06:04:27.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.355+0000 7fa772400640 1 --2- 172.21.15.19:0/3177893332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa750003a00 0x7fa750003e20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.355+0000 7fa772400640 1 -- 172.21.15.19:0/3177893332 >> 172.21.15.19:0/3177893332 conn(0x7fa76c06c740 msgr2=0x7fa76c06cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:27.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.355+0000 7fa772400640 1 -- 172.21.15.19:0/3177893332 shutdown_connections 2024-03-08T06:04:27.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.355+0000 7fa772400640 1 -- 172.21.15.19:0/3177893332 wait complete. 2024-03-08T06:04:27.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.357+0000 7fa772400640 1 Processor -- start 2024-03-08T06:04:27.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.357+0000 7fa772400640 1 -- start start 2024-03-08T06:04:27.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.358+0000 7fa772400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa750003a00 0x7fa76c1e7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:27.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.358+0000 7fa772400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa76c153b60 0x7fa76c15f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:27.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.358+0000 7fa772400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa76c0c8ca0 0x7fa76c0c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:27.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.358+0000 7fa772400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0ce9e0 con 0x7fa76c0c8ca0 2024-03-08T06:04:27.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.358+0000 7fa772400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0d2460 con 0x7fa76c153b60 2024-03-08T06:04:27.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.358+0000 7fa772400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c0ceb60 con 0x7fa750003a00 2024-03-08T06:04:27.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.359+0000 7fa771a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa76c0c8ca0 0x7fa76c0c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:27.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.359+0000 7fa771a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa76c0c8ca0 0x7fa76c0c9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35772/0 (socket says 172.21.15.19:35772) 2024-03-08T06:04:27.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.359+0000 7fa771a00640 1 -- 172.21.15.19:0/2109827790 learned_addr learned my addr 172.21.15.19:0/2109827790 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:27.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.359+0000 7fa76be00640 1 --2- 172.21.15.19:0/2109827790 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa76c153b60 0x7fa76c15f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:27.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.359+0000 7fa771000640 1 --2- 172.21.15.19:0/2109827790 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa750003a00 0x7fa76c1e7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:27.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.359+0000 7fa771a00640 1 -- 172.21.15.19:0/2109827790 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa750003a00 msgr2=0x7fa76c1e7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:27.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.359+0000 7fa771a00640 1 --2- 172.21.15.19:0/2109827790 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa750003a00 0x7fa76c1e7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.359+0000 7fa771a00640 1 -- 172.21.15.19:0/2109827790 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa76c153b60 msgr2=0x7fa76c15f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:27.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.359+0000 7fa771a00640 1 --2- 172.21.15.19:0/2109827790 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa76c153b60 0x7fa76c15f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.359+0000 7fa771a00640 1 -- 172.21.15.19:0/2109827790 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c153fe0 con 0x7fa76c0c8ca0 2024-03-08T06:04:27.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.360+0000 7fa771a00640 1 --2- 172.21.15.19:0/2109827790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa76c0c8ca0 0x7fa76c0c9120 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0b7040 tx=0x7fa76400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.360+0000 7fa768c00640 1 -- 172.21.15.19:0/2109827790 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa764016420 con 0x7fa76c0c8ca0 2024-03-08T06:04:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.360+0000 7fa768c00640 1 -- 172.21.15.19:0/2109827790 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76401b070 con 0x7fa76c0c8ca0 2024-03-08T06:04:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.360+0000 7fa768c00640 1 -- 172.21.15.19:0/2109827790 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa764016820 con 0x7fa76c0c8ca0 2024-03-08T06:04:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.360+0000 7fa772400640 1 -- 172.21.15.19:0/2109827790 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76c1e7bf0 con 0x7fa76c0c8ca0 2024-03-08T06:04:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.360+0000 7fa772400640 1 -- 172.21.15.19:0/2109827790 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76c1e81b0 con 0x7fa76c0c8ca0 2024-03-08T06:04:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.361+0000 7fa772400640 1 -- 172.21.15.19:0/2109827790 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76c075100 con 0x7fa76c0c8ca0 2024-03-08T06:04:27.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.362+0000 7fa768c00640 1 -- 172.21.15.19:0/2109827790 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa764005d10 con 0x7fa76c0c8ca0 2024-03-08T06:04:27.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.363+0000 7fa768c00640 1 --2- 172.21.15.19:0/2109827790 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa74806b4d0 0x7fa74806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:27.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.363+0000 7fa768c00640 1 -- 172.21.15.19:0/2109827790 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa76408aa00 con 0x7fa76c0c8ca0 2024-03-08T06:04:27.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.364+0000 7fa771000640 1 --2- 172.21.15.19:0/2109827790 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa74806b4d0 0x7fa74806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:27.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.364+0000 7fa771000640 1 --2- 172.21.15.19:0/2109827790 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa74806b4d0 0x7fa74806d990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa75c033000 tx=0x7fa75c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:27.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.368+0000 7fa768c00640 1 -- 172.21.15.19:0/2109827790 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa764025020 con 0x7fa76c0c8ca0 2024-03-08T06:04:27.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.568+0000 7fa772400640 1 -- 172.21.15.19:0/2109827790 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa76c0d16e0 con 0x7fa76c0c8ca0 2024-03-08T06:04:27.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.568+0000 7fa768c00640 1 -- 172.21.15.19:0/2109827790 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa764059b30 con 0x7fa76c0c8ca0 2024-03-08T06:04:27.569 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:27.569 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-03-08T06:04:27.569 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:27.570 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2024-03-08T06:04:27.570 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2024-03-08T06:04:27.570 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:27.570 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-03-08T06:04:27.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.571+0000 7fa772400640 1 -- 172.21.15.19:0/2109827790 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa74806b4d0 msgr2=0x7fa74806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:27.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.571+0000 7fa772400640 1 --2- 172.21.15.19:0/2109827790 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa74806b4d0 0x7fa74806d990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa75c033000 tx=0x7fa75c009030 comp rx=0 tx=0).stop 2024-03-08T06:04:27.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.571+0000 7fa772400640 1 -- 172.21.15.19:0/2109827790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa76c0c8ca0 msgr2=0x7fa76c0c9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:27.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.571+0000 7fa772400640 1 --2- 172.21.15.19:0/2109827790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa76c0c8ca0 0x7fa76c0c9120 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0b7040 tx=0x7fa76400f520 comp rx=0 tx=0).stop 2024-03-08T06:04:27.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.571+0000 7fa772400640 1 -- 172.21.15.19:0/2109827790 shutdown_connections 2024-03-08T06:04:27.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.571+0000 7fa772400640 1 --2- 172.21.15.19:0/2109827790 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa74806b4d0 0x7fa74806d990 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.571+0000 7fa772400640 1 --2- 172.21.15.19:0/2109827790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa76c0c8ca0 0x7fa76c0c9120 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.571+0000 7fa772400640 1 --2- 172.21.15.19:0/2109827790 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa76c153b60 0x7fa76c15f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.571+0000 7fa772400640 1 --2- 172.21.15.19:0/2109827790 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa750003a00 0x7fa76c1e7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.571+0000 7fa772400640 1 -- 172.21.15.19:0/2109827790 >> 172.21.15.19:0/2109827790 conn(0x7fa76c06c740 msgr2=0x7fa76c0b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:27.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.571+0000 7fa772400640 1 -- 172.21.15.19:0/2109827790 shutdown_connections 2024-03-08T06:04:27.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.571+0000 7fa772400640 1 -- 172.21.15.19:0/2109827790 wait complete. 2024-03-08T06:04:27.590 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-08T06:04:27.591 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-08T06:04:27.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.821+0000 7f0464600640 1 Processor -- start 2024-03-08T06:04:27.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.821+0000 7f0464600640 1 -- start start 2024-03-08T06:04:27.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.823+0000 7f0464600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f045c071cf0 0x7f045c15afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:27.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.823+0000 7f0464600640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f045c06f7d0 0x7f045c06d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:27.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.823+0000 7f0464600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f045c0720d0 0x7f045c1430f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:27.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.823+0000 7f0464600640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045c0b3280 con 0x7f045c06f7d0 2024-03-08T06:04:27.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.823+0000 7f0464600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f045c06dcc0 con 0x7f045c0720d0 2024-03-08T06:04:27.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.823+0000 7f0464600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045c06df40 con 0x7f045c071cf0 2024-03-08T06:04:27.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.823+0000 7f0461200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f045c06f7d0 0x7f045c06d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:27.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.823+0000 7f0461200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f045c06f7d0 0x7f045c06d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35784/0 (socket says 172.21.15.19:35784) 2024-03-08T06:04:27.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.823+0000 7f0461200640 1 -- 172.21.15.19:0/356679439 learned_addr learned my addr 172.21.15.19:0/356679439 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:27.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.824+0000 7f0461c00640 1 --2- 172.21.15.19:0/356679439 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f045c071cf0 0x7f045c15afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:27.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.824+0000 7f0461200640 1 -- 172.21.15.19:0/356679439 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f045c071cf0 msgr2=0x7f045c15afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:27.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.824+0000 7f0461200640 1 --2- 172.21.15.19:0/356679439 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f045c071cf0 0x7f045c15afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.824+0000 7f0461200640 1 -- 172.21.15.19:0/356679439 >> v2:172.21.15.42:3300/0 conn(0x7f045c0720d0 msgr2=0x7f045c1430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:27.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.824+0000 7f0462600640 1 --2- 172.21.15.19:0/356679439 >> v2:172.21.15.42:3300/0 conn(0x7f045c0720d0 0x7f045c1430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:27.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.824+0000 7f0461200640 1 --2- 172.21.15.19:0/356679439 >> v2:172.21.15.42:3300/0 conn(0x7f045c0720d0 0x7f045c1430f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.824+0000 7f0461200640 1 -- 172.21.15.19:0/356679439 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c06e220 con 0x7f045c06f7d0 2024-03-08T06:04:27.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.824+0000 7f0462600640 1 --2- 172.21.15.19:0/356679439 >> v2:172.21.15.42:3300/0 conn(0x7f045c0720d0 0x7f045c1430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:27.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.825+0000 7f0461200640 1 --2- 172.21.15.19:0/356679439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f045c06f7d0 0x7f045c06d780 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f045c06eac0 tx=0x7f044802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd8328d56607b80 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:27.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.826+0000 7f045be00640 1 -- 172.21.15.19:0/356679439 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448035020 con 0x7f045c06f7d0 2024-03-08T06:04:27.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.826+0000 7f045be00640 1 -- 172.21.15.19:0/356679439 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0448031870 con 0x7f045c06f7d0 2024-03-08T06:04:27.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.826+0000 7f045be00640 1 -- 172.21.15.19:0/356679439 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448031c40 con 0x7f045c06f7d0 2024-03-08T06:04:27.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.826+0000 7f0464600640 1 -- 172.21.15.19:0/356679439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f045c06f7d0 msgr2=0x7f045c06d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:27.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.826+0000 7f0464600640 1 --2- 172.21.15.19:0/356679439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f045c06f7d0 0x7f045c06d780 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f045c06eac0 tx=0x7f044802b910 comp rx=0 tx=0).stop 2024-03-08T06:04:27.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.826+0000 7f0464600640 1 -- 172.21.15.19:0/356679439 shutdown_connections 2024-03-08T06:04:27.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.826+0000 7f0464600640 1 --2- 172.21.15.19:0/356679439 >> v2:172.21.15.42:3300/0 conn(0x7f045c0720d0 0x7f045c1430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.826+0000 7f0464600640 1 --2- 172.21.15.19:0/356679439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f045c06f7d0 0x7f045c06d780 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.826+0000 7f0464600640 1 --2- 172.21.15.19:0/356679439 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f045c071cf0 0x7f045c15afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.827+0000 7f0464600640 1 -- 172.21.15.19:0/356679439 >> 172.21.15.19:0/356679439 conn(0x7f045c06ae30 msgr2=0x7f045c06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:27.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.827+0000 7f0464600640 1 -- 172.21.15.19:0/356679439 shutdown_connections 2024-03-08T06:04:27.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.827+0000 7f0464600640 1 -- 172.21.15.19:0/356679439 wait complete. 2024-03-08T06:04:27.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.828+0000 7f0464600640 1 Processor -- start 2024-03-08T06:04:27.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.829+0000 7f0464600640 1 -- start start 2024-03-08T06:04:27.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.830+0000 7f0464600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f045c06f7d0 0x7f045c1542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:27.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.830+0000 7f0464600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f045c071cf0 0x7f045c1e4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:27.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.830+0000 7f0464600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f045c0720d0 0x7f045c1e5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:27.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.830+0000 7f0464600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c0ce3c0 con 0x7f045c071cf0 2024-03-08T06:04:27.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.830+0000 7f0464600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045c06e7e0 con 0x7f045c06f7d0 2024-03-08T06:04:27.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.830+0000 7f0464600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045c0ce540 con 0x7f045c0720d0 2024-03-08T06:04:27.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.830+0000 7f0461200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f045c071cf0 0x7f045c1e4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:27.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.830+0000 7f0461200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f045c071cf0 0x7f045c1e4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35788/0 (socket says 172.21.15.19:35788) 2024-03-08T06:04:27.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.830+0000 7f0461200640 1 -- 172.21.15.19:0/1819915491 learned_addr learned my addr 172.21.15.19:0/1819915491 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:27.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.830+0000 7f0461200640 1 -- 172.21.15.19:0/1819915491 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f045c0720d0 msgr2=0x7f045c1e5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:27.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.830+0000 7f0461200640 1 --2- 172.21.15.19:0/1819915491 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f045c0720d0 0x7f045c1e5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.830+0000 7f0461200640 1 -- 172.21.15.19:0/1819915491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f045c06f7d0 msgr2=0x7f045c1542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:27.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.830+0000 7f0461200640 1 --2- 172.21.15.19:0/1819915491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f045c06f7d0 0x7f045c1542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:27.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.830+0000 7f0461200640 1 -- 172.21.15.19:0/1819915491 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045c0ad420 con 0x7f045c071cf0 2024-03-08T06:04:27.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.831+0000 7f0461200640 1 --2- 172.21.15.19:0/1819915491 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f045c071cf0 0x7f045c1e4c20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f044802b950 tx=0x7f04480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:27.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.831+0000 7f0459600640 1 -- 172.21.15.19:0/1819915491 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448040070 con 0x7f045c071cf0 2024-03-08T06:04:27.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.831+0000 7f0459600640 1 -- 172.21.15.19:0/1819915491 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0448030d00 con 0x7f045c071cf0 2024-03-08T06:04:27.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.831+0000 7f0464600640 1 -- 172.21.15.19:0/1819915491 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045c0ad700 con 0x7f045c071cf0 2024-03-08T06:04:27.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.831+0000 7f0459600640 1 -- 172.21.15.19:0/1819915491 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448035040 con 0x7f045c071cf0 2024-03-08T06:04:27.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.831+0000 7f0464600640 1 -- 172.21.15.19:0/1819915491 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045c0adcc0 con 0x7f045c071cf0 2024-03-08T06:04:27.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.833+0000 7f0464600640 1 -- 172.21.15.19:0/1819915491 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045c067cb0 con 0x7f045c071cf0 2024-03-08T06:04:27.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.834+0000 7f0459600640 1 -- 172.21.15.19:0/1819915491 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f0448038020 con 0x7f045c071cf0 2024-03-08T06:04:27.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.834+0000 7f0459600640 1 --2- 172.21.15.19:0/1819915491 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f043c06b4d0 0x7f043c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:27.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.835+0000 7f0459600640 1 -- 172.21.15.19:0/1819915491 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f04480abd40 con 0x7f045c071cf0 2024-03-08T06:04:27.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.835+0000 7f0461c00640 1 --2- 172.21.15.19:0/1819915491 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f043c06b4d0 0x7f043c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:27.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.835+0000 7f0461c00640 1 --2- 172.21.15.19:0/1819915491 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f043c06b4d0 0x7f043c06d990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f045000b7f0 tx=0x7f0450008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:27.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:27.839+0000 7f0459600640 1 -- 172.21.15.19:0/1819915491 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f044807ae80 con 0x7f045c071cf0 2024-03-08T06:04:28.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.039+0000 7f0464600640 1 -- 172.21.15.19:0/1819915491 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f045c159e60 con 0x7f045c071cf0 2024-03-08T06:04:28.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.642+0000 7f0459600640 1 -- 172.21.15.19:0/1819915491 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f044807a780 con 0x7f045c071cf0 2024-03-08T06:04:28.644 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2024-03-08T06:04:28.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.647+0000 7f0464600640 1 -- 172.21.15.19:0/1819915491 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f043c06b4d0 msgr2=0x7f043c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:28.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.647+0000 7f0464600640 1 --2- 172.21.15.19:0/1819915491 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f043c06b4d0 0x7f043c06d990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f045000b7f0 tx=0x7f0450008040 comp rx=0 tx=0).stop 2024-03-08T06:04:28.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.647+0000 7f0464600640 1 -- 172.21.15.19:0/1819915491 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f045c071cf0 msgr2=0x7f045c1e4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:28.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.647+0000 7f0464600640 1 --2- 172.21.15.19:0/1819915491 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f045c071cf0 0x7f045c1e4c20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f044802b950 tx=0x7f04480046c0 comp rx=0 tx=0).stop 2024-03-08T06:04:28.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.647+0000 7f0464600640 1 -- 172.21.15.19:0/1819915491 shutdown_connections 2024-03-08T06:04:28.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.647+0000 7f0464600640 1 --2- 172.21.15.19:0/1819915491 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f043c06b4d0 0x7f043c06d990 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:28.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.647+0000 7f0464600640 1 --2- 172.21.15.19:0/1819915491 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f045c0720d0 0x7f045c1e5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:28.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.647+0000 7f0464600640 1 --2- 172.21.15.19:0/1819915491 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f045c071cf0 0x7f045c1e4c20 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:28.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.647+0000 7f0464600640 1 --2- 172.21.15.19:0/1819915491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f045c06f7d0 0x7f045c1542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:28.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.647+0000 7f0464600640 1 -- 172.21.15.19:0/1819915491 >> 172.21.15.19:0/1819915491 conn(0x7f045c06ae30 msgr2=0x7f045c15ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:28.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.648+0000 7f0464600640 1 -- 172.21.15.19:0/1819915491 shutdown_connections 2024-03-08T06:04:28.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.648+0000 7f0464600640 1 -- 172.21.15.19:0/1819915491 wait complete. 2024-03-08T06:04:28.675 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-08T06:04:28.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.896+0000 7efd1a800640 1 Processor -- start 2024-03-08T06:04:28.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.896+0000 7efd1a800640 1 -- start start 2024-03-08T06:04:28.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.897+0000 7efd1a800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efd140b97d0 0x7efd140ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:28.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.897+0000 7efd1a800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd14162520 con 0x7efd1415de50 2024-03-08T06:04:28.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.897+0000 7efd1a800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd14162800 con 0x7efd1415e230 2024-03-08T06:04:28.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.897+0000 7efd1a800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd141622e0 con 0x7efd140b97d0 2024-03-08T06:04:28.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.898+0000 7efd13400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7efd1415de50 0x7efd14161bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37382/0 (socket says 172.21.15.19:37382) 2024-03-08T06:04:28.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.898+0000 7efd13400640 1 -- 172.21.15.19:0/862546446 learned_addr learned my addr 172.21.15.19:0/862546446 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:28.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.898+0000 7efd12a00640 1 --2- 172.21.15.19:0/862546446 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efd140b97d0 0x7efd140ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:28.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.898+0000 7efd12000640 1 -- 172.21.15.19:0/862546446 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884794725 0 0) 0x7efd14162520 con 0x7efd1415de50 2024-03-08T06:04:28.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.898+0000 7efd12000640 1 -- 172.21.15.19:0/862546446 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcf8003520 con 0x7efd1415de50 2024-03-08T06:04:28.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.899+0000 7efd12000640 1 -- 172.21.15.19:0/862546446 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 45757604 0 0) 0x7efcf8003520 con 0x7efd1415de50 2024-03-08T06:04:28.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.899+0000 7efd12000640 1 -- 172.21.15.19:0/862546446 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efd140b97d0 msgr2=0x7efd140ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:28.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.899+0000 7efd12000640 1 --2- 172.21.15.19:0/862546446 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efd140b97d0 0x7efd140ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:28.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.899+0000 7efd12000640 1 -- 172.21.15.19:0/862546446 >> v1:172.21.15.42:6789/0 conn(0x7efd1415e230 legacy=0x7efd140d27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:28.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.899+0000 7efd12000640 1 -- 172.21.15.19:0/862546446 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd140d1ff0 con 0x7efd1415de50 2024-03-08T06:04:28.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.899+0000 7efd12000640 1 -- 172.21.15.19:0/862546446 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7efd040019f0 con 0x7efd1415de50 2024-03-08T06:04:28.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.899+0000 7efd12000640 1 -- 172.21.15.19:0/862546446 >> v1:172.21.15.19:6789/0 conn(0x7efd1415de50 legacy=0x7efd14161bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:28.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.899+0000 7efd12000640 1 --2- 172.21.15.19:0/862546446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcf80039e0 0x7efcf8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:28.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.899+0000 7efd12000640 1 --2- 172.21.15.19:0/862546446 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efd140b97d0 0x7efcf8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:28.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.899+0000 7efd12000640 1 --2- 172.21.15.19:0/862546446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcf8004d40 0x7efcf80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:28.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.899+0000 7efd12000640 1 -- 172.21.15.19:0/862546446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd141622e0 con 0x7efcf80039e0 2024-03-08T06:04:28.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.899+0000 7efd12000640 1 -- 172.21.15.19:0/862546446 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf800baa0 con 0x7efcf8004d40 2024-03-08T06:04:28.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.899+0000 7efd12000640 1 -- 172.21.15.19:0/862546446 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf800bca0 con 0x7efd140b97d0 2024-03-08T06:04:28.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.899+0000 7efd13400640 1 --2- 172.21.15.19:0/862546446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcf80039e0 0x7efcf8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:28.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.900+0000 7efd13400640 1 -- 172.21.15.19:0/862546446 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efd140b97d0 msgr2=0x7efcf8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:28.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.900+0000 7efd13400640 1 --2- 172.21.15.19:0/862546446 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efd140b97d0 0x7efcf8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:28.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.900+0000 7efd13400640 1 -- 172.21.15.19:0/862546446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcf8004d40 msgr2=0x7efcf80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:28.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.900+0000 7efd13400640 1 --2- 172.21.15.19:0/862546446 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcf8004d40 0x7efcf80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:28.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.900+0000 7efd13400640 1 -- 172.21.15.19:0/862546446 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf8003520 con 0x7efcf80039e0 2024-03-08T06:04:28.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.901+0000 7efd13400640 1 --2- 172.21.15.19:0/862546446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcf80039e0 0x7efcf8003e00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efd0400a760 tx=0x7efcf8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45226c911982e26d server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:28.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.901+0000 7efd12000640 1 -- 172.21.15.19:0/862546446 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0400a3b0 con 0x7efcf80039e0 2024-03-08T06:04:28.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.901+0000 7efd12000640 1 -- 172.21.15.19:0/862546446 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd04034650 con 0x7efcf80039e0 2024-03-08T06:04:28.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.901+0000 7efd12000640 1 -- 172.21.15.19:0/862546446 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd04034a40 con 0x7efcf80039e0 2024-03-08T06:04:28.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.902+0000 7efd1a800640 1 -- 172.21.15.19:0/862546446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcf80039e0 msgr2=0x7efcf8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:28.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.902+0000 7efd1a800640 1 --2- 172.21.15.19:0/862546446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcf80039e0 0x7efcf8003e00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efd0400a760 tx=0x7efcf8005830 comp rx=0 tx=0).stop 2024-03-08T06:04:28.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.902+0000 7efd13e00640 1 -- 172.21.15.19:0/862546446 reap_dead start 2024-03-08T06:04:28.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.902+0000 7efd1a800640 1 -- 172.21.15.19:0/862546446 shutdown_connections 2024-03-08T06:04:28.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.902+0000 7efd1a800640 1 -- 172.21.15.19:0/862546446 >> 172.21.15.19:0/862546446 conn(0x7efd1406c490 msgr2=0x7efd1406c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:28.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.902+0000 7efd1a800640 1 -- 172.21.15.19:0/862546446 shutdown_connections 2024-03-08T06:04:28.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.902+0000 7efd1a800640 1 -- 172.21.15.19:0/862546446 wait complete. 2024-03-08T06:04:28.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.904+0000 7efd1a800640 1 Processor -- start 2024-03-08T06:04:28.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.904+0000 7efd1a800640 1 -- start start 2024-03-08T06:04:28.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.905+0000 7efd1a800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcf80039e0 0x7efd140ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:28.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.905+0000 7efd1a800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd141598f0 0x7efd141499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:28.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.905+0000 7efd1a800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efd141579e0 0x7efd14157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:28.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.905+0000 7efd1a800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd140cef40 con 0x7efd141598f0 2024-03-08T06:04:28.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.905+0000 7efd1a800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd140cedc0 con 0x7efcf80039e0 2024-03-08T06:04:28.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.905+0000 7efd1a800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd140cf0c0 con 0x7efd141579e0 2024-03-08T06:04:28.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.905+0000 7efd12a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd141598f0 0x7efd141499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:28.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.906+0000 7efd12a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd141598f0 0x7efd141499e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35806/0 (socket says 172.21.15.19:35806) 2024-03-08T06:04:28.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.906+0000 7efd12a00640 1 -- 172.21.15.19:0/235300483 learned_addr learned my addr 172.21.15.19:0/235300483 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:28.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.906+0000 7efd13e00640 1 --2- 172.21.15.19:0/235300483 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efd141579e0 0x7efd14157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:28.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.906+0000 7efd13400640 1 --2- 172.21.15.19:0/235300483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcf80039e0 0x7efd140ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:28.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.906+0000 7efd12a00640 1 -- 172.21.15.19:0/235300483 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efd141579e0 msgr2=0x7efd14157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:28.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.906+0000 7efd12a00640 1 --2- 172.21.15.19:0/235300483 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efd141579e0 0x7efd14157e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:28.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.906+0000 7efd12a00640 1 -- 172.21.15.19:0/235300483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcf80039e0 msgr2=0x7efd140ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:28.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.906+0000 7efd12a00640 1 --2- 172.21.15.19:0/235300483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcf80039e0 0x7efd140ca2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:28.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.906+0000 7efd12a00640 1 -- 172.21.15.19:0/235300483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1415a080 con 0x7efd141598f0 2024-03-08T06:04:28.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.906+0000 7efd12a00640 1 --2- 172.21.15.19:0/235300483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd141598f0 0x7efd141499e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00e7f0 tx=0x7efcfc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:28.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.907+0000 7efd0b400640 1 -- 172.21.15.19:0/235300483 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc017070 con 0x7efd141598f0 2024-03-08T06:04:28.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.907+0000 7efd0b400640 1 -- 172.21.15.19:0/235300483 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc00c8e0 con 0x7efd141598f0 2024-03-08T06:04:28.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.907+0000 7efd0b400640 1 -- 172.21.15.19:0/235300483 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc00eea0 con 0x7efd141598f0 2024-03-08T06:04:28.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.907+0000 7efd1a800640 1 -- 172.21.15.19:0/235300483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd1415a360 con 0x7efd141598f0 2024-03-08T06:04:28.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.907+0000 7efd1a800640 1 -- 172.21.15.19:0/235300483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd1415a920 con 0x7efd141598f0 2024-03-08T06:04:28.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.908+0000 7efd1a800640 1 -- 172.21.15.19:0/235300483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd1415ad00 con 0x7efd141598f0 2024-03-08T06:04:28.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.909+0000 7efd0b400640 1 -- 172.21.15.19:0/235300483 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efcfc01a070 con 0x7efd141598f0 2024-03-08T06:04:28.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.910+0000 7efd0b400640 1 --2- 172.21.15.19:0/235300483 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efcf006b4d0 0x7efcf006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:28.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.910+0000 7efd0b400640 1 -- 172.21.15.19:0/235300483 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7efcfc08a050 con 0x7efd141598f0 2024-03-08T06:04:28.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.910+0000 7efd13400640 1 --2- 172.21.15.19:0/235300483 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efcf006b4d0 0x7efcf006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:28.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.911+0000 7efd13400640 1 --2- 172.21.15.19:0/235300483 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efcf006b4d0 0x7efcf006d990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efd04034000 tx=0x7efd0402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:28.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:28.915+0000 7efd0b400640 1 -- 172.21.15.19:0/235300483 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efd1415ad00 con 0x7efd141598f0 2024-03-08T06:04:29.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.123+0000 7efd1a800640 1 -- 172.21.15.19:0/235300483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efd14067cb0 con 0x7efd141598f0 2024-03-08T06:04:29.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.660+0000 7efd0b400640 1 -- 172.21.15.19:0/235300483 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7efcfc059140 con 0x7efd141598f0 2024-03-08T06:04:29.661 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2024-03-08T06:04:29.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.663+0000 7efd1a800640 1 -- 172.21.15.19:0/235300483 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efcf006b4d0 msgr2=0x7efcf006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:29.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.663+0000 7efd1a800640 1 --2- 172.21.15.19:0/235300483 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efcf006b4d0 0x7efcf006d990 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efd04034000 tx=0x7efd0402f000 comp rx=0 tx=0).stop 2024-03-08T06:04:29.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.663+0000 7efd1a800640 1 -- 172.21.15.19:0/235300483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd141598f0 msgr2=0x7efd141499e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:29.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.663+0000 7efd1a800640 1 --2- 172.21.15.19:0/235300483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd141598f0 0x7efd141499e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00e7f0 tx=0x7efcfc00ecb0 comp rx=0 tx=0).stop 2024-03-08T06:04:29.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.663+0000 7efd1a800640 1 -- 172.21.15.19:0/235300483 shutdown_connections 2024-03-08T06:04:29.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.663+0000 7efd1a800640 1 --2- 172.21.15.19:0/235300483 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efcf006b4d0 0x7efcf006d990 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:29.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.663+0000 7efd1a800640 1 --2- 172.21.15.19:0/235300483 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efd141579e0 0x7efd14157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:29.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.663+0000 7efd1a800640 1 --2- 172.21.15.19:0/235300483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd141598f0 0x7efd141499e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:29.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.663+0000 7efd1a800640 1 --2- 172.21.15.19:0/235300483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efcf80039e0 0x7efd140ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:29.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.663+0000 7efd1a800640 1 -- 172.21.15.19:0/235300483 >> 172.21.15.19:0/235300483 conn(0x7efd1406c490 msgr2=0x7efd140d27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:29.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.664+0000 7efd1a800640 1 -- 172.21.15.19:0/235300483 shutdown_connections 2024-03-08T06:04:29.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.666+0000 7efd1a800640 1 -- 172.21.15.19:0/235300483 wait complete. 2024-03-08T06:04:29.704 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-08T06:04:29.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.890+0000 7efe10c00640 1 Processor -- start 2024-03-08T06:04:29.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.891+0000 7efe10c00640 1 -- start start 2024-03-08T06:04:29.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.892+0000 7efe10c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efe0c1584a0 0x7efe0c071950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:29.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.892+0000 7efe10c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efe0c15ed20 0x7efe0c0ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:29.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.892+0000 7efe10c00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0c15f390 con 0x7efe0c071e90 2024-03-08T06:04:29.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.892+0000 7efe10c00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0c15f140 con 0x7efe0c15ed20 2024-03-08T06:04:29.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.892+0000 7efe10c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c06d820 con 0x7efe0c1584a0 2024-03-08T06:04:29.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.893+0000 7efe0a800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efe0c15ed20 0x7efe0c0ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:29.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.893+0000 7efe0a800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efe0c15ed20 0x7efe0c0ae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35816/0 (socket says 172.21.15.19:35816) 2024-03-08T06:04:29.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.893+0000 7efe0a800640 1 -- 172.21.15.19:0/3028537196 learned_addr learned my addr 172.21.15.19:0/3028537196 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:29.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.893+0000 7efe09e00640 1 --2- 172.21.15.19:0/3028537196 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efe0c1584a0 0x7efe0c071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:29.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.893+0000 7efe0a800640 1 -- 172.21.15.19:0/3028537196 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efe0c1584a0 msgr2=0x7efe0c071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:29.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.893+0000 7efe0a800640 1 --2- 172.21.15.19:0/3028537196 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efe0c1584a0 0x7efe0c071950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:29.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.893+0000 7efe0a800640 1 -- 172.21.15.19:0/3028537196 >> v1:172.21.15.19:6789/0 conn(0x7efe0c071e90 legacy=0x7efe0c15e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:29.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.893+0000 7efe0a800640 1 -- 172.21.15.19:0/3028537196 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c06db00 con 0x7efe0c15ed20 2024-03-08T06:04:29.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.894+0000 7efe0a800640 1 --2- 172.21.15.19:0/3028537196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe0c15ed20 0x7efe0c0ae1d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7efe04009e50 tx=0x7efe0402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d497da6d2c8502 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:29.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.895+0000 7efe09400640 1 -- 172.21.15.19:0/3028537196 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0402ca80 con 0x7efe0c15ed20 2024-03-08T06:04:29.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.895+0000 7efe09400640 1 -- 172.21.15.19:0/3028537196 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0402cc20 con 0x7efe0c15ed20 2024-03-08T06:04:29.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.895+0000 7efe09400640 1 -- 172.21.15.19:0/3028537196 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe040343f0 con 0x7efe0c15ed20 2024-03-08T06:04:29.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.895+0000 7efe10c00640 1 -- 172.21.15.19:0/3028537196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe0c15ed20 msgr2=0x7efe0c0ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:29.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.895+0000 7efe10c00640 1 --2- 172.21.15.19:0/3028537196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe0c15ed20 0x7efe0c0ae1d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7efe04009e50 tx=0x7efe0402bee0 comp rx=0 tx=0).stop 2024-03-08T06:04:29.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.896+0000 7efe10c00640 1 -- 172.21.15.19:0/3028537196 shutdown_connections 2024-03-08T06:04:29.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.896+0000 7efe10c00640 1 --2- 172.21.15.19:0/3028537196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe0c15ed20 0x7efe0c0ae1d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:29.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.896+0000 7efe10c00640 1 --2- 172.21.15.19:0/3028537196 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efe0c1584a0 0x7efe0c071950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:29.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.896+0000 7efe10c00640 1 -- 172.21.15.19:0/3028537196 >> 172.21.15.19:0/3028537196 conn(0x7efe0c06ae30 msgr2=0x7efe0c06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:29.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.896+0000 7efe10c00640 1 -- 172.21.15.19:0/3028537196 shutdown_connections 2024-03-08T06:04:29.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.896+0000 7efe10c00640 1 -- 172.21.15.19:0/3028537196 wait complete. 2024-03-08T06:04:29.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.897+0000 7efe10c00640 1 Processor -- start 2024-03-08T06:04:29.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.898+0000 7efe10c00640 1 -- start start 2024-03-08T06:04:29.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.898+0000 7efe10c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe0c071e90 0x7efe0c13f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:29.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.898+0000 7efe10c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efe0c1584a0 0x7efe0c141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:29.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.899+0000 7efe10c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe0c15ed20 0x7efe0c0b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:29.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.899+0000 7efe10c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c06e5e0 con 0x7efe0c071e90 2024-03-08T06:04:29.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.899+0000 7efe10c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c158880 con 0x7efe0c15ed20 2024-03-08T06:04:29.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.899+0000 7efe10c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c140f40 con 0x7efe0c1584a0 2024-03-08T06:04:29.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.899+0000 7efe09e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe0c071e90 0x7efe0c13f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:29.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.899+0000 7efe09e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe0c071e90 0x7efe0c13f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35822/0 (socket says 172.21.15.19:35822) 2024-03-08T06:04:29.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.899+0000 7efe09e00640 1 -- 172.21.15.19:0/921576863 learned_addr learned my addr 172.21.15.19:0/921576863 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:29.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.899+0000 7efe09e00640 1 -- 172.21.15.19:0/921576863 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efe0c1584a0 msgr2=0x7efe0c141d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:29.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.899+0000 7efe09e00640 1 --2- 172.21.15.19:0/921576863 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efe0c1584a0 0x7efe0c141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:29.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.899+0000 7efe09e00640 1 -- 172.21.15.19:0/921576863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe0c15ed20 msgr2=0x7efe0c0b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:29.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.899+0000 7efe09e00640 1 --2- 172.21.15.19:0/921576863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe0c15ed20 0x7efe0c0b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:29.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.899+0000 7efe09e00640 1 -- 172.21.15.19:0/921576863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c140c60 con 0x7efe0c071e90 2024-03-08T06:04:29.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.900+0000 7efe09e00640 1 --2- 172.21.15.19:0/921576863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe0c071e90 0x7efe0c13f700 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00d830 tx=0x7efdfc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:29.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.900+0000 7efe02a00640 1 -- 172.21.15.19:0/921576863 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc00b6c0 con 0x7efe0c071e90 2024-03-08T06:04:29.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.900+0000 7efe02a00640 1 -- 172.21.15.19:0/921576863 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc019070 con 0x7efe0c071e90 2024-03-08T06:04:29.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.900+0000 7efe02a00640 1 -- 172.21.15.19:0/921576863 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc00ba80 con 0x7efe0c071e90 2024-03-08T06:04:29.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.900+0000 7efe10c00640 1 -- 172.21.15.19:0/921576863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0c0b2380 con 0x7efe0c071e90 2024-03-08T06:04:29.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.900+0000 7efe10c00640 1 -- 172.21.15.19:0/921576863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0c0b2940 con 0x7efe0c071e90 2024-03-08T06:04:29.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.901+0000 7efe10c00640 1 -- 172.21.15.19:0/921576863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0c067cb0 con 0x7efe0c071e90 2024-03-08T06:04:29.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.903+0000 7efe02a00640 1 -- 172.21.15.19:0/921576863 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efdfc01e460 con 0x7efe0c071e90 2024-03-08T06:04:29.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.903+0000 7efe02a00640 1 --2- 172.21.15.19:0/921576863 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efde806b4d0 0x7efde806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:29.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.903+0000 7efe02a00640 1 -- 172.21.15.19:0/921576863 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7efdfc08a8c0 con 0x7efe0c071e90 2024-03-08T06:04:29.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.904+0000 7efe01400640 1 --2- 172.21.15.19:0/921576863 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efde806b4d0 0x7efde806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:29.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.905+0000 7efe01400640 1 --2- 172.21.15.19:0/921576863 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efde806b4d0 0x7efde806d990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efdf4000f60 tx=0x7efdf40079d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:29.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:29.909+0000 7efe02a00640 1 -- 172.21.15.19:0/921576863 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efdfc059790 con 0x7efe0c071e90 2024-03-08T06:04:30.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.146+0000 7efe10c00640 1 -- 172.21.15.19:0/921576863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7efe0c06f280 con 0x7efe0c071e90 2024-03-08T06:04:30.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.664+0000 7efe02a00640 1 -- 172.21.15.19:0/921576863 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7efdfc059090 con 0x7efe0c071e90 2024-03-08T06:04:30.665 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 4 and data pool 5 2024-03-08T06:04:30.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.669+0000 7efe10c00640 1 -- 172.21.15.19:0/921576863 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efde806b4d0 msgr2=0x7efde806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:30.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.669+0000 7efe10c00640 1 --2- 172.21.15.19:0/921576863 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efde806b4d0 0x7efde806d990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efdf4000f60 tx=0x7efdf40079d0 comp rx=0 tx=0).stop 2024-03-08T06:04:30.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.669+0000 7efe10c00640 1 -- 172.21.15.19:0/921576863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe0c071e90 msgr2=0x7efe0c13f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:30.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.669+0000 7efe10c00640 1 --2- 172.21.15.19:0/921576863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe0c071e90 0x7efe0c13f700 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00d830 tx=0x7efdfc00dcf0 comp rx=0 tx=0).stop 2024-03-08T06:04:30.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.669+0000 7efe10c00640 1 -- 172.21.15.19:0/921576863 shutdown_connections 2024-03-08T06:04:30.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.669+0000 7efe10c00640 1 --2- 172.21.15.19:0/921576863 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efde806b4d0 0x7efde806d990 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:30.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.669+0000 7efe10c00640 1 --2- 172.21.15.19:0/921576863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe0c15ed20 0x7efe0c0b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:30.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.669+0000 7efe10c00640 1 --2- 172.21.15.19:0/921576863 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efe0c1584a0 0x7efe0c141d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:30.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.669+0000 7efe10c00640 1 --2- 172.21.15.19:0/921576863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe0c071e90 0x7efe0c13f700 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:30.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.669+0000 7efe10c00640 1 -- 172.21.15.19:0/921576863 >> 172.21.15.19:0/921576863 conn(0x7efe0c06ae30 msgr2=0x7efe0c0cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:30.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.672+0000 7efe10c00640 1 -- 172.21.15.19:0/921576863 shutdown_connections 2024-03-08T06:04:30.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.673+0000 7efe10c00640 1 -- 172.21.15.19:0/921576863 wait complete. 2024-03-08T06:04:30.712 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:04:30.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.893+0000 7f5501e00640 1 Processor -- start 2024-03-08T06:04:30.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.893+0000 7f5501e00640 1 -- start start 2024-03-08T06:04:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.895+0000 7f5501e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f54fc145520 0x7f54fc15d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.895+0000 7f5501e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54fc071df0 0x7f54fc06d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.895+0000 7f5501e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54fc15ceb0 con 0x7f54fc15bea0 2024-03-08T06:04:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.895+0000 7f5501e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54fc15c330 con 0x7f54fc145520 2024-03-08T06:04:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.895+0000 7f5501e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc15c610 con 0x7f54fc071df0 2024-03-08T06:04:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.896+0000 7f5501400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54fc071df0 0x7f54fc06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.896+0000 7f5500a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f54fc145520 0x7f54fc15d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.896+0000 7f5501400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54fc071df0 0x7f54fc06d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.19:57318/0 (socket says 172.21.15.19:57318) 2024-03-08T06:04:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.896+0000 7f5500a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f54fc145520 0x7f54fc15d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.19:45098/0 (socket says 172.21.15.19:45098) 2024-03-08T06:04:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.896+0000 7f5501400640 1 -- 172.21.15.19:0/1321125541 learned_addr learned my addr 172.21.15.19:0/1321125541 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.896+0000 7f5501400640 1 -- 172.21.15.19:0/1321125541 >> v2:172.21.15.42:3300/0 conn(0x7f54fc145520 msgr2=0x7f54fc15d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.896+0000 7f5501400640 1 --2- 172.21.15.19:0/1321125541 >> v2:172.21.15.42:3300/0 conn(0x7f54fc145520 0x7f54fc15d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.896+0000 7f5501400640 1 -- 172.21.15.19:0/1321125541 >> v1:172.21.15.42:6789/0 conn(0x7f54fc15bea0 legacy=0x7f54fc0716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:30.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.896+0000 7f5501400640 1 -- 172.21.15.19:0/1321125541 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc15c8f0 con 0x7f54fc071df0 2024-03-08T06:04:30.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.898+0000 7f5501400640 1 --2- 172.21.15.19:0/1321125541 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54fc071df0 0x7f54fc06d570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009e50 tx=0x7f54f402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9944534ec463ea98 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:30.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.898+0000 7f54fbe00640 1 -- 172.21.15.19:0/1321125541 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f402cb00 con 0x7f54fc071df0 2024-03-08T06:04:30.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.898+0000 7f54fbe00640 1 -- 172.21.15.19:0/1321125541 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f402cca0 con 0x7f54fc071df0 2024-03-08T06:04:30.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.898+0000 7f54fbe00640 1 -- 172.21.15.19:0/1321125541 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f4034610 con 0x7f54fc071df0 2024-03-08T06:04:30.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.899+0000 7f5501e00640 1 -- 172.21.15.19:0/1321125541 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54fc071df0 msgr2=0x7f54fc06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:30.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.899+0000 7f5501e00640 1 --2- 172.21.15.19:0/1321125541 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54fc071df0 0x7f54fc06d570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f54f4009e50 tx=0x7f54f402bf60 comp rx=0 tx=0).stop 2024-03-08T06:04:30.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.899+0000 7f5501e00640 1 -- 172.21.15.19:0/1321125541 shutdown_connections 2024-03-08T06:04:30.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.899+0000 7f5501e00640 1 --2- 172.21.15.19:0/1321125541 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54fc071df0 0x7f54fc06d570 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:30.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.899+0000 7f5501e00640 1 --2- 172.21.15.19:0/1321125541 >> v2:172.21.15.42:3300/0 conn(0x7f54fc145520 0x7f54fc15d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:30.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.899+0000 7f5501e00640 1 -- 172.21.15.19:0/1321125541 >> 172.21.15.19:0/1321125541 conn(0x7f54fc0b1850 msgr2=0x7f54fc0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:30.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.899+0000 7f5501e00640 1 -- 172.21.15.19:0/1321125541 shutdown_connections 2024-03-08T06:04:30.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.899+0000 7f5501e00640 1 -- 172.21.15.19:0/1321125541 wait complete. 2024-03-08T06:04:30.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.901+0000 7f5501e00640 1 Processor -- start 2024-03-08T06:04:30.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.901+0000 7f5501e00640 1 -- start start 2024-03-08T06:04:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.902+0000 7f5501e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54fc071df0 0x7f54fc1f2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.902+0000 7f5501e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54fc145520 0x7f54fc1f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.902+0000 7f5501e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54fc136180 0x7f54fc15d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.902+0000 7f5501e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc0af1c0 con 0x7f54fc145520 2024-03-08T06:04:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.902+0000 7f5501e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc0af040 con 0x7f54fc136180 2024-03-08T06:04:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.902+0000 7f5501e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc06e410 con 0x7f54fc071df0 2024-03-08T06:04:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.902+0000 7f54f3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54fc145520 0x7f54fc1f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.902+0000 7f54f3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54fc145520 0x7f54fc1f2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35838/0 (socket says 172.21.15.19:35838) 2024-03-08T06:04:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.902+0000 7f54f3e00640 1 -- 172.21.15.19:0/525109990 learned_addr learned my addr 172.21.15.19:0/525109990 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.902+0000 7f5500a00640 1 --2- 172.21.15.19:0/525109990 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54fc071df0 0x7f54fc1f2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.902+0000 7f5501400640 1 --2- 172.21.15.19:0/525109990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54fc136180 0x7f54fc15d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.902+0000 7f54f3e00640 1 -- 172.21.15.19:0/525109990 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54fc071df0 msgr2=0x7f54fc1f2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.902+0000 7f54f3e00640 1 --2- 172.21.15.19:0/525109990 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54fc071df0 0x7f54fc1f2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.902+0000 7f54f3e00640 1 -- 172.21.15.19:0/525109990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54fc136180 msgr2=0x7f54fc15d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.902+0000 7f54f3e00640 1 --2- 172.21.15.19:0/525109990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54fc136180 0x7f54fc15d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.902+0000 7f54f3e00640 1 -- 172.21.15.19:0/525109990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc136610 con 0x7f54fc145520 2024-03-08T06:04:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.903+0000 7f54f3e00640 1 --2- 172.21.15.19:0/525109990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54fc145520 0x7f54fc1f2670 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f54e400c3f0 tx=0x7f54e400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.903+0000 7f54f9600640 1 -- 172.21.15.19:0/525109990 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e40052d0 con 0x7f54fc145520 2024-03-08T06:04:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.903+0000 7f54f9600640 1 -- 172.21.15.19:0/525109990 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e4005490 con 0x7f54fc145520 2024-03-08T06:04:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.903+0000 7f54f9600640 1 -- 172.21.15.19:0/525109990 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e4007260 con 0x7f54fc145520 2024-03-08T06:04:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.903+0000 7f5501e00640 1 -- 172.21.15.19:0/525109990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54fc15e0b0 con 0x7f54fc145520 2024-03-08T06:04:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.903+0000 7f5501e00640 1 -- 172.21.15.19:0/525109990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54fc15daf0 con 0x7f54fc145520 2024-03-08T06:04:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.904+0000 7f5501e00640 1 -- 172.21.15.19:0/525109990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54fc075100 con 0x7f54fc145520 2024-03-08T06:04:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.905+0000 7f54f9600640 1 -- 172.21.15.19:0/525109990 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f54e4007400 con 0x7f54fc145520 2024-03-08T06:04:30.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.906+0000 7f54f9600640 1 --2- 172.21.15.19:0/525109990 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f54d806b4d0 0x7f54d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:30.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.906+0000 7f54f9600640 1 -- 172.21.15.19:0/525109990 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54e40896c0 con 0x7f54fc145520 2024-03-08T06:04:30.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.906+0000 7f5500a00640 1 --2- 172.21.15.19:0/525109990 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f54d806b4d0 0x7f54d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:30.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.907+0000 7f5500a00640 1 --2- 172.21.15.19:0/525109990 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f54d806b4d0 0x7f54d806d990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f54fc15a440 tx=0x7f54ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:30.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:30.911+0000 7f54f9600640 1 -- 172.21.15.19:0/525109990 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f54e4058530 con 0x7f54fc145520 2024-03-08T06:04:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.104+0000 7f5501e00640 1 -- 172.21.15.19:0/525109990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54fc0b05e0 con 0x7f54fc145520 2024-03-08T06:04:31.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.106+0000 7f54f9600640 1 -- 172.21.15.19:0/525109990 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16622 (secure 0 0 0) 0x7f54e4057e30 con 0x7f54fc145520 2024-03-08T06:04:31.107 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:31.107 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":33,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:04:30.148446+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:04:28.095112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-08T06:04:29.178532+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:04:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.108+0000 7f5501e00640 1 -- 172.21.15.19:0/525109990 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f54d806b4d0 msgr2=0x7f54d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.108+0000 7f5501e00640 1 --2- 172.21.15.19:0/525109990 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f54d806b4d0 0x7f54d806d990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f54fc15a440 tx=0x7f54ec008040 comp rx=0 tx=0).stop 2024-03-08T06:04:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.108+0000 7f5501e00640 1 -- 172.21.15.19:0/525109990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54fc145520 msgr2=0x7f54fc1f2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.108+0000 7f5501e00640 1 --2- 172.21.15.19:0/525109990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54fc145520 0x7f54fc1f2670 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f54e400c3f0 tx=0x7f54e400c8b0 comp rx=0 tx=0).stop 2024-03-08T06:04:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.108+0000 7f5501e00640 1 -- 172.21.15.19:0/525109990 shutdown_connections 2024-03-08T06:04:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.108+0000 7f5501e00640 1 --2- 172.21.15.19:0/525109990 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f54d806b4d0 0x7f54d806d990 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.108+0000 7f5501e00640 1 --2- 172.21.15.19:0/525109990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f54fc136180 0x7f54fc15d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.108+0000 7f5501e00640 1 --2- 172.21.15.19:0/525109990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54fc145520 0x7f54fc1f2670 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.108+0000 7f5501e00640 1 --2- 172.21.15.19:0/525109990 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f54fc071df0 0x7f54fc1f2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.108+0000 7f5501e00640 1 -- 172.21.15.19:0/525109990 >> 172.21.15.19:0/525109990 conn(0x7f54fc0b1850 msgr2=0x7f54fc0b08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.109+0000 7f5501e00640 1 -- 172.21.15.19:0/525109990 shutdown_connections 2024-03-08T06:04:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.109+0000 7f5501e00640 1 -- 172.21.15.19:0/525109990 wait complete. 2024-03-08T06:04:31.127 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:04:31.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.342+0000 7fe1dcc00640 1 Processor -- start 2024-03-08T06:04:31.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.342+0000 7fe1dcc00640 1 -- start start 2024-03-08T06:04:31.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.343+0000 7fe1dcc00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe1d81445d0 0x7fe1d806deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:31.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.343+0000 7fe1dcc00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe1d8071b80 0x7fe1d80cc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:31.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.344+0000 7fe1dcc00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d806e3f0 con 0x7fe1d8144d50 2024-03-08T06:04:31.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.344+0000 7fe1dcc00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d806ebf0 con 0x7fe1d8071b80 2024-03-08T06:04:31.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.344+0000 7fe1dcc00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d806eed0 con 0x7fe1d81445d0 2024-03-08T06:04:31.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.344+0000 7fe1d7e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe1d8071b80 0x7fe1d80cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:31.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.344+0000 7fe1d7e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe1d8071b80 0x7fe1d80cc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35844/0 (socket says 172.21.15.19:35844) 2024-03-08T06:04:31.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.344+0000 7fe1d7e00640 1 -- 172.21.15.19:0/1518822130 learned_addr learned my addr 172.21.15.19:0/1518822130 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:31.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.344+0000 7fe1d7400640 1 --2- 172.21.15.19:0/1518822130 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe1d81445d0 0x7fe1d806deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:31.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.344+0000 7fe1d7e00640 1 -- 172.21.15.19:0/1518822130 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe1d81445d0 msgr2=0x7fe1d806deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:31.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.345+0000 7fe1d7e00640 1 --2- 172.21.15.19:0/1518822130 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe1d81445d0 0x7fe1d806deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:31.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.345+0000 7fe1d7e00640 1 -- 172.21.15.19:0/1518822130 >> v1:172.21.15.19:6789/0 conn(0x7fe1d8144d50 legacy=0x7fe1d8071470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:31.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.345+0000 7fe1d7e00640 1 -- 172.21.15.19:0/1518822130 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d806f1b0 con 0x7fe1d8071b80 2024-03-08T06:04:31.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.346+0000 7fe1d7e00640 1 --2- 172.21.15.19:0/1518822130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d8071b80 0x7fe1d80cc860 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009e50 tx=0x7fe1d002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a64c62fd291266 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:31.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.346+0000 7fe1d6a00640 1 -- 172.21.15.19:0/1518822130 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d002cb00 con 0x7fe1d8071b80 2024-03-08T06:04:31.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.346+0000 7fe1d6a00640 1 -- 172.21.15.19:0/1518822130 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d002cca0 con 0x7fe1d8071b80 2024-03-08T06:04:31.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.346+0000 7fe1d6a00640 1 -- 172.21.15.19:0/1518822130 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0034610 con 0x7fe1d8071b80 2024-03-08T06:04:31.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.347+0000 7fe1dcc00640 1 -- 172.21.15.19:0/1518822130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d8071b80 msgr2=0x7fe1d80cc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:31.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.347+0000 7fe1dcc00640 1 --2- 172.21.15.19:0/1518822130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d8071b80 0x7fe1d80cc860 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009e50 tx=0x7fe1d002bf60 comp rx=0 tx=0).stop 2024-03-08T06:04:31.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.347+0000 7fe1dcc00640 1 -- 172.21.15.19:0/1518822130 shutdown_connections 2024-03-08T06:04:31.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.347+0000 7fe1dcc00640 1 --2- 172.21.15.19:0/1518822130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d8071b80 0x7fe1d80cc860 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:31.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.347+0000 7fe1dcc00640 1 --2- 172.21.15.19:0/1518822130 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe1d81445d0 0x7fe1d806deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:31.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.347+0000 7fe1dcc00640 1 -- 172.21.15.19:0/1518822130 >> 172.21.15.19:0/1518822130 conn(0x7fe1d80b1600 msgr2=0x7fe1d80b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:31.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.347+0000 7fe1dcc00640 1 -- 172.21.15.19:0/1518822130 shutdown_connections 2024-03-08T06:04:31.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.347+0000 7fe1dcc00640 1 -- 172.21.15.19:0/1518822130 wait complete. 2024-03-08T06:04:31.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.348+0000 7fe1dcc00640 1 Processor -- start 2024-03-08T06:04:31.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.349+0000 7fe1dcc00640 1 -- start start 2024-03-08T06:04:31.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.350+0000 7fe1dcc00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d8071b80 0x7fe1d813a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:31.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.350+0000 7fe1dcc00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe1d81445d0 0x7fe1d80b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:31.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.350+0000 7fe1dcc00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1d8144d50 0x7fe1d815a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:31.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.350+0000 7fe1dcc00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d81449b0 con 0x7fe1d8071b80 2024-03-08T06:04:31.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.350+0000 7fe1dcc00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d80cc340 con 0x7fe1d8144d50 2024-03-08T06:04:31.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.350+0000 7fe1dcc00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d8144b30 con 0x7fe1d81445d0 2024-03-08T06:04:31.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.350+0000 7fe1d7400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d8071b80 0x7fe1d813a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:31.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.350+0000 7fe1d7400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d8071b80 0x7fe1d813a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35846/0 (socket says 172.21.15.19:35846) 2024-03-08T06:04:31.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.350+0000 7fe1d7400640 1 -- 172.21.15.19:0/547677207 learned_addr learned my addr 172.21.15.19:0/547677207 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:31.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.350+0000 7fe1cea00640 1 --2- 172.21.15.19:0/547677207 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe1d81445d0 0x7fe1d80b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:31.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.350+0000 7fe1d7e00640 1 --2- 172.21.15.19:0/547677207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1d8144d50 0x7fe1d815a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:31.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.350+0000 7fe1d7400640 1 -- 172.21.15.19:0/547677207 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe1d81445d0 msgr2=0x7fe1d80b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:31.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.350+0000 7fe1d7400640 1 --2- 172.21.15.19:0/547677207 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe1d81445d0 0x7fe1d80b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:31.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.350+0000 7fe1d7400640 1 -- 172.21.15.19:0/547677207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1d8144d50 msgr2=0x7fe1d815a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:31.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.350+0000 7fe1d7400640 1 --2- 172.21.15.19:0/547677207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1d8144d50 0x7fe1d815a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:31.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.350+0000 7fe1d7400640 1 -- 172.21.15.19:0/547677207 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d80b4770 con 0x7fe1d8071b80 2024-03-08T06:04:31.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.350+0000 7fe1cea00640 1 --2- 172.21.15.19:0/547677207 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe1d81445d0 0x7fe1d80b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:31.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.351+0000 7fe1d7400640 1 --2- 172.21.15.19:0/547677207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d8071b80 0x7fe1d813a050 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800d830 tx=0x7fe1c800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:31.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.351+0000 7fe1cfe00640 1 -- 172.21.15.19:0/547677207 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c800b6c0 con 0x7fe1d8071b80 2024-03-08T06:04:31.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.351+0000 7fe1cfe00640 1 -- 172.21.15.19:0/547677207 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c8019070 con 0x7fe1d8071b80 2024-03-08T06:04:31.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.351+0000 7fe1cfe00640 1 -- 172.21.15.19:0/547677207 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c800ba80 con 0x7fe1d8071b80 2024-03-08T06:04:31.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.351+0000 7fe1dcc00640 1 -- 172.21.15.19:0/547677207 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d80b3ed0 con 0x7fe1d8071b80 2024-03-08T06:04:31.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.351+0000 7fe1dcc00640 1 -- 172.21.15.19:0/547677207 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d80b4490 con 0x7fe1d8071b80 2024-03-08T06:04:31.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.353+0000 7fe1dcc00640 1 -- 172.21.15.19:0/547677207 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d8075100 con 0x7fe1d8071b80 2024-03-08T06:04:31.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.353+0000 7fe1cfe00640 1 -- 172.21.15.19:0/547677207 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe1c801e460 con 0x7fe1d8071b80 2024-03-08T06:04:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.354+0000 7fe1cfe00640 1 --2- 172.21.15.19:0/547677207 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe1b406b500 0x7fe1b406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.355+0000 7fe1cfe00640 1 -- 172.21.15.19:0/547677207 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1c808a8b0 con 0x7fe1d8071b80 2024-03-08T06:04:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.355+0000 7fe1cea00640 1 --2- 172.21.15.19:0/547677207 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe1b406b500 0x7fe1b406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.356+0000 7fe1cea00640 1 --2- 172.21.15.19:0/547677207 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe1b406b500 0x7fe1b406d9c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80719d0 tx=0x7fe1c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.359+0000 7fe1cfe00640 1 -- 172.21.15.19:0/547677207 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe1c8059720 con 0x7fe1d8071b80 2024-03-08T06:04:31.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.555+0000 7fe1dcc00640 1 -- 172.21.15.19:0/547677207 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1d8072080 con 0x7fe1d8071b80 2024-03-08T06:04:31.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.558+0000 7fe1cfe00640 1 -- 172.21.15.19:0/547677207 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16622 (secure 0 0 0) 0x7fe1c8059020 con 0x7fe1d8071b80 2024-03-08T06:04:31.559 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:31.560 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":33,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:04:30.148446+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:04:28.095112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-08T06:04:29.178532+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:04:31.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.561+0000 7fe1dcc00640 1 -- 172.21.15.19:0/547677207 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe1b406b500 msgr2=0x7fe1b406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:31.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.561+0000 7fe1dcc00640 1 --2- 172.21.15.19:0/547677207 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe1b406b500 0x7fe1b406d9c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80719d0 tx=0x7fe1c0009040 comp rx=0 tx=0).stop 2024-03-08T06:04:31.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.561+0000 7fe1dcc00640 1 -- 172.21.15.19:0/547677207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d8071b80 msgr2=0x7fe1d813a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:31.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.561+0000 7fe1dcc00640 1 --2- 172.21.15.19:0/547677207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d8071b80 0x7fe1d813a050 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800d830 tx=0x7fe1c800dcf0 comp rx=0 tx=0).stop 2024-03-08T06:04:31.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.561+0000 7fe1dcc00640 1 -- 172.21.15.19:0/547677207 shutdown_connections 2024-03-08T06:04:31.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.561+0000 7fe1dcc00640 1 --2- 172.21.15.19:0/547677207 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe1b406b500 0x7fe1b406d9c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:31.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.561+0000 7fe1dcc00640 1 --2- 172.21.15.19:0/547677207 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1d8144d50 0x7fe1d815a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:31.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.561+0000 7fe1dcc00640 1 --2- 172.21.15.19:0/547677207 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe1d81445d0 0x7fe1d80b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:31.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.561+0000 7fe1dcc00640 1 --2- 172.21.15.19:0/547677207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d8071b80 0x7fe1d813a050 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:31.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.561+0000 7fe1dcc00640 1 -- 172.21.15.19:0/547677207 >> 172.21.15.19:0/547677207 conn(0x7fe1d80b1600 msgr2=0x7fe1d80af6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:31.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.561+0000 7fe1dcc00640 1 -- 172.21.15.19:0/547677207 shutdown_connections 2024-03-08T06:04:31.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.561+0000 7fe1dcc00640 1 -- 172.21.15.19:0/547677207 wait complete. 2024-03-08T06:04:31.580 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-08T06:04:31.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.800+0000 7f5f5ee00640 1 Processor -- start 2024-03-08T06:04:31.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.800+0000 7f5f5ee00640 1 -- start start 2024-03-08T06:04:31.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.802+0000 7f5f5ee00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5f580ccc70 0x7f5f580cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:31.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.802+0000 7f5f5ee00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5f580b2bc0 0x7f5f580b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:31.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.802+0000 7f5f5ee00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f58071990 con 0x7f5f58145590 2024-03-08T06:04:31.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.802+0000 7f5f5ee00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f580cf8b0 con 0x7f5f580b2bc0 2024-03-08T06:04:31.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.802+0000 7f5f5ee00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f580cd5f0 con 0x7f5f580ccc70 2024-03-08T06:04:31.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.802+0000 7f5f5ce00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5f580b2bc0 0x7f5f580b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:31.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.802+0000 7f5f5ce00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5f580b2bc0 0x7f5f580b3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35848/0 (socket says 172.21.15.19:35848) 2024-03-08T06:04:31.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.802+0000 7f5f5ce00640 1 -- 172.21.15.19:0/510596638 learned_addr learned my addr 172.21.15.19:0/510596638 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:31.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.802+0000 7f5f57400640 1 --2- 172.21.15.19:0/510596638 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5f580ccc70 0x7f5f580cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:31.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.803+0000 7f5f5ce00640 1 -- 172.21.15.19:0/510596638 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5f580ccc70 msgr2=0x7f5f580cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:31.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.803+0000 7f5f5ce00640 1 --2- 172.21.15.19:0/510596638 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5f580ccc70 0x7f5f580cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:31.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.803+0000 7f5f5ce00640 1 -- 172.21.15.19:0/510596638 >> v1:172.21.15.42:6789/0 conn(0x7f5f58145590 legacy=0x7f5f580cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:31.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.803+0000 7f5f5ce00640 1 -- 172.21.15.19:0/510596638 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f58071c70 con 0x7f5f580b2bc0 2024-03-08T06:04:31.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.804+0000 7f5f5ce00640 1 --2- 172.21.15.19:0/510596638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f580b2bc0 0x7f5f580b3010 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009e50 tx=0x7f5f5002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab87ec66235ff01 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:31.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.804+0000 7f5f56a00640 1 -- 172.21.15.19:0/510596638 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5002cb00 con 0x7f5f580b2bc0 2024-03-08T06:04:31.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.804+0000 7f5f56a00640 1 -- 172.21.15.19:0/510596638 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5002cca0 con 0x7f5f580b2bc0 2024-03-08T06:04:31.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.804+0000 7f5f56a00640 1 -- 172.21.15.19:0/510596638 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50034610 con 0x7f5f580b2bc0 2024-03-08T06:04:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.805+0000 7f5f5ee00640 1 -- 172.21.15.19:0/510596638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f580b2bc0 msgr2=0x7f5f580b3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.805+0000 7f5f5ee00640 1 --2- 172.21.15.19:0/510596638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f580b2bc0 0x7f5f580b3010 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5f50009e50 tx=0x7f5f5002bf60 comp rx=0 tx=0).stop 2024-03-08T06:04:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.805+0000 7f5f5ee00640 1 -- 172.21.15.19:0/510596638 shutdown_connections 2024-03-08T06:04:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.805+0000 7f5f5ee00640 1 --2- 172.21.15.19:0/510596638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f580b2bc0 0x7f5f580b3010 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.805+0000 7f5f5ee00640 1 --2- 172.21.15.19:0/510596638 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5f580ccc70 0x7f5f580cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.805+0000 7f5f5ee00640 1 -- 172.21.15.19:0/510596638 >> 172.21.15.19:0/510596638 conn(0x7f5f580cfaa0 msgr2=0x7f5f580cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.805+0000 7f5f5ee00640 1 -- 172.21.15.19:0/510596638 shutdown_connections 2024-03-08T06:04:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.805+0000 7f5f5ee00640 1 -- 172.21.15.19:0/510596638 wait complete. 2024-03-08T06:04:31.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.806+0000 7f5f5ee00640 1 Processor -- start 2024-03-08T06:04:31.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.807+0000 7f5f5ee00640 1 -- start start 2024-03-08T06:04:31.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.808+0000 7f5f5ee00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f580b2bc0 0x7f5f581f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:31.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.808+0000 7f5f5ee00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5f580ccc70 0x7f5f581e87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:31.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.808+0000 7f5f5ee00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f58145590 0x7f5f581e5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:31.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.808+0000 7f5f5ee00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f58072510 con 0x7f5f58145590 2024-03-08T06:04:31.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.808+0000 7f5f5ee00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f58072230 con 0x7f5f580b2bc0 2024-03-08T06:04:31.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.808+0000 7f5f5ee00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f58145970 con 0x7f5f580ccc70 2024-03-08T06:04:31.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.808+0000 7f5f5ce00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f58145590 0x7f5f581e5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:31.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.808+0000 7f5f5ce00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f58145590 0x7f5f581e5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35852/0 (socket says 172.21.15.19:35852) 2024-03-08T06:04:31.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.808+0000 7f5f5ce00640 1 -- 172.21.15.19:0/2984281019 learned_addr learned my addr 172.21.15.19:0/2984281019 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:31.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.808+0000 7f5f57e00640 1 --2- 172.21.15.19:0/2984281019 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f580b2bc0 0x7f5f581f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:31.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.808+0000 7f5f57400640 1 --2- 172.21.15.19:0/2984281019 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5f580ccc70 0x7f5f581e87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:31.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.808+0000 7f5f5ce00640 1 -- 172.21.15.19:0/2984281019 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5f580ccc70 msgr2=0x7f5f581e87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:31.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.808+0000 7f5f5ce00640 1 --2- 172.21.15.19:0/2984281019 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5f580ccc70 0x7f5f581e87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:31.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.808+0000 7f5f5ce00640 1 -- 172.21.15.19:0/2984281019 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f580b2bc0 msgr2=0x7f5f581f3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:31.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.808+0000 7f5f5ce00640 1 --2- 172.21.15.19:0/2984281019 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f580b2bc0 0x7f5f581f3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:31.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.808+0000 7f5f5ce00640 1 -- 172.21.15.19:0/2984281019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f581e6690 con 0x7f5f58145590 2024-03-08T06:04:31.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.808+0000 7f5f57e00640 1 --2- 172.21.15.19:0/2984281019 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f580b2bc0 0x7f5f581f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:31.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.809+0000 7f5f5ce00640 1 --2- 172.21.15.19:0/2984281019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f58145590 0x7f5f581e5b20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5f50036040 tx=0x7f5f50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:31.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.809+0000 7f5f4fe00640 1 -- 172.21.15.19:0/2984281019 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50043020 con 0x7f5f58145590 2024-03-08T06:04:31.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.809+0000 7f5f4fe00640 1 -- 172.21.15.19:0/2984281019 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5002ce50 con 0x7f5f58145590 2024-03-08T06:04:31.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.809+0000 7f5f4fe00640 1 -- 172.21.15.19:0/2984281019 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50009510 con 0x7f5f58145590 2024-03-08T06:04:31.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.809+0000 7f5f5ee00640 1 -- 172.21.15.19:0/2984281019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f581e6970 con 0x7f5f58145590 2024-03-08T06:04:31.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.809+0000 7f5f5ee00640 1 -- 172.21.15.19:0/2984281019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f581e6f30 con 0x7f5f58145590 2024-03-08T06:04:31.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.810+0000 7f5f5ee00640 1 -- 172.21.15.19:0/2984281019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f58067cb0 con 0x7f5f58145590 2024-03-08T06:04:31.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.811+0000 7f5f4fe00640 1 -- 172.21.15.19:0/2984281019 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5f50046020 con 0x7f5f58145590 2024-03-08T06:04:31.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.812+0000 7f5f4fe00640 1 --2- 172.21.15.19:0/2984281019 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5f3806b4d0 0x7f5f3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:31.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.812+0000 7f5f4fe00640 1 -- 172.21.15.19:0/2984281019 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f500ac8b0 con 0x7f5f58145590 2024-03-08T06:04:31.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.813+0000 7f5f57e00640 1 --2- 172.21.15.19:0/2984281019 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5f3806b4d0 0x7f5f3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:31.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.813+0000 7f5f57e00640 1 --2- 172.21.15.19:0/2984281019 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5f3806b4d0 0x7f5f3806d990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5f48000f60 tx=0x7f5f48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:31.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:31.817+0000 7f5f4fe00640 1 -- 172.21.15.19:0/2984281019 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5f5004d030 con 0x7f5f58145590 2024-03-08T06:04:32.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.045+0000 7f5f5ee00640 1 -- 172.21.15.19:0/2984281019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5f580b4630 con 0x7f5f58145590 2024-03-08T06:04:32.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.702+0000 7f5f4fe00640 1 -- 172.21.15.19:0/2984281019 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5f5003c350 con 0x7f5f58145590 2024-03-08T06:04:32.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.706+0000 7f5f5ee00640 1 -- 172.21.15.19:0/2984281019 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5f3806b4d0 msgr2=0x7f5f3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:32.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.706+0000 7f5f5ee00640 1 --2- 172.21.15.19:0/2984281019 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5f3806b4d0 0x7f5f3806d990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5f48000f60 tx=0x7f5f48009040 comp rx=0 tx=0).stop 2024-03-08T06:04:32.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.706+0000 7f5f5ee00640 1 -- 172.21.15.19:0/2984281019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f58145590 msgr2=0x7f5f581e5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:32.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.706+0000 7f5f5ee00640 1 --2- 172.21.15.19:0/2984281019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f58145590 0x7f5f581e5b20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5f50036040 tx=0x7f5f50004a40 comp rx=0 tx=0).stop 2024-03-08T06:04:32.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.706+0000 7f5f5ee00640 1 -- 172.21.15.19:0/2984281019 shutdown_connections 2024-03-08T06:04:32.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.706+0000 7f5f5ee00640 1 --2- 172.21.15.19:0/2984281019 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5f3806b4d0 0x7f5f3806d990 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:32.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.706+0000 7f5f5ee00640 1 --2- 172.21.15.19:0/2984281019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f58145590 0x7f5f581e5b20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:32.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.706+0000 7f5f5ee00640 1 --2- 172.21.15.19:0/2984281019 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5f580ccc70 0x7f5f581e87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:32.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.706+0000 7f5f5ee00640 1 --2- 172.21.15.19:0/2984281019 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5f580b2bc0 0x7f5f581f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:32.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.706+0000 7f5f5ee00640 1 -- 172.21.15.19:0/2984281019 >> 172.21.15.19:0/2984281019 conn(0x7f5f580cfaa0 msgr2=0x7f5f580afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:32.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.707+0000 7f5f5ee00640 1 -- 172.21.15.19:0/2984281019 shutdown_connections 2024-03-08T06:04:32.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.707+0000 7f5f5ee00640 1 -- 172.21.15.19:0/2984281019 wait complete. 2024-03-08T06:04:32.729 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-08T06:04:32.730 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-08T06:04:32.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.944+0000 7ff7d3e00640 1 Processor -- start 2024-03-08T06:04:32.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.944+0000 7ff7d3e00640 1 -- start start 2024-03-08T06:04:32.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.946+0000 7ff7d3e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff7d4144240 0x7ff7d40cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:32.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.946+0000 7ff7d3e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff7d406ea40 0x7ff7d415e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:32.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.946+0000 7ff7d3e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d40cd3e0 con 0x7ff7d40b42c0 2024-03-08T06:04:32.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.946+0000 7ff7d3e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d40b3e30 con 0x7ff7d406ea40 2024-03-08T06:04:32.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.946+0000 7ff7d3e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d40cd6c0 con 0x7ff7d4144240 2024-03-08T06:04:32.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.946+0000 7ff7d3400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff7d406ea40 0x7ff7d415e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:32.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.946+0000 7ff7d3400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff7d406ea40 0x7ff7d415e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52146/0 (socket says 172.21.15.19:52146) 2024-03-08T06:04:32.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.946+0000 7ff7d3400640 1 -- 172.21.15.19:0/3844392499 learned_addr learned my addr 172.21.15.19:0/3844392499 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:32.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.947+0000 7ff7d2a00640 1 --2- 172.21.15.19:0/3844392499 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff7d4144240 0x7ff7d40cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:32.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.947+0000 7ff7d3400640 1 -- 172.21.15.19:0/3844392499 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff7d4144240 msgr2=0x7ff7d40cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:32.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.947+0000 7ff7d3400640 1 --2- 172.21.15.19:0/3844392499 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff7d4144240 0x7ff7d40cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:32.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.947+0000 7ff7d3400640 1 -- 172.21.15.19:0/3844392499 >> v1:172.21.15.19:6789/0 conn(0x7ff7d40b42c0 legacy=0x7ff7d406e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:32.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.947+0000 7ff7d3400640 1 -- 172.21.15.19:0/3844392499 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d40b37e0 con 0x7ff7d406ea40 2024-03-08T06:04:32.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.947+0000 7ff7d1600640 1 -- 172.21.15.19:0/3844392499 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3131653451 0 0) 0x7ff7d40cd3e0 con 0x7ff7d40b42c0 2024-03-08T06:04:32.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.948+0000 7ff7d3400640 1 --2- 172.21.15.19:0/3844392499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7d406ea40 0x7ff7d415e460 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009e50 tx=0x7ff7cc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f8b5e7b2fcb47e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:32.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.948+0000 7ff7d1600640 1 -- 172.21.15.19:0/3844392499 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc02cb00 con 0x7ff7d406ea40 2024-03-08T06:04:32.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.948+0000 7ff7d1600640 1 -- 172.21.15.19:0/3844392499 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc02cca0 con 0x7ff7d406ea40 2024-03-08T06:04:32.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.948+0000 7ff7d1600640 1 -- 172.21.15.19:0/3844392499 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc034610 con 0x7ff7d406ea40 2024-03-08T06:04:32.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.949+0000 7ff7d3e00640 1 -- 172.21.15.19:0/3844392499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7d406ea40 msgr2=0x7ff7d415e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:32.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.949+0000 7ff7d3e00640 1 --2- 172.21.15.19:0/3844392499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7d406ea40 0x7ff7d415e460 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009e50 tx=0x7ff7cc02bf60 comp rx=0 tx=0).stop 2024-03-08T06:04:32.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.949+0000 7ff7d3e00640 1 -- 172.21.15.19:0/3844392499 shutdown_connections 2024-03-08T06:04:32.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.949+0000 7ff7d3e00640 1 --2- 172.21.15.19:0/3844392499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7d406ea40 0x7ff7d415e460 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:32.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.949+0000 7ff7d3e00640 1 --2- 172.21.15.19:0/3844392499 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff7d4144240 0x7ff7d40cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:32.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.949+0000 7ff7d3e00640 1 -- 172.21.15.19:0/3844392499 >> 172.21.15.19:0/3844392499 conn(0x7ff7d40b1850 msgr2=0x7ff7d40b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:32.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.949+0000 7ff7d3e00640 1 -- 172.21.15.19:0/3844392499 shutdown_connections 2024-03-08T06:04:32.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.949+0000 7ff7d3e00640 1 -- 172.21.15.19:0/3844392499 wait complete. 2024-03-08T06:04:32.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.951+0000 7ff7d3e00640 1 Processor -- start 2024-03-08T06:04:32.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.951+0000 7ff7d3e00640 1 -- start start 2024-03-08T06:04:32.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.952+0000 7ff7d3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7d406ea40 0x7ff7d414bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:32.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.952+0000 7ff7d3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7d4144240 0x7ff7d4159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:32.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.952+0000 7ff7d3e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff7d413c290 0x7ff7d41e7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:32.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.952+0000 7ff7d3e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d40b4b30 con 0x7ff7d4144240 2024-03-08T06:04:32.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.952+0000 7ff7d3e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d4144620 con 0x7ff7d406ea40 2024-03-08T06:04:32.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.952+0000 7ff7d3e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d40b4cb0 con 0x7ff7d413c290 2024-03-08T06:04:32.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.952+0000 7ff7d2000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7d4144240 0x7ff7d4159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:32.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.952+0000 7ff7d2000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7d4144240 0x7ff7d4159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52154/0 (socket says 172.21.15.19:52154) 2024-03-08T06:04:32.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.952+0000 7ff7d2000640 1 -- 172.21.15.19:0/3926980223 learned_addr learned my addr 172.21.15.19:0/3926980223 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.953+0000 7ff7d2a00640 1 --2- 172.21.15.19:0/3926980223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7d406ea40 0x7ff7d414bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.953+0000 7ff7d3400640 1 --2- 172.21.15.19:0/3926980223 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff7d413c290 0x7ff7d41e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.953+0000 7ff7d2000640 1 -- 172.21.15.19:0/3926980223 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff7d413c290 msgr2=0x7ff7d41e7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.953+0000 7ff7d2000640 1 --2- 172.21.15.19:0/3926980223 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff7d413c290 0x7ff7d41e7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.953+0000 7ff7d2000640 1 -- 172.21.15.19:0/3926980223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7d406ea40 msgr2=0x7ff7d414bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.953+0000 7ff7d2000640 1 --2- 172.21.15.19:0/3926980223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7d406ea40 0x7ff7d414bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.953+0000 7ff7d2000640 1 -- 172.21.15.19:0/3926980223 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d414c130 con 0x7ff7d4144240 2024-03-08T06:04:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.953+0000 7ff7d2000640 1 --2- 172.21.15.19:0/3926980223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7d4144240 0x7ff7d4159ea0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000c4b0 tx=0x7ff7c000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.953+0000 7ff7caa00640 1 -- 172.21.15.19:0/3926980223 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0017070 con 0x7ff7d4144240 2024-03-08T06:04:32.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.953+0000 7ff7caa00640 1 -- 172.21.15.19:0/3926980223 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c0005480 con 0x7ff7d4144240 2024-03-08T06:04:32.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.953+0000 7ff7caa00640 1 -- 172.21.15.19:0/3926980223 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0003830 con 0x7ff7d4144240 2024-03-08T06:04:32.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.953+0000 7ff7d3e00640 1 -- 172.21.15.19:0/3926980223 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d413c850 con 0x7ff7d4144240 2024-03-08T06:04:32.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.953+0000 7ff7d3e00640 1 -- 172.21.15.19:0/3926980223 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d413ce10 con 0x7ff7d4144240 2024-03-08T06:04:32.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.955+0000 7ff7d3e00640 1 -- 172.21.15.19:0/3926980223 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d4075090 con 0x7ff7d4144240 2024-03-08T06:04:32.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.955+0000 7ff7caa00640 1 -- 172.21.15.19:0/3926980223 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff7c001a070 con 0x7ff7d4144240 2024-03-08T06:04:32.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.956+0000 7ff7caa00640 1 --2- 172.21.15.19:0/3926980223 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff7b406b4d0 0x7ff7b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:32.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.956+0000 7ff7caa00640 1 -- 172.21.15.19:0/3926980223 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7c00895c0 con 0x7ff7d4144240 2024-03-08T06:04:32.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.957+0000 7ff7d2a00640 1 --2- 172.21.15.19:0/3926980223 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff7b406b4d0 0x7ff7b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:32.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.957+0000 7ff7d2a00640 1 --2- 172.21.15.19:0/3926980223 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff7b406b4d0 0x7ff7b406d990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4006fd0 tx=0x7ff7c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:32.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:32.961+0000 7ff7caa00640 1 -- 172.21.15.19:0/3926980223 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff7c0058430 con 0x7ff7d4144240 2024-03-08T06:04:33.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.193+0000 7ff7d3e00640 1 -- 172.21.15.19:0/3926980223 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff7d406f160 con 0x7ff7d4144240 2024-03-08T06:04:33.481 INFO:tasks.ceph.mds.c.smithi019.stderr:2024-03-08T06:04:33.480+0000 7f665bc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-08T06:04:33.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.724+0000 7ff7caa00640 1 -- 172.21.15.19:0/3926980223 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff7c0057d30 con 0x7ff7d4144240 2024-03-08T06:04:33.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.728+0000 7ff7d3e00640 1 -- 172.21.15.19:0/3926980223 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff7b406b4d0 msgr2=0x7ff7b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:33.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.728+0000 7ff7d3e00640 1 --2- 172.21.15.19:0/3926980223 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff7b406b4d0 0x7ff7b406d990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4006fd0 tx=0x7ff7c4008040 comp rx=0 tx=0).stop 2024-03-08T06:04:33.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.728+0000 7ff7d3e00640 1 -- 172.21.15.19:0/3926980223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7d4144240 msgr2=0x7ff7d4159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:33.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.728+0000 7ff7d3e00640 1 --2- 172.21.15.19:0/3926980223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7d4144240 0x7ff7d4159ea0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000c4b0 tx=0x7ff7c000c970 comp rx=0 tx=0).stop 2024-03-08T06:04:33.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.728+0000 7ff7d3e00640 1 -- 172.21.15.19:0/3926980223 shutdown_connections 2024-03-08T06:04:33.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.728+0000 7ff7d3e00640 1 --2- 172.21.15.19:0/3926980223 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff7b406b4d0 0x7ff7b406d990 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:33.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.728+0000 7ff7d3e00640 1 --2- 172.21.15.19:0/3926980223 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff7d413c290 0x7ff7d41e7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:33.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.728+0000 7ff7d3e00640 1 --2- 172.21.15.19:0/3926980223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7d4144240 0x7ff7d4159ea0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:33.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.728+0000 7ff7d3e00640 1 --2- 172.21.15.19:0/3926980223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7d406ea40 0x7ff7d414bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:33.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.728+0000 7ff7d3e00640 1 -- 172.21.15.19:0/3926980223 >> 172.21.15.19:0/3926980223 conn(0x7ff7d40b1850 msgr2=0x7ff7d415ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:33.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.728+0000 7ff7d3e00640 1 -- 172.21.15.19:0/3926980223 shutdown_connections 2024-03-08T06:04:33.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.728+0000 7ff7d3e00640 1 -- 172.21.15.19:0/3926980223 wait complete. 2024-03-08T06:04:33.750 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-08T06:04:33.750 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T06:04:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.973+0000 7f42cce00640 1 Processor -- start 2024-03-08T06:04:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.973+0000 7f42cce00640 1 -- start start 2024-03-08T06:04:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.975+0000 7f42cce00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f42c8071ab0 0x7f42c815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.975+0000 7f42cce00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f42c806d600 0x7f42c8144d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.975+0000 7f42cce00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f42c8071e90 0x7f42c81452a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.975+0000 7f42cce00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c806ef40 con 0x7f42c8071e90 2024-03-08T06:04:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.975+0000 7f42cce00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c81457e0 con 0x7f42c806d600 2024-03-08T06:04:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.975+0000 7f42cce00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c815d0c0 con 0x7f42c8071ab0 2024-03-08T06:04:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.975+0000 7f42c6800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f42c8071e90 0x7f42c81452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.975+0000 7f42c6800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f42c8071e90 0x7f42c81452a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52160/0 (socket says 172.21.15.19:52160) 2024-03-08T06:04:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.975+0000 7f42c6800640 1 -- 172.21.15.19:0/537903539 learned_addr learned my addr 172.21.15.19:0/537903539 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.976+0000 7f42bd400640 1 --2- 172.21.15.19:0/537903539 >> v2:172.21.15.42:3300/0 conn(0x7f42c806d600 0x7f42c8144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.976+0000 7f42c5e00640 1 --2- 172.21.15.19:0/537903539 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f42c8071ab0 0x7f42c815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.976+0000 7f42c6800640 1 -- 172.21.15.19:0/537903539 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f42c8071ab0 msgr2=0x7f42c815cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.976+0000 7f42c6800640 1 --2- 172.21.15.19:0/537903539 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f42c8071ab0 0x7f42c815cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.976+0000 7f42c6800640 1 -- 172.21.15.19:0/537903539 >> v2:172.21.15.42:3300/0 conn(0x7f42c806d600 msgr2=0x7f42c8144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.976+0000 7f42c6800640 1 --2- 172.21.15.19:0/537903539 >> v2:172.21.15.42:3300/0 conn(0x7f42c806d600 0x7f42c8144d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:33.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.976+0000 7f42c6800640 1 -- 172.21.15.19:0/537903539 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c806da80 con 0x7f42c8071e90 2024-03-08T06:04:33.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.977+0000 7f42c6800640 1 --2- 172.21.15.19:0/537903539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42c8071e90 0x7f42c81452a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f42c815d270 tx=0x7f42c002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ccb794071dd6d55 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:33.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.977+0000 7f42c5400640 1 -- 172.21.15.19:0/537903539 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c0035020 con 0x7f42c8071e90 2024-03-08T06:04:33.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.977+0000 7f42c5400640 1 -- 172.21.15.19:0/537903539 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c0031640 con 0x7f42c8071e90 2024-03-08T06:04:33.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.977+0000 7f42c5400640 1 -- 172.21.15.19:0/537903539 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c002d040 con 0x7f42c8071e90 2024-03-08T06:04:33.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.978+0000 7f42cce00640 1 -- 172.21.15.19:0/537903539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42c8071e90 msgr2=0x7f42c81452a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:33.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.978+0000 7f42cce00640 1 --2- 172.21.15.19:0/537903539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42c8071e90 0x7f42c81452a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f42c815d270 tx=0x7f42c002b8f0 comp rx=0 tx=0).stop 2024-03-08T06:04:33.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.978+0000 7f42cce00640 1 -- 172.21.15.19:0/537903539 shutdown_connections 2024-03-08T06:04:33.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.978+0000 7f42cce00640 1 --2- 172.21.15.19:0/537903539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42c8071e90 0x7f42c81452a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.978+0000 7f42cce00640 1 --2- 172.21.15.19:0/537903539 >> v2:172.21.15.42:3300/0 conn(0x7f42c806d600 0x7f42c8144d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.978+0000 7f42cce00640 1 --2- 172.21.15.19:0/537903539 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f42c8071ab0 0x7f42c815cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.978+0000 7f42cce00640 1 -- 172.21.15.19:0/537903539 >> 172.21.15.19:0/537903539 conn(0x7f42c806ae30 msgr2=0x7f42c806b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.978+0000 7f42cce00640 1 -- 172.21.15.19:0/537903539 shutdown_connections 2024-03-08T06:04:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.978+0000 7f42cce00640 1 -- 172.21.15.19:0/537903539 wait complete. 2024-03-08T06:04:33.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.980+0000 7f42cce00640 1 Processor -- start 2024-03-08T06:04:33.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.980+0000 7f42cce00640 1 -- start start 2024-03-08T06:04:33.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.981+0000 7f42cce00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42c806d600 0x7f42c8139440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:33.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.981+0000 7f42cce00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42c8071ab0 0x7f42c813c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:33.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.981+0000 7f42cce00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f42c8071e90 0x7f42c81f1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:33.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.981+0000 7f42cce00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c806e320 con 0x7f42c806d600 2024-03-08T06:04:33.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.981+0000 7f42cce00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c806e040 con 0x7f42c8071ab0 2024-03-08T06:04:33.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.981+0000 7f42cce00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c806e600 con 0x7f42c8071e90 2024-03-08T06:04:33.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.981+0000 7f42c5e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42c806d600 0x7f42c8139440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:33.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.981+0000 7f42c5e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42c806d600 0x7f42c8139440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52168/0 (socket says 172.21.15.19:52168) 2024-03-08T06:04:33.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.981+0000 7f42c5e00640 1 -- 172.21.15.19:0/3591352631 learned_addr learned my addr 172.21.15.19:0/3591352631 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:33.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.982+0000 7f42bd400640 1 --2- 172.21.15.19:0/3591352631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42c8071ab0 0x7f42c813c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:33.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.982+0000 7f42c6800640 1 --2- 172.21.15.19:0/3591352631 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f42c8071e90 0x7f42c81f1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:33.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.982+0000 7f42c5e00640 1 -- 172.21.15.19:0/3591352631 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f42c8071e90 msgr2=0x7f42c81f1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:33.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.982+0000 7f42c5e00640 1 --2- 172.21.15.19:0/3591352631 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f42c8071e90 0x7f42c81f1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:33.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.982+0000 7f42c5e00640 1 -- 172.21.15.19:0/3591352631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42c8071ab0 msgr2=0x7f42c813c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:33.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.982+0000 7f42c5e00640 1 --2- 172.21.15.19:0/3591352631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42c8071ab0 0x7f42c813c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:33.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.982+0000 7f42c5e00640 1 -- 172.21.15.19:0/3591352631 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c813e890 con 0x7f42c806d600 2024-03-08T06:04:33.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.982+0000 7f42c5e00640 1 --2- 172.21.15.19:0/3591352631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42c806d600 0x7f42c8139440 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f42b8007f20 tx=0x7f42b800e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:33.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.983+0000 7f42bea00640 1 -- 172.21.15.19:0/3591352631 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8014620 con 0x7f42c806d600 2024-03-08T06:04:33.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.983+0000 7f42bea00640 1 -- 172.21.15.19:0/3591352631 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b8019070 con 0x7f42c806d600 2024-03-08T06:04:33.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.983+0000 7f42bea00640 1 -- 172.21.15.19:0/3591352631 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8014a00 con 0x7f42c806d600 2024-03-08T06:04:33.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.983+0000 7f42cce00640 1 -- 172.21.15.19:0/3591352631 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c813eb70 con 0x7f42c806d600 2024-03-08T06:04:33.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.983+0000 7f42cce00640 1 -- 172.21.15.19:0/3591352631 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c813f130 con 0x7f42c806d600 2024-03-08T06:04:33.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.984+0000 7f42cce00640 1 -- 172.21.15.19:0/3591352631 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c8067cb0 con 0x7f42c806d600 2024-03-08T06:04:33.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.985+0000 7f42bea00640 1 -- 172.21.15.19:0/3591352631 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f42b8014ba0 con 0x7f42c806d600 2024-03-08T06:04:33.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.986+0000 7f42bea00640 1 --2- 172.21.15.19:0/3591352631 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f42a406b4d0 0x7f42a406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:33.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.986+0000 7f42bea00640 1 -- 172.21.15.19:0/3591352631 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42b808aab0 con 0x7f42c806d600 2024-03-08T06:04:33.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.986+0000 7f42bd400640 1 --2- 172.21.15.19:0/3591352631 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f42a406b4d0 0x7f42a406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:33.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.987+0000 7f42bd400640 1 --2- 172.21.15.19:0/3591352631 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f42a406b4d0 0x7f42a406d990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f42c8143ee0 tx=0x7f42b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:33.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:33.993+0000 7f42bea00640 1 -- 172.21.15.19:0/3591352631 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f42b8059920 con 0x7f42c806d600 2024-03-08T06:04:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.231+0000 7f42cce00640 1 -- 172.21.15.19:0/3591352631 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42c8143850 con 0x7f42c806d600 2024-03-08T06:04:34.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.232+0000 7f42bea00640 1 -- 172.21.15.19:0/3591352631 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f42b8059220 con 0x7f42c806d600 2024-03-08T06:04:34.233 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:34.234 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3542863285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3542863285},{"type":"v1","addr":"172.21.15.42:6833","nonce":3542863285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4708,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1679053115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1679053115},{"type":"v1","addr":"172.21.15.42:6835","nonce":1679053115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5022,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/717236359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":717236359},{"type":"v1","addr":"172.21.15.19:6835","nonce":717236359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T06:04:30.148899+0000","modified":"2024-03-08T06:04:33.195351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6837/1359509141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1359509141},{"type":"v1","addr":"172.21.15.19:6837","nonce":1359509141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-08T06:04:34.234 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 16 2024-03-08T06:04:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.235+0000 7f42cce00640 1 -- 172.21.15.19:0/3591352631 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f42a406b4d0 msgr2=0x7f42a406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.235+0000 7f42cce00640 1 --2- 172.21.15.19:0/3591352631 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f42a406b4d0 0x7f42a406d990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f42c8143ee0 tx=0x7f42b0008040 comp rx=0 tx=0).stop 2024-03-08T06:04:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.235+0000 7f42cce00640 1 -- 172.21.15.19:0/3591352631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42c806d600 msgr2=0x7f42c8139440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.235+0000 7f42cce00640 1 --2- 172.21.15.19:0/3591352631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42c806d600 0x7f42c8139440 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f42b8007f20 tx=0x7f42b800e570 comp rx=0 tx=0).stop 2024-03-08T06:04:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.235+0000 7f42cce00640 1 -- 172.21.15.19:0/3591352631 shutdown_connections 2024-03-08T06:04:34.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.235+0000 7f42cce00640 1 --2- 172.21.15.19:0/3591352631 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f42a406b4d0 0x7f42a406d990 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:34.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.235+0000 7f42cce00640 1 --2- 172.21.15.19:0/3591352631 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f42c8071e90 0x7f42c81f1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:34.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.235+0000 7f42cce00640 1 --2- 172.21.15.19:0/3591352631 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f42c8071ab0 0x7f42c813c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:34.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.235+0000 7f42cce00640 1 --2- 172.21.15.19:0/3591352631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42c806d600 0x7f42c8139440 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:34.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.235+0000 7f42cce00640 1 -- 172.21.15.19:0/3591352631 >> 172.21.15.19:0/3591352631 conn(0x7f42c806ae30 msgr2=0x7f42c80b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:34.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.235+0000 7f42cce00640 1 -- 172.21.15.19:0/3591352631 shutdown_connections 2024-03-08T06:04:34.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.235+0000 7f42cce00640 1 -- 172.21.15.19:0/3591352631 wait complete. 2024-03-08T06:04:34.255 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:04:34.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.473+0000 7f8969800640 1 Processor -- start 2024-03-08T06:04:34.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.474+0000 7f8969800640 1 -- start start 2024-03-08T06:04:34.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.475+0000 7f8969800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f89640d1800 0x7f89640b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:34.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.475+0000 7f8969800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f89640b5bf0 0x7f89640b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:34.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.475+0000 7f8969800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896415e100 con 0x7f896415dd20 2024-03-08T06:04:34.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.475+0000 7f8969800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89640d3a60 con 0x7f89640d1800 2024-03-08T06:04:34.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.475+0000 7f8969800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89640d35d0 con 0x7f89640b5bf0 2024-03-08T06:04:34.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.475+0000 7f8962a00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f896415dd20 0x7f89640cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44262/0 (socket says 172.21.15.19:44262) 2024-03-08T06:04:34.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.475+0000 7f8962a00640 1 -- 172.21.15.19:0/647460163 learned_addr learned my addr 172.21.15.19:0/647460163 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:34.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.475+0000 7f8962000640 1 --2- 172.21.15.19:0/647460163 >> v2:172.21.15.19:3300/0 conn(0x7f89640d1800 0x7f89640b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:34.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.476+0000 7f8961600640 1 -- 172.21.15.19:0/647460163 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846461869 0 0) 0x7f896415e100 con 0x7f896415dd20 2024-03-08T06:04:34.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.476+0000 7f8961600640 1 -- 172.21.15.19:0/647460163 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8948003520 con 0x7f896415dd20 2024-03-08T06:04:34.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.476+0000 7f8962000640 1 -- 172.21.15.19:0/647460163 >> v2:172.21.15.42:3300/0 conn(0x7f89640b5bf0 msgr2=0x7f89640b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:34.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.476+0000 7f8962000640 1 --2- 172.21.15.19:0/647460163 >> v2:172.21.15.42:3300/0 conn(0x7f89640b5bf0 0x7f89640b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:34.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.476+0000 7f8962000640 1 -- 172.21.15.19:0/647460163 >> v1:172.21.15.19:6789/0 conn(0x7f896415dd20 legacy=0x7f89640cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:34.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.476+0000 7f8962000640 1 -- 172.21.15.19:0/647460163 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89640d29c0 con 0x7f89640d1800 2024-03-08T06:04:34.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.477+0000 7f8962000640 1 --2- 172.21.15.19:0/647460163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89640d1800 0x7f89640b56b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f89640d17b0 tx=0x7f894c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e226b84c2f83e414 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:34.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.477+0000 7f8961600640 1 -- 172.21.15.19:0/647460163 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c034070 con 0x7f89640d1800 2024-03-08T06:04:34.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.477+0000 7f8961600640 1 -- 172.21.15.19:0/647460163 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c030610 con 0x7f89640d1800 2024-03-08T06:04:34.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.477+0000 7f8961600640 1 -- 172.21.15.19:0/647460163 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c0309e0 con 0x7f89640d1800 2024-03-08T06:04:34.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.478+0000 7f8969800640 1 -- 172.21.15.19:0/647460163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89640d1800 msgr2=0x7f89640b56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:34.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.478+0000 7f8969800640 1 --2- 172.21.15.19:0/647460163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89640d1800 0x7f89640b56b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f89640d17b0 tx=0x7f894c02b960 comp rx=0 tx=0).stop 2024-03-08T06:04:34.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.478+0000 7f8969800640 1 -- 172.21.15.19:0/647460163 shutdown_connections 2024-03-08T06:04:34.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.478+0000 7f8969800640 1 --2- 172.21.15.19:0/647460163 >> v2:172.21.15.42:3300/0 conn(0x7f89640b5bf0 0x7f89640b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:34.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.478+0000 7f8969800640 1 --2- 172.21.15.19:0/647460163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89640d1800 0x7f89640b56b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:34.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.478+0000 7f8969800640 1 -- 172.21.15.19:0/647460163 >> 172.21.15.19:0/647460163 conn(0x7f8964067240 msgr2=0x7f89640d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:34.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.478+0000 7f8969800640 1 -- 172.21.15.19:0/647460163 shutdown_connections 2024-03-08T06:04:34.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.478+0000 7f8969800640 1 -- 172.21.15.19:0/647460163 wait complete. 2024-03-08T06:04:34.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.480+0000 7f8969800640 1 Processor -- start 2024-03-08T06:04:34.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.480+0000 7f8969800640 1 -- start start 2024-03-08T06:04:34.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.481+0000 7f8969800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89640b5bf0 0x7f89640c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:34.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.481+0000 7f8969800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89640d1800 0x7f89640ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:34.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.482+0000 7f8969800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f896415dd20 0x7f89640ce730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:34.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.482+0000 7f8969800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89640d3260 con 0x7f896415dd20 2024-03-08T06:04:34.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.482+0000 7f8969800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89640d2f80 con 0x7f89640d1800 2024-03-08T06:04:34.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.482+0000 7f8969800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89640b7130 con 0x7f89640b5bf0 2024-03-08T06:04:34.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.482+0000 7f8963400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f896415dd20 0x7f89640ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:34.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.482+0000 7f8963400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f896415dd20 0x7f89640ce730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52180/0 (socket says 172.21.15.19:52180) 2024-03-08T06:04:34.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.482+0000 7f8963400640 1 -- 172.21.15.19:0/631439908 learned_addr learned my addr 172.21.15.19:0/631439908 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:34.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.482+0000 7f8962a00640 1 --2- 172.21.15.19:0/631439908 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89640b5bf0 0x7f89640c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:34.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.482+0000 7f8962000640 1 --2- 172.21.15.19:0/631439908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89640d1800 0x7f89640ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:34.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.482+0000 7f8963400640 1 -- 172.21.15.19:0/631439908 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89640b5bf0 msgr2=0x7f89640c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:34.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.482+0000 7f8963400640 1 --2- 172.21.15.19:0/631439908 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89640b5bf0 0x7f89640c9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:34.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.482+0000 7f8963400640 1 -- 172.21.15.19:0/631439908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89640d1800 msgr2=0x7f89640ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:34.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.482+0000 7f8963400640 1 --2- 172.21.15.19:0/631439908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89640d1800 0x7f89640ce1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:34.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.482+0000 7f8963400640 1 -- 172.21.15.19:0/631439908 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89640c9ff0 con 0x7f896415dd20 2024-03-08T06:04:34.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.483+0000 7f8963400640 1 --2- 172.21.15.19:0/631439908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f896415dd20 0x7f89640ce730 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f895c009fd0 tx=0x7f895c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:34.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.483+0000 7f895aa00640 1 -- 172.21.15.19:0/631439908 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c011830 con 0x7f896415dd20 2024-03-08T06:04:34.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.483+0000 7f895aa00640 1 -- 172.21.15.19:0/631439908 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c016070 con 0x7f896415dd20 2024-03-08T06:04:34.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.483+0000 7f895aa00640 1 -- 172.21.15.19:0/631439908 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c011bf0 con 0x7f896415dd20 2024-03-08T06:04:34.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.483+0000 7f8969800640 1 -- 172.21.15.19:0/631439908 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89641f7240 con 0x7f896415dd20 2024-03-08T06:04:34.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.483+0000 7f8969800640 1 -- 172.21.15.19:0/631439908 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89641f7800 con 0x7f896415dd20 2024-03-08T06:04:34.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.484+0000 7f8969800640 1 -- 172.21.15.19:0/631439908 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8964067cb0 con 0x7f896415dd20 2024-03-08T06:04:34.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.485+0000 7f895aa00640 1 -- 172.21.15.19:0/631439908 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f895c01b460 con 0x7f896415dd20 2024-03-08T06:04:34.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.486+0000 7f895aa00640 1 --2- 172.21.15.19:0/631439908 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f894006b500 0x7f894006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:34.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.487+0000 7f895aa00640 1 -- 172.21.15.19:0/631439908 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f895c089f40 con 0x7f896415dd20 2024-03-08T06:04:34.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.487+0000 7f8962a00640 1 --2- 172.21.15.19:0/631439908 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f894006b500 0x7f894006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:34.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.487+0000 7f8962a00640 1 --2- 172.21.15.19:0/631439908 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f894006b500 0x7f894006d9c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f89540012e0 tx=0x7f8954009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:34.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.491+0000 7f895aa00640 1 -- 172.21.15.19:0/631439908 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f895c058db0 con 0x7f896415dd20 2024-03-08T06:04:34.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.686+0000 7f8969800640 1 -- 172.21.15.19:0/631439908 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89640b5770 con 0x7f896415dd20 2024-03-08T06:04:34.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.689+0000 7f895aa00640 1 -- 172.21.15.19:0/631439908 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16609 (secure 0 0 0) 0x7f895c0586b0 con 0x7f896415dd20 2024-03-08T06:04:34.690 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:34.690 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":34,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:04:31.685292+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:04:28.095112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-08T06:04:29.178532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:04:34.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.692+0000 7f8969800640 1 -- 172.21.15.19:0/631439908 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f894006b500 msgr2=0x7f894006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:34.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.692+0000 7f8969800640 1 --2- 172.21.15.19:0/631439908 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f894006b500 0x7f894006d9c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f89540012e0 tx=0x7f8954009040 comp rx=0 tx=0).stop 2024-03-08T06:04:34.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.692+0000 7f8969800640 1 -- 172.21.15.19:0/631439908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f896415dd20 msgr2=0x7f89640ce730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:34.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.692+0000 7f8969800640 1 --2- 172.21.15.19:0/631439908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f896415dd20 0x7f89640ce730 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f895c009fd0 tx=0x7f895c00b8e0 comp rx=0 tx=0).stop 2024-03-08T06:04:34.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.692+0000 7f8969800640 1 -- 172.21.15.19:0/631439908 shutdown_connections 2024-03-08T06:04:34.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.692+0000 7f8969800640 1 --2- 172.21.15.19:0/631439908 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f894006b500 0x7f894006d9c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:34.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.692+0000 7f8969800640 1 --2- 172.21.15.19:0/631439908 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f896415dd20 0x7f89640ce730 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.692+0000 7f8969800640 1 --2- 172.21.15.19:0/631439908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f89640d1800 0x7f89640ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.692+0000 7f8969800640 1 --2- 172.21.15.19:0/631439908 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f89640b5bf0 0x7f89640c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.692+0000 7f8969800640 1 -- 172.21.15.19:0/631439908 >> 172.21.15.19:0/631439908 conn(0x7f8964067240 msgr2=0x7f89640b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.692+0000 7f8969800640 1 -- 172.21.15.19:0/631439908 shutdown_connections 2024-03-08T06:04:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.692+0000 7f8969800640 1 -- 172.21.15.19:0/631439908 wait complete. 2024-03-08T06:04:34.712 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-08T06:04:34.713 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T06:04:34.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.932+0000 7f5724a00640 1 Processor -- start 2024-03-08T06:04:34.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.932+0000 7f5724a00640 1 -- start start 2024-03-08T06:04:34.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.934+0000 7f5724a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5720145520 0x7f572015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:34.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.934+0000 7f5724a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572015ceb0 con 0x7f572015bea0 2024-03-08T06:04:34.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.934+0000 7f5724a00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572015c330 con 0x7f5720071df0 2024-03-08T06:04:34.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.934+0000 7f5724a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572015c610 con 0x7f5720145520 2024-03-08T06:04:34.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.934+0000 7f571ea00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f572015bea0 0x7f57200716e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44272/0 (socket says 172.21.15.19:44272) 2024-03-08T06:04:34.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.934+0000 7f571ea00640 1 -- 172.21.15.19:0/2337550645 learned_addr learned my addr 172.21.15.19:0/2337550645 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.934+0000 7f571f400640 1 --2- 172.21.15.19:0/2337550645 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5720145520 0x7f572015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.934+0000 7f571e000640 1 -- 172.21.15.19:0/2337550645 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080605620 0 0) 0x7f572015ceb0 con 0x7f572015bea0 2024-03-08T06:04:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.935+0000 7f571e000640 1 -- 172.21.15.19:0/2337550645 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5704003520 con 0x7f572015bea0 2024-03-08T06:04:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.935+0000 7f571e000640 1 -- 172.21.15.19:0/2337550645 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3281056098 0 0) 0x7f5704003520 con 0x7f572015bea0 2024-03-08T06:04:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.935+0000 7f571e000640 1 -- 172.21.15.19:0/2337550645 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5720145520 msgr2=0x7f572015d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.935+0000 7f571e000640 1 --2- 172.21.15.19:0/2337550645 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5720145520 0x7f572015d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.935+0000 7f571e000640 1 -- 172.21.15.19:0/2337550645 >> v1:172.21.15.42:6789/0 conn(0x7f5720071df0 legacy=0x7f572006d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.935+0000 7f571e000640 1 -- 172.21.15.19:0/2337550645 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572015c8f0 con 0x7f572015bea0 2024-03-08T06:04:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.935+0000 7f571e000640 1 -- 172.21.15.19:0/2337550645 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f5708001670 con 0x7f572015bea0 2024-03-08T06:04:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.935+0000 7f571e000640 1 -- 172.21.15.19:0/2337550645 >> v1:172.21.15.19:6789/0 conn(0x7f572015bea0 legacy=0x7f57200716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.935+0000 7f571e000640 1 --2- 172.21.15.19:0/2337550645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57040039e0 0x7f5704003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.935+0000 7f571e000640 1 --2- 172.21.15.19:0/2337550645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5704004800 0x7f5704004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.935+0000 7f571e000640 1 --2- 172.21.15.19:0/2337550645 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5720145520 0x7f57040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.935+0000 7f571e000640 1 -- 172.21.15.19:0/2337550645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572015c610 con 0x7f5704004800 2024-03-08T06:04:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.935+0000 7f571e000640 1 -- 172.21.15.19:0/2337550645 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570400baa0 con 0x7f57040039e0 2024-03-08T06:04:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.935+0000 7f571e000640 1 -- 172.21.15.19:0/2337550645 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f570400bca0 con 0x7f5720145520 2024-03-08T06:04:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.935+0000 7f571ea00640 1 --2- 172.21.15.19:0/2337550645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5704004800 0x7f5704004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.936+0000 7f571fe00640 1 --2- 172.21.15.19:0/2337550645 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5720145520 0x7f57040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.936+0000 7f571f400640 1 --2- 172.21.15.19:0/2337550645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57040039e0 0x7f5704003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.936+0000 7f571ea00640 1 -- 172.21.15.19:0/2337550645 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5720145520 msgr2=0x7f57040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.936+0000 7f571ea00640 1 --2- 172.21.15.19:0/2337550645 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5720145520 0x7f57040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.936+0000 7f571ea00640 1 -- 172.21.15.19:0/2337550645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57040039e0 msgr2=0x7f5704003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.936+0000 7f571ea00640 1 --2- 172.21.15.19:0/2337550645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57040039e0 0x7f5704003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:34.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.936+0000 7f571ea00640 1 -- 172.21.15.19:0/2337550645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5704003520 con 0x7f5704004800 2024-03-08T06:04:34.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.936+0000 7f571f400640 1 --2- 172.21.15.19:0/2337550645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57040039e0 0x7f5704003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:34.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.937+0000 7f571ea00640 1 --2- 172.21.15.19:0/2337550645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5704004800 0x7f5704004c80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5708007fd0 tx=0x7f5704005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04e241f1315a3b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:34.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.937+0000 7f571e000640 1 -- 172.21.15.19:0/2337550645 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5708007c20 con 0x7f5704004800 2024-03-08T06:04:34.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.937+0000 7f571e000640 1 -- 172.21.15.19:0/2337550645 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5708030070 con 0x7f5704004800 2024-03-08T06:04:34.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.937+0000 7f571e000640 1 -- 172.21.15.19:0/2337550645 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5708005d30 con 0x7f5704004800 2024-03-08T06:04:34.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.938+0000 7f5724a00640 1 -- 172.21.15.19:0/2337550645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5704004800 msgr2=0x7f5704004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:34.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.938+0000 7f5724a00640 1 --2- 172.21.15.19:0/2337550645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5704004800 0x7f5704004c80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5708007fd0 tx=0x7f5704005830 comp rx=0 tx=0).stop 2024-03-08T06:04:34.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.938+0000 7f571fe00640 1 -- 172.21.15.19:0/2337550645 reap_dead start 2024-03-08T06:04:34.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.938+0000 7f5724a00640 1 -- 172.21.15.19:0/2337550645 shutdown_connections 2024-03-08T06:04:34.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.938+0000 7f5724a00640 1 -- 172.21.15.19:0/2337550645 >> 172.21.15.19:0/2337550645 conn(0x7f57200b1850 msgr2=0x7f57200b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:34.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.938+0000 7f5724a00640 1 -- 172.21.15.19:0/2337550645 shutdown_connections 2024-03-08T06:04:34.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.938+0000 7f5724a00640 1 -- 172.21.15.19:0/2337550645 wait complete. 2024-03-08T06:04:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.940+0000 7f5724a00640 1 Processor -- start 2024-03-08T06:04:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.940+0000 7f5724a00640 1 -- start start 2024-03-08T06:04:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.941+0000 7f5724a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5704004800 0x7f572015aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.941+0000 7f5724a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f572015b330 0x7f57201f6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.941+0000 7f5724a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f57201f74f0 0x7f57200b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.941+0000 7f5724a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57200af1c0 con 0x7f5704004800 2024-03-08T06:04:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.941+0000 7f5724a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57200af040 con 0x7f572015b330 2024-03-08T06:04:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.941+0000 7f5724a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572006e410 con 0x7f57201f74f0 2024-03-08T06:04:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.941+0000 7f571f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5704004800 0x7f572015aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.941+0000 7f571f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5704004800 0x7f572015aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52196/0 (socket says 172.21.15.19:52196) 2024-03-08T06:04:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.941+0000 7f571f400640 1 -- 172.21.15.19:0/2662904320 learned_addr learned my addr 172.21.15.19:0/2662904320 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.942+0000 7f571f400640 1 -- 172.21.15.19:0/2662904320 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f57201f74f0 msgr2=0x7f57200b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.942+0000 7f571f400640 1 --2- 172.21.15.19:0/2662904320 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f57201f74f0 0x7f57200b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.942+0000 7f571f400640 1 -- 172.21.15.19:0/2662904320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f572015b330 msgr2=0x7f57201f6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.942+0000 7f571ea00640 1 --2- 172.21.15.19:0/2662904320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f572015b330 0x7f57201f6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.942+0000 7f571f400640 1 --2- 172.21.15.19:0/2662904320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f572015b330 0x7f57201f6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.942+0000 7f571f400640 1 -- 172.21.15.19:0/2662904320 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57201f7990 con 0x7f5704004800 2024-03-08T06:04:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.942+0000 7f571f400640 1 --2- 172.21.15.19:0/2662904320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5704004800 0x7f572015aa10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5710010890 tx=0x7f5710010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.942+0000 7f5717400640 1 -- 172.21.15.19:0/2662904320 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571000f040 con 0x7f5704004800 2024-03-08T06:04:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.942+0000 7f5717400640 1 -- 172.21.15.19:0/2662904320 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571000eb00 con 0x7f5704004800 2024-03-08T06:04:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.942+0000 7f5717400640 1 -- 172.21.15.19:0/2662904320 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571001c400 con 0x7f5704004800 2024-03-08T06:04:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.942+0000 7f5724a00640 1 -- 172.21.15.19:0/2662904320 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57201f7c70 con 0x7f5704004800 2024-03-08T06:04:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.942+0000 7f5724a00640 1 -- 172.21.15.19:0/2662904320 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572015af50 con 0x7f5704004800 2024-03-08T06:04:34.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.944+0000 7f5724a00640 1 -- 172.21.15.19:0/2662904320 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5720075100 con 0x7f5704004800 2024-03-08T06:04:34.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.944+0000 7f5717400640 1 -- 172.21.15.19:0/2662904320 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f571001c5a0 con 0x7f5704004800 2024-03-08T06:04:34.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.945+0000 7f5717400640 1 --2- 172.21.15.19:0/2662904320 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f56fc06b4d0 0x7f56fc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:34.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.945+0000 7f5717400640 1 -- 172.21.15.19:0/2662904320 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f571008a880 con 0x7f5704004800 2024-03-08T06:04:34.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.946+0000 7f571ea00640 1 --2- 172.21.15.19:0/2662904320 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f56fc06b4d0 0x7f56fc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:34.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.946+0000 7f571ea00640 1 --2- 172.21.15.19:0/2662904320 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f56fc06b4d0 0x7f56fc06d990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5708034000 tx=0x7f5708039040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:34.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:34.950+0000 7f5717400640 1 -- 172.21.15.19:0/2662904320 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5710018030 con 0x7f5704004800 2024-03-08T06:04:35.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.145+0000 7f5724a00640 1 -- 172.21.15.19:0/2662904320 --> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f57201f7e40 con 0x7f56fc06b4d0 2024-03-08T06:04:35.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.167+0000 7f5717400640 1 -- 172.21.15.19:0/2662904320 <== mgr.4107 v2:172.21.15.19:6832/3589745192 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251950 (secure 0 0 0) 0x7f57201f7e40 con 0x7f56fc06b4d0 2024-03-08T06:04:35.171 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:35.172 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-08T06:04:35.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.171+0000 7f5724a00640 1 -- 172.21.15.19:0/2662904320 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f56fc06b4d0 msgr2=0x7f56fc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:35.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.171+0000 7f5724a00640 1 --2- 172.21.15.19:0/2662904320 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f56fc06b4d0 0x7f56fc06d990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5708034000 tx=0x7f5708039040 comp rx=0 tx=0).stop 2024-03-08T06:04:35.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.171+0000 7f5724a00640 1 -- 172.21.15.19:0/2662904320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5704004800 msgr2=0x7f572015aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:35.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.171+0000 7f5724a00640 1 --2- 172.21.15.19:0/2662904320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5704004800 0x7f572015aa10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5710010890 tx=0x7f5710010d50 comp rx=0 tx=0).stop 2024-03-08T06:04:35.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.171+0000 7f5724a00640 1 -- 172.21.15.19:0/2662904320 shutdown_connections 2024-03-08T06:04:35.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.171+0000 7f5724a00640 1 --2- 172.21.15.19:0/2662904320 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f56fc06b4d0 0x7f56fc06d990 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:35.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.171+0000 7f5724a00640 1 --2- 172.21.15.19:0/2662904320 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f57201f74f0 0x7f57200b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:35.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.171+0000 7f5724a00640 1 --2- 172.21.15.19:0/2662904320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f572015b330 0x7f57201f6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:35.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.171+0000 7f5724a00640 1 --2- 172.21.15.19:0/2662904320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5704004800 0x7f572015aa10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:35.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.171+0000 7f5724a00640 1 -- 172.21.15.19:0/2662904320 >> 172.21.15.19:0/2662904320 conn(0x7f57200b1850 msgr2=0x7f572015d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:35.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.171+0000 7f5724a00640 1 -- 172.21.15.19:0/2662904320 shutdown_connections 2024-03-08T06:04:35.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.171+0000 7f5724a00640 1 -- 172.21.15.19:0/2662904320 wait complete. 2024-03-08T06:04:35.193 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-03-08T06:04:34.097224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237032,"kb_used_data":4196,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737688,"statfs":{"total":773094113280,"available":772851392512,"internally_reserved":0,"allocated":4296704,"data_stored":2376824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.450845"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.990417+0000","last_change":"2024-03-08T06:04:30.698390+0000","last_active":"2024-03-08T06:04:32.990417+0000","last_peered":"2024-03-08T06:04:32.990417+0000","last_clean":"2024-03-08T06:04:32.990417+0000","last_became_active":"2024-03-08T06:04:30.698062+0000","last_became_peered":"2024-03-08T06:04:30.698062+0000","last_unstale":"2024-03-08T06:04:32.990417+0000","last_undegraded":"2024-03-08T06:04:32.990417+0000","last_fullsized":"2024-03-08T06:04:32.990417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:06:09.516032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.704476+0000","last_change":"2024-03-08T06:04:30.708629+0000","last_active":"2024-03-08T06:04:31.704476+0000","last_peered":"2024-03-08T06:04:31.704476+0000","last_clean":"2024-03-08T06:04:31.704476+0000","last_became_active":"2024-03-08T06:04:30.706044+0000","last_became_peered":"2024-03-08T06:04:30.706044+0000","last_unstale":"2024-03-08T06:04:31.704476+0000","last_undegraded":"2024-03-08T06:04:31.704476+0000","last_fullsized":"2024-03-08T06:04:31.704476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:04:10.845389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.710046+0000","last_change":"2024-03-08T06:04:30.707203+0000","last_active":"2024-03-08T06:04:31.710046+0000","last_peered":"2024-03-08T06:04:31.710046+0000","last_clean":"2024-03-08T06:04:31.710046+0000","last_became_active":"2024-03-08T06:04:30.706868+0000","last_became_peered":"2024-03-08T06:04:30.706868+0000","last_unstale":"2024-03-08T06:04:31.710046+0000","last_undegraded":"2024-03-08T06:04:31.710046+0000","last_fullsized":"2024-03-08T06:04:31.710046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:56:19.091016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.742733+0000","last_change":"2024-03-08T06:04:30.706646+0000","last_active":"2024-03-08T06:04:32.742733+0000","last_peered":"2024-03-08T06:04:32.742733+0000","last_clean":"2024-03-08T06:04:32.742733+0000","last_became_active":"2024-03-08T06:04:30.706378+0000","last_became_peered":"2024-03-08T06:04:30.706378+0000","last_unstale":"2024-03-08T06:04:32.742733+0000","last_undegraded":"2024-03-08T06:04:32.742733+0000","last_fullsized":"2024-03-08T06:04:32.742733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:14:54.537720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989176+0000","last_change":"2024-03-08T06:04:30.698196+0000","last_active":"2024-03-08T06:04:32.989176+0000","last_peered":"2024-03-08T06:04:32.989176+0000","last_clean":"2024-03-08T06:04:32.989176+0000","last_became_active":"2024-03-08T06:04:30.694572+0000","last_became_peered":"2024-03-08T06:04:30.694572+0000","last_unstale":"2024-03-08T06:04:32.989176+0000","last_undegraded":"2024-03-08T06:04:32.989176+0000","last_fullsized":"2024-03-08T06:04:32.989176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:19:59.668374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.703770+0000","last_change":"2024-03-08T06:04:30.701584+0000","last_active":"2024-03-08T06:04:31.703770+0000","last_peered":"2024-03-08T06:04:31.703770+0000","last_clean":"2024-03-08T06:04:31.703770+0000","last_became_active":"2024-03-08T06:04:30.701253+0000","last_became_peered":"2024-03-08T06:04:30.701253+0000","last_unstale":"2024-03-08T06:04:31.703770+0000","last_undegraded":"2024-03-08T06:04:31.703770+0000","last_fullsized":"2024-03-08T06:04:31.703770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:49:06.618016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.706856+0000","last_change":"2024-03-08T06:04:30.703017+0000","last_active":"2024-03-08T06:04:31.706856+0000","last_peered":"2024-03-08T06:04:31.706856+0000","last_clean":"2024-03-08T06:04:31.706856+0000","last_became_active":"2024-03-08T06:04:30.702370+0000","last_became_peered":"2024-03-08T06:04:30.702370+0000","last_unstale":"2024-03-08T06:04:31.706856+0000","last_undegraded":"2024-03-08T06:04:31.706856+0000","last_fullsized":"2024-03-08T06:04:31.706856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:14:54.537720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.706915+0000","last_change":"2024-03-08T06:04:30.698248+0000","last_active":"2024-03-08T06:04:31.706915+0000","last_peered":"2024-03-08T06:04:31.706915+0000","last_clean":"2024-03-08T06:04:31.706915+0000","last_became_active":"2024-03-08T06:04:30.697941+0000","last_became_peered":"2024-03-08T06:04:30.697941+0000","last_unstale":"2024-03-08T06:04:31.706915+0000","last_undegraded":"2024-03-08T06:04:31.706915+0000","last_fullsized":"2024-03-08T06:04:31.706915+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:26:41.031717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.795657+0000","last_change":"2024-03-08T06:04:30.712176+0000","last_active":"2024-03-08T06:04:32.795657+0000","last_peered":"2024-03-08T06:04:32.795657+0000","last_clean":"2024-03-08T06:04:32.795657+0000","last_became_active":"2024-03-08T06:04:30.711790+0000","last_became_peered":"2024-03-08T06:04:30.711790+0000","last_unstale":"2024-03-08T06:04:32.795657+0000","last_undegraded":"2024-03-08T06:04:32.795657+0000","last_fullsized":"2024-03-08T06:04:32.795657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:00:13.481439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.743063+0000","last_change":"2024-03-08T06:04:30.710845+0000","last_active":"2024-03-08T06:04:32.743063+0000","last_peered":"2024-03-08T06:04:32.743063+0000","last_clean":"2024-03-08T06:04:32.743063+0000","last_became_active":"2024-03-08T06:04:30.709887+0000","last_became_peered":"2024-03-08T06:04:30.709887+0000","last_unstale":"2024-03-08T06:04:32.743063+0000","last_undegraded":"2024-03-08T06:04:32.743063+0000","last_fullsized":"2024-03-08T06:04:32.743063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:39:17.549225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.708299+0000","last_change":"2024-03-08T06:04:30.688175+0000","last_active":"2024-03-08T06:04:31.708299+0000","last_peered":"2024-03-08T06:04:31.708299+0000","last_clean":"2024-03-08T06:04:31.708299+0000","last_became_active":"2024-03-08T06:04:30.687636+0000","last_became_peered":"2024-03-08T06:04:30.687636+0000","last_unstale":"2024-03-08T06:04:31.708299+0000","last_undegraded":"2024-03-08T06:04:31.708299+0000","last_fullsized":"2024-03-08T06:04:31.708299+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:49:06.618016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.709161+0000","last_change":"2024-03-08T06:04:30.708914+0000","last_active":"2024-03-08T06:04:31.709161+0000","last_peered":"2024-03-08T06:04:31.709161+0000","last_clean":"2024-03-08T06:04:31.709161+0000","last_became_active":"2024-03-08T06:04:30.708643+0000","last_became_peered":"2024-03-08T06:04:30.708643+0000","last_unstale":"2024-03-08T06:04:31.709161+0000","last_undegraded":"2024-03-08T06:04:31.709161+0000","last_fullsized":"2024-03-08T06:04:31.709161+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:44:44.555166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989350+0000","last_change":"2024-03-08T06:04:30.693552+0000","last_active":"2024-03-08T06:04:32.989350+0000","last_peered":"2024-03-08T06:04:32.989350+0000","last_clean":"2024-03-08T06:04:32.989350+0000","last_became_active":"2024-03-08T06:04:30.692862+0000","last_became_peered":"2024-03-08T06:04:30.692862+0000","last_unstale":"2024-03-08T06:04:32.989350+0000","last_undegraded":"2024-03-08T06:04:32.989350+0000","last_fullsized":"2024-03-08T06:04:32.989350+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:44:37.021711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.703964+0000","last_change":"2024-03-08T06:04:30.702154+0000","last_active":"2024-03-08T06:04:31.703964+0000","last_peered":"2024-03-08T06:04:31.703964+0000","last_clean":"2024-03-08T06:04:31.703964+0000","last_became_active":"2024-03-08T06:04:30.701878+0000","last_became_peered":"2024-03-08T06:04:30.701878+0000","last_unstale":"2024-03-08T06:04:31.703964+0000","last_undegraded":"2024-03-08T06:04:31.703964+0000","last_fullsized":"2024-03-08T06:04:31.703964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:56:19.091016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.708869+0000","last_change":"2024-03-08T06:04:30.707852+0000","last_active":"2024-03-08T06:04:31.708869+0000","last_peered":"2024-03-08T06:04:31.708869+0000","last_clean":"2024-03-08T06:04:31.708869+0000","last_became_active":"2024-03-08T06:04:30.707465+0000","last_became_peered":"2024-03-08T06:04:30.707465+0000","last_unstale":"2024-03-08T06:04:31.708869+0000","last_undegraded":"2024-03-08T06:04:31.708869+0000","last_fullsized":"2024-03-08T06:04:31.708869+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:39:17.549225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.707962+0000","last_change":"2024-03-08T06:04:30.692086+0000","last_active":"2024-03-08T06:04:31.707962+0000","last_peered":"2024-03-08T06:04:31.707962+0000","last_clean":"2024-03-08T06:04:31.707962+0000","last_became_active":"2024-03-08T06:04:30.691781+0000","last_became_peered":"2024-03-08T06:04:30.691781+0000","last_unstale":"2024-03-08T06:04:31.707962+0000","last_undegraded":"2024-03-08T06:04:31.707962+0000","last_fullsized":"2024-03-08T06:04:31.707962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:14:14.538452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.707998+0000","last_change":"2024-03-08T06:04:30.712038+0000","last_active":"2024-03-08T06:04:31.707998+0000","last_peered":"2024-03-08T06:04:31.707998+0000","last_clean":"2024-03-08T06:04:31.707998+0000","last_became_active":"2024-03-08T06:04:30.711726+0000","last_became_peered":"2024-03-08T06:04:30.711726+0000","last_unstale":"2024-03-08T06:04:31.707998+0000","last_undegraded":"2024-03-08T06:04:31.707998+0000","last_fullsized":"2024-03-08T06:04:31.707998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:24:27.225080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.704911+0000","last_change":"2024-03-08T06:04:30.696376+0000","last_active":"2024-03-08T06:04:31.704911+0000","last_peered":"2024-03-08T06:04:31.704911+0000","last_clean":"2024-03-08T06:04:31.704911+0000","last_became_active":"2024-03-08T06:04:30.696059+0000","last_became_peered":"2024-03-08T06:04:30.696059+0000","last_unstale":"2024-03-08T06:04:31.704911+0000","last_undegraded":"2024-03-08T06:04:31.704911+0000","last_fullsized":"2024-03-08T06:04:31.704911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:03:51.140740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.704694+0000","last_change":"2024-03-08T06:04:30.694921+0000","last_active":"2024-03-08T06:04:31.704694+0000","last_peered":"2024-03-08T06:04:31.704694+0000","last_clean":"2024-03-08T06:04:31.704694+0000","last_became_active":"2024-03-08T06:04:30.694665+0000","last_became_peered":"2024-03-08T06:04:30.694665+0000","last_unstale":"2024-03-08T06:04:31.704694+0000","last_undegraded":"2024-03-08T06:04:31.704694+0000","last_fullsized":"2024-03-08T06:04:31.704694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:18:23.963098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989769+0000","last_change":"2024-03-08T06:04:30.699394+0000","last_active":"2024-03-08T06:04:32.989769+0000","last_peered":"2024-03-08T06:04:32.989769+0000","last_clean":"2024-03-08T06:04:32.989769+0000","last_became_active":"2024-03-08T06:04:30.699164+0000","last_became_peered":"2024-03-08T06:04:30.699164+0000","last_unstale":"2024-03-08T06:04:32.989769+0000","last_undegraded":"2024-03-08T06:04:32.989769+0000","last_fullsized":"2024-03-08T06:04:32.989769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:39:06.790675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.794705+0000","last_change":"2024-03-08T06:04:30.712482+0000","last_active":"2024-03-08T06:04:32.794705+0000","last_peered":"2024-03-08T06:04:32.794705+0000","last_clean":"2024-03-08T06:04:32.794705+0000","last_became_active":"2024-03-08T06:04:30.712134+0000","last_became_peered":"2024-03-08T06:04:30.712134+0000","last_unstale":"2024-03-08T06:04:32.794705+0000","last_undegraded":"2024-03-08T06:04:32.794705+0000","last_fullsized":"2024-03-08T06:04:32.794705+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:31:39.475858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.795458+0000","last_change":"2024-03-08T06:04:30.716153+0000","last_active":"2024-03-08T06:04:32.795458+0000","last_peered":"2024-03-08T06:04:32.795458+0000","last_clean":"2024-03-08T06:04:32.795458+0000","last_became_active":"2024-03-08T06:04:30.715266+0000","last_became_peered":"2024-03-08T06:04:30.715266+0000","last_unstale":"2024-03-08T06:04:32.795458+0000","last_undegraded":"2024-03-08T06:04:32.795458+0000","last_fullsized":"2024-03-08T06:04:32.795458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:35:58.857526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.088476+0000","last_change":"2024-03-08T06:04:30.698823+0000","last_active":"2024-03-08T06:04:32.088476+0000","last_peered":"2024-03-08T06:04:32.088476+0000","last_clean":"2024-03-08T06:04:32.088476+0000","last_became_active":"2024-03-08T06:04:30.698554+0000","last_became_peered":"2024-03-08T06:04:30.698554+0000","last_unstale":"2024-03-08T06:04:32.088476+0000","last_undegraded":"2024-03-08T06:04:32.088476+0000","last_fullsized":"2024-03-08T06:04:32.088476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:02:52.659754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.707874+0000","last_change":"2024-03-08T06:04:30.701306+0000","last_active":"2024-03-08T06:04:31.707874+0000","last_peered":"2024-03-08T06:04:31.707874+0000","last_clean":"2024-03-08T06:04:31.707874+0000","last_became_active":"2024-03-08T06:04:30.701001+0000","last_became_peered":"2024-03-08T06:04:30.701001+0000","last_unstale":"2024-03-08T06:04:31.707874+0000","last_undegraded":"2024-03-08T06:04:31.707874+0000","last_fullsized":"2024-03-08T06:04:31.707874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T06:29:55.161250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.743203+0000","last_change":"2024-03-08T06:04:30.698617+0000","last_active":"2024-03-08T06:04:32.743203+0000","last_peered":"2024-03-08T06:04:32.743203+0000","last_clean":"2024-03-08T06:04:32.743203+0000","last_became_active":"2024-03-08T06:04:30.695511+0000","last_became_peered":"2024-03-08T06:04:30.695511+0000","last_unstale":"2024-03-08T06:04:32.743203+0000","last_undegraded":"2024-03-08T06:04:32.743203+0000","last_fullsized":"2024-03-08T06:04:32.743203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:46:41.655761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.705345+0000","last_change":"2024-03-08T06:04:30.710536+0000","last_active":"2024-03-08T06:04:31.705345+0000","last_peered":"2024-03-08T06:04:31.705345+0000","last_clean":"2024-03-08T06:04:31.705345+0000","last_became_active":"2024-03-08T06:04:30.710190+0000","last_became_peered":"2024-03-08T06:04:30.710190+0000","last_unstale":"2024-03-08T06:04:31.705345+0000","last_undegraded":"2024-03-08T06:04:31.705345+0000","last_fullsized":"2024-03-08T06:04:31.705345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:57:20.239629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.743041+0000","last_change":"2024-03-08T06:04:30.718301+0000","last_active":"2024-03-08T06:04:32.743041+0000","last_peered":"2024-03-08T06:04:32.743041+0000","last_clean":"2024-03-08T06:04:32.743041+0000","last_became_active":"2024-03-08T06:04:30.714116+0000","last_became_peered":"2024-03-08T06:04:30.714116+0000","last_unstale":"2024-03-08T06:04:32.743041+0000","last_undegraded":"2024-03-08T06:04:32.743041+0000","last_fullsized":"2024-03-08T06:04:32.743041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T06:29:55.161250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.709264+0000","last_change":"2024-03-08T06:04:30.710067+0000","last_active":"2024-03-08T06:04:31.709264+0000","last_peered":"2024-03-08T06:04:31.709264+0000","last_clean":"2024-03-08T06:04:31.709264+0000","last_became_active":"2024-03-08T06:04:30.709264+0000","last_became_peered":"2024-03-08T06:04:30.709264+0000","last_unstale":"2024-03-08T06:04:31.709264+0000","last_undegraded":"2024-03-08T06:04:31.709264+0000","last_fullsized":"2024-03-08T06:04:31.709264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:33:36.594482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.794443+0000","last_change":"2024-03-08T06:04:30.720648+0000","last_active":"2024-03-08T06:04:32.794443+0000","last_peered":"2024-03-08T06:04:32.794443+0000","last_clean":"2024-03-08T06:04:32.794443+0000","last_became_active":"2024-03-08T06:04:30.720336+0000","last_became_peered":"2024-03-08T06:04:30.720336+0000","last_unstale":"2024-03-08T06:04:32.794443+0000","last_undegraded":"2024-03-08T06:04:32.794443+0000","last_fullsized":"2024-03-08T06:04:32.794443+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:33:49.833346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.707377+0000","last_change":"2024-03-08T06:04:30.698185+0000","last_active":"2024-03-08T06:04:31.707377+0000","last_peered":"2024-03-08T06:04:31.707377+0000","last_clean":"2024-03-08T06:04:31.707377+0000","last_became_active":"2024-03-08T06:04:30.697835+0000","last_became_peered":"2024-03-08T06:04:30.697835+0000","last_unstale":"2024-03-08T06:04:31.707377+0000","last_undegraded":"2024-03-08T06:04:31.707377+0000","last_fullsized":"2024-03-08T06:04:31.707377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:46:41.655761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989999+0000","last_change":"2024-03-08T06:04:30.700483+0000","last_active":"2024-03-08T06:04:32.989999+0000","last_peered":"2024-03-08T06:04:32.989999+0000","last_clean":"2024-03-08T06:04:32.989999+0000","last_became_active":"2024-03-08T06:04:30.699136+0000","last_became_peered":"2024-03-08T06:04:30.699136+0000","last_unstale":"2024-03-08T06:04:32.989999+0000","last_undegraded":"2024-03-08T06:04:32.989999+0000","last_fullsized":"2024-03-08T06:04:32.989999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:50:40.811793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.707570+0000","last_change":"2024-03-08T06:04:30.705721+0000","last_active":"2024-03-08T06:04:31.707570+0000","last_peered":"2024-03-08T06:04:31.707570+0000","last_clean":"2024-03-08T06:04:31.707570+0000","last_became_active":"2024-03-08T06:04:30.705291+0000","last_became_peered":"2024-03-08T06:04:30.705291+0000","last_unstale":"2024-03-08T06:04:31.707570+0000","last_undegraded":"2024-03-08T06:04:31.707570+0000","last_fullsized":"2024-03-08T06:04:31.707570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:33:36.594482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.088784+0000","last_change":"2024-03-08T06:04:30.690196+0000","last_active":"2024-03-08T06:04:32.088784+0000","last_peered":"2024-03-08T06:04:32.088784+0000","last_clean":"2024-03-08T06:04:32.088784+0000","last_became_active":"2024-03-08T06:04:30.689865+0000","last_became_peered":"2024-03-08T06:04:30.689865+0000","last_unstale":"2024-03-08T06:04:32.088784+0000","last_undegraded":"2024-03-08T06:04:32.088784+0000","last_fullsized":"2024-03-08T06:04:32.088784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:12:39.906906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.990571+0000","last_change":"2024-03-08T06:04:29.702608+0000","last_active":"2024-03-08T06:04:32.990571+0000","last_peered":"2024-03-08T06:04:32.990571+0000","last_clean":"2024-03-08T06:04:32.990571+0000","last_became_active":"2024-03-08T06:04:29.701532+0000","last_became_peered":"2024-03-08T06:04:29.701532+0000","last_unstale":"2024-03-08T06:04:32.990571+0000","last_undegraded":"2024-03-08T06:04:32.990571+0000","last_fullsized":"2024-03-08T06:04:32.990571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:39:05.777435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.990474+0000","last_change":"2024-03-08T06:04:30.713960+0000","last_active":"2024-03-08T06:04:32.990474+0000","last_peered":"2024-03-08T06:04:32.990474+0000","last_clean":"2024-03-08T06:04:32.990474+0000","last_became_active":"2024-03-08T06:04:30.713678+0000","last_became_peered":"2024-03-08T06:04:30.713678+0000","last_unstale":"2024-03-08T06:04:32.990474+0000","last_undegraded":"2024-03-08T06:04:32.990474+0000","last_fullsized":"2024-03-08T06:04:32.990474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:02:52.659754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.088840+0000","last_change":"2024-03-08T06:04:29.690622+0000","last_active":"2024-03-08T06:04:32.088840+0000","last_peered":"2024-03-08T06:04:32.088840+0000","last_clean":"2024-03-08T06:04:32.088840+0000","last_became_active":"2024-03-08T06:04:29.690290+0000","last_became_peered":"2024-03-08T06:04:29.690290+0000","last_unstale":"2024-03-08T06:04:32.088840+0000","last_undegraded":"2024-03-08T06:04:32.088840+0000","last_fullsized":"2024-03-08T06:04:32.088840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:44:08.589995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.795306+0000","last_change":"2024-03-08T06:04:30.720606+0000","last_active":"2024-03-08T06:04:32.795306+0000","last_peered":"2024-03-08T06:04:32.795306+0000","last_clean":"2024-03-08T06:04:32.795306+0000","last_became_active":"2024-03-08T06:04:30.720298+0000","last_became_peered":"2024-03-08T06:04:30.720298+0000","last_unstale":"2024-03-08T06:04:32.795306+0000","last_undegraded":"2024-03-08T06:04:32.795306+0000","last_fullsized":"2024-03-08T06:04:32.795306+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:08:17.612578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.704963+0000","last_change":"2024-03-08T06:04:29.682715+0000","last_active":"2024-03-08T06:04:31.704963+0000","last_peered":"2024-03-08T06:04:31.704963+0000","last_clean":"2024-03-08T06:04:31.704963+0000","last_became_active":"2024-03-08T06:04:29.679987+0000","last_became_peered":"2024-03-08T06:04:29.679987+0000","last_unstale":"2024-03-08T06:04:31.704963+0000","last_undegraded":"2024-03-08T06:04:31.704963+0000","last_fullsized":"2024-03-08T06:04:31.704963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:50:39.798554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.743426+0000","last_change":"2024-03-08T06:04:30.715586+0000","last_active":"2024-03-08T06:04:32.743426+0000","last_peered":"2024-03-08T06:04:32.743426+0000","last_clean":"2024-03-08T06:04:32.743426+0000","last_became_active":"2024-03-08T06:04:30.713774+0000","last_became_peered":"2024-03-08T06:04:30.713774+0000","last_unstale":"2024-03-08T06:04:32.743426+0000","last_undegraded":"2024-03-08T06:04:32.743426+0000","last_fullsized":"2024-03-08T06:04:32.743426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:44:44.555166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989707+0000","last_change":"2024-03-08T06:04:29.692118+0000","last_active":"2024-03-08T06:04:32.989707+0000","last_peered":"2024-03-08T06:04:32.989707+0000","last_clean":"2024-03-08T06:04:32.989707+0000","last_became_active":"2024-03-08T06:04:29.691713+0000","last_became_peered":"2024-03-08T06:04:29.691713+0000","last_unstale":"2024-03-08T06:04:32.989707+0000","last_undegraded":"2024-03-08T06:04:32.989707+0000","last_fullsized":"2024-03-08T06:04:32.989707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:52:02.206135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.707411+0000","last_change":"2024-03-08T06:04:30.704077+0000","last_active":"2024-03-08T06:04:31.707411+0000","last_peered":"2024-03-08T06:04:31.707411+0000","last_clean":"2024-03-08T06:04:31.707411+0000","last_became_active":"2024-03-08T06:04:30.702558+0000","last_became_peered":"2024-03-08T06:04:30.702558+0000","last_unstale":"2024-03-08T06:04:31.707411+0000","last_undegraded":"2024-03-08T06:04:31.707411+0000","last_fullsized":"2024-03-08T06:04:31.707411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:44:44.555166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.794805+0000","last_change":"2024-03-08T06:04:29.696002+0000","last_active":"2024-03-08T06:04:32.794805+0000","last_peered":"2024-03-08T06:04:32.794805+0000","last_clean":"2024-03-08T06:04:32.794805+0000","last_became_active":"2024-03-08T06:04:29.695622+0000","last_became_peered":"2024-03-08T06:04:29.695622+0000","last_unstale":"2024-03-08T06:04:32.794805+0000","last_undegraded":"2024-03-08T06:04:32.794805+0000","last_fullsized":"2024-03-08T06:04:32.794805+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:19:18.025497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.709160+0000","last_change":"2024-03-08T06:04:30.709495+0000","last_active":"2024-03-08T06:04:31.709160+0000","last_peered":"2024-03-08T06:04:31.709160+0000","last_clean":"2024-03-08T06:04:31.709160+0000","last_became_active":"2024-03-08T06:04:30.709148+0000","last_became_peered":"2024-03-08T06:04:30.709148+0000","last_unstale":"2024-03-08T06:04:31.709160+0000","last_undegraded":"2024-03-08T06:04:31.709160+0000","last_fullsized":"2024-03-08T06:04:31.709160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:46:41.655761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.795517+0000","last_change":"2024-03-08T06:04:29.688149+0000","last_active":"2024-03-08T06:04:32.795517+0000","last_peered":"2024-03-08T06:04:32.795517+0000","last_clean":"2024-03-08T06:04:32.795517+0000","last_became_active":"2024-03-08T06:04:29.687845+0000","last_became_peered":"2024-03-08T06:04:29.687845+0000","last_unstale":"2024-03-08T06:04:32.795517+0000","last_undegraded":"2024-03-08T06:04:32.795517+0000","last_fullsized":"2024-03-08T06:04:32.795517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:24:29.255665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.794513+0000","last_change":"2024-03-08T06:04:30.712490+0000","last_active":"2024-03-08T06:04:32.794513+0000","last_peered":"2024-03-08T06:04:32.794513+0000","last_clean":"2024-03-08T06:04:32.794513+0000","last_became_active":"2024-03-08T06:04:30.706932+0000","last_became_peered":"2024-03-08T06:04:30.706932+0000","last_unstale":"2024-03-08T06:04:32.794513+0000","last_undegraded":"2024-03-08T06:04:32.794513+0000","last_fullsized":"2024-03-08T06:04:32.794513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:02:52.659754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.703530+0000","last_change":"2024-03-08T06:04:29.683463+0000","last_active":"2024-03-08T06:04:31.703530+0000","last_peered":"2024-03-08T06:04:31.703530+0000","last_clean":"2024-03-08T06:04:31.703530+0000","last_became_active":"2024-03-08T06:04:29.683111+0000","last_became_peered":"2024-03-08T06:04:29.683111+0000","last_unstale":"2024-03-08T06:04:31.703530+0000","last_undegraded":"2024-03-08T06:04:31.703530+0000","last_fullsized":"2024-03-08T06:04:31.703530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:48:55.679517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.742584+0000","last_change":"2024-03-08T06:04:30.699573+0000","last_active":"2024-03-08T06:04:32.742584+0000","last_peered":"2024-03-08T06:04:32.742584+0000","last_clean":"2024-03-08T06:04:32.742584+0000","last_became_active":"2024-03-08T06:04:30.699258+0000","last_became_peered":"2024-03-08T06:04:30.699258+0000","last_unstale":"2024-03-08T06:04:32.742584+0000","last_undegraded":"2024-03-08T06:04:32.742584+0000","last_fullsized":"2024-03-08T06:04:32.742584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:00:13.481439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.794322+0000","last_change":"2024-03-08T06:04:29.698413+0000","last_active":"2024-03-08T06:04:32.794322+0000","last_peered":"2024-03-08T06:04:32.794322+0000","last_clean":"2024-03-08T06:04:32.794322+0000","last_became_active":"2024-03-08T06:04:29.698025+0000","last_became_peered":"2024-03-08T06:04:29.698025+0000","last_unstale":"2024-03-08T06:04:32.794322+0000","last_undegraded":"2024-03-08T06:04:32.794322+0000","last_fullsized":"2024-03-08T06:04:32.794322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:44:36.008471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.709555+0000","last_change":"2024-03-08T06:04:30.710536+0000","last_active":"2024-03-08T06:04:31.709555+0000","last_peered":"2024-03-08T06:04:31.709555+0000","last_clean":"2024-03-08T06:04:31.709555+0000","last_became_active":"2024-03-08T06:04:30.709779+0000","last_became_peered":"2024-03-08T06:04:30.709779+0000","last_unstale":"2024-03-08T06:04:31.709555+0000","last_undegraded":"2024-03-08T06:04:31.709555+0000","last_fullsized":"2024-03-08T06:04:31.709555+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:14:14.538452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.704834+0000","last_change":"2024-03-08T06:04:29.693916+0000","last_active":"2024-03-08T06:04:31.704834+0000","last_peered":"2024-03-08T06:04:31.704834+0000","last_clean":"2024-03-08T06:04:31.704834+0000","last_became_active":"2024-03-08T06:04:29.693531+0000","last_became_peered":"2024-03-08T06:04:29.693531+0000","last_unstale":"2024-03-08T06:04:31.704834+0000","last_undegraded":"2024-03-08T06:04:31.704834+0000","last_fullsized":"2024-03-08T06:04:31.704834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T06:17:11.476589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.704441+0000","last_change":"2024-03-08T06:04:30.693955+0000","last_active":"2024-03-08T06:04:31.704441+0000","last_peered":"2024-03-08T06:04:31.704441+0000","last_clean":"2024-03-08T06:04:31.704441+0000","last_became_active":"2024-03-08T06:04:30.692155+0000","last_became_peered":"2024-03-08T06:04:30.692155+0000","last_unstale":"2024-03-08T06:04:31.704441+0000","last_undegraded":"2024-03-08T06:04:31.704441+0000","last_fullsized":"2024-03-08T06:04:31.704441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:29:13.994886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.089120+0000","last_change":"2024-03-08T06:04:29.687478+0000","last_active":"2024-03-08T06:04:32.089120+0000","last_peered":"2024-03-08T06:04:32.089120+0000","last_clean":"2024-03-08T06:04:32.089120+0000","last_became_active":"2024-03-08T06:04:29.686826+0000","last_became_peered":"2024-03-08T06:04:29.686826+0000","last_unstale":"2024-03-08T06:04:32.089120+0000","last_undegraded":"2024-03-08T06:04:32.089120+0000","last_fullsized":"2024-03-08T06:04:32.089120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:46:33.384729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.705358+0000","last_change":"2024-03-08T06:04:30.708513+0000","last_active":"2024-03-08T06:04:31.705358+0000","last_peered":"2024-03-08T06:04:31.705358+0000","last_clean":"2024-03-08T06:04:31.705358+0000","last_became_active":"2024-03-08T06:04:30.708218+0000","last_became_peered":"2024-03-08T06:04:30.708218+0000","last_unstale":"2024-03-08T06:04:31.705358+0000","last_undegraded":"2024-03-08T06:04:31.705358+0000","last_fullsized":"2024-03-08T06:04:31.705358+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:58:03.921492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.710107+0000","last_change":"2024-03-08T06:04:29.697681+0000","last_active":"2024-03-08T06:04:31.710107+0000","last_peered":"2024-03-08T06:04:31.710107+0000","last_clean":"2024-03-08T06:04:31.710107+0000","last_became_active":"2024-03-08T06:04:29.697381+0000","last_became_peered":"2024-03-08T06:04:29.697381+0000","last_unstale":"2024-03-08T06:04:31.710107+0000","last_undegraded":"2024-03-08T06:04:31.710107+0000","last_fullsized":"2024-03-08T06:04:31.710107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:48:55.679517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.709896+0000","last_change":"2024-03-08T06:04:30.710917+0000","last_active":"2024-03-08T06:04:31.709896+0000","last_peered":"2024-03-08T06:04:31.709896+0000","last_clean":"2024-03-08T06:04:31.709896+0000","last_became_active":"2024-03-08T06:04:30.710602+0000","last_became_peered":"2024-03-08T06:04:30.710602+0000","last_unstale":"2024-03-08T06:04:31.709896+0000","last_undegraded":"2024-03-08T06:04:31.709896+0000","last_fullsized":"2024-03-08T06:04:31.709896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:49:06.618016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.704840+0000","last_change":"2024-03-08T06:04:29.688564+0000","last_active":"2024-03-08T06:04:31.704840+0000","last_peered":"2024-03-08T06:04:31.704840+0000","last_clean":"2024-03-08T06:04:31.704840+0000","last_became_active":"2024-03-08T06:04:29.688240+0000","last_became_peered":"2024-03-08T06:04:29.688240+0000","last_unstale":"2024-03-08T06:04:31.704840+0000","last_undegraded":"2024-03-08T06:04:31.704840+0000","last_fullsized":"2024-03-08T06:04:31.704840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:31:38.462618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.742386+0000","last_change":"2024-03-08T06:04:30.696015+0000","last_active":"2024-03-08T06:04:32.742386+0000","last_peered":"2024-03-08T06:04:32.742386+0000","last_clean":"2024-03-08T06:04:32.742386+0000","last_became_active":"2024-03-08T06:04:30.695459+0000","last_became_peered":"2024-03-08T06:04:30.695459+0000","last_unstale":"2024-03-08T06:04:32.742386+0000","last_undegraded":"2024-03-08T06:04:32.742386+0000","last_fullsized":"2024-03-08T06:04:32.742386+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:35:58.857526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.795034+0000","last_change":"2024-03-08T06:04:29.699330+0000","last_active":"2024-03-08T06:04:32.795034+0000","last_peered":"2024-03-08T06:04:32.795034+0000","last_clean":"2024-03-08T06:04:32.795034+0000","last_became_active":"2024-03-08T06:04:29.697897+0000","last_became_peered":"2024-03-08T06:04:29.697897+0000","last_unstale":"2024-03-08T06:04:32.795034+0000","last_undegraded":"2024-03-08T06:04:32.795034+0000","last_fullsized":"2024-03-08T06:04:32.795034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:32:01.514292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.704400+0000","last_change":"2024-03-08T06:04:30.704714+0000","last_active":"2024-03-08T06:04:31.704400+0000","last_peered":"2024-03-08T06:04:31.704400+0000","last_clean":"2024-03-08T06:04:31.704400+0000","last_became_active":"2024-03-08T06:04:30.704429+0000","last_became_peered":"2024-03-08T06:04:30.704429+0000","last_unstale":"2024-03-08T06:04:31.704400+0000","last_undegraded":"2024-03-08T06:04:31.704400+0000","last_fullsized":"2024-03-08T06:04:31.704400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:24:27.396333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.742545+0000","last_change":"2024-03-08T06:04:29.699572+0000","last_active":"2024-03-08T06:04:32.742545+0000","last_peered":"2024-03-08T06:04:32.742545+0000","last_clean":"2024-03-08T06:04:32.742545+0000","last_became_active":"2024-03-08T06:04:29.699294+0000","last_became_peered":"2024-03-08T06:04:29.699294+0000","last_unstale":"2024-03-08T06:04:32.742545+0000","last_undegraded":"2024-03-08T06:04:32.742545+0000","last_fullsized":"2024-03-08T06:04:32.742545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:44:08.589995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.707331+0000","last_change":"2024-03-08T06:04:30.705011+0000","last_active":"2024-03-08T06:04:31.707331+0000","last_peered":"2024-03-08T06:04:31.707331+0000","last_clean":"2024-03-08T06:04:31.707331+0000","last_became_active":"2024-03-08T06:04:30.704729+0000","last_became_peered":"2024-03-08T06:04:30.704729+0000","last_unstale":"2024-03-08T06:04:31.707331+0000","last_undegraded":"2024-03-08T06:04:31.707331+0000","last_fullsized":"2024-03-08T06:04:31.707331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:39:17.549225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.703808+0000","last_change":"2024-03-08T06:04:29.688374+0000","last_active":"2024-03-08T06:04:31.703808+0000","last_peered":"2024-03-08T06:04:31.703808+0000","last_clean":"2024-03-08T06:04:31.703808+0000","last_became_active":"2024-03-08T06:04:29.687091+0000","last_became_peered":"2024-03-08T06:04:29.687091+0000","last_unstale":"2024-03-08T06:04:31.703808+0000","last_undegraded":"2024-03-08T06:04:31.703808+0000","last_fullsized":"2024-03-08T06:04:31.703808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:33:48.820107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.990407+0000","last_change":"2024-03-08T06:04:30.707652+0000","last_active":"2024-03-08T06:04:32.990407+0000","last_peered":"2024-03-08T06:04:32.990407+0000","last_clean":"2024-03-08T06:04:32.990407+0000","last_became_active":"2024-03-08T06:04:30.707315+0000","last_became_peered":"2024-03-08T06:04:30.707315+0000","last_unstale":"2024-03-08T06:04:32.990407+0000","last_undegraded":"2024-03-08T06:04:32.990407+0000","last_fullsized":"2024-03-08T06:04:32.990407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:33:49.833346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.703561+0000","last_change":"2024-03-08T06:04:29.680280+0000","last_active":"2024-03-08T06:04:31.703561+0000","last_peered":"2024-03-08T06:04:31.703561+0000","last_clean":"2024-03-08T06:04:31.703561+0000","last_became_active":"2024-03-08T06:04:29.679954+0000","last_became_peered":"2024-03-08T06:04:29.679954+0000","last_unstale":"2024-03-08T06:04:31.703561+0000","last_undegraded":"2024-03-08T06:04:31.703561+0000","last_fullsized":"2024-03-08T06:04:31.703561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:02:51.646514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.795055+0000","last_change":"2024-03-08T06:04:30.717143+0000","last_active":"2024-03-08T06:04:32.795055+0000","last_peered":"2024-03-08T06:04:32.795055+0000","last_clean":"2024-03-08T06:04:32.795055+0000","last_became_active":"2024-03-08T06:04:30.715005+0000","last_became_peered":"2024-03-08T06:04:30.715005+0000","last_unstale":"2024-03-08T06:04:32.795055+0000","last_undegraded":"2024-03-08T06:04:32.795055+0000","last_fullsized":"2024-03-08T06:04:32.795055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:12:39.906906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.743349+0000","last_change":"2024-03-08T06:04:29.690726+0000","last_active":"2024-03-08T06:04:32.743349+0000","last_peered":"2024-03-08T06:04:32.743349+0000","last_clean":"2024-03-08T06:04:32.743349+0000","last_became_active":"2024-03-08T06:04:29.690417+0000","last_became_peered":"2024-03-08T06:04:29.690417+0000","last_unstale":"2024-03-08T06:04:32.743349+0000","last_undegraded":"2024-03-08T06:04:32.743349+0000","last_fullsized":"2024-03-08T06:04:32.743349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:39:05.777435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.709825+0000","last_change":"2024-03-08T06:04:30.717302+0000","last_active":"2024-03-08T06:04:31.709825+0000","last_peered":"2024-03-08T06:04:31.709825+0000","last_clean":"2024-03-08T06:04:31.709825+0000","last_became_active":"2024-03-08T06:04:30.715685+0000","last_became_peered":"2024-03-08T06:04:30.715685+0000","last_unstale":"2024-03-08T06:04:31.709825+0000","last_undegraded":"2024-03-08T06:04:31.709825+0000","last_fullsized":"2024-03-08T06:04:31.709825+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:24:27.225080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.795364+0000","last_change":"2024-03-08T06:04:29.700584+0000","last_active":"2024-03-08T06:04:32.795364+0000","last_peered":"2024-03-08T06:04:32.795364+0000","last_clean":"2024-03-08T06:04:32.795364+0000","last_became_active":"2024-03-08T06:04:29.699652+0000","last_became_peered":"2024-03-08T06:04:29.699652+0000","last_unstale":"2024-03-08T06:04:32.795364+0000","last_undegraded":"2024-03-08T06:04:32.795364+0000","last_fullsized":"2024-03-08T06:04:32.795364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T06:04:28.802854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.742810+0000","last_change":"2024-03-08T06:04:30.714068+0000","last_active":"2024-03-08T06:04:32.742810+0000","last_peered":"2024-03-08T06:04:32.742810+0000","last_clean":"2024-03-08T06:04:32.742810+0000","last_became_active":"2024-03-08T06:04:30.709630+0000","last_became_peered":"2024-03-08T06:04:30.709630+0000","last_unstale":"2024-03-08T06:04:32.742810+0000","last_undegraded":"2024-03-08T06:04:32.742810+0000","last_fullsized":"2024-03-08T06:04:32.742810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:26:41.031717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.795097+0000","last_change":"2024-03-08T06:04:29.687615+0000","last_active":"2024-03-08T06:04:32.795097+0000","last_peered":"2024-03-08T06:04:32.795097+0000","last_clean":"2024-03-08T06:04:32.795097+0000","last_became_active":"2024-03-08T06:04:29.687294+0000","last_became_peered":"2024-03-08T06:04:29.687294+0000","last_unstale":"2024-03-08T06:04:32.795097+0000","last_undegraded":"2024-03-08T06:04:32.795097+0000","last_fullsized":"2024-03-08T06:04:32.795097+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:11.301516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989333+0000","last_change":"2024-03-08T06:04:30.707196+0000","last_active":"2024-03-08T06:04:32.989333+0000","last_peered":"2024-03-08T06:04:32.989333+0000","last_clean":"2024-03-08T06:04:32.989333+0000","last_became_active":"2024-03-08T06:04:30.706526+0000","last_became_peered":"2024-03-08T06:04:30.706526+0000","last_unstale":"2024-03-08T06:04:32.989333+0000","last_undegraded":"2024-03-08T06:04:32.989333+0000","last_fullsized":"2024-03-08T06:04:32.989333+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T06:04:29.816093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.795411+0000","last_change":"2024-03-08T06:04:29.692711+0000","last_active":"2024-03-08T06:04:32.795411+0000","last_peered":"2024-03-08T06:04:32.795411+0000","last_clean":"2024-03-08T06:04:32.795411+0000","last_became_active":"2024-03-08T06:04:29.692379+0000","last_became_peered":"2024-03-08T06:04:29.692379+0000","last_unstale":"2024-03-08T06:04:32.795411+0000","last_undegraded":"2024-03-08T06:04:32.795411+0000","last_fullsized":"2024-03-08T06:04:32.795411+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:58:47.676859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989283+0000","last_change":"2024-03-08T06:04:30.713768+0000","last_active":"2024-03-08T06:04:32.989283+0000","last_peered":"2024-03-08T06:04:32.989283+0000","last_clean":"2024-03-08T06:04:32.989283+0000","last_became_active":"2024-03-08T06:04:30.713324+0000","last_became_peered":"2024-03-08T06:04:30.713324+0000","last_unstale":"2024-03-08T06:04:32.989283+0000","last_undegraded":"2024-03-08T06:04:32.989283+0000","last_fullsized":"2024-03-08T06:04:32.989283+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:46:34.197425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.088902+0000","last_change":"2024-03-08T06:04:29.687265+0000","last_active":"2024-03-08T06:04:32.088902+0000","last_peered":"2024-03-08T06:04:32.088902+0000","last_clean":"2024-03-08T06:04:32.088902+0000","last_became_active":"2024-03-08T06:04:29.686942+0000","last_became_peered":"2024-03-08T06:04:29.686942+0000","last_unstale":"2024-03-08T06:04:32.088902+0000","last_undegraded":"2024-03-08T06:04:32.088902+0000","last_fullsized":"2024-03-08T06:04:32.088902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:39:05.777435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989504+0000","last_change":"2024-03-08T06:04:30.685348+0000","last_active":"2024-03-08T06:04:32.989504+0000","last_peered":"2024-03-08T06:04:32.989504+0000","last_clean":"2024-03-08T06:04:32.989504+0000","last_became_active":"2024-03-08T06:04:30.685054+0000","last_became_peered":"2024-03-08T06:04:30.685054+0000","last_unstale":"2024-03-08T06:04:32.989504+0000","last_undegraded":"2024-03-08T06:04:32.989504+0000","last_fullsized":"2024-03-08T06:04:32.989504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:12:21.399194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989867+0000","last_change":"2024-03-08T06:04:29.695737+0000","last_active":"2024-03-08T06:04:32.989867+0000","last_peered":"2024-03-08T06:04:32.989867+0000","last_clean":"2024-03-08T06:04:32.989867+0000","last_became_active":"2024-03-08T06:04:29.695166+0000","last_became_peered":"2024-03-08T06:04:29.695166+0000","last_unstale":"2024-03-08T06:04:32.989867+0000","last_undegraded":"2024-03-08T06:04:32.989867+0000","last_fullsized":"2024-03-08T06:04:32.989867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:12:20.385955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.988957+0000","last_change":"2024-03-08T06:04:30.693634+0000","last_active":"2024-03-08T06:04:32.988957+0000","last_peered":"2024-03-08T06:04:32.988957+0000","last_clean":"2024-03-08T06:04:32.988957+0000","last_became_active":"2024-03-08T06:04:30.692981+0000","last_became_peered":"2024-03-08T06:04:30.692981+0000","last_unstale":"2024-03-08T06:04:32.988957+0000","last_undegraded":"2024-03-08T06:04:32.988957+0000","last_fullsized":"2024-03-08T06:04:32.988957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:12.314755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.794794+0000","last_change":"2024-03-08T06:04:29.696731+0000","last_active":"2024-03-08T06:04:32.794794+0000","last_peered":"2024-03-08T06:04:32.794794+0000","last_clean":"2024-03-08T06:04:32.794794+0000","last_became_active":"2024-03-08T06:04:29.696366+0000","last_became_peered":"2024-03-08T06:04:29.696366+0000","last_unstale":"2024-03-08T06:04:32.794794+0000","last_undegraded":"2024-03-08T06:04:32.794794+0000","last_fullsized":"2024-03-08T06:04:32.794794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:19:58.655135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.706634+0000","last_change":"2024-03-08T06:04:30.705119+0000","last_active":"2024-03-08T06:04:31.706634+0000","last_peered":"2024-03-08T06:04:31.706634+0000","last_clean":"2024-03-08T06:04:31.706634+0000","last_became_active":"2024-03-08T06:04:30.704355+0000","last_became_peered":"2024-03-08T06:04:30.704355+0000","last_unstale":"2024-03-08T06:04:31.706634+0000","last_undegraded":"2024-03-08T06:04:31.706634+0000","last_fullsized":"2024-03-08T06:04:31.706634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:00:13.481439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.708354+0000","last_change":"2024-03-08T06:04:29.695077+0000","last_active":"2024-03-08T06:04:31.708354+0000","last_peered":"2024-03-08T06:04:31.708354+0000","last_clean":"2024-03-08T06:04:31.708354+0000","last_became_active":"2024-03-08T06:04:29.694304+0000","last_became_peered":"2024-03-08T06:04:29.694304+0000","last_unstale":"2024-03-08T06:04:31.708354+0000","last_undegraded":"2024-03-08T06:04:31.708354+0000","last_fullsized":"2024-03-08T06:04:31.708354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:50:39.798554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989544+0000","last_change":"2024-03-08T06:04:30.696238+0000","last_active":"2024-03-08T06:04:32.989544+0000","last_peered":"2024-03-08T06:04:32.989544+0000","last_clean":"2024-03-08T06:04:32.989544+0000","last_became_active":"2024-03-08T06:04:30.695961+0000","last_became_peered":"2024-03-08T06:04:30.695961+0000","last_unstale":"2024-03-08T06:04:32.989544+0000","last_undegraded":"2024-03-08T06:04:32.989544+0000","last_fullsized":"2024-03-08T06:04:32.989544+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:58:26.211626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.743383+0000","last_change":"2024-03-08T06:04:29.697670+0000","last_active":"2024-03-08T06:04:32.743383+0000","last_peered":"2024-03-08T06:04:32.743383+0000","last_clean":"2024-03-08T06:04:32.743383+0000","last_became_active":"2024-03-08T06:04:29.697421+0000","last_became_peered":"2024-03-08T06:04:29.697421+0000","last_unstale":"2024-03-08T06:04:32.743383+0000","last_undegraded":"2024-03-08T06:04:32.743383+0000","last_fullsized":"2024-03-08T06:04:32.743383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:57:38.025862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.710076+0000","last_change":"2024-03-08T06:04:30.701119+0000","last_active":"2024-03-08T06:04:31.710076+0000","last_peered":"2024-03-08T06:04:31.710076+0000","last_clean":"2024-03-08T06:04:31.710076+0000","last_became_active":"2024-03-08T06:04:30.700746+0000","last_became_peered":"2024-03-08T06:04:30.700746+0000","last_unstale":"2024-03-08T06:04:31.710076+0000","last_undegraded":"2024-03-08T06:04:31.710076+0000","last_fullsized":"2024-03-08T06:04:31.710076+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:24:27.396333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.089065+0000","last_change":"2024-03-08T06:04:29.687775+0000","last_active":"2024-03-08T06:04:32.089065+0000","last_peered":"2024-03-08T06:04:32.089065+0000","last_clean":"2024-03-08T06:04:32.089065+0000","last_became_active":"2024-03-08T06:04:29.687163+0000","last_became_peered":"2024-03-08T06:04:29.687163+0000","last_unstale":"2024-03-08T06:04:32.089065+0000","last_undegraded":"2024-03-08T06:04:32.089065+0000","last_fullsized":"2024-03-08T06:04:32.089065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T06:36:25.224626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.088467+0000","last_change":"2024-03-08T06:04:30.682323+0000","last_active":"2024-03-08T06:04:32.088467+0000","last_peered":"2024-03-08T06:04:32.088467+0000","last_clean":"2024-03-08T06:04:32.088467+0000","last_became_active":"2024-03-08T06:04:30.681789+0000","last_became_peered":"2024-03-08T06:04:30.681789+0000","last_unstale":"2024-03-08T06:04:32.088467+0000","last_undegraded":"2024-03-08T06:04:32.088467+0000","last_fullsized":"2024-03-08T06:04:32.088467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:31:39.475858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.743029+0000","last_change":"2024-03-08T06:04:29.687932+0000","last_active":"2024-03-08T06:04:32.743029+0000","last_peered":"2024-03-08T06:04:32.743029+0000","last_clean":"2024-03-08T06:04:32.743029+0000","last_became_active":"2024-03-08T06:04:29.687633+0000","last_became_peered":"2024-03-08T06:04:29.687633+0000","last_unstale":"2024-03-08T06:04:32.743029+0000","last_undegraded":"2024-03-08T06:04:32.743029+0000","last_fullsized":"2024-03-08T06:04:32.743029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:46:33.384729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.990032+0000","last_change":"2024-03-08T06:04:30.698218+0000","last_active":"2024-03-08T06:04:32.990032+0000","last_peered":"2024-03-08T06:04:32.990032+0000","last_clean":"2024-03-08T06:04:32.990032+0000","last_became_active":"2024-03-08T06:04:30.696114+0000","last_became_peered":"2024-03-08T06:04:30.696114+0000","last_unstale":"2024-03-08T06:04:32.990032+0000","last_undegraded":"2024-03-08T06:04:32.990032+0000","last_fullsized":"2024-03-08T06:04:32.990032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:48:56.692756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.089166+0000","last_change":"2024-03-08T06:04:29.701703+0000","last_active":"2024-03-08T06:04:32.089166+0000","last_peered":"2024-03-08T06:04:32.089166+0000","last_clean":"2024-03-08T06:04:32.089166+0000","last_became_active":"2024-03-08T06:04:29.701394+0000","last_became_peered":"2024-03-08T06:04:29.701394+0000","last_unstale":"2024-03-08T06:04:32.089166+0000","last_undegraded":"2024-03-08T06:04:32.089166+0000","last_fullsized":"2024-03-08T06:04:32.089166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:57:38.025862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.088816+0000","last_change":"2024-03-08T06:04:30.702646+0000","last_active":"2024-03-08T06:04:32.088816+0000","last_peered":"2024-03-08T06:04:32.088816+0000","last_clean":"2024-03-08T06:04:32.088816+0000","last_became_active":"2024-03-08T06:04:30.702333+0000","last_became_peered":"2024-03-08T06:04:30.702333+0000","last_unstale":"2024-03-08T06:04:32.088816+0000","last_undegraded":"2024-03-08T06:04:32.088816+0000","last_fullsized":"2024-03-08T06:04:32.088816+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:08:17.612578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.742712+0000","last_change":"2024-03-08T06:04:29.701532+0000","last_active":"2024-03-08T06:04:32.742712+0000","last_peered":"2024-03-08T06:04:32.742712+0000","last_clean":"2024-03-08T06:04:32.742712+0000","last_became_active":"2024-03-08T06:04:29.701196+0000","last_became_peered":"2024-03-08T06:04:29.701196+0000","last_unstale":"2024-03-08T06:04:32.742712+0000","last_undegraded":"2024-03-08T06:04:32.742712+0000","last_fullsized":"2024-03-08T06:04:32.742712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T06:36:25.224626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.703563+0000","last_change":"2024-03-08T06:04:30.707606+0000","last_active":"2024-03-08T06:04:31.703563+0000","last_peered":"2024-03-08T06:04:31.703563+0000","last_clean":"2024-03-08T06:04:31.703563+0000","last_became_active":"2024-03-08T06:04:30.707310+0000","last_became_peered":"2024-03-08T06:04:30.707310+0000","last_unstale":"2024-03-08T06:04:31.703563+0000","last_undegraded":"2024-03-08T06:04:31.703563+0000","last_fullsized":"2024-03-08T06:04:31.703563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:24:27.225080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.795087+0000","last_change":"2024-03-08T06:04:29.698135+0000","last_active":"2024-03-08T06:04:32.795087+0000","last_peered":"2024-03-08T06:04:32.795087+0000","last_clean":"2024-03-08T06:04:32.795087+0000","last_became_active":"2024-03-08T06:04:29.697796+0000","last_became_peered":"2024-03-08T06:04:29.697796+0000","last_unstale":"2024-03-08T06:04:32.795087+0000","last_undegraded":"2024-03-08T06:04:32.795087+0000","last_fullsized":"2024-03-08T06:04:32.795087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:46:33.184185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.794452+0000","last_change":"2024-03-08T06:04:30.720583+0000","last_active":"2024-03-08T06:04:32.794452+0000","last_peered":"2024-03-08T06:04:32.794452+0000","last_clean":"2024-03-08T06:04:32.794452+0000","last_became_active":"2024-03-08T06:04:30.720303+0000","last_became_peered":"2024-03-08T06:04:30.720303+0000","last_unstale":"2024-03-08T06:04:32.794452+0000","last_undegraded":"2024-03-08T06:04:32.794452+0000","last_fullsized":"2024-03-08T06:04:32.794452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:06:09.516032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.703418+0000","last_change":"2024-03-08T06:04:29.687748+0000","last_active":"2024-03-08T06:04:31.703418+0000","last_peered":"2024-03-08T06:04:31.703418+0000","last_clean":"2024-03-08T06:04:31.703418+0000","last_became_active":"2024-03-08T06:04:29.687454+0000","last_became_peered":"2024-03-08T06:04:29.687454+0000","last_unstale":"2024-03-08T06:04:31.703418+0000","last_undegraded":"2024-03-08T06:04:31.703418+0000","last_fullsized":"2024-03-08T06:04:31.703418+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:06:08.502792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.707077+0000","last_change":"2024-03-08T06:04:30.697950+0000","last_active":"2024-03-08T06:04:31.707077+0000","last_peered":"2024-03-08T06:04:31.707077+0000","last_clean":"2024-03-08T06:04:31.707077+0000","last_became_active":"2024-03-08T06:04:30.697637+0000","last_became_peered":"2024-03-08T06:04:30.697637+0000","last_unstale":"2024-03-08T06:04:31.707077+0000","last_undegraded":"2024-03-08T06:04:31.707077+0000","last_fullsized":"2024-03-08T06:04:31.707077+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T06:29:55.161250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989824+0000","last_change":"2024-03-08T06:04:29.699600+0000","last_active":"2024-03-08T06:04:32.989824+0000","last_peered":"2024-03-08T06:04:32.989824+0000","last_clean":"2024-03-08T06:04:32.989824+0000","last_became_active":"2024-03-08T06:04:29.699296+0000","last_became_peered":"2024-03-08T06:04:29.699296+0000","last_unstale":"2024-03-08T06:04:32.989824+0000","last_undegraded":"2024-03-08T06:04:32.989824+0000","last_fullsized":"2024-03-08T06:04:32.989824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:58:25.198387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":196,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.707807+0000","last_change":"2024-03-08T06:03:16.679654+0000","last_active":"2024-03-08T06:04:31.707807+0000","last_peered":"2024-03-08T06:04:31.707807+0000","last_clean":"2024-03-08T06:04:31.707807+0000","last_became_active":"2024-03-08T06:03:16.676829+0000","last_became_peered":"2024-03-08T06:03:16.676829+0000","last_unstale":"2024-03-08T06:04:31.707807+0000","last_undegraded":"2024-03-08T06:04:31.707807+0000","last_fullsized":"2024-03-08T06:04:31.707807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:14.800941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:14.800941+0000","last_clean_scrub_stamp":"2024-03-08T06:03:14.800941+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:20:09.927678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":741729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":380928,"data_stored":145587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":393216,"data_stored":151943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":380928,"data_stored":145075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":152905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":145041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":152905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":978944,"data_stored":741639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T06:04:35.197 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T06:04:35.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.458+0000 7efd63200640 1 Processor -- start 2024-03-08T06:04:35.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.458+0000 7efd63200640 1 -- start start 2024-03-08T06:04:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.460+0000 7efd63200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efd5c145520 0x7efd5c15d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.460+0000 7efd63200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd5c071df0 0x7efd5c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.460+0000 7efd63200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5c15ceb0 con 0x7efd5c15bea0 2024-03-08T06:04:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.460+0000 7efd63200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5c15c330 con 0x7efd5c071df0 2024-03-08T06:04:35.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.460+0000 7efd63200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5c15c610 con 0x7efd5c145520 2024-03-08T06:04:35.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.460+0000 7efd62800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd5c071df0 0x7efd5c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:35.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.460+0000 7efd62800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd5c071df0 0x7efd5c06d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52212/0 (socket says 172.21.15.19:52212) 2024-03-08T06:04:35.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.460+0000 7efd61400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7efd5c15bea0 0x7efd5c0716e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44286/0 (socket says 172.21.15.19:44286) 2024-03-08T06:04:35.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.460+0000 7efd62800640 1 -- 172.21.15.19:0/1109655656 learned_addr learned my addr 172.21.15.19:0/1109655656 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:35.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.461+0000 7efd61e00640 1 --2- 172.21.15.19:0/1109655656 >> v2:172.21.15.42:3300/0 conn(0x7efd5c145520 0x7efd5c15d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:35.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.461+0000 7efd62800640 1 -- 172.21.15.19:0/1109655656 >> v2:172.21.15.42:3300/0 conn(0x7efd5c145520 msgr2=0x7efd5c15d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:35.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.461+0000 7efd62800640 1 --2- 172.21.15.19:0/1109655656 >> v2:172.21.15.42:3300/0 conn(0x7efd5c145520 0x7efd5c15d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:35.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.461+0000 7efd62800640 1 -- 172.21.15.19:0/1109655656 >> v1:172.21.15.19:6789/0 conn(0x7efd5c15bea0 legacy=0x7efd5c0716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:35.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.461+0000 7efd62800640 1 -- 172.21.15.19:0/1109655656 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c15c8f0 con 0x7efd5c071df0 2024-03-08T06:04:35.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.461+0000 7efd60a00640 1 -- 172.21.15.19:0/1109655656 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907307134 0 0) 0x7efd5c15ceb0 con 0x7efd5c15bea0 2024-03-08T06:04:35.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.462+0000 7efd62800640 1 --2- 172.21.15.19:0/1109655656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd5c071df0 0x7efd5c06d570 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efd5c0b4de0 tx=0x7efd5802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5c5bdaa1b56410 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:35.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.463+0000 7efd60a00640 1 -- 172.21.15.19:0/1109655656 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5802cb20 con 0x7efd5c071df0 2024-03-08T06:04:35.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.463+0000 7efd60a00640 1 -- 172.21.15.19:0/1109655656 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5802ccc0 con 0x7efd5c071df0 2024-03-08T06:04:35.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.463+0000 7efd60a00640 1 -- 172.21.15.19:0/1109655656 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd58034610 con 0x7efd5c071df0 2024-03-08T06:04:35.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.463+0000 7efd63200640 1 -- 172.21.15.19:0/1109655656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd5c071df0 msgr2=0x7efd5c06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:35.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.463+0000 7efd63200640 1 --2- 172.21.15.19:0/1109655656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd5c071df0 0x7efd5c06d570 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efd5c0b4de0 tx=0x7efd5802bf80 comp rx=0 tx=0).stop 2024-03-08T06:04:35.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.464+0000 7efd63200640 1 -- 172.21.15.19:0/1109655656 shutdown_connections 2024-03-08T06:04:35.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.464+0000 7efd63200640 1 --2- 172.21.15.19:0/1109655656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd5c071df0 0x7efd5c06d570 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:35.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.464+0000 7efd63200640 1 --2- 172.21.15.19:0/1109655656 >> v2:172.21.15.42:3300/0 conn(0x7efd5c145520 0x7efd5c15d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:35.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.464+0000 7efd63200640 1 -- 172.21.15.19:0/1109655656 >> 172.21.15.19:0/1109655656 conn(0x7efd5c0b1850 msgr2=0x7efd5c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:35.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.464+0000 7efd63200640 1 -- 172.21.15.19:0/1109655656 shutdown_connections 2024-03-08T06:04:35.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.464+0000 7efd63200640 1 -- 172.21.15.19:0/1109655656 wait complete. 2024-03-08T06:04:35.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.465+0000 7efd63200640 1 Processor -- start 2024-03-08T06:04:35.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.466+0000 7efd63200640 1 -- start start 2024-03-08T06:04:35.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.467+0000 7efd63200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd5c071df0 0x7efd5c15fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:35.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.467+0000 7efd63200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd5c145520 0x7efd5c13f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:35.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.467+0000 7efd63200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efd5c1407d0 0x7efd5c15b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:35.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.467+0000 7efd63200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c0af1c0 con 0x7efd5c145520 2024-03-08T06:04:35.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.467+0000 7efd63200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c0af040 con 0x7efd5c071df0 2024-03-08T06:04:35.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.467+0000 7efd63200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c06e410 con 0x7efd5c1407d0 2024-03-08T06:04:35.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.467+0000 7efd61400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd5c145520 0x7efd5c13f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:35.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.467+0000 7efd61400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd5c145520 0x7efd5c13f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52216/0 (socket says 172.21.15.19:52216) 2024-03-08T06:04:35.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.467+0000 7efd61400640 1 -- 172.21.15.19:0/1453788582 learned_addr learned my addr 172.21.15.19:0/1453788582 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:35.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.467+0000 7efd61e00640 1 --2- 172.21.15.19:0/1453788582 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd5c071df0 0x7efd5c15fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:35.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.467+0000 7efd61400640 1 -- 172.21.15.19:0/1453788582 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efd5c1407d0 msgr2=0x7efd5c15b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:35.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.467+0000 7efd61400640 1 --2- 172.21.15.19:0/1453788582 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efd5c1407d0 0x7efd5c15b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:35.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.467+0000 7efd61400640 1 -- 172.21.15.19:0/1453788582 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd5c071df0 msgr2=0x7efd5c15fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:35.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.467+0000 7efd61400640 1 --2- 172.21.15.19:0/1453788582 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd5c071df0 0x7efd5c15fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:35.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.467+0000 7efd61400640 1 -- 172.21.15.19:0/1453788582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c13b130 con 0x7efd5c145520 2024-03-08T06:04:35.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.468+0000 7efd61400640 1 --2- 172.21.15.19:0/1453788582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd5c145520 0x7efd5c13f0a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00c430 tx=0x7efd4c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:35.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.468+0000 7efd56000640 1 -- 172.21.15.19:0/1453788582 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c0074e0 con 0x7efd5c145520 2024-03-08T06:04:35.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.468+0000 7efd56000640 1 -- 172.21.15.19:0/1453788582 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4c0047e0 con 0x7efd5c145520 2024-03-08T06:04:35.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.468+0000 7efd56000640 1 -- 172.21.15.19:0/1453788582 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4c004bd0 con 0x7efd5c145520 2024-03-08T06:04:35.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.468+0000 7efd63200640 1 -- 172.21.15.19:0/1453788582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5c13f730 con 0x7efd5c145520 2024-03-08T06:04:35.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.468+0000 7efd63200640 1 -- 172.21.15.19:0/1453788582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5c13fcf0 con 0x7efd5c145520 2024-03-08T06:04:35.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.469+0000 7efd63200640 1 -- 172.21.15.19:0/1453788582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5c075100 con 0x7efd5c145520 2024-03-08T06:04:35.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.470+0000 7efd56000640 1 -- 172.21.15.19:0/1453788582 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efd4c011070 con 0x7efd5c145520 2024-03-08T06:04:35.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.472+0000 7efd56000640 1 --2- 172.21.15.19:0/1453788582 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efd4006b4d0 0x7efd4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:35.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.472+0000 7efd56000640 1 -- 172.21.15.19:0/1453788582 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd4c089f40 con 0x7efd5c145520 2024-03-08T06:04:35.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.472+0000 7efd61e00640 1 --2- 172.21.15.19:0/1453788582 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efd4006b4d0 0x7efd4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:35.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.473+0000 7efd61e00640 1 --2- 172.21.15.19:0/1453788582 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efd4006b4d0 0x7efd4006d990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efd50006fd0 tx=0x7efd50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:35.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.476+0000 7efd56000640 1 -- 172.21.15.19:0/1453788582 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efd4c00e280 con 0x7efd5c145520 2024-03-08T06:04:35.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.672+0000 7efd63200640 1 -- 172.21.15.19:0/1453788582 --> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efd5c1413c0 con 0x7efd4006b4d0 2024-03-08T06:04:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.689+0000 7efd56000640 1 -- 172.21.15.19:0/1453788582 <== mgr.4107 v2:172.21.15.19:6832/3589745192 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251950 (secure 0 0 0) 0x7efd5c1413c0 con 0x7efd4006b4d0 2024-03-08T06:04:35.694 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:35.695 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-08T06:04:35.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.695+0000 7efd63200640 1 -- 172.21.15.19:0/1453788582 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efd4006b4d0 msgr2=0x7efd4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:35.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.695+0000 7efd63200640 1 --2- 172.21.15.19:0/1453788582 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efd4006b4d0 0x7efd4006d990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efd50006fd0 tx=0x7efd50008040 comp rx=0 tx=0).stop 2024-03-08T06:04:35.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.695+0000 7efd63200640 1 -- 172.21.15.19:0/1453788582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd5c145520 msgr2=0x7efd5c13f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:35.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.695+0000 7efd63200640 1 --2- 172.21.15.19:0/1453788582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd5c145520 0x7efd5c13f0a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00c430 tx=0x7efd4c00c8f0 comp rx=0 tx=0).stop 2024-03-08T06:04:35.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.695+0000 7efd63200640 1 -- 172.21.15.19:0/1453788582 shutdown_connections 2024-03-08T06:04:35.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.695+0000 7efd63200640 1 --2- 172.21.15.19:0/1453788582 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efd4006b4d0 0x7efd4006d990 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:35.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.695+0000 7efd63200640 1 --2- 172.21.15.19:0/1453788582 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efd5c1407d0 0x7efd5c15b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:35.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.695+0000 7efd63200640 1 --2- 172.21.15.19:0/1453788582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd5c145520 0x7efd5c13f0a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:35.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.695+0000 7efd63200640 1 --2- 172.21.15.19:0/1453788582 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd5c071df0 0x7efd5c15fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:35.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.696+0000 7efd63200640 1 -- 172.21.15.19:0/1453788582 >> 172.21.15.19:0/1453788582 conn(0x7efd5c0b1850 msgr2=0x7efd5c0cebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:35.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.696+0000 7efd63200640 1 -- 172.21.15.19:0/1453788582 shutdown_connections 2024-03-08T06:04:35.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.696+0000 7efd63200640 1 -- 172.21.15.19:0/1453788582 wait complete. 2024-03-08T06:04:35.716 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-03-08T06:04:34.097224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237032,"kb_used_data":4196,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737688,"statfs":{"total":773094113280,"available":772851392512,"internally_reserved":0,"allocated":4296704,"data_stored":2376824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.450845"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.990417+0000","last_change":"2024-03-08T06:04:30.698390+0000","last_active":"2024-03-08T06:04:32.990417+0000","last_peered":"2024-03-08T06:04:32.990417+0000","last_clean":"2024-03-08T06:04:32.990417+0000","last_became_active":"2024-03-08T06:04:30.698062+0000","last_became_peered":"2024-03-08T06:04:30.698062+0000","last_unstale":"2024-03-08T06:04:32.990417+0000","last_undegraded":"2024-03-08T06:04:32.990417+0000","last_fullsized":"2024-03-08T06:04:32.990417+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:06:09.516032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.704476+0000","last_change":"2024-03-08T06:04:30.708629+0000","last_active":"2024-03-08T06:04:31.704476+0000","last_peered":"2024-03-08T06:04:31.704476+0000","last_clean":"2024-03-08T06:04:31.704476+0000","last_became_active":"2024-03-08T06:04:30.706044+0000","last_became_peered":"2024-03-08T06:04:30.706044+0000","last_unstale":"2024-03-08T06:04:31.704476+0000","last_undegraded":"2024-03-08T06:04:31.704476+0000","last_fullsized":"2024-03-08T06:04:31.704476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:04:10.845389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.710046+0000","last_change":"2024-03-08T06:04:30.707203+0000","last_active":"2024-03-08T06:04:31.710046+0000","last_peered":"2024-03-08T06:04:31.710046+0000","last_clean":"2024-03-08T06:04:31.710046+0000","last_became_active":"2024-03-08T06:04:30.706868+0000","last_became_peered":"2024-03-08T06:04:30.706868+0000","last_unstale":"2024-03-08T06:04:31.710046+0000","last_undegraded":"2024-03-08T06:04:31.710046+0000","last_fullsized":"2024-03-08T06:04:31.710046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:56:19.091016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.742733+0000","last_change":"2024-03-08T06:04:30.706646+0000","last_active":"2024-03-08T06:04:32.742733+0000","last_peered":"2024-03-08T06:04:32.742733+0000","last_clean":"2024-03-08T06:04:32.742733+0000","last_became_active":"2024-03-08T06:04:30.706378+0000","last_became_peered":"2024-03-08T06:04:30.706378+0000","last_unstale":"2024-03-08T06:04:32.742733+0000","last_undegraded":"2024-03-08T06:04:32.742733+0000","last_fullsized":"2024-03-08T06:04:32.742733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:14:54.537720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989176+0000","last_change":"2024-03-08T06:04:30.698196+0000","last_active":"2024-03-08T06:04:32.989176+0000","last_peered":"2024-03-08T06:04:32.989176+0000","last_clean":"2024-03-08T06:04:32.989176+0000","last_became_active":"2024-03-08T06:04:30.694572+0000","last_became_peered":"2024-03-08T06:04:30.694572+0000","last_unstale":"2024-03-08T06:04:32.989176+0000","last_undegraded":"2024-03-08T06:04:32.989176+0000","last_fullsized":"2024-03-08T06:04:32.989176+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:19:59.668374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.703770+0000","last_change":"2024-03-08T06:04:30.701584+0000","last_active":"2024-03-08T06:04:31.703770+0000","last_peered":"2024-03-08T06:04:31.703770+0000","last_clean":"2024-03-08T06:04:31.703770+0000","last_became_active":"2024-03-08T06:04:30.701253+0000","last_became_peered":"2024-03-08T06:04:30.701253+0000","last_unstale":"2024-03-08T06:04:31.703770+0000","last_undegraded":"2024-03-08T06:04:31.703770+0000","last_fullsized":"2024-03-08T06:04:31.703770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:49:06.618016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.706856+0000","last_change":"2024-03-08T06:04:30.703017+0000","last_active":"2024-03-08T06:04:31.706856+0000","last_peered":"2024-03-08T06:04:31.706856+0000","last_clean":"2024-03-08T06:04:31.706856+0000","last_became_active":"2024-03-08T06:04:30.702370+0000","last_became_peered":"2024-03-08T06:04:30.702370+0000","last_unstale":"2024-03-08T06:04:31.706856+0000","last_undegraded":"2024-03-08T06:04:31.706856+0000","last_fullsized":"2024-03-08T06:04:31.706856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:14:54.537720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.706915+0000","last_change":"2024-03-08T06:04:30.698248+0000","last_active":"2024-03-08T06:04:31.706915+0000","last_peered":"2024-03-08T06:04:31.706915+0000","last_clean":"2024-03-08T06:04:31.706915+0000","last_became_active":"2024-03-08T06:04:30.697941+0000","last_became_peered":"2024-03-08T06:04:30.697941+0000","last_unstale":"2024-03-08T06:04:31.706915+0000","last_undegraded":"2024-03-08T06:04:31.706915+0000","last_fullsized":"2024-03-08T06:04:31.706915+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:26:41.031717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.795657+0000","last_change":"2024-03-08T06:04:30.712176+0000","last_active":"2024-03-08T06:04:32.795657+0000","last_peered":"2024-03-08T06:04:32.795657+0000","last_clean":"2024-03-08T06:04:32.795657+0000","last_became_active":"2024-03-08T06:04:30.711790+0000","last_became_peered":"2024-03-08T06:04:30.711790+0000","last_unstale":"2024-03-08T06:04:32.795657+0000","last_undegraded":"2024-03-08T06:04:32.795657+0000","last_fullsized":"2024-03-08T06:04:32.795657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:00:13.481439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.743063+0000","last_change":"2024-03-08T06:04:30.710845+0000","last_active":"2024-03-08T06:04:32.743063+0000","last_peered":"2024-03-08T06:04:32.743063+0000","last_clean":"2024-03-08T06:04:32.743063+0000","last_became_active":"2024-03-08T06:04:30.709887+0000","last_became_peered":"2024-03-08T06:04:30.709887+0000","last_unstale":"2024-03-08T06:04:32.743063+0000","last_undegraded":"2024-03-08T06:04:32.743063+0000","last_fullsized":"2024-03-08T06:04:32.743063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:39:17.549225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.708299+0000","last_change":"2024-03-08T06:04:30.688175+0000","last_active":"2024-03-08T06:04:31.708299+0000","last_peered":"2024-03-08T06:04:31.708299+0000","last_clean":"2024-03-08T06:04:31.708299+0000","last_became_active":"2024-03-08T06:04:30.687636+0000","last_became_peered":"2024-03-08T06:04:30.687636+0000","last_unstale":"2024-03-08T06:04:31.708299+0000","last_undegraded":"2024-03-08T06:04:31.708299+0000","last_fullsized":"2024-03-08T06:04:31.708299+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:49:06.618016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.709161+0000","last_change":"2024-03-08T06:04:30.708914+0000","last_active":"2024-03-08T06:04:31.709161+0000","last_peered":"2024-03-08T06:04:31.709161+0000","last_clean":"2024-03-08T06:04:31.709161+0000","last_became_active":"2024-03-08T06:04:30.708643+0000","last_became_peered":"2024-03-08T06:04:30.708643+0000","last_unstale":"2024-03-08T06:04:31.709161+0000","last_undegraded":"2024-03-08T06:04:31.709161+0000","last_fullsized":"2024-03-08T06:04:31.709161+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:44:44.555166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989350+0000","last_change":"2024-03-08T06:04:30.693552+0000","last_active":"2024-03-08T06:04:32.989350+0000","last_peered":"2024-03-08T06:04:32.989350+0000","last_clean":"2024-03-08T06:04:32.989350+0000","last_became_active":"2024-03-08T06:04:30.692862+0000","last_became_peered":"2024-03-08T06:04:30.692862+0000","last_unstale":"2024-03-08T06:04:32.989350+0000","last_undegraded":"2024-03-08T06:04:32.989350+0000","last_fullsized":"2024-03-08T06:04:32.989350+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:44:37.021711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.703964+0000","last_change":"2024-03-08T06:04:30.702154+0000","last_active":"2024-03-08T06:04:31.703964+0000","last_peered":"2024-03-08T06:04:31.703964+0000","last_clean":"2024-03-08T06:04:31.703964+0000","last_became_active":"2024-03-08T06:04:30.701878+0000","last_became_peered":"2024-03-08T06:04:30.701878+0000","last_unstale":"2024-03-08T06:04:31.703964+0000","last_undegraded":"2024-03-08T06:04:31.703964+0000","last_fullsized":"2024-03-08T06:04:31.703964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:56:19.091016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.708869+0000","last_change":"2024-03-08T06:04:30.707852+0000","last_active":"2024-03-08T06:04:31.708869+0000","last_peered":"2024-03-08T06:04:31.708869+0000","last_clean":"2024-03-08T06:04:31.708869+0000","last_became_active":"2024-03-08T06:04:30.707465+0000","last_became_peered":"2024-03-08T06:04:30.707465+0000","last_unstale":"2024-03-08T06:04:31.708869+0000","last_undegraded":"2024-03-08T06:04:31.708869+0000","last_fullsized":"2024-03-08T06:04:31.708869+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:39:17.549225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.707962+0000","last_change":"2024-03-08T06:04:30.692086+0000","last_active":"2024-03-08T06:04:31.707962+0000","last_peered":"2024-03-08T06:04:31.707962+0000","last_clean":"2024-03-08T06:04:31.707962+0000","last_became_active":"2024-03-08T06:04:30.691781+0000","last_became_peered":"2024-03-08T06:04:30.691781+0000","last_unstale":"2024-03-08T06:04:31.707962+0000","last_undegraded":"2024-03-08T06:04:31.707962+0000","last_fullsized":"2024-03-08T06:04:31.707962+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:14:14.538452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.707998+0000","last_change":"2024-03-08T06:04:30.712038+0000","last_active":"2024-03-08T06:04:31.707998+0000","last_peered":"2024-03-08T06:04:31.707998+0000","last_clean":"2024-03-08T06:04:31.707998+0000","last_became_active":"2024-03-08T06:04:30.711726+0000","last_became_peered":"2024-03-08T06:04:30.711726+0000","last_unstale":"2024-03-08T06:04:31.707998+0000","last_undegraded":"2024-03-08T06:04:31.707998+0000","last_fullsized":"2024-03-08T06:04:31.707998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:24:27.225080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.704911+0000","last_change":"2024-03-08T06:04:30.696376+0000","last_active":"2024-03-08T06:04:31.704911+0000","last_peered":"2024-03-08T06:04:31.704911+0000","last_clean":"2024-03-08T06:04:31.704911+0000","last_became_active":"2024-03-08T06:04:30.696059+0000","last_became_peered":"2024-03-08T06:04:30.696059+0000","last_unstale":"2024-03-08T06:04:31.704911+0000","last_undegraded":"2024-03-08T06:04:31.704911+0000","last_fullsized":"2024-03-08T06:04:31.704911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:03:51.140740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.704694+0000","last_change":"2024-03-08T06:04:30.694921+0000","last_active":"2024-03-08T06:04:31.704694+0000","last_peered":"2024-03-08T06:04:31.704694+0000","last_clean":"2024-03-08T06:04:31.704694+0000","last_became_active":"2024-03-08T06:04:30.694665+0000","last_became_peered":"2024-03-08T06:04:30.694665+0000","last_unstale":"2024-03-08T06:04:31.704694+0000","last_undegraded":"2024-03-08T06:04:31.704694+0000","last_fullsized":"2024-03-08T06:04:31.704694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:18:23.963098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989769+0000","last_change":"2024-03-08T06:04:30.699394+0000","last_active":"2024-03-08T06:04:32.989769+0000","last_peered":"2024-03-08T06:04:32.989769+0000","last_clean":"2024-03-08T06:04:32.989769+0000","last_became_active":"2024-03-08T06:04:30.699164+0000","last_became_peered":"2024-03-08T06:04:30.699164+0000","last_unstale":"2024-03-08T06:04:32.989769+0000","last_undegraded":"2024-03-08T06:04:32.989769+0000","last_fullsized":"2024-03-08T06:04:32.989769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:39:06.790675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.794705+0000","last_change":"2024-03-08T06:04:30.712482+0000","last_active":"2024-03-08T06:04:32.794705+0000","last_peered":"2024-03-08T06:04:32.794705+0000","last_clean":"2024-03-08T06:04:32.794705+0000","last_became_active":"2024-03-08T06:04:30.712134+0000","last_became_peered":"2024-03-08T06:04:30.712134+0000","last_unstale":"2024-03-08T06:04:32.794705+0000","last_undegraded":"2024-03-08T06:04:32.794705+0000","last_fullsized":"2024-03-08T06:04:32.794705+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:31:39.475858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.795458+0000","last_change":"2024-03-08T06:04:30.716153+0000","last_active":"2024-03-08T06:04:32.795458+0000","last_peered":"2024-03-08T06:04:32.795458+0000","last_clean":"2024-03-08T06:04:32.795458+0000","last_became_active":"2024-03-08T06:04:30.715266+0000","last_became_peered":"2024-03-08T06:04:30.715266+0000","last_unstale":"2024-03-08T06:04:32.795458+0000","last_undegraded":"2024-03-08T06:04:32.795458+0000","last_fullsized":"2024-03-08T06:04:32.795458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:35:58.857526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.088476+0000","last_change":"2024-03-08T06:04:30.698823+0000","last_active":"2024-03-08T06:04:32.088476+0000","last_peered":"2024-03-08T06:04:32.088476+0000","last_clean":"2024-03-08T06:04:32.088476+0000","last_became_active":"2024-03-08T06:04:30.698554+0000","last_became_peered":"2024-03-08T06:04:30.698554+0000","last_unstale":"2024-03-08T06:04:32.088476+0000","last_undegraded":"2024-03-08T06:04:32.088476+0000","last_fullsized":"2024-03-08T06:04:32.088476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:02:52.659754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.707874+0000","last_change":"2024-03-08T06:04:30.701306+0000","last_active":"2024-03-08T06:04:31.707874+0000","last_peered":"2024-03-08T06:04:31.707874+0000","last_clean":"2024-03-08T06:04:31.707874+0000","last_became_active":"2024-03-08T06:04:30.701001+0000","last_became_peered":"2024-03-08T06:04:30.701001+0000","last_unstale":"2024-03-08T06:04:31.707874+0000","last_undegraded":"2024-03-08T06:04:31.707874+0000","last_fullsized":"2024-03-08T06:04:31.707874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T06:29:55.161250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.743203+0000","last_change":"2024-03-08T06:04:30.698617+0000","last_active":"2024-03-08T06:04:32.743203+0000","last_peered":"2024-03-08T06:04:32.743203+0000","last_clean":"2024-03-08T06:04:32.743203+0000","last_became_active":"2024-03-08T06:04:30.695511+0000","last_became_peered":"2024-03-08T06:04:30.695511+0000","last_unstale":"2024-03-08T06:04:32.743203+0000","last_undegraded":"2024-03-08T06:04:32.743203+0000","last_fullsized":"2024-03-08T06:04:32.743203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:46:41.655761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.705345+0000","last_change":"2024-03-08T06:04:30.710536+0000","last_active":"2024-03-08T06:04:31.705345+0000","last_peered":"2024-03-08T06:04:31.705345+0000","last_clean":"2024-03-08T06:04:31.705345+0000","last_became_active":"2024-03-08T06:04:30.710190+0000","last_became_peered":"2024-03-08T06:04:30.710190+0000","last_unstale":"2024-03-08T06:04:31.705345+0000","last_undegraded":"2024-03-08T06:04:31.705345+0000","last_fullsized":"2024-03-08T06:04:31.705345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:57:20.239629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.743041+0000","last_change":"2024-03-08T06:04:30.718301+0000","last_active":"2024-03-08T06:04:32.743041+0000","last_peered":"2024-03-08T06:04:32.743041+0000","last_clean":"2024-03-08T06:04:32.743041+0000","last_became_active":"2024-03-08T06:04:30.714116+0000","last_became_peered":"2024-03-08T06:04:30.714116+0000","last_unstale":"2024-03-08T06:04:32.743041+0000","last_undegraded":"2024-03-08T06:04:32.743041+0000","last_fullsized":"2024-03-08T06:04:32.743041+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T06:29:55.161250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.709264+0000","last_change":"2024-03-08T06:04:30.710067+0000","last_active":"2024-03-08T06:04:31.709264+0000","last_peered":"2024-03-08T06:04:31.709264+0000","last_clean":"2024-03-08T06:04:31.709264+0000","last_became_active":"2024-03-08T06:04:30.709264+0000","last_became_peered":"2024-03-08T06:04:30.709264+0000","last_unstale":"2024-03-08T06:04:31.709264+0000","last_undegraded":"2024-03-08T06:04:31.709264+0000","last_fullsized":"2024-03-08T06:04:31.709264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:33:36.594482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.794443+0000","last_change":"2024-03-08T06:04:30.720648+0000","last_active":"2024-03-08T06:04:32.794443+0000","last_peered":"2024-03-08T06:04:32.794443+0000","last_clean":"2024-03-08T06:04:32.794443+0000","last_became_active":"2024-03-08T06:04:30.720336+0000","last_became_peered":"2024-03-08T06:04:30.720336+0000","last_unstale":"2024-03-08T06:04:32.794443+0000","last_undegraded":"2024-03-08T06:04:32.794443+0000","last_fullsized":"2024-03-08T06:04:32.794443+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:33:49.833346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.707377+0000","last_change":"2024-03-08T06:04:30.698185+0000","last_active":"2024-03-08T06:04:31.707377+0000","last_peered":"2024-03-08T06:04:31.707377+0000","last_clean":"2024-03-08T06:04:31.707377+0000","last_became_active":"2024-03-08T06:04:30.697835+0000","last_became_peered":"2024-03-08T06:04:30.697835+0000","last_unstale":"2024-03-08T06:04:31.707377+0000","last_undegraded":"2024-03-08T06:04:31.707377+0000","last_fullsized":"2024-03-08T06:04:31.707377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:46:41.655761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989999+0000","last_change":"2024-03-08T06:04:30.700483+0000","last_active":"2024-03-08T06:04:32.989999+0000","last_peered":"2024-03-08T06:04:32.989999+0000","last_clean":"2024-03-08T06:04:32.989999+0000","last_became_active":"2024-03-08T06:04:30.699136+0000","last_became_peered":"2024-03-08T06:04:30.699136+0000","last_unstale":"2024-03-08T06:04:32.989999+0000","last_undegraded":"2024-03-08T06:04:32.989999+0000","last_fullsized":"2024-03-08T06:04:32.989999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:50:40.811793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.707570+0000","last_change":"2024-03-08T06:04:30.705721+0000","last_active":"2024-03-08T06:04:31.707570+0000","last_peered":"2024-03-08T06:04:31.707570+0000","last_clean":"2024-03-08T06:04:31.707570+0000","last_became_active":"2024-03-08T06:04:30.705291+0000","last_became_peered":"2024-03-08T06:04:30.705291+0000","last_unstale":"2024-03-08T06:04:31.707570+0000","last_undegraded":"2024-03-08T06:04:31.707570+0000","last_fullsized":"2024-03-08T06:04:31.707570+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:33:36.594482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.088784+0000","last_change":"2024-03-08T06:04:30.690196+0000","last_active":"2024-03-08T06:04:32.088784+0000","last_peered":"2024-03-08T06:04:32.088784+0000","last_clean":"2024-03-08T06:04:32.088784+0000","last_became_active":"2024-03-08T06:04:30.689865+0000","last_became_peered":"2024-03-08T06:04:30.689865+0000","last_unstale":"2024-03-08T06:04:32.088784+0000","last_undegraded":"2024-03-08T06:04:32.088784+0000","last_fullsized":"2024-03-08T06:04:32.088784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:12:39.906906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.990571+0000","last_change":"2024-03-08T06:04:29.702608+0000","last_active":"2024-03-08T06:04:32.990571+0000","last_peered":"2024-03-08T06:04:32.990571+0000","last_clean":"2024-03-08T06:04:32.990571+0000","last_became_active":"2024-03-08T06:04:29.701532+0000","last_became_peered":"2024-03-08T06:04:29.701532+0000","last_unstale":"2024-03-08T06:04:32.990571+0000","last_undegraded":"2024-03-08T06:04:32.990571+0000","last_fullsized":"2024-03-08T06:04:32.990571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:39:05.777435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.990474+0000","last_change":"2024-03-08T06:04:30.713960+0000","last_active":"2024-03-08T06:04:32.990474+0000","last_peered":"2024-03-08T06:04:32.990474+0000","last_clean":"2024-03-08T06:04:32.990474+0000","last_became_active":"2024-03-08T06:04:30.713678+0000","last_became_peered":"2024-03-08T06:04:30.713678+0000","last_unstale":"2024-03-08T06:04:32.990474+0000","last_undegraded":"2024-03-08T06:04:32.990474+0000","last_fullsized":"2024-03-08T06:04:32.990474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:02:52.659754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.088840+0000","last_change":"2024-03-08T06:04:29.690622+0000","last_active":"2024-03-08T06:04:32.088840+0000","last_peered":"2024-03-08T06:04:32.088840+0000","last_clean":"2024-03-08T06:04:32.088840+0000","last_became_active":"2024-03-08T06:04:29.690290+0000","last_became_peered":"2024-03-08T06:04:29.690290+0000","last_unstale":"2024-03-08T06:04:32.088840+0000","last_undegraded":"2024-03-08T06:04:32.088840+0000","last_fullsized":"2024-03-08T06:04:32.088840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:44:08.589995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.795306+0000","last_change":"2024-03-08T06:04:30.720606+0000","last_active":"2024-03-08T06:04:32.795306+0000","last_peered":"2024-03-08T06:04:32.795306+0000","last_clean":"2024-03-08T06:04:32.795306+0000","last_became_active":"2024-03-08T06:04:30.720298+0000","last_became_peered":"2024-03-08T06:04:30.720298+0000","last_unstale":"2024-03-08T06:04:32.795306+0000","last_undegraded":"2024-03-08T06:04:32.795306+0000","last_fullsized":"2024-03-08T06:04:32.795306+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:08:17.612578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.704963+0000","last_change":"2024-03-08T06:04:29.682715+0000","last_active":"2024-03-08T06:04:31.704963+0000","last_peered":"2024-03-08T06:04:31.704963+0000","last_clean":"2024-03-08T06:04:31.704963+0000","last_became_active":"2024-03-08T06:04:29.679987+0000","last_became_peered":"2024-03-08T06:04:29.679987+0000","last_unstale":"2024-03-08T06:04:31.704963+0000","last_undegraded":"2024-03-08T06:04:31.704963+0000","last_fullsized":"2024-03-08T06:04:31.704963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:50:39.798554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.743426+0000","last_change":"2024-03-08T06:04:30.715586+0000","last_active":"2024-03-08T06:04:32.743426+0000","last_peered":"2024-03-08T06:04:32.743426+0000","last_clean":"2024-03-08T06:04:32.743426+0000","last_became_active":"2024-03-08T06:04:30.713774+0000","last_became_peered":"2024-03-08T06:04:30.713774+0000","last_unstale":"2024-03-08T06:04:32.743426+0000","last_undegraded":"2024-03-08T06:04:32.743426+0000","last_fullsized":"2024-03-08T06:04:32.743426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:44:44.555166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989707+0000","last_change":"2024-03-08T06:04:29.692118+0000","last_active":"2024-03-08T06:04:32.989707+0000","last_peered":"2024-03-08T06:04:32.989707+0000","last_clean":"2024-03-08T06:04:32.989707+0000","last_became_active":"2024-03-08T06:04:29.691713+0000","last_became_peered":"2024-03-08T06:04:29.691713+0000","last_unstale":"2024-03-08T06:04:32.989707+0000","last_undegraded":"2024-03-08T06:04:32.989707+0000","last_fullsized":"2024-03-08T06:04:32.989707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:52:02.206135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.707411+0000","last_change":"2024-03-08T06:04:30.704077+0000","last_active":"2024-03-08T06:04:31.707411+0000","last_peered":"2024-03-08T06:04:31.707411+0000","last_clean":"2024-03-08T06:04:31.707411+0000","last_became_active":"2024-03-08T06:04:30.702558+0000","last_became_peered":"2024-03-08T06:04:30.702558+0000","last_unstale":"2024-03-08T06:04:31.707411+0000","last_undegraded":"2024-03-08T06:04:31.707411+0000","last_fullsized":"2024-03-08T06:04:31.707411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:44:44.555166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.794805+0000","last_change":"2024-03-08T06:04:29.696002+0000","last_active":"2024-03-08T06:04:32.794805+0000","last_peered":"2024-03-08T06:04:32.794805+0000","last_clean":"2024-03-08T06:04:32.794805+0000","last_became_active":"2024-03-08T06:04:29.695622+0000","last_became_peered":"2024-03-08T06:04:29.695622+0000","last_unstale":"2024-03-08T06:04:32.794805+0000","last_undegraded":"2024-03-08T06:04:32.794805+0000","last_fullsized":"2024-03-08T06:04:32.794805+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:19:18.025497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.709160+0000","last_change":"2024-03-08T06:04:30.709495+0000","last_active":"2024-03-08T06:04:31.709160+0000","last_peered":"2024-03-08T06:04:31.709160+0000","last_clean":"2024-03-08T06:04:31.709160+0000","last_became_active":"2024-03-08T06:04:30.709148+0000","last_became_peered":"2024-03-08T06:04:30.709148+0000","last_unstale":"2024-03-08T06:04:31.709160+0000","last_undegraded":"2024-03-08T06:04:31.709160+0000","last_fullsized":"2024-03-08T06:04:31.709160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:46:41.655761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.795517+0000","last_change":"2024-03-08T06:04:29.688149+0000","last_active":"2024-03-08T06:04:32.795517+0000","last_peered":"2024-03-08T06:04:32.795517+0000","last_clean":"2024-03-08T06:04:32.795517+0000","last_became_active":"2024-03-08T06:04:29.687845+0000","last_became_peered":"2024-03-08T06:04:29.687845+0000","last_unstale":"2024-03-08T06:04:32.795517+0000","last_undegraded":"2024-03-08T06:04:32.795517+0000","last_fullsized":"2024-03-08T06:04:32.795517+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:24:29.255665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.794513+0000","last_change":"2024-03-08T06:04:30.712490+0000","last_active":"2024-03-08T06:04:32.794513+0000","last_peered":"2024-03-08T06:04:32.794513+0000","last_clean":"2024-03-08T06:04:32.794513+0000","last_became_active":"2024-03-08T06:04:30.706932+0000","last_became_peered":"2024-03-08T06:04:30.706932+0000","last_unstale":"2024-03-08T06:04:32.794513+0000","last_undegraded":"2024-03-08T06:04:32.794513+0000","last_fullsized":"2024-03-08T06:04:32.794513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:02:52.659754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.703530+0000","last_change":"2024-03-08T06:04:29.683463+0000","last_active":"2024-03-08T06:04:31.703530+0000","last_peered":"2024-03-08T06:04:31.703530+0000","last_clean":"2024-03-08T06:04:31.703530+0000","last_became_active":"2024-03-08T06:04:29.683111+0000","last_became_peered":"2024-03-08T06:04:29.683111+0000","last_unstale":"2024-03-08T06:04:31.703530+0000","last_undegraded":"2024-03-08T06:04:31.703530+0000","last_fullsized":"2024-03-08T06:04:31.703530+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:48:55.679517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.742584+0000","last_change":"2024-03-08T06:04:30.699573+0000","last_active":"2024-03-08T06:04:32.742584+0000","last_peered":"2024-03-08T06:04:32.742584+0000","last_clean":"2024-03-08T06:04:32.742584+0000","last_became_active":"2024-03-08T06:04:30.699258+0000","last_became_peered":"2024-03-08T06:04:30.699258+0000","last_unstale":"2024-03-08T06:04:32.742584+0000","last_undegraded":"2024-03-08T06:04:32.742584+0000","last_fullsized":"2024-03-08T06:04:32.742584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:00:13.481439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.794322+0000","last_change":"2024-03-08T06:04:29.698413+0000","last_active":"2024-03-08T06:04:32.794322+0000","last_peered":"2024-03-08T06:04:32.794322+0000","last_clean":"2024-03-08T06:04:32.794322+0000","last_became_active":"2024-03-08T06:04:29.698025+0000","last_became_peered":"2024-03-08T06:04:29.698025+0000","last_unstale":"2024-03-08T06:04:32.794322+0000","last_undegraded":"2024-03-08T06:04:32.794322+0000","last_fullsized":"2024-03-08T06:04:32.794322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:44:36.008471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.709555+0000","last_change":"2024-03-08T06:04:30.710536+0000","last_active":"2024-03-08T06:04:31.709555+0000","last_peered":"2024-03-08T06:04:31.709555+0000","last_clean":"2024-03-08T06:04:31.709555+0000","last_became_active":"2024-03-08T06:04:30.709779+0000","last_became_peered":"2024-03-08T06:04:30.709779+0000","last_unstale":"2024-03-08T06:04:31.709555+0000","last_undegraded":"2024-03-08T06:04:31.709555+0000","last_fullsized":"2024-03-08T06:04:31.709555+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:14:14.538452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.704834+0000","last_change":"2024-03-08T06:04:29.693916+0000","last_active":"2024-03-08T06:04:31.704834+0000","last_peered":"2024-03-08T06:04:31.704834+0000","last_clean":"2024-03-08T06:04:31.704834+0000","last_became_active":"2024-03-08T06:04:29.693531+0000","last_became_peered":"2024-03-08T06:04:29.693531+0000","last_unstale":"2024-03-08T06:04:31.704834+0000","last_undegraded":"2024-03-08T06:04:31.704834+0000","last_fullsized":"2024-03-08T06:04:31.704834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T06:17:11.476589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.704441+0000","last_change":"2024-03-08T06:04:30.693955+0000","last_active":"2024-03-08T06:04:31.704441+0000","last_peered":"2024-03-08T06:04:31.704441+0000","last_clean":"2024-03-08T06:04:31.704441+0000","last_became_active":"2024-03-08T06:04:30.692155+0000","last_became_peered":"2024-03-08T06:04:30.692155+0000","last_unstale":"2024-03-08T06:04:31.704441+0000","last_undegraded":"2024-03-08T06:04:31.704441+0000","last_fullsized":"2024-03-08T06:04:31.704441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:29:13.994886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.089120+0000","last_change":"2024-03-08T06:04:29.687478+0000","last_active":"2024-03-08T06:04:32.089120+0000","last_peered":"2024-03-08T06:04:32.089120+0000","last_clean":"2024-03-08T06:04:32.089120+0000","last_became_active":"2024-03-08T06:04:29.686826+0000","last_became_peered":"2024-03-08T06:04:29.686826+0000","last_unstale":"2024-03-08T06:04:32.089120+0000","last_undegraded":"2024-03-08T06:04:32.089120+0000","last_fullsized":"2024-03-08T06:04:32.089120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:46:33.384729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.705358+0000","last_change":"2024-03-08T06:04:30.708513+0000","last_active":"2024-03-08T06:04:31.705358+0000","last_peered":"2024-03-08T06:04:31.705358+0000","last_clean":"2024-03-08T06:04:31.705358+0000","last_became_active":"2024-03-08T06:04:30.708218+0000","last_became_peered":"2024-03-08T06:04:30.708218+0000","last_unstale":"2024-03-08T06:04:31.705358+0000","last_undegraded":"2024-03-08T06:04:31.705358+0000","last_fullsized":"2024-03-08T06:04:31.705358+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:58:03.921492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.710107+0000","last_change":"2024-03-08T06:04:29.697681+0000","last_active":"2024-03-08T06:04:31.710107+0000","last_peered":"2024-03-08T06:04:31.710107+0000","last_clean":"2024-03-08T06:04:31.710107+0000","last_became_active":"2024-03-08T06:04:29.697381+0000","last_became_peered":"2024-03-08T06:04:29.697381+0000","last_unstale":"2024-03-08T06:04:31.710107+0000","last_undegraded":"2024-03-08T06:04:31.710107+0000","last_fullsized":"2024-03-08T06:04:31.710107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:48:55.679517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.709896+0000","last_change":"2024-03-08T06:04:30.710917+0000","last_active":"2024-03-08T06:04:31.709896+0000","last_peered":"2024-03-08T06:04:31.709896+0000","last_clean":"2024-03-08T06:04:31.709896+0000","last_became_active":"2024-03-08T06:04:30.710602+0000","last_became_peered":"2024-03-08T06:04:30.710602+0000","last_unstale":"2024-03-08T06:04:31.709896+0000","last_undegraded":"2024-03-08T06:04:31.709896+0000","last_fullsized":"2024-03-08T06:04:31.709896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:49:06.618016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.704840+0000","last_change":"2024-03-08T06:04:29.688564+0000","last_active":"2024-03-08T06:04:31.704840+0000","last_peered":"2024-03-08T06:04:31.704840+0000","last_clean":"2024-03-08T06:04:31.704840+0000","last_became_active":"2024-03-08T06:04:29.688240+0000","last_became_peered":"2024-03-08T06:04:29.688240+0000","last_unstale":"2024-03-08T06:04:31.704840+0000","last_undegraded":"2024-03-08T06:04:31.704840+0000","last_fullsized":"2024-03-08T06:04:31.704840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:31:38.462618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.742386+0000","last_change":"2024-03-08T06:04:30.696015+0000","last_active":"2024-03-08T06:04:32.742386+0000","last_peered":"2024-03-08T06:04:32.742386+0000","last_clean":"2024-03-08T06:04:32.742386+0000","last_became_active":"2024-03-08T06:04:30.695459+0000","last_became_peered":"2024-03-08T06:04:30.695459+0000","last_unstale":"2024-03-08T06:04:32.742386+0000","last_undegraded":"2024-03-08T06:04:32.742386+0000","last_fullsized":"2024-03-08T06:04:32.742386+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:35:58.857526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.795034+0000","last_change":"2024-03-08T06:04:29.699330+0000","last_active":"2024-03-08T06:04:32.795034+0000","last_peered":"2024-03-08T06:04:32.795034+0000","last_clean":"2024-03-08T06:04:32.795034+0000","last_became_active":"2024-03-08T06:04:29.697897+0000","last_became_peered":"2024-03-08T06:04:29.697897+0000","last_unstale":"2024-03-08T06:04:32.795034+0000","last_undegraded":"2024-03-08T06:04:32.795034+0000","last_fullsized":"2024-03-08T06:04:32.795034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:32:01.514292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.704400+0000","last_change":"2024-03-08T06:04:30.704714+0000","last_active":"2024-03-08T06:04:31.704400+0000","last_peered":"2024-03-08T06:04:31.704400+0000","last_clean":"2024-03-08T06:04:31.704400+0000","last_became_active":"2024-03-08T06:04:30.704429+0000","last_became_peered":"2024-03-08T06:04:30.704429+0000","last_unstale":"2024-03-08T06:04:31.704400+0000","last_undegraded":"2024-03-08T06:04:31.704400+0000","last_fullsized":"2024-03-08T06:04:31.704400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:24:27.396333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.742545+0000","last_change":"2024-03-08T06:04:29.699572+0000","last_active":"2024-03-08T06:04:32.742545+0000","last_peered":"2024-03-08T06:04:32.742545+0000","last_clean":"2024-03-08T06:04:32.742545+0000","last_became_active":"2024-03-08T06:04:29.699294+0000","last_became_peered":"2024-03-08T06:04:29.699294+0000","last_unstale":"2024-03-08T06:04:32.742545+0000","last_undegraded":"2024-03-08T06:04:32.742545+0000","last_fullsized":"2024-03-08T06:04:32.742545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:44:08.589995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.707331+0000","last_change":"2024-03-08T06:04:30.705011+0000","last_active":"2024-03-08T06:04:31.707331+0000","last_peered":"2024-03-08T06:04:31.707331+0000","last_clean":"2024-03-08T06:04:31.707331+0000","last_became_active":"2024-03-08T06:04:30.704729+0000","last_became_peered":"2024-03-08T06:04:30.704729+0000","last_unstale":"2024-03-08T06:04:31.707331+0000","last_undegraded":"2024-03-08T06:04:31.707331+0000","last_fullsized":"2024-03-08T06:04:31.707331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:39:17.549225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.703808+0000","last_change":"2024-03-08T06:04:29.688374+0000","last_active":"2024-03-08T06:04:31.703808+0000","last_peered":"2024-03-08T06:04:31.703808+0000","last_clean":"2024-03-08T06:04:31.703808+0000","last_became_active":"2024-03-08T06:04:29.687091+0000","last_became_peered":"2024-03-08T06:04:29.687091+0000","last_unstale":"2024-03-08T06:04:31.703808+0000","last_undegraded":"2024-03-08T06:04:31.703808+0000","last_fullsized":"2024-03-08T06:04:31.703808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:33:48.820107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.990407+0000","last_change":"2024-03-08T06:04:30.707652+0000","last_active":"2024-03-08T06:04:32.990407+0000","last_peered":"2024-03-08T06:04:32.990407+0000","last_clean":"2024-03-08T06:04:32.990407+0000","last_became_active":"2024-03-08T06:04:30.707315+0000","last_became_peered":"2024-03-08T06:04:30.707315+0000","last_unstale":"2024-03-08T06:04:32.990407+0000","last_undegraded":"2024-03-08T06:04:32.990407+0000","last_fullsized":"2024-03-08T06:04:32.990407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:33:49.833346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.703561+0000","last_change":"2024-03-08T06:04:29.680280+0000","last_active":"2024-03-08T06:04:31.703561+0000","last_peered":"2024-03-08T06:04:31.703561+0000","last_clean":"2024-03-08T06:04:31.703561+0000","last_became_active":"2024-03-08T06:04:29.679954+0000","last_became_peered":"2024-03-08T06:04:29.679954+0000","last_unstale":"2024-03-08T06:04:31.703561+0000","last_undegraded":"2024-03-08T06:04:31.703561+0000","last_fullsized":"2024-03-08T06:04:31.703561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T16:02:51.646514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.795055+0000","last_change":"2024-03-08T06:04:30.717143+0000","last_active":"2024-03-08T06:04:32.795055+0000","last_peered":"2024-03-08T06:04:32.795055+0000","last_clean":"2024-03-08T06:04:32.795055+0000","last_became_active":"2024-03-08T06:04:30.715005+0000","last_became_peered":"2024-03-08T06:04:30.715005+0000","last_unstale":"2024-03-08T06:04:32.795055+0000","last_undegraded":"2024-03-08T06:04:32.795055+0000","last_fullsized":"2024-03-08T06:04:32.795055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:12:39.906906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.743349+0000","last_change":"2024-03-08T06:04:29.690726+0000","last_active":"2024-03-08T06:04:32.743349+0000","last_peered":"2024-03-08T06:04:32.743349+0000","last_clean":"2024-03-08T06:04:32.743349+0000","last_became_active":"2024-03-08T06:04:29.690417+0000","last_became_peered":"2024-03-08T06:04:29.690417+0000","last_unstale":"2024-03-08T06:04:32.743349+0000","last_undegraded":"2024-03-08T06:04:32.743349+0000","last_fullsized":"2024-03-08T06:04:32.743349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:39:05.777435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.709825+0000","last_change":"2024-03-08T06:04:30.717302+0000","last_active":"2024-03-08T06:04:31.709825+0000","last_peered":"2024-03-08T06:04:31.709825+0000","last_clean":"2024-03-08T06:04:31.709825+0000","last_became_active":"2024-03-08T06:04:30.715685+0000","last_became_peered":"2024-03-08T06:04:30.715685+0000","last_unstale":"2024-03-08T06:04:31.709825+0000","last_undegraded":"2024-03-08T06:04:31.709825+0000","last_fullsized":"2024-03-08T06:04:31.709825+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:24:27.225080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.795364+0000","last_change":"2024-03-08T06:04:29.700584+0000","last_active":"2024-03-08T06:04:32.795364+0000","last_peered":"2024-03-08T06:04:32.795364+0000","last_clean":"2024-03-08T06:04:32.795364+0000","last_became_active":"2024-03-08T06:04:29.699652+0000","last_became_peered":"2024-03-08T06:04:29.699652+0000","last_unstale":"2024-03-08T06:04:32.795364+0000","last_undegraded":"2024-03-08T06:04:32.795364+0000","last_fullsized":"2024-03-08T06:04:32.795364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T06:04:28.802854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.742810+0000","last_change":"2024-03-08T06:04:30.714068+0000","last_active":"2024-03-08T06:04:32.742810+0000","last_peered":"2024-03-08T06:04:32.742810+0000","last_clean":"2024-03-08T06:04:32.742810+0000","last_became_active":"2024-03-08T06:04:30.709630+0000","last_became_peered":"2024-03-08T06:04:30.709630+0000","last_unstale":"2024-03-08T06:04:32.742810+0000","last_undegraded":"2024-03-08T06:04:32.742810+0000","last_fullsized":"2024-03-08T06:04:32.742810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:26:41.031717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.795097+0000","last_change":"2024-03-08T06:04:29.687615+0000","last_active":"2024-03-08T06:04:32.795097+0000","last_peered":"2024-03-08T06:04:32.795097+0000","last_clean":"2024-03-08T06:04:32.795097+0000","last_became_active":"2024-03-08T06:04:29.687294+0000","last_became_peered":"2024-03-08T06:04:29.687294+0000","last_unstale":"2024-03-08T06:04:32.795097+0000","last_undegraded":"2024-03-08T06:04:32.795097+0000","last_fullsized":"2024-03-08T06:04:32.795097+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:11.301516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989333+0000","last_change":"2024-03-08T06:04:30.707196+0000","last_active":"2024-03-08T06:04:32.989333+0000","last_peered":"2024-03-08T06:04:32.989333+0000","last_clean":"2024-03-08T06:04:32.989333+0000","last_became_active":"2024-03-08T06:04:30.706526+0000","last_became_peered":"2024-03-08T06:04:30.706526+0000","last_unstale":"2024-03-08T06:04:32.989333+0000","last_undegraded":"2024-03-08T06:04:32.989333+0000","last_fullsized":"2024-03-08T06:04:32.989333+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T06:04:29.816093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.795411+0000","last_change":"2024-03-08T06:04:29.692711+0000","last_active":"2024-03-08T06:04:32.795411+0000","last_peered":"2024-03-08T06:04:32.795411+0000","last_clean":"2024-03-08T06:04:32.795411+0000","last_became_active":"2024-03-08T06:04:29.692379+0000","last_became_peered":"2024-03-08T06:04:29.692379+0000","last_unstale":"2024-03-08T06:04:32.795411+0000","last_undegraded":"2024-03-08T06:04:32.795411+0000","last_fullsized":"2024-03-08T06:04:32.795411+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:58:47.676859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989283+0000","last_change":"2024-03-08T06:04:30.713768+0000","last_active":"2024-03-08T06:04:32.989283+0000","last_peered":"2024-03-08T06:04:32.989283+0000","last_clean":"2024-03-08T06:04:32.989283+0000","last_became_active":"2024-03-08T06:04:30.713324+0000","last_became_peered":"2024-03-08T06:04:30.713324+0000","last_unstale":"2024-03-08T06:04:32.989283+0000","last_undegraded":"2024-03-08T06:04:32.989283+0000","last_fullsized":"2024-03-08T06:04:32.989283+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:46:34.197425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.088902+0000","last_change":"2024-03-08T06:04:29.687265+0000","last_active":"2024-03-08T06:04:32.088902+0000","last_peered":"2024-03-08T06:04:32.088902+0000","last_clean":"2024-03-08T06:04:32.088902+0000","last_became_active":"2024-03-08T06:04:29.686942+0000","last_became_peered":"2024-03-08T06:04:29.686942+0000","last_unstale":"2024-03-08T06:04:32.088902+0000","last_undegraded":"2024-03-08T06:04:32.088902+0000","last_fullsized":"2024-03-08T06:04:32.088902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T07:39:05.777435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989504+0000","last_change":"2024-03-08T06:04:30.685348+0000","last_active":"2024-03-08T06:04:32.989504+0000","last_peered":"2024-03-08T06:04:32.989504+0000","last_clean":"2024-03-08T06:04:32.989504+0000","last_became_active":"2024-03-08T06:04:30.685054+0000","last_became_peered":"2024-03-08T06:04:30.685054+0000","last_unstale":"2024-03-08T06:04:32.989504+0000","last_undegraded":"2024-03-08T06:04:32.989504+0000","last_fullsized":"2024-03-08T06:04:32.989504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:12:21.399194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989867+0000","last_change":"2024-03-08T06:04:29.695737+0000","last_active":"2024-03-08T06:04:32.989867+0000","last_peered":"2024-03-08T06:04:32.989867+0000","last_clean":"2024-03-08T06:04:32.989867+0000","last_became_active":"2024-03-08T06:04:29.695166+0000","last_became_peered":"2024-03-08T06:04:29.695166+0000","last_unstale":"2024-03-08T06:04:32.989867+0000","last_undegraded":"2024-03-08T06:04:32.989867+0000","last_fullsized":"2024-03-08T06:04:32.989867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T11:12:20.385955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.988957+0000","last_change":"2024-03-08T06:04:30.693634+0000","last_active":"2024-03-08T06:04:32.988957+0000","last_peered":"2024-03-08T06:04:32.988957+0000","last_clean":"2024-03-08T06:04:32.988957+0000","last_became_active":"2024-03-08T06:04:30.692981+0000","last_became_peered":"2024-03-08T06:04:30.692981+0000","last_unstale":"2024-03-08T06:04:32.988957+0000","last_undegraded":"2024-03-08T06:04:32.988957+0000","last_fullsized":"2024-03-08T06:04:32.988957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:44:12.314755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.794794+0000","last_change":"2024-03-08T06:04:29.696731+0000","last_active":"2024-03-08T06:04:32.794794+0000","last_peered":"2024-03-08T06:04:32.794794+0000","last_clean":"2024-03-08T06:04:32.794794+0000","last_became_active":"2024-03-08T06:04:29.696366+0000","last_became_peered":"2024-03-08T06:04:29.696366+0000","last_unstale":"2024-03-08T06:04:32.794794+0000","last_undegraded":"2024-03-08T06:04:32.794794+0000","last_fullsized":"2024-03-08T06:04:32.794794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:19:58.655135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.706634+0000","last_change":"2024-03-08T06:04:30.705119+0000","last_active":"2024-03-08T06:04:31.706634+0000","last_peered":"2024-03-08T06:04:31.706634+0000","last_clean":"2024-03-08T06:04:31.706634+0000","last_became_active":"2024-03-08T06:04:30.704355+0000","last_became_peered":"2024-03-08T06:04:30.704355+0000","last_unstale":"2024-03-08T06:04:31.706634+0000","last_undegraded":"2024-03-08T06:04:31.706634+0000","last_fullsized":"2024-03-08T06:04:31.706634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:00:13.481439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.708354+0000","last_change":"2024-03-08T06:04:29.695077+0000","last_active":"2024-03-08T06:04:31.708354+0000","last_peered":"2024-03-08T06:04:31.708354+0000","last_clean":"2024-03-08T06:04:31.708354+0000","last_became_active":"2024-03-08T06:04:29.694304+0000","last_became_peered":"2024-03-08T06:04:29.694304+0000","last_unstale":"2024-03-08T06:04:31.708354+0000","last_undegraded":"2024-03-08T06:04:31.708354+0000","last_fullsized":"2024-03-08T06:04:31.708354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:50:39.798554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989544+0000","last_change":"2024-03-08T06:04:30.696238+0000","last_active":"2024-03-08T06:04:32.989544+0000","last_peered":"2024-03-08T06:04:32.989544+0000","last_clean":"2024-03-08T06:04:32.989544+0000","last_became_active":"2024-03-08T06:04:30.695961+0000","last_became_peered":"2024-03-08T06:04:30.695961+0000","last_unstale":"2024-03-08T06:04:32.989544+0000","last_undegraded":"2024-03-08T06:04:32.989544+0000","last_fullsized":"2024-03-08T06:04:32.989544+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:58:26.211626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.743383+0000","last_change":"2024-03-08T06:04:29.697670+0000","last_active":"2024-03-08T06:04:32.743383+0000","last_peered":"2024-03-08T06:04:32.743383+0000","last_clean":"2024-03-08T06:04:32.743383+0000","last_became_active":"2024-03-08T06:04:29.697421+0000","last_became_peered":"2024-03-08T06:04:29.697421+0000","last_unstale":"2024-03-08T06:04:32.743383+0000","last_undegraded":"2024-03-08T06:04:32.743383+0000","last_fullsized":"2024-03-08T06:04:32.743383+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:57:38.025862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.710076+0000","last_change":"2024-03-08T06:04:30.701119+0000","last_active":"2024-03-08T06:04:31.710076+0000","last_peered":"2024-03-08T06:04:31.710076+0000","last_clean":"2024-03-08T06:04:31.710076+0000","last_became_active":"2024-03-08T06:04:30.700746+0000","last_became_peered":"2024-03-08T06:04:30.700746+0000","last_unstale":"2024-03-08T06:04:31.710076+0000","last_undegraded":"2024-03-08T06:04:31.710076+0000","last_fullsized":"2024-03-08T06:04:31.710076+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:24:27.396333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.089065+0000","last_change":"2024-03-08T06:04:29.687775+0000","last_active":"2024-03-08T06:04:32.089065+0000","last_peered":"2024-03-08T06:04:32.089065+0000","last_clean":"2024-03-08T06:04:32.089065+0000","last_became_active":"2024-03-08T06:04:29.687163+0000","last_became_peered":"2024-03-08T06:04:29.687163+0000","last_unstale":"2024-03-08T06:04:32.089065+0000","last_undegraded":"2024-03-08T06:04:32.089065+0000","last_fullsized":"2024-03-08T06:04:32.089065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T06:36:25.224626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.088467+0000","last_change":"2024-03-08T06:04:30.682323+0000","last_active":"2024-03-08T06:04:32.088467+0000","last_peered":"2024-03-08T06:04:32.088467+0000","last_clean":"2024-03-08T06:04:32.088467+0000","last_became_active":"2024-03-08T06:04:30.681789+0000","last_became_peered":"2024-03-08T06:04:30.681789+0000","last_unstale":"2024-03-08T06:04:32.088467+0000","last_undegraded":"2024-03-08T06:04:32.088467+0000","last_fullsized":"2024-03-08T06:04:32.088467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T09:31:39.475858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.743029+0000","last_change":"2024-03-08T06:04:29.687932+0000","last_active":"2024-03-08T06:04:32.743029+0000","last_peered":"2024-03-08T06:04:32.743029+0000","last_clean":"2024-03-08T06:04:32.743029+0000","last_became_active":"2024-03-08T06:04:29.687633+0000","last_became_peered":"2024-03-08T06:04:29.687633+0000","last_unstale":"2024-03-08T06:04:32.743029+0000","last_undegraded":"2024-03-08T06:04:32.743029+0000","last_fullsized":"2024-03-08T06:04:32.743029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:46:33.384729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.990032+0000","last_change":"2024-03-08T06:04:30.698218+0000","last_active":"2024-03-08T06:04:32.990032+0000","last_peered":"2024-03-08T06:04:32.990032+0000","last_clean":"2024-03-08T06:04:32.990032+0000","last_became_active":"2024-03-08T06:04:30.696114+0000","last_became_peered":"2024-03-08T06:04:30.696114+0000","last_unstale":"2024-03-08T06:04:32.990032+0000","last_undegraded":"2024-03-08T06:04:32.990032+0000","last_fullsized":"2024-03-08T06:04:32.990032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T13:48:56.692756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.089166+0000","last_change":"2024-03-08T06:04:29.701703+0000","last_active":"2024-03-08T06:04:32.089166+0000","last_peered":"2024-03-08T06:04:32.089166+0000","last_clean":"2024-03-08T06:04:32.089166+0000","last_became_active":"2024-03-08T06:04:29.701394+0000","last_became_peered":"2024-03-08T06:04:29.701394+0000","last_unstale":"2024-03-08T06:04:32.089166+0000","last_undegraded":"2024-03-08T06:04:32.089166+0000","last_fullsized":"2024-03-08T06:04:32.089166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:57:38.025862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.088816+0000","last_change":"2024-03-08T06:04:30.702646+0000","last_active":"2024-03-08T06:04:32.088816+0000","last_peered":"2024-03-08T06:04:32.088816+0000","last_clean":"2024-03-08T06:04:32.088816+0000","last_became_active":"2024-03-08T06:04:30.702333+0000","last_became_peered":"2024-03-08T06:04:30.702333+0000","last_unstale":"2024-03-08T06:04:32.088816+0000","last_undegraded":"2024-03-08T06:04:32.088816+0000","last_fullsized":"2024-03-08T06:04:32.088816+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T10:08:17.612578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.742712+0000","last_change":"2024-03-08T06:04:29.701532+0000","last_active":"2024-03-08T06:04:32.742712+0000","last_peered":"2024-03-08T06:04:32.742712+0000","last_clean":"2024-03-08T06:04:32.742712+0000","last_became_active":"2024-03-08T06:04:29.701196+0000","last_became_peered":"2024-03-08T06:04:29.701196+0000","last_unstale":"2024-03-08T06:04:32.742712+0000","last_undegraded":"2024-03-08T06:04:32.742712+0000","last_fullsized":"2024-03-08T06:04:32.742712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T06:36:25.224626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.703563+0000","last_change":"2024-03-08T06:04:30.707606+0000","last_active":"2024-03-08T06:04:31.703563+0000","last_peered":"2024-03-08T06:04:31.703563+0000","last_clean":"2024-03-08T06:04:31.703563+0000","last_became_active":"2024-03-08T06:04:30.707310+0000","last_became_peered":"2024-03-08T06:04:30.707310+0000","last_unstale":"2024-03-08T06:04:31.703563+0000","last_undegraded":"2024-03-08T06:04:31.703563+0000","last_fullsized":"2024-03-08T06:04:31.703563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:24:27.225080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.795087+0000","last_change":"2024-03-08T06:04:29.698135+0000","last_active":"2024-03-08T06:04:32.795087+0000","last_peered":"2024-03-08T06:04:32.795087+0000","last_clean":"2024-03-08T06:04:32.795087+0000","last_became_active":"2024-03-08T06:04:29.697796+0000","last_became_peered":"2024-03-08T06:04:29.697796+0000","last_unstale":"2024-03-08T06:04:32.795087+0000","last_undegraded":"2024-03-08T06:04:32.795087+0000","last_fullsized":"2024-03-08T06:04:32.795087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T17:46:33.184185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.794452+0000","last_change":"2024-03-08T06:04:30.720583+0000","last_active":"2024-03-08T06:04:32.794452+0000","last_peered":"2024-03-08T06:04:32.794452+0000","last_clean":"2024-03-08T06:04:32.794452+0000","last_became_active":"2024-03-08T06:04:30.720303+0000","last_became_peered":"2024-03-08T06:04:30.720303+0000","last_unstale":"2024-03-08T06:04:32.794452+0000","last_undegraded":"2024-03-08T06:04:32.794452+0000","last_fullsized":"2024-03-08T06:04:32.794452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:06:09.516032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.703418+0000","last_change":"2024-03-08T06:04:29.687748+0000","last_active":"2024-03-08T06:04:31.703418+0000","last_peered":"2024-03-08T06:04:31.703418+0000","last_clean":"2024-03-08T06:04:31.703418+0000","last_became_active":"2024-03-08T06:04:29.687454+0000","last_became_peered":"2024-03-08T06:04:29.687454+0000","last_unstale":"2024-03-08T06:04:31.703418+0000","last_undegraded":"2024-03-08T06:04:31.703418+0000","last_fullsized":"2024-03-08T06:04:31.703418+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T08:06:08.502792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.707077+0000","last_change":"2024-03-08T06:04:30.697950+0000","last_active":"2024-03-08T06:04:31.707077+0000","last_peered":"2024-03-08T06:04:31.707077+0000","last_clean":"2024-03-08T06:04:31.707077+0000","last_became_active":"2024-03-08T06:04:30.697637+0000","last_became_peered":"2024-03-08T06:04:30.697637+0000","last_unstale":"2024-03-08T06:04:31.707077+0000","last_undegraded":"2024-03-08T06:04:31.707077+0000","last_fullsized":"2024-03-08T06:04:31.707077+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:29.644841+0000","last_clean_scrub_stamp":"2024-03-08T06:04:29.644841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T06:29:55.161250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:32.989824+0000","last_change":"2024-03-08T06:04:29.699600+0000","last_active":"2024-03-08T06:04:32.989824+0000","last_peered":"2024-03-08T06:04:32.989824+0000","last_clean":"2024-03-08T06:04:32.989824+0000","last_became_active":"2024-03-08T06:04:29.699296+0000","last_became_peered":"2024-03-08T06:04:29.699296+0000","last_unstale":"2024-03-08T06:04:32.989824+0000","last_undegraded":"2024-03-08T06:04:32.989824+0000","last_fullsized":"2024-03-08T06:04:32.989824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:04:28.631601+0000","last_clean_scrub_stamp":"2024-03-08T06:04:28.631601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T12:58:25.198387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":196,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-08T06:04:31.707807+0000","last_change":"2024-03-08T06:03:16.679654+0000","last_active":"2024-03-08T06:04:31.707807+0000","last_peered":"2024-03-08T06:04:31.707807+0000","last_clean":"2024-03-08T06:04:31.707807+0000","last_became_active":"2024-03-08T06:03:16.676829+0000","last_became_peered":"2024-03-08T06:03:16.676829+0000","last_unstale":"2024-03-08T06:04:31.707807+0000","last_undegraded":"2024-03-08T06:04:31.707807+0000","last_fullsized":"2024-03-08T06:04:31.707807+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:14.800941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:14.800941+0000","last_clean_scrub_stamp":"2024-03-08T06:03:14.800941+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:20:09.927678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":741729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":380928,"data_stored":145587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31572,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340268,"statfs":{"total":96636764160,"available":96604434432,"internally_reserved":0,"allocated":393216,"data_stored":151943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31556,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340284,"statfs":{"total":96636764160,"available":96604450816,"internally_reserved":0,"allocated":380928,"data_stored":145075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":401408,"data_stored":152905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":145041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":152905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":978944,"data_stored":741639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T06:04:35.720 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-08T06:04:35.720 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-08T06:04:35.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.994+0000 7f3a84a00640 1 Processor -- start 2024-03-08T06:04:35.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.995+0000 7f3a84a00640 1 -- start start 2024-03-08T06:04:35.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.996+0000 7f3a84a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3a8015e5a0 0x7f3a800cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:35.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.997+0000 7f3a84a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8015ea30 con 0x7f3a8006e8a0 2024-03-08T06:04:35.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.997+0000 7f3a84a00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a8015ed10 con 0x7f3a8006ec80 2024-03-08T06:04:35.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.997+0000 7f3a84a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8015eff0 con 0x7f3a8015e5a0 2024-03-08T06:04:35.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.997+0000 7f3a7e800640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3a8006e8a0 0x7f3a800b32a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44302/0 (socket says 172.21.15.19:44302) 2024-03-08T06:04:35.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.997+0000 7f3a7e800640 1 -- 172.21.15.19:0/848533283 learned_addr learned my addr 172.21.15.19:0/848533283 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:35.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.997+0000 7f3a7de00640 1 --2- 172.21.15.19:0/848533283 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3a8015e5a0 0x7f3a800cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:35.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.998+0000 7f3a7d400640 1 -- 172.21.15.19:0/848533283 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122651958 0 0) 0x7f3a8015ea30 con 0x7f3a8006e8a0 2024-03-08T06:04:35.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.998+0000 7f3a7d400640 1 -- 172.21.15.19:0/848533283 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a64005730 con 0x7f3a8006e8a0 2024-03-08T06:04:36.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.998+0000 7f3a7d400640 1 -- 172.21.15.19:0/848533283 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 600747296 0 0) 0x7f3a64005730 con 0x7f3a8006e8a0 2024-03-08T06:04:36.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.998+0000 7f3a7d400640 1 -- 172.21.15.19:0/848533283 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3a8015e5a0 msgr2=0x7f3a800cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:36.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.998+0000 7f3a7d400640 1 --2- 172.21.15.19:0/848533283 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3a8015e5a0 0x7f3a800cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:36.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.998+0000 7f3a7d400640 1 -- 172.21.15.19:0/848533283 >> v1:172.21.15.42:6789/0 conn(0x7f3a8006ec80 legacy=0x7f3a800cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:36.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.998+0000 7f3a7d400640 1 -- 172.21.15.19:0/848533283 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8015f2d0 con 0x7f3a8006e8a0 2024-03-08T06:04:36.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.998+0000 7f3a7d400640 1 -- 172.21.15.19:0/848533283 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f3a70001670 con 0x7f3a8006e8a0 2024-03-08T06:04:36.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.998+0000 7f3a7d400640 1 -- 172.21.15.19:0/848533283 >> v1:172.21.15.19:6789/0 conn(0x7f3a8006e8a0 legacy=0x7f3a800b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:36.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.998+0000 7f3a7d400640 1 --2- 172.21.15.19:0/848533283 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3a64005c60 0x7f3a64006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:36.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.998+0000 7f3a7d400640 1 --2- 172.21.15.19:0/848533283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a640065c0 0x7f3a64006a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.998+0000 7f3a7d400640 1 --2- 172.21.15.19:0/848533283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a64007290 0x7f3a6400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.998+0000 7f3a7d400640 1 -- 172.21.15.19:0/848533283 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8015eff0 con 0x7f3a640065c0 2024-03-08T06:04:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.998+0000 7f3a7d400640 1 -- 172.21.15.19:0/848533283 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6400e1c0 con 0x7f3a64007290 2024-03-08T06:04:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.998+0000 7f3a7d400640 1 -- 172.21.15.19:0/848533283 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6400e3c0 con 0x7f3a64005c60 2024-03-08T06:04:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.999+0000 7f3a7de00640 1 --2- 172.21.15.19:0/848533283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a640065c0 0x7f3a64006a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.999+0000 7f3a7e800640 1 --2- 172.21.15.19:0/848533283 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3a64005c60 0x7f3a64006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.999+0000 7f3a7f200640 1 --2- 172.21.15.19:0/848533283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a64007290 0x7f3a6400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.999+0000 7f3a7de00640 1 -- 172.21.15.19:0/848533283 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3a64005c60 msgr2=0x7f3a64006040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.999+0000 7f3a7de00640 1 --2- 172.21.15.19:0/848533283 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3a64005c60 0x7f3a64006040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.999+0000 7f3a7de00640 1 -- 172.21.15.19:0/848533283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a64007290 msgr2=0x7f3a6400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.999+0000 7f3a7de00640 1 --2- 172.21.15.19:0/848533283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a64007290 0x7f3a6400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.999+0000 7f3a7de00640 1 -- 172.21.15.19:0/848533283 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a64005730 con 0x7f3a640065c0 2024-03-08T06:04:36.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:35.999+0000 7f3a7f200640 1 --2- 172.21.15.19:0/848533283 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a64007290 0x7f3a6400dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:36.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.000+0000 7f3a7de00640 1 --2- 172.21.15.19:0/848533283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a640065c0 0x7f3a64006a90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009ac0 tx=0x7f3a64007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c296087b05d98fb server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:36.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.001+0000 7f3a7d400640 1 -- 172.21.15.19:0/848533283 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c039070 con 0x7f3a640065c0 2024-03-08T06:04:36.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.001+0000 7f3a7d400640 1 -- 172.21.15.19:0/848533283 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c02c6b0 con 0x7f3a640065c0 2024-03-08T06:04:36.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.001+0000 7f3a7d400640 1 -- 172.21.15.19:0/848533283 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c009690 con 0x7f3a640065c0 2024-03-08T06:04:36.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.001+0000 7f3a84a00640 1 -- 172.21.15.19:0/848533283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a640065c0 msgr2=0x7f3a64006a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:36.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.001+0000 7f3a84a00640 1 --2- 172.21.15.19:0/848533283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a640065c0 0x7f3a64006a90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009ac0 tx=0x7f3a64007a40 comp rx=0 tx=0).stop 2024-03-08T06:04:36.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.001+0000 7f3a7f200640 1 -- 172.21.15.19:0/848533283 reap_dead start 2024-03-08T06:04:36.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.001+0000 7f3a84a00640 1 -- 172.21.15.19:0/848533283 shutdown_connections 2024-03-08T06:04:36.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.001+0000 7f3a84a00640 1 -- 172.21.15.19:0/848533283 >> 172.21.15.19:0/848533283 conn(0x7f3a8006ac50 msgr2=0x7f3a8006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:36.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.001+0000 7f3a84a00640 1 -- 172.21.15.19:0/848533283 shutdown_connections 2024-03-08T06:04:36.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.002+0000 7f3a84a00640 1 -- 172.21.15.19:0/848533283 wait complete. 2024-03-08T06:04:36.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.003+0000 7f3a84a00640 1 Processor -- start 2024-03-08T06:04:36.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.004+0000 7f3a84a00640 1 -- start start 2024-03-08T06:04:36.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.004+0000 7f3a84a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3a640065c0 0x7f3a800b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:36.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.004+0000 7f3a84a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a800afff0 0x7f3a8014bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:36.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.004+0000 7f3a84a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a800b3aa0 0x7f3a800b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:36.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.005+0000 7f3a84a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a800cf030 con 0x7f3a800b3aa0 2024-03-08T06:04:36.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.005+0000 7f3a84a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a800cd750 con 0x7f3a800afff0 2024-03-08T06:04:36.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.005+0000 7f3a84a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a800cf1b0 con 0x7f3a640065c0 2024-03-08T06:04:36.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.005+0000 7f3a7f200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a800b3aa0 0x7f3a800b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:36.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.005+0000 7f3a7f200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a800b3aa0 0x7f3a800b3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52246/0 (socket says 172.21.15.19:52246) 2024-03-08T06:04:36.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.005+0000 7f3a7f200640 1 -- 172.21.15.19:0/393448362 learned_addr learned my addr 172.21.15.19:0/393448362 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:36.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.005+0000 7f3a7e800640 1 --2- 172.21.15.19:0/393448362 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3a640065c0 0x7f3a800b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:36.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.005+0000 7f3a7de00640 1 --2- 172.21.15.19:0/393448362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a800afff0 0x7f3a8014bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:36.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.005+0000 7f3a7f200640 1 -- 172.21.15.19:0/393448362 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3a640065c0 msgr2=0x7f3a800b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:36.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.005+0000 7f3a7f200640 1 --2- 172.21.15.19:0/393448362 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3a640065c0 0x7f3a800b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:36.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.005+0000 7f3a7f200640 1 -- 172.21.15.19:0/393448362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a800afff0 msgr2=0x7f3a8014bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:36.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.005+0000 7f3a7f200640 1 --2- 172.21.15.19:0/393448362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a800afff0 0x7f3a8014bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:36.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.005+0000 7f3a7f200640 1 -- 172.21.15.19:0/393448362 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8014c420 con 0x7f3a800b3aa0 2024-03-08T06:04:36.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.006+0000 7f3a7f200640 1 --2- 172.21.15.19:0/393448362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a800b3aa0 0x7f3a800b3f20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3a800b5100 tx=0x7f3a7800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:36.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.006+0000 7f3a76a00640 1 -- 172.21.15.19:0/393448362 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78006d50 con 0x7f3a800b3aa0 2024-03-08T06:04:36.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.006+0000 7f3a76a00640 1 -- 172.21.15.19:0/393448362 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a78003970 con 0x7f3a800b3aa0 2024-03-08T06:04:36.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.006+0000 7f3a76a00640 1 -- 172.21.15.19:0/393448362 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78003da0 con 0x7f3a800b3aa0 2024-03-08T06:04:36.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.006+0000 7f3a84a00640 1 -- 172.21.15.19:0/393448362 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8014e500 con 0x7f3a800b3aa0 2024-03-08T06:04:36.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.006+0000 7f3a84a00640 1 -- 172.21.15.19:0/393448362 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a800af7f0 con 0x7f3a800b3aa0 2024-03-08T06:04:36.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.007+0000 7f3a84a00640 1 -- 172.21.15.19:0/393448362 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8014c9b0 con 0x7f3a800b3aa0 2024-03-08T06:04:36.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.008+0000 7f3a76a00640 1 -- 172.21.15.19:0/393448362 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3a7801b020 con 0x7f3a800b3aa0 2024-03-08T06:04:36.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.009+0000 7f3a76a00640 1 --2- 172.21.15.19:0/393448362 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3a6006b4d0 0x7f3a6006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:36.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.009+0000 7f3a76a00640 1 -- 172.21.15.19:0/393448362 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a78089f10 con 0x7f3a800b3aa0 2024-03-08T06:04:36.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.010+0000 7f3a7e800640 1 --2- 172.21.15.19:0/393448362 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3a6006b4d0 0x7f3a6006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:36.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.010+0000 7f3a7e800640 1 --2- 172.21.15.19:0/393448362 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3a6006b4d0 0x7f3a6006d990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3a70000f60 tx=0x7f3a70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:36.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.015+0000 7f3a76a00640 1 -- 172.21.15.19:0/393448362 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3a7801ce40 con 0x7f3a800b3aa0 2024-03-08T06:04:36.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.284+0000 7f3a84a00640 1 -- 172.21.15.19:0/393448362 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3a80075090 con 0x7f3a800b3aa0 2024-03-08T06:04:36.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.290+0000 7f3a76a00640 1 -- 172.21.15.19:0/393448362 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f3a78058cf0 con 0x7f3a800b3aa0 2024-03-08T06:04:36.290 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-03-08T06:04:36.291 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDtqeplzcxPEBAABnbNLSY0GpjUgDT5bL7o6Q== 2024-03-08T06:04:36.291 INFO:teuthology.orchestra.run.smithi019.stdout: caps mds = "allow" 2024-03-08T06:04:36.291 INFO:teuthology.orchestra.run.smithi019.stdout: caps mon = "allow r" 2024-03-08T06:04:36.291 INFO:teuthology.orchestra.run.smithi019.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-08T06:04:36.291 INFO:teuthology.orchestra.run.smithi019.stderr:updated caps for client.0 2024-03-08T06:04:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.292+0000 7f3a84a00640 1 -- 172.21.15.19:0/393448362 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3a6006b4d0 msgr2=0x7f3a6006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.292+0000 7f3a84a00640 1 --2- 172.21.15.19:0/393448362 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3a6006b4d0 0x7f3a6006d990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3a70000f60 tx=0x7f3a70009040 comp rx=0 tx=0).stop 2024-03-08T06:04:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.292+0000 7f3a84a00640 1 -- 172.21.15.19:0/393448362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a800b3aa0 msgr2=0x7f3a800b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.292+0000 7f3a84a00640 1 --2- 172.21.15.19:0/393448362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a800b3aa0 0x7f3a800b3f20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3a800b5100 tx=0x7f3a7800dc00 comp rx=0 tx=0).stop 2024-03-08T06:04:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.292+0000 7f3a84a00640 1 -- 172.21.15.19:0/393448362 shutdown_connections 2024-03-08T06:04:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.292+0000 7f3a84a00640 1 --2- 172.21.15.19:0/393448362 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3a6006b4d0 0x7f3a6006d990 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.292+0000 7f3a84a00640 1 --2- 172.21.15.19:0/393448362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a800b3aa0 0x7f3a800b3f20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.292+0000 7f3a84a00640 1 --2- 172.21.15.19:0/393448362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3a800afff0 0x7f3a8014bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.292+0000 7f3a84a00640 1 --2- 172.21.15.19:0/393448362 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3a640065c0 0x7f3a800b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:36.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.292+0000 7f3a84a00640 1 -- 172.21.15.19:0/393448362 >> 172.21.15.19:0/393448362 conn(0x7f3a8006ac50 msgr2=0x7f3a80153930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:36.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.292+0000 7f3a84a00640 1 -- 172.21.15.19:0/393448362 shutdown_connections 2024-03-08T06:04:36.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.292+0000 7f3a84a00640 1 -- 172.21.15.19:0/393448362 wait complete. 2024-03-08T06:04:36.312 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T06:04:36.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.533+0000 7f9bbd200640 1 Processor -- start 2024-03-08T06:04:36.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.534+0000 7f9bbd200640 1 -- start start 2024-03-08T06:04:36.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.535+0000 7f9bbd200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9bb8146a40 0x7f9bb806efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:36.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.535+0000 7f9bbd200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9bb80b4ae0 0x7f9bb80ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:36.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.535+0000 7f9bbd200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb80b2ec0 con 0x7f9bb8146660 2024-03-08T06:04:36.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.535+0000 7f9bbd200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb80b31a0 con 0x7f9bb8146a40 2024-03-08T06:04:36.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.536+0000 7f9bbd200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80b3480 con 0x7f9bb80b4ae0 2024-03-08T06:04:36.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.536+0000 7f9bb7400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9bb8146660 0x7f9bb80b43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44310/0 (socket says 172.21.15.19:44310) 2024-03-08T06:04:36.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.536+0000 7f9bb7400640 1 -- 172.21.15.19:0/1103979259 learned_addr learned my addr 172.21.15.19:0/1103979259 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:36.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.536+0000 7f9bafe00640 1 --2- 172.21.15.19:0/1103979259 >> v2:172.21.15.19:3300/0 conn(0x7f9bb8146a40 0x7f9bb806efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:36.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.536+0000 7f9bb7e00640 1 --2- 172.21.15.19:0/1103979259 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9bb80b4ae0 0x7f9bb80ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.536+0000 7f9bafe00640 1 -- 172.21.15.19:0/1103979259 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9bb80b4ae0 msgr2=0x7f9bb80ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.536+0000 7f9bafe00640 1 --2- 172.21.15.19:0/1103979259 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9bb80b4ae0 0x7f9bb80ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.536+0000 7f9bafe00640 1 -- 172.21.15.19:0/1103979259 >> v1:172.21.15.19:6789/0 conn(0x7f9bb8146660 legacy=0x7f9bb80b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.536+0000 7f9bafe00640 1 -- 172.21.15.19:0/1103979259 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb80b3760 con 0x7f9bb8146a40 2024-03-08T06:04:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.536+0000 7f9bb6a00640 1 -- 172.21.15.19:0/1103979259 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3116120266 0 0) 0x7f9bb80b2ec0 con 0x7f9bb8146660 2024-03-08T06:04:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.538+0000 7f9bafe00640 1 --2- 172.21.15.19:0/1103979259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb8146a40 0x7f9bb806efc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00097a0 tx=0x7f9ba002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c0f6f410289760 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.538+0000 7f9bb6a00640 1 -- 172.21.15.19:0/1103979259 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0035020 con 0x7f9bb8146a40 2024-03-08T06:04:36.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.538+0000 7f9bb6a00640 1 -- 172.21.15.19:0/1103979259 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba0031830 con 0x7f9bb8146a40 2024-03-08T06:04:36.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.538+0000 7f9bb6a00640 1 -- 172.21.15.19:0/1103979259 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0031c00 con 0x7f9bb8146a40 2024-03-08T06:04:36.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.538+0000 7f9bbd200640 1 -- 172.21.15.19:0/1103979259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb8146a40 msgr2=0x7f9bb806efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:36.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.538+0000 7f9bbd200640 1 --2- 172.21.15.19:0/1103979259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb8146a40 0x7f9bb806efc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00097a0 tx=0x7f9ba002b8d0 comp rx=0 tx=0).stop 2024-03-08T06:04:36.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.539+0000 7f9bbd200640 1 -- 172.21.15.19:0/1103979259 shutdown_connections 2024-03-08T06:04:36.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.539+0000 7f9bbd200640 1 --2- 172.21.15.19:0/1103979259 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9bb80b4ae0 0x7f9bb80ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:36.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.539+0000 7f9bbd200640 1 --2- 172.21.15.19:0/1103979259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb8146a40 0x7f9bb806efc0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:36.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.539+0000 7f9bbd200640 1 -- 172.21.15.19:0/1103979259 >> 172.21.15.19:0/1103979259 conn(0x7f9bb80b1600 msgr2=0x7f9bb80b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:36.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.539+0000 7f9bbd200640 1 -- 172.21.15.19:0/1103979259 shutdown_connections 2024-03-08T06:04:36.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.539+0000 7f9bbd200640 1 -- 172.21.15.19:0/1103979259 wait complete. 2024-03-08T06:04:36.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.540+0000 7f9bbd200640 1 Processor -- start 2024-03-08T06:04:36.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.540+0000 7f9bbd200640 1 -- start start 2024-03-08T06:04:36.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.541+0000 7f9bbd200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9bb80b4ae0 0x7f9bb813ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:36.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.541+0000 7f9bbd200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb8146660 0x7f9bb815b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:36.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.541+0000 7f9bbd200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bb813b2b0 0x7f9bb813b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:36.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.541+0000 7f9bbd200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80b2900 con 0x7f9bb8146660 2024-03-08T06:04:36.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.541+0000 7f9bbd200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb8147660 con 0x7f9bb813b2b0 2024-03-08T06:04:36.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.541+0000 7f9bbd200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80b2a80 con 0x7f9bb80b4ae0 2024-03-08T06:04:36.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.542+0000 7f9bafe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb8146660 0x7f9bb815b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:36.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.542+0000 7f9bafe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb8146660 0x7f9bb815b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52258/0 (socket says 172.21.15.19:52258) 2024-03-08T06:04:36.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.542+0000 7f9bafe00640 1 -- 172.21.15.19:0/3224152854 learned_addr learned my addr 172.21.15.19:0/3224152854 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:36.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.542+0000 7f9bb7e00640 1 --2- 172.21.15.19:0/3224152854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bb813b2b0 0x7f9bb813b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:36.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.542+0000 7f9bb7400640 1 --2- 172.21.15.19:0/3224152854 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9bb80b4ae0 0x7f9bb813ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:36.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.542+0000 7f9bafe00640 1 -- 172.21.15.19:0/3224152854 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9bb80b4ae0 msgr2=0x7f9bb813ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:36.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.542+0000 7f9bafe00640 1 --2- 172.21.15.19:0/3224152854 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9bb80b4ae0 0x7f9bb813ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:36.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.542+0000 7f9bafe00640 1 -- 172.21.15.19:0/3224152854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bb813b2b0 msgr2=0x7f9bb813b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:36.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.542+0000 7f9bafe00640 1 --2- 172.21.15.19:0/3224152854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bb813b2b0 0x7f9bb813b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:36.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.542+0000 7f9bafe00640 1 -- 172.21.15.19:0/3224152854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb80b0800 con 0x7f9bb8146660 2024-03-08T06:04:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.543+0000 7f9bafe00640 1 --2- 172.21.15.19:0/3224152854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb8146660 0x7f9bb815b0f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00097a0 tx=0x7f9ba00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.543+0000 7f9baf400640 1 -- 172.21.15.19:0/3224152854 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0035040 con 0x7f9bb8146660 2024-03-08T06:04:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.543+0000 7f9baf400640 1 -- 172.21.15.19:0/3224152854 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba0004230 con 0x7f9bb8146660 2024-03-08T06:04:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.543+0000 7f9baf400640 1 -- 172.21.15.19:0/3224152854 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba003a700 con 0x7f9bb8146660 2024-03-08T06:04:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.543+0000 7f9bbd200640 1 -- 172.21.15.19:0/3224152854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb80b0ae0 con 0x7f9bb8146660 2024-03-08T06:04:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.543+0000 7f9bbd200640 1 -- 172.21.15.19:0/3224152854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb813e1f0 con 0x7f9bb8146660 2024-03-08T06:04:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.544+0000 7f9bbd200640 1 -- 172.21.15.19:0/3224152854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb813e020 con 0x7f9bb8146660 2024-03-08T06:04:36.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.545+0000 7f9baf400640 1 -- 172.21.15.19:0/3224152854 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9ba0038020 con 0x7f9bb8146660 2024-03-08T06:04:36.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.546+0000 7f9baf400640 1 --2- 172.21.15.19:0/3224152854 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9b9406b520 0x7f9b9406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:36.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.546+0000 7f9baf400640 1 -- 172.21.15.19:0/3224152854 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ba00ac090 con 0x7f9bb8146660 2024-03-08T06:04:36.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.546+0000 7f9bb7400640 1 --2- 172.21.15.19:0/3224152854 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9b9406b520 0x7f9b9406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:36.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.547+0000 7f9bb7400640 1 --2- 172.21.15.19:0/3224152854 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9b9406b520 0x7f9b9406d9e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8007fd0 tx=0x7f9ba8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:36.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.550+0000 7f9baf400640 1 -- 172.21.15.19:0/3224152854 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9ba007aef0 con 0x7f9bb8146660 2024-03-08T06:04:36.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.794+0000 7f9bbd200640 1 -- 172.21.15.19:0/3224152854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9bb80b2ec0 con 0x7f9bb8146660 2024-03-08T06:04:36.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.795+0000 7f9baf400640 1 -- 172.21.15.19:0/3224152854 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f9bb80b2ec0 con 0x7f9bb8146660 2024-03-08T06:04:36.796 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:04:36.796 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3542863285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3542863285},{"type":"v1","addr":"172.21.15.42:6833","nonce":3542863285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4708,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1679053115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1679053115},{"type":"v1","addr":"172.21.15.42:6835","nonce":1679053115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5022,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/717236359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":717236359},{"type":"v1","addr":"172.21.15.19:6835","nonce":717236359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T06:04:30.148899+0000","modified":"2024-03-08T06:04:33.195351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6837/1359509141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1359509141},{"type":"v1","addr":"172.21.15.19:6837","nonce":1359509141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-08T06:04:36.796 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 16 2024-03-08T06:04:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.798+0000 7f9bbd200640 1 -- 172.21.15.19:0/3224152854 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9b9406b520 msgr2=0x7f9b9406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.798+0000 7f9bbd200640 1 --2- 172.21.15.19:0/3224152854 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9b9406b520 0x7f9b9406d9e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8007fd0 tx=0x7f9ba8009040 comp rx=0 tx=0).stop 2024-03-08T06:04:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.798+0000 7f9bbd200640 1 -- 172.21.15.19:0/3224152854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb8146660 msgr2=0x7f9bb815b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.798+0000 7f9bbd200640 1 --2- 172.21.15.19:0/3224152854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb8146660 0x7f9bb815b0f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00097a0 tx=0x7f9ba00046c0 comp rx=0 tx=0).stop 2024-03-08T06:04:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.798+0000 7f9bbd200640 1 -- 172.21.15.19:0/3224152854 shutdown_connections 2024-03-08T06:04:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.798+0000 7f9bbd200640 1 --2- 172.21.15.19:0/3224152854 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9b9406b520 0x7f9b9406d9e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.798+0000 7f9bbd200640 1 --2- 172.21.15.19:0/3224152854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bb813b2b0 0x7f9bb813b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.798+0000 7f9bbd200640 1 --2- 172.21.15.19:0/3224152854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb8146660 0x7f9bb815b0f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.798+0000 7f9bbd200640 1 --2- 172.21.15.19:0/3224152854 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9bb80b4ae0 0x7f9bb813ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.798+0000 7f9bbd200640 1 -- 172.21.15.19:0/3224152854 >> 172.21.15.19:0/3224152854 conn(0x7f9bb80b1600 msgr2=0x7f9bb806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.798+0000 7f9bbd200640 1 -- 172.21.15.19:0/3224152854 shutdown_connections 2024-03-08T06:04:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:36.798+0000 7f9bbd200640 1 -- 172.21.15.19:0/3224152854 wait complete. 2024-03-08T06:04:37.221 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-08T06:04:30.148899+0000', 'modified': '2024-03-08T06:04:33.195351+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5028}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5028': {'gid': 5028, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.19:6837/1359509141', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6836', 'nonce': 1359509141}, {'type': 'v1', 'addr': '172.21.15.19:6837', 'nonce': 1359509141}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-08T06:04:37.221 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-08T06:04:37.221 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-08T06:04:37.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.452+0000 7fe785200640 1 Processor -- start 2024-03-08T06:04:37.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.453+0000 7fe785200640 1 -- start start 2024-03-08T06:04:37.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.454+0000 7fe785200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe7800b4420 0x7fe7800b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.454+0000 7fe785200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78006ed10 con 0x7fe7801442a0 2024-03-08T06:04:37.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.455+0000 7fe785200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe780161950 con 0x7fe7800ae1a0 2024-03-08T06:04:37.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.455+0000 7fe785200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe780144680 con 0x7fe7800b4420 2024-03-08T06:04:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.455+0000 7fe77f400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe7801442a0 0x7fe78006e600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44324/0 (socket says 172.21.15.19:44324) 2024-03-08T06:04:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.455+0000 7fe77f400640 1 -- 172.21.15.19:0/1640327492 learned_addr learned my addr 172.21.15.19:0/1640327492 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.455+0000 7fe77ea00640 1 --2- 172.21.15.19:0/1640327492 >> v2:172.21.15.42:3300/0 conn(0x7fe7800b4420 0x7fe7800b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.455+0000 7fe77e000640 1 -- 172.21.15.19:0/1640327492 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620527741 0 0) 0x7fe78006ed10 con 0x7fe7801442a0 2024-03-08T06:04:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.456+0000 7fe77e000640 1 -- 172.21.15.19:0/1640327492 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe764003520 con 0x7fe7801442a0 2024-03-08T06:04:37.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.456+0000 7fe77e000640 1 -- 172.21.15.19:0/1640327492 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3422301608 0 0) 0x7fe764003520 con 0x7fe7801442a0 2024-03-08T06:04:37.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.456+0000 7fe77e000640 1 -- 172.21.15.19:0/1640327492 >> v2:172.21.15.42:3300/0 conn(0x7fe7800b4420 msgr2=0x7fe7800b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:37.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.456+0000 7fe77e000640 1 --2- 172.21.15.19:0/1640327492 >> v2:172.21.15.42:3300/0 conn(0x7fe7800b4420 0x7fe7800b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.456+0000 7fe77e000640 1 -- 172.21.15.19:0/1640327492 >> v1:172.21.15.42:6789/0 conn(0x7fe7800ae1a0 legacy=0x7fe7800ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:37.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.456+0000 7fe77e000640 1 -- 172.21.15.19:0/1640327492 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe780161c30 con 0x7fe7801442a0 2024-03-08T06:04:37.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.456+0000 7fe77e000640 1 -- 172.21.15.19:0/1640327492 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7fe7700019f0 con 0x7fe7801442a0 2024-03-08T06:04:37.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.456+0000 7fe77e000640 1 -- 172.21.15.19:0/1640327492 >> v1:172.21.15.19:6789/0 conn(0x7fe7801442a0 legacy=0x7fe78006e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:37.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.456+0000 7fe77e000640 1 --2- 172.21.15.19:0/1640327492 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe764003a90 0x7fe764003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.456+0000 7fe77e000640 1 --2- 172.21.15.19:0/1640327492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe764004800 0x7fe764004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.456+0000 7fe77e000640 1 --2- 172.21.15.19:0/1640327492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe7640052c0 0x7fe76400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.456+0000 7fe77e000640 1 -- 172.21.15.19:0/1640327492 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe780144680 con 0x7fe764004800 2024-03-08T06:04:37.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.456+0000 7fe77e000640 1 -- 172.21.15.19:0/1640327492 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76400c200 con 0x7fe7640052c0 2024-03-08T06:04:37.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.456+0000 7fe77e000640 1 -- 172.21.15.19:0/1640327492 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76400c400 con 0x7fe764003a90 2024-03-08T06:04:37.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.456+0000 7fe77ea00640 1 --2- 172.21.15.19:0/1640327492 >> v2:172.21.15.42:3300/0 conn(0x7fe7800b4420 0x7fe7800b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:04:37.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.457+0000 7fe77ea00640 1 --2- 172.21.15.19:0/1640327492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe764004800 0x7fe764004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.457+0000 7fe77fe00640 1 --2- 172.21.15.19:0/1640327492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe7640052c0 0x7fe76400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.457+0000 7fe77f400640 1 --2- 172.21.15.19:0/1640327492 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe764003a90 0x7fe764003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.457+0000 7fe77ea00640 1 -- 172.21.15.19:0/1640327492 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe764003a90 msgr2=0x7fe764003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:37.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.457+0000 7fe77ea00640 1 --2- 172.21.15.19:0/1640327492 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe764003a90 0x7fe764003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.457+0000 7fe77ea00640 1 -- 172.21.15.19:0/1640327492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe7640052c0 msgr2=0x7fe76400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:37.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.457+0000 7fe77ea00640 1 --2- 172.21.15.19:0/1640327492 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe7640052c0 0x7fe76400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.457+0000 7fe77ea00640 1 -- 172.21.15.19:0/1640327492 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe764003520 con 0x7fe764004800 2024-03-08T06:04:37.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.457+0000 7fe77fe00640 1 -- 172.21.15.19:0/1640327492 reap_dead start 2024-03-08T06:04:37.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.458+0000 7fe77ea00640 1 --2- 172.21.15.19:0/1640327492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe764004800 0x7fe764004c80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0098a0 tx=0x7fe764005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e736b02151f38bd7 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:37.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.458+0000 7fe77e000640 1 -- 172.21.15.19:0/1640327492 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c034070 con 0x7fe764004800 2024-03-08T06:04:37.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.459+0000 7fe77e000640 1 -- 172.21.15.19:0/1640327492 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c030630 con 0x7fe764004800 2024-03-08T06:04:37.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.459+0000 7fe77e000640 1 -- 172.21.15.19:0/1640327492 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c00f040 con 0x7fe764004800 2024-03-08T06:04:37.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.459+0000 7fe785200640 1 -- 172.21.15.19:0/1640327492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe764004800 msgr2=0x7fe764004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:37.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.459+0000 7fe785200640 1 --2- 172.21.15.19:0/1640327492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe764004800 0x7fe764004c80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0098a0 tx=0x7fe764005830 comp rx=0 tx=0).stop 2024-03-08T06:04:37.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.459+0000 7fe785200640 1 -- 172.21.15.19:0/1640327492 shutdown_connections 2024-03-08T06:04:37.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.459+0000 7fe785200640 1 --2- 172.21.15.19:0/1640327492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe764004800 0x7fe764004c80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.459+0000 7fe785200640 1 -- 172.21.15.19:0/1640327492 >> 172.21.15.19:0/1640327492 conn(0x7fe7800b1590 msgr2=0x7fe7800b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:37.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.459+0000 7fe785200640 1 -- 172.21.15.19:0/1640327492 shutdown_connections 2024-03-08T06:04:37.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.459+0000 7fe785200640 1 -- 172.21.15.19:0/1640327492 wait complete. 2024-03-08T06:04:37.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.461+0000 7fe785200640 1 Processor -- start 2024-03-08T06:04:37.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.461+0000 7fe785200640 1 -- start start 2024-03-08T06:04:37.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.462+0000 7fe785200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe764004800 0x7fe78006aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.462+0000 7fe785200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe780160860 0x7fe780160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.462+0000 7fe785200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe78015ceb0 0x7fe78015d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.462+0000 7fe785200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7801624d0 con 0x7fe764004800 2024-03-08T06:04:37.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.462+0000 7fe785200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7801621f0 con 0x7fe78015ceb0 2024-03-08T06:04:37.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.462+0000 7fe785200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe780147660 con 0x7fe780160860 2024-03-08T06:04:37.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.462+0000 7fe77f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe764004800 0x7fe78006aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.463+0000 7fe77f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe764004800 0x7fe78006aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52264/0 (socket says 172.21.15.19:52264) 2024-03-08T06:04:37.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.463+0000 7fe77f400640 1 -- 172.21.15.19:0/2788588335 learned_addr learned my addr 172.21.15.19:0/2788588335 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:37.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.463+0000 7fe77fe00640 1 --2- 172.21.15.19:0/2788588335 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe78015ceb0 0x7fe78015d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.463+0000 7fe77ea00640 1 --2- 172.21.15.19:0/2788588335 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe780160860 0x7fe780160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.463+0000 7fe77f400640 1 -- 172.21.15.19:0/2788588335 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe780160860 msgr2=0x7fe780160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:37.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.463+0000 7fe77f400640 1 --2- 172.21.15.19:0/2788588335 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe780160860 0x7fe780160ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.463+0000 7fe77f400640 1 -- 172.21.15.19:0/2788588335 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe78015ceb0 msgr2=0x7fe78015d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:37.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.463+0000 7fe77f400640 1 --2- 172.21.15.19:0/2788588335 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe78015ceb0 0x7fe78015d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.463+0000 7fe77f400640 1 -- 172.21.15.19:0/2788588335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7801f6e50 con 0x7fe764004800 2024-03-08T06:04:37.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.463+0000 7fe77fe00640 1 --2- 172.21.15.19:0/2788588335 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe78015ceb0 0x7fe78015d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:37.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.463+0000 7fe77f400640 1 --2- 172.21.15.19:0/2788588335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe764004800 0x7fe78006aec0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe770007a10 tx=0x7fe77000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:37.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.464+0000 7fe777400640 1 -- 172.21.15.19:0/2788588335 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77000ee50 con 0x7fe764004800 2024-03-08T06:04:37.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.464+0000 7fe777400640 1 -- 172.21.15.19:0/2788588335 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe770018070 con 0x7fe764004800 2024-03-08T06:04:37.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.464+0000 7fe777400640 1 -- 172.21.15.19:0/2788588335 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe770013420 con 0x7fe764004800 2024-03-08T06:04:37.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.464+0000 7fe785200640 1 -- 172.21.15.19:0/2788588335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7801f70f0 con 0x7fe764004800 2024-03-08T06:04:37.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.464+0000 7fe785200640 1 -- 172.21.15.19:0/2788588335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7801f7990 con 0x7fe764004800 2024-03-08T06:04:37.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.467+0000 7fe777400640 1 -- 172.21.15.19:0/2788588335 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe7700135c0 con 0x7fe764004800 2024-03-08T06:04:37.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.468+0000 7fe777400640 1 --2- 172.21.15.19:0/2788588335 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe76006b6a0 0x7fe76006db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.468+0000 7fe777400640 1 -- 172.21.15.19:0/2788588335 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe77008a830 con 0x7fe764004800 2024-03-08T06:04:37.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.468+0000 7fe77ea00640 1 --2- 172.21.15.19:0/2788588335 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe76006b6a0 0x7fe76006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.468+0000 7fe7895c7740 1 Processor -- start 2024-03-08T06:04:37.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.469+0000 7fe7895c7740 1 -- start start 2024-03-08T06:04:37.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.469+0000 7fe77ea00640 1 --2- 172.21.15.19:0/2788588335 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe76006b6a0 0x7fe76006db60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe76c036000 tx=0x7fe76c031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.469+0000 7fe7895c7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 0x55ea6c3ec930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.470+0000 7fe7895c7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c419d70 0x55ea6c41c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.470+0000 7fe7895c7740 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55ea6c3ece70 0x55ea6c41cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.470+0000 7fe7895c7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea6c356600 con 0x55ea6c419990 2024-03-08T06:04:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.470+0000 7fe7895c7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea6c2ff930 con 0x55ea6c419d70 2024-03-08T06:04:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.470+0000 7fe7895c7740 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea6c3526a0 con 0x55ea6c3ece70 2024-03-08T06:04:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.470+0000 7fe77f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 0x55ea6c3ec930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.470+0000 7fe77f400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 0x55ea6c3ec930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52276/0 (socket says 172.21.15.19:52276) 2024-03-08T06:04:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.470+0000 7fe77f400640 1 -- 172.21.15.19:0/3923351898 learned_addr learned my addr 172.21.15.19:0/3923351898 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.470+0000 7fe77ea00640 1 --2- 172.21.15.19:0/3923351898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c419d70 0x55ea6c41c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.470+0000 7fe77f400640 1 -- 172.21.15.19:0/3923351898 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55ea6c3ece70 msgr2=0x55ea6c41cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.470+0000 7fe77fe00640 1 --2- 172.21.15.19:0/3923351898 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55ea6c3ece70 0x55ea6c41cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.470+0000 7fe77f400640 1 --2- 172.21.15.19:0/3923351898 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55ea6c3ece70 0x55ea6c41cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.470+0000 7fe77f400640 1 -- 172.21.15.19:0/3923351898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c419d70 msgr2=0x55ea6c41c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:37.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.470+0000 7fe77f400640 1 --2- 172.21.15.19:0/3923351898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c419d70 0x55ea6c41c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.470+0000 7fe77f400640 1 -- 172.21.15.19:0/3923351898 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea6c06b2d0 con 0x55ea6c419990 2024-03-08T06:04:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.470+0000 7fe77ea00640 1 --2- 172.21.15.19:0/3923351898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c419d70 0x55ea6c41c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.471+0000 7fe77f400640 1 --2- 172.21.15.19:0/3923351898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 0x55ea6c3ec930 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe7700610f0 tx=0x7fe770059750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec4ebfd89b0472c server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.471+0000 7fe76be00640 1 -- 172.21.15.19:0/3923351898 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe770087070 con 0x55ea6c419990 2024-03-08T06:04:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.471+0000 7fe76be00640 1 -- 172.21.15.19:0/3923351898 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe770061620 con 0x55ea6c419990 2024-03-08T06:04:37.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.471+0000 7fe76be00640 1 -- 172.21.15.19:0/3923351898 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe770070070 con 0x55ea6c419990 2024-03-08T06:04:37.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.472+0000 7fe7895c7740 1 -- 172.21.15.19:0/3923351898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 msgr2=0x55ea6c3ec930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:37.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.472+0000 7fe7895c7740 1 --2- 172.21.15.19:0/3923351898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 0x55ea6c3ec930 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe7700610f0 tx=0x7fe770059750 comp rx=0 tx=0).stop 2024-03-08T06:04:37.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.472+0000 7fe7895c7740 1 -- 172.21.15.19:0/3923351898 shutdown_connections 2024-03-08T06:04:37.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.472+0000 7fe7895c7740 1 --2- 172.21.15.19:0/3923351898 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55ea6c3ece70 0x55ea6c41cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.472+0000 7fe7895c7740 1 --2- 172.21.15.19:0/3923351898 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c419d70 0x55ea6c41c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.472+0000 7fe7895c7740 1 --2- 172.21.15.19:0/3923351898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 0x55ea6c3ec930 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.472+0000 7fe7895c7740 1 -- 172.21.15.19:0/3923351898 >> 172.21.15.19:0/3923351898 conn(0x55ea6c3eeba0 msgr2=0x55ea6c437720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:37.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.472+0000 7fe7895c7740 1 -- 172.21.15.19:0/3923351898 shutdown_connections 2024-03-08T06:04:37.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.472+0000 7fe7895c7740 1 -- 172.21.15.19:0/3923351898 wait complete. 2024-03-08T06:04:37.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.473+0000 7fe7895c7740 1 -- start start 2024-03-08T06:04:37.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.473+0000 7fe7895c7740 1 Processor -- start 2024-03-08T06:04:37.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.474+0000 7fe7895c7740 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55ea6c419990 0x55ea6c4072a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.474+0000 7fe7895c7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419d70 0x55ea6c41e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.474+0000 7fe7895c7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c4077e0 0x55ea6c41e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.474+0000 7fe7895c7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea6c3f1140 con 0x55ea6c419d70 2024-03-08T06:04:37.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.474+0000 7fe7895c7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea6c312d90 con 0x55ea6c4077e0 2024-03-08T06:04:37.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.474+0000 7fe7895c7740 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea6c3f0530 con 0x55ea6c419990 2024-03-08T06:04:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.474+0000 7fe7895c7740 10 client.0 _ll_register_callbacks cb 0x55ea6c34e350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-08T06:04:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.474+0000 7fe77ea00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419d70 0x55ea6c41e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.474+0000 7fe77ea00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419d70 0x55ea6c41e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52288/0 (socket says 172.21.15.19:52288) 2024-03-08T06:04:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.474+0000 7fe77ea00640 1 -- 172.21.15.19:0/3567242204 learned_addr learned my addr 172.21.15.19:0/3567242204 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.475+0000 7fe77fe00640 1 --2- 172.21.15.19:0/3567242204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c4077e0 0x55ea6c41e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.475+0000 7fe77f400640 1 --2- 172.21.15.19:0/3567242204 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55ea6c419990 0x55ea6c4072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.475+0000 7fe77ea00640 1 -- 172.21.15.19:0/3567242204 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55ea6c419990 msgr2=0x55ea6c4072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.475+0000 7fe77ea00640 1 --2- 172.21.15.19:0/3567242204 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55ea6c419990 0x55ea6c4072a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.475+0000 7fe77ea00640 1 -- 172.21.15.19:0/3567242204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c4077e0 msgr2=0x55ea6c41e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.475+0000 7fe77ea00640 1 --2- 172.21.15.19:0/3567242204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c4077e0 0x55ea6c41e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.475+0000 7fe77ea00640 1 -- 172.21.15.19:0/3567242204 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea6c1356b0 con 0x55ea6c419d70 2024-03-08T06:04:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.475+0000 7fe77f400640 1 --2- 172.21.15.19:0/3567242204 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55ea6c419990 0x55ea6c4072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.475+0000 7fe77ea00640 1 --2- 172.21.15.19:0/3567242204 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419d70 0x55ea6c41e410 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe76c02bf90 tx=0x7fe76c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe41bf57a3ef2e61 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.475+0000 7fe768c00640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-03-08T06:04:37.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.475+0000 7fe768c00640 1 -- 172.21.15.19:0/3567242204 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c034040 con 0x55ea6c419d70 2024-03-08T06:04:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.475+0000 7fe768c00640 1 -- 172.21.15.19:0/3567242204 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe76c052ad0 con 0x55ea6c419d70 2024-03-08T06:04:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.476+0000 7fe7895c7740 1 -- 172.21.15.19:0/3567242204 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe770061620 con 0x55ea6c419d70 2024-03-08T06:04:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.476+0000 7fe768c00640 1 -- 172.21.15.19:0/3567242204 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe76c052cd0 con 0x55ea6c419d70 2024-03-08T06:04:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.476+0000 7fe7895c7740 10 client.5220 fetch_fsmap learned FSMap version 16 2024-03-08T06:04:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.476+0000 7fe7895c7740 1 -- 172.21.15.19:0/3567242204 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55ea6c41f470 con 0x55ea6c419d70 2024-03-08T06:04:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.476+0000 7fe768c00640 1 -- 172.21.15.19:0/3567242204 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe770061620 con 0x55ea6c419d70 2024-03-08T06:04:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.476+0000 7fe768c00640 1 -- 172.21.15.19:0/3567242204 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe76c059050 con 0x55ea6c419d70 2024-03-08T06:04:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.476+0000 7fe7895c7740 10 client.5220 fetch_fsmap finished waiting for FSMap version 16 2024-03-08T06:04:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.476+0000 7fe7895c7740 10 client.5220 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-08T06:04:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.476+0000 7fe7895c7740 20 client.5220 populate_metadata read hostname 'smithi019' 2024-03-08T06:04:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.476+0000 7fe7895c7740 1 --2- 172.21.15.19:0/3567242204 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55ea6c44b220 0x55ea6c44b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.476+0000 7fe7895c7740 4 client.5220 mds_command: new command op to 5028 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-08T06:04:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.476+0000 7fe7895c7740 1 -- 172.21.15.19:0/3567242204 --> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea6c363b40 con 0x55ea6c44b220 2024-03-08T06:04:37.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.477+0000 7fe77f400640 1 --2- 172.21.15.19:0/3567242204 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55ea6c44b220 0x55ea6c44b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.477+0000 7fe77f400640 1 --2- 172.21.15.19:0/3567242204 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55ea6c44b220 0x55ea6c44b600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52a4ee7849b5f3b4 server_cookie=6201720f11ca521c in_seq=0 out_seq=0 2024-03-08T06:04:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.477+0000 7fe768c00640 10 client.5220 ms_handle_connect on v2:172.21.15.19:6836/1359509141 2024-03-08T06:04:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.478+0000 7fe768c00640 1 -- 172.21.15.19:0/3567242204 <== mds.0 v2:172.21.15.19:6836/1359509141 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ea6c363b40 con 0x55ea6c44b220 2024-03-08T06:04:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.478+0000 7fe768c00640 10 client.5220 handle_command_reply: tid=0 2024-03-08T06:04:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.478+0000 7fe7895c7740 1 client.5220 shutdown 2024-03-08T06:04:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.478+0000 7fe7895c7740 1 -- 172.21.15.19:0/3567242204 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419d70 msgr2=0x55ea6c41e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.478+0000 7fe7895c7740 1 --2- 172.21.15.19:0/3567242204 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419d70 0x55ea6c41e410 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe76c02bf90 tx=0x7fe76c0046c0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.478+0000 7fe7895c7740 1 -- 172.21.15.19:0/3567242204 shutdown_connections 2024-03-08T06:04:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.478+0000 7fe7895c7740 1 --2- 172.21.15.19:0/3567242204 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55ea6c44b220 0x55ea6c44b600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.478+0000 7fe7895c7740 1 --2- 172.21.15.19:0/3567242204 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c4077e0 0x55ea6c41e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.478+0000 7fe7895c7740 1 --2- 172.21.15.19:0/3567242204 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419d70 0x55ea6c41e410 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.478+0000 7fe7895c7740 1 --2- 172.21.15.19:0/3567242204 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55ea6c419990 0x55ea6c4072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.478+0000 7fe768c00640 0 client.5220 ms_handle_reset on v2:172.21.15.19:6836/1359509141 2024-03-08T06:04:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.478+0000 7fe7895c7740 1 -- 172.21.15.19:0/3567242204 >> 172.21.15.19:0/3567242204 conn(0x55ea6c3ece70 msgr2=0x55ea6c431580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.479+0000 7fe7895c7740 1 -- 172.21.15.19:0/3567242204 shutdown_connections 2024-03-08T06:04:37.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.479+0000 7fe7895c7740 1 -- 172.21.15.19:0/3567242204 wait complete. 2024-03-08T06:04:37.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.479+0000 7fe7895c7740 20 client.5220 trim_cache size 0 max 16384 2024-03-08T06:04:37.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.496+0000 7fe7895c7740 1 Processor -- start 2024-03-08T06:04:37.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.496+0000 7fe7895c7740 1 -- start start 2024-03-08T06:04:37.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.497+0000 7fe7895c7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c4077e0 0x55ea6c431720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.497+0000 7fe7895c7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 0x55ea6c3f0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.497+0000 7fe7895c7740 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55ea6c419d70 0x55ea6c432e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.497+0000 7fe7895c7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7801ff6b0 con 0x55ea6c419990 2024-03-08T06:04:37.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.497+0000 7fe7895c7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78015f140 con 0x55ea6c4077e0 2024-03-08T06:04:37.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.497+0000 7fe7895c7740 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7801ff100 con 0x55ea6c419d70 2024-03-08T06:04:37.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.497+0000 7fe77ea00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 0x55ea6c3f0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.498+0000 7fe77ea00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 0x55ea6c3f0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52304/0 (socket says 172.21.15.19:52304) 2024-03-08T06:04:37.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.498+0000 7fe77ea00640 1 -- 172.21.15.19:0/4172646399 learned_addr learned my addr 172.21.15.19:0/4172646399 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:37.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.498+0000 7fe77f400640 1 --2- 172.21.15.19:0/4172646399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c4077e0 0x55ea6c431720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.498+0000 7fe77fe00640 1 --2- 172.21.15.19:0/4172646399 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55ea6c419d70 0x55ea6c432e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.498+0000 7fe77ea00640 1 -- 172.21.15.19:0/4172646399 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55ea6c419d70 msgr2=0x55ea6c432e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.498+0000 7fe77ea00640 1 --2- 172.21.15.19:0/4172646399 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55ea6c419d70 0x55ea6c432e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.498+0000 7fe77ea00640 1 -- 172.21.15.19:0/4172646399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c4077e0 msgr2=0x55ea6c431720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.498+0000 7fe77ea00640 1 --2- 172.21.15.19:0/4172646399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c4077e0 0x55ea6c431720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.498+0000 7fe77ea00640 1 -- 172.21.15.19:0/4172646399 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea6c364270 con 0x55ea6c419990 2024-03-08T06:04:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.499+0000 7fe77ea00640 1 --2- 172.21.15.19:0/4172646399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 0x55ea6c3f0720 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe76c048960 tx=0x7fe76c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e301f8eba116815 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.499+0000 7fe76b400640 1 -- 172.21.15.19:0/4172646399 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c048c00 con 0x55ea6c419990 2024-03-08T06:04:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.499+0000 7fe76b400640 1 -- 172.21.15.19:0/4172646399 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c060020 con 0x55ea6c419990 2024-03-08T06:04:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.499+0000 7fe76b400640 1 -- 172.21.15.19:0/4172646399 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c048da0 con 0x55ea6c419990 2024-03-08T06:04:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.499+0000 7fe7895c7740 1 -- 172.21.15.19:0/4172646399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 msgr2=0x55ea6c3f0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.499+0000 7fe7895c7740 1 --2- 172.21.15.19:0/4172646399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 0x55ea6c3f0720 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe76c048960 tx=0x7fe76c04c000 comp rx=0 tx=0).stop 2024-03-08T06:04:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.500+0000 7fe7895c7740 1 -- 172.21.15.19:0/4172646399 shutdown_connections 2024-03-08T06:04:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.500+0000 7fe7895c7740 1 --2- 172.21.15.19:0/4172646399 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55ea6c419d70 0x55ea6c432e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.500+0000 7fe7895c7740 1 --2- 172.21.15.19:0/4172646399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 0x55ea6c3f0720 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.500+0000 7fe7895c7740 1 --2- 172.21.15.19:0/4172646399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c4077e0 0x55ea6c431720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.500+0000 7fe7895c7740 1 -- 172.21.15.19:0/4172646399 >> 172.21.15.19:0/4172646399 conn(0x55ea6c3ece70 msgr2=0x55ea6c4206a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:37.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.500+0000 7fe7895c7740 1 -- 172.21.15.19:0/4172646399 shutdown_connections 2024-03-08T06:04:37.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.500+0000 7fe7895c7740 1 -- 172.21.15.19:0/4172646399 wait complete. 2024-03-08T06:04:37.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.500+0000 7fe7895c7740 1 -- start start 2024-03-08T06:04:37.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.501+0000 7fe7895c7740 1 Processor -- start 2024-03-08T06:04:37.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.501+0000 7fe7895c7740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c4077e0 0x55ea6c449ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.502+0000 7fe7895c7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 0x55ea6c433420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.502+0000 7fe7895c7740 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55ea6c419d70 0x55ea6c439a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.502+0000 7fe7895c7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea6c4093a0 con 0x55ea6c419990 2024-03-08T06:04:37.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.502+0000 7fe7895c7740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea6c41fa30 con 0x55ea6c4077e0 2024-03-08T06:04:37.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.502+0000 7fe7895c7740 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea6c40a980 con 0x55ea6c419d70 2024-03-08T06:04:37.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.502+0000 7fe7895c7740 10 client.0 _ll_register_callbacks cb 0x7fe770058ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-08T06:04:37.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.502+0000 7fe77ea00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 0x55ea6c433420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.502+0000 7fe77ea00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 0x55ea6c433420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52308/0 (socket says 172.21.15.19:52308) 2024-03-08T06:04:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.502+0000 7fe77ea00640 1 -- 172.21.15.19:0/833782733 learned_addr learned my addr 172.21.15.19:0/833782733 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.502+0000 7fe77f400640 1 --2- 172.21.15.19:0/833782733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c4077e0 0x55ea6c449ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.502+0000 7fe77ea00640 1 -- 172.21.15.19:0/833782733 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55ea6c419d70 msgr2=0x55ea6c439a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.502+0000 7fe77ea00640 1 --2- 172.21.15.19:0/833782733 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55ea6c419d70 0x55ea6c439a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.502+0000 7fe77ea00640 1 -- 172.21.15.19:0/833782733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c4077e0 msgr2=0x55ea6c449ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.502+0000 7fe77ea00640 1 --2- 172.21.15.19:0/833782733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c4077e0 0x55ea6c449ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.502+0000 7fe77ea00640 1 -- 172.21.15.19:0/833782733 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea6c44a020 con 0x55ea6c419990 2024-03-08T06:04:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.503+0000 7fe77ea00640 1 --2- 172.21.15.19:0/833782733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 0x55ea6c433420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe76c02bf90 tx=0x7fe76c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e166b6ad372f0e59 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.503+0000 7fe768c00640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-03-08T06:04:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.503+0000 7fe768c00640 1 -- 172.21.15.19:0/833782733 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c069060 con 0x55ea6c419990 2024-03-08T06:04:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.503+0000 7fe768c00640 1 -- 172.21.15.19:0/833782733 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe76c047da0 con 0x55ea6c419990 2024-03-08T06:04:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.503+0000 7fe7895c7740 1 -- 172.21.15.19:0/833782733 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe76c060020 con 0x55ea6c419990 2024-03-08T06:04:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.503+0000 7fe768c00640 1 -- 172.21.15.19:0/833782733 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe76c06f050 con 0x55ea6c419990 2024-03-08T06:04:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.503+0000 7fe7895c7740 10 client.5226 fetch_fsmap learned FSMap version 16 2024-03-08T06:04:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.503+0000 7fe7895c7740 1 -- 172.21.15.19:0/833782733 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55ea6c3ee6b0 con 0x55ea6c419990 2024-03-08T06:04:37.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.504+0000 7fe768c00640 1 -- 172.21.15.19:0/833782733 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c060020 con 0x55ea6c419990 2024-03-08T06:04:37.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.504+0000 7fe768c00640 1 -- 172.21.15.19:0/833782733 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe76c072020 con 0x55ea6c419990 2024-03-08T06:04:37.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.504+0000 7fe7895c7740 10 client.5226 fetch_fsmap finished waiting for FSMap version 16 2024-03-08T06:04:37.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.504+0000 7fe7895c7740 10 client.5226 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-08T06:04:37.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.504+0000 7fe7895c7740 20 client.5226 populate_metadata read hostname 'smithi019' 2024-03-08T06:04:37.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.504+0000 7fe7895c7740 1 --2- 172.21.15.19:0/833782733 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55ea6c451630 0x55ea6c451a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.504+0000 7fe7895c7740 4 client.5226 mds_command: new command op to 5028 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-08T06:04:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.504+0000 7fe7895c7740 1 -- 172.21.15.19:0/833782733 --> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ea6c35de90 con 0x55ea6c451630 2024-03-08T06:04:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.504+0000 7fe77f400640 1 --2- 172.21.15.19:0/833782733 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55ea6c451630 0x55ea6c451a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.505+0000 7fe77f400640 1 --2- 172.21.15.19:0/833782733 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55ea6c451630 0x55ea6c451a10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79b4e401bef8b3aa server_cookie=706daac91e19f4ab in_seq=0 out_seq=0 2024-03-08T06:04:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.505+0000 7fe768c00640 10 client.5226 ms_handle_connect on v2:172.21.15.19:6836/1359509141 2024-03-08T06:04:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.505+0000 7fe768c00640 1 -- 172.21.15.19:0/833782733 <== mds.0 v2:172.21.15.19:6836/1359509141 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55ea6c35de90 con 0x55ea6c451630 2024-03-08T06:04:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.505+0000 7fe768c00640 10 client.5226 handle_command_reply: tid=0 2024-03-08T06:04:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.505+0000 7fe7895c7740 1 client.5226 shutdown 2024-03-08T06:04:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.505+0000 7fe7895c7740 1 -- 172.21.15.19:0/833782733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 msgr2=0x55ea6c433420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.505+0000 7fe7895c7740 1 --2- 172.21.15.19:0/833782733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 0x55ea6c433420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe76c02bf90 tx=0x7fe76c008040 comp rx=0 tx=0).stop 2024-03-08T06:04:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.505+0000 7fe7895c7740 1 -- 172.21.15.19:0/833782733 shutdown_connections 2024-03-08T06:04:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.505+0000 7fe7895c7740 1 --2- 172.21.15.19:0/833782733 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55ea6c451630 0x55ea6c451a10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.505+0000 7fe7895c7740 1 --2- 172.21.15.19:0/833782733 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55ea6c419d70 0x55ea6c439a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.505+0000 7fe7895c7740 1 --2- 172.21.15.19:0/833782733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6c419990 0x55ea6c433420 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.505+0000 7fe768c00640 0 client.5226 ms_handle_reset on v2:172.21.15.19:6836/1359509141 2024-03-08T06:04:37.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.505+0000 7fe7895c7740 1 --2- 172.21.15.19:0/833782733 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55ea6c4077e0 0x55ea6c449ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.505+0000 7fe7895c7740 1 -- 172.21.15.19:0/833782733 >> 172.21.15.19:0/833782733 conn(0x55ea6c3ece70 msgr2=0x55ea6c430a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:37.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.505+0000 7fe7895c7740 1 -- 172.21.15.19:0/833782733 shutdown_connections 2024-03-08T06:04:37.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.505+0000 7fe7895c7740 1 -- 172.21.15.19:0/833782733 wait complete. 2024-03-08T06:04:37.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.505+0000 7fe7895c7740 20 client.5226 trim_cache size 0 max 16384 2024-03-08T06:04:37.509 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-08T06:04:37.509 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd", 2024-03-08T06:04:37.509 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-03-08T06:04:37.509 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 5028, 2024-03-08T06:04:37.509 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-03-08T06:04:37.509 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-03-08T06:04:37.509 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-03-08T06:04:37.510 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 6.8387557839999999, 2024-03-08T06:04:37.510 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 16, 2024-03-08T06:04:37.510 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 34, 2024-03-08T06:04:37.510 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 34, 2024-03-08T06:04:37.510 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 15.794789891000001 2024-03-08T06:04:37.510 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-08T06:04:37.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.506+0000 7fe785200640 1 -- 172.21.15.19:0/2788588335 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe76006b6a0 msgr2=0x7fe76006db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:37.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.506+0000 7fe785200640 1 --2- 172.21.15.19:0/2788588335 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe76006b6a0 0x7fe76006db60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe76c036000 tx=0x7fe76c031000 comp rx=0 tx=0).stop 2024-03-08T06:04:37.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.506+0000 7fe785200640 1 -- 172.21.15.19:0/2788588335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe764004800 msgr2=0x7fe78006aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:37.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.506+0000 7fe785200640 1 --2- 172.21.15.19:0/2788588335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe764004800 0x7fe78006aec0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe770007a10 tx=0x7fe77000e530 comp rx=0 tx=0).stop 2024-03-08T06:04:37.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.506+0000 7fe785200640 1 -- 172.21.15.19:0/2788588335 shutdown_connections 2024-03-08T06:04:37.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.506+0000 7fe785200640 1 --2- 172.21.15.19:0/2788588335 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe76006b6a0 0x7fe76006db60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.506+0000 7fe785200640 1 --2- 172.21.15.19:0/2788588335 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe78015ceb0 0x7fe78015d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.506+0000 7fe785200640 1 --2- 172.21.15.19:0/2788588335 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe780160860 0x7fe780160ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.506+0000 7fe785200640 1 --2- 172.21.15.19:0/2788588335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe764004800 0x7fe78006aec0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.506+0000 7fe785200640 1 -- 172.21.15.19:0/2788588335 >> 172.21.15.19:0/2788588335 conn(0x7fe7800b1590 msgr2=0x7fe780141b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:37.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.506+0000 7fe785200640 1 -- 172.21.15.19:0/2788588335 shutdown_connections 2024-03-08T06:04:37.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.506+0000 7fe785200640 1 -- 172.21.15.19:0/2788588335 wait complete. 2024-03-08T06:04:37.524 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-08T06:04:37.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.726+0000 7fd0cb400640 1 Processor -- start 2024-03-08T06:04:37.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.726+0000 7fd0cb400640 1 -- start start 2024-03-08T06:04:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.728+0000 7fd0cb400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd0c406d600 0x7fd0c4144d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.728+0000 7fd0cb400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd0c4071e90 0x7fd0c41452a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.728+0000 7fd0cb400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c406da80 con 0x7fd0c4071ab0 2024-03-08T06:04:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.728+0000 7fd0cb400640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c406ef40 con 0x7fd0c406d600 2024-03-08T06:04:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.728+0000 7fd0cb400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c41457e0 con 0x7fd0c4071e90 2024-03-08T06:04:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.728+0000 7fd0c8a00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd0c4071ab0 0x7fd0c415cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44338/0 (socket says 172.21.15.19:44338) 2024-03-08T06:04:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.728+0000 7fd0c8a00640 1 -- 172.21.15.19:0/445723032 learned_addr learned my addr 172.21.15.19:0/445723032 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.729+0000 7fd0c9400640 1 --2- 172.21.15.19:0/445723032 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd0c4071e90 0x7fd0c41452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.729+0000 7fd0bbe00640 1 --2- 172.21.15.19:0/445723032 >> v2:172.21.15.42:3300/0 conn(0x7fd0c406d600 0x7fd0c4144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.729+0000 7fd0c3e00640 1 -- 172.21.15.19:0/445723032 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437175620 0 0) 0x7fd0c406da80 con 0x7fd0c4071ab0 2024-03-08T06:04:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.729+0000 7fd0c3e00640 1 -- 172.21.15.19:0/445723032 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0a8003520 con 0x7fd0c4071ab0 2024-03-08T06:04:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.729+0000 7fd0c3e00640 1 -- 172.21.15.19:0/445723032 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3757397681 0 0) 0x7fd0a8003520 con 0x7fd0c4071ab0 2024-03-08T06:04:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.729+0000 7fd0c3e00640 1 -- 172.21.15.19:0/445723032 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd0c4071e90 msgr2=0x7fd0c41452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.729+0000 7fd0c3e00640 1 --2- 172.21.15.19:0/445723032 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd0c4071e90 0x7fd0c41452a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.729+0000 7fd0c3e00640 1 -- 172.21.15.19:0/445723032 >> v2:172.21.15.42:3300/0 conn(0x7fd0c406d600 msgr2=0x7fd0c4144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.729+0000 7fd0c3e00640 1 --2- 172.21.15.19:0/445723032 >> v2:172.21.15.42:3300/0 conn(0x7fd0c406d600 0x7fd0c4144d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.729+0000 7fd0c3e00640 1 -- 172.21.15.19:0/445723032 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c406dd60 con 0x7fd0c4071ab0 2024-03-08T06:04:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.729+0000 7fd0c3e00640 1 -- 172.21.15.19:0/445723032 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7fd0b4001670 con 0x7fd0c4071ab0 2024-03-08T06:04:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.729+0000 7fd0c3e00640 1 -- 172.21.15.19:0/445723032 >> v1:172.21.15.19:6789/0 conn(0x7fd0c4071ab0 legacy=0x7fd0c415cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.729+0000 7fd0c3e00640 1 --2- 172.21.15.19:0/445723032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0a80039b0 0x7fd0a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.729+0000 7fd0c3e00640 1 --2- 172.21.15.19:0/445723032 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd0c4071e90 0x7fd0a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.730+0000 7fd0c3e00640 1 --2- 172.21.15.19:0/445723032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a8004d40 0x7fd0a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.730+0000 7fd0c3e00640 1 -- 172.21.15.19:0/445723032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c41457e0 con 0x7fd0a80039b0 2024-03-08T06:04:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.730+0000 7fd0c3e00640 1 -- 172.21.15.19:0/445723032 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a800b9c0 con 0x7fd0a8004d40 2024-03-08T06:04:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.730+0000 7fd0c3e00640 1 -- 172.21.15.19:0/445723032 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a800bb40 con 0x7fd0c4071e90 2024-03-08T06:04:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.730+0000 7fd0c8a00640 1 --2- 172.21.15.19:0/445723032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0a80039b0 0x7fd0a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.730+0000 7fd0c9400640 1 --2- 172.21.15.19:0/445723032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a8004d40 0x7fd0a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.730+0000 7fd0bbe00640 1 --2- 172.21.15.19:0/445723032 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd0c4071e90 0x7fd0a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.730+0000 7fd0c8a00640 1 -- 172.21.15.19:0/445723032 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd0c4071e90 msgr2=0x7fd0a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.730+0000 7fd0c8a00640 1 --2- 172.21.15.19:0/445723032 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd0c4071e90 0x7fd0a8004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.730+0000 7fd0c8a00640 1 -- 172.21.15.19:0/445723032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a8004d40 msgr2=0x7fd0a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:37.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.730+0000 7fd0c8a00640 1 --2- 172.21.15.19:0/445723032 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a8004d40 0x7fd0a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.730+0000 7fd0c8a00640 1 -- 172.21.15.19:0/445723032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a8003520 con 0x7fd0a80039b0 2024-03-08T06:04:37.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.731+0000 7fd0c8a00640 1 --2- 172.21.15.19:0/445723032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0a80039b0 0x7fd0a8003dd0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd0b400c240 tx=0x7fd0a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6117288ceaaa2ac server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:37.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.732+0000 7fd0c3e00640 1 -- 172.21.15.19:0/445723032 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4007d30 con 0x7fd0a80039b0 2024-03-08T06:04:37.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.732+0000 7fd0c3e00640 1 -- 172.21.15.19:0/445723032 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b4030070 con 0x7fd0a80039b0 2024-03-08T06:04:37.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.732+0000 7fd0c3e00640 1 -- 172.21.15.19:0/445723032 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b402cd60 con 0x7fd0a80039b0 2024-03-08T06:04:37.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.732+0000 7fd0cb400640 1 -- 172.21.15.19:0/445723032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0a80039b0 msgr2=0x7fd0a8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:37.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.732+0000 7fd0cb400640 1 --2- 172.21.15.19:0/445723032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0a80039b0 0x7fd0a8003dd0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd0b400c240 tx=0x7fd0a8005830 comp rx=0 tx=0).stop 2024-03-08T06:04:37.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.732+0000 7fd0c9400640 1 -- 172.21.15.19:0/445723032 reap_dead start 2024-03-08T06:04:37.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.732+0000 7fd0cb400640 1 -- 172.21.15.19:0/445723032 shutdown_connections 2024-03-08T06:04:37.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.732+0000 7fd0cb400640 1 -- 172.21.15.19:0/445723032 >> 172.21.15.19:0/445723032 conn(0x7fd0c406ae30 msgr2=0x7fd0c406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:37.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.733+0000 7fd0cb400640 1 -- 172.21.15.19:0/445723032 shutdown_connections 2024-03-08T06:04:37.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.733+0000 7fd0cb400640 1 -- 172.21.15.19:0/445723032 wait complete. 2024-03-08T06:04:37.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.734+0000 7fd0cb400640 1 Processor -- start 2024-03-08T06:04:37.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.735+0000 7fd0cb400640 1 -- start start 2024-03-08T06:04:37.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.736+0000 7fd0cb400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a80039b0 0x7fd0c413bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.736+0000 7fd0cb400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd0c413b1f0 0x7fd0c41420a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.736+0000 7fd0cb400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0c415dee0 0x7fd0c415e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.736+0000 7fd0cb400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c406e600 con 0x7fd0c415dee0 2024-03-08T06:04:37.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.736+0000 7fd0cb400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c406e320 con 0x7fd0a80039b0 2024-03-08T06:04:37.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.736+0000 7fd0cb400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c41452a0 con 0x7fd0c413b1f0 2024-03-08T06:04:37.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.736+0000 7fd0c9400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0c415dee0 0x7fd0c415e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.736+0000 7fd0c9400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0c415dee0 0x7fd0c415e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52318/0 (socket says 172.21.15.19:52318) 2024-03-08T06:04:37.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.736+0000 7fd0c9400640 1 -- 172.21.15.19:0/2041987607 learned_addr learned my addr 172.21.15.19:0/2041987607 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:37.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.736+0000 7fd0c8a00640 1 --2- 172.21.15.19:0/2041987607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a80039b0 0x7fd0c413bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.736+0000 7fd0bbe00640 1 --2- 172.21.15.19:0/2041987607 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd0c413b1f0 0x7fd0c41420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.736+0000 7fd0c9400640 1 -- 172.21.15.19:0/2041987607 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd0c413b1f0 msgr2=0x7fd0c41420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:37.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.736+0000 7fd0c9400640 1 --2- 172.21.15.19:0/2041987607 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd0c413b1f0 0x7fd0c41420a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.736+0000 7fd0c9400640 1 -- 172.21.15.19:0/2041987607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a80039b0 msgr2=0x7fd0c413bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:37.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.736+0000 7fd0c9400640 1 --2- 172.21.15.19:0/2041987607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a80039b0 0x7fd0c413bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.736+0000 7fd0c9400640 1 -- 172.21.15.19:0/2041987607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c41425e0 con 0x7fd0c415dee0 2024-03-08T06:04:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.737+0000 7fd0c9400640 1 --2- 172.21.15.19:0/2041987607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0c415dee0 0x7fd0c415e360 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd0c406f930 tx=0x7fd0bc0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.737+0000 7fd0c1600640 1 -- 172.21.15.19:0/2041987607 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc011e10 con 0x7fd0c415dee0 2024-03-08T06:04:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.737+0000 7fd0c1600640 1 -- 172.21.15.19:0/2041987607 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0bc01b070 con 0x7fd0c415dee0 2024-03-08T06:04:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.737+0000 7fd0c1600640 1 -- 172.21.15.19:0/2041987607 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc003990 con 0x7fd0c415dee0 2024-03-08T06:04:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.737+0000 7fd0cb400640 1 -- 172.21.15.19:0/2041987607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c413b650 con 0x7fd0c415dee0 2024-03-08T06:04:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.737+0000 7fd0cb400640 1 -- 172.21.15.19:0/2041987607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c413c600 con 0x7fd0c415dee0 2024-03-08T06:04:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.739+0000 7fd0cb400640 1 -- 172.21.15.19:0/2041987607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c415e8a0 con 0x7fd0c415dee0 2024-03-08T06:04:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.740+0000 7fd0c1600640 1 -- 172.21.15.19:0/2041987607 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd0bc005d10 con 0x7fd0c415dee0 2024-03-08T06:04:37.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.741+0000 7fd0c1600640 1 --2- 172.21.15.19:0/2041987607 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd0a006b500 0x7fd0a006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:37.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.741+0000 7fd0c1600640 1 -- 172.21.15.19:0/2041987607 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0bc08a7c0 con 0x7fd0c415dee0 2024-03-08T06:04:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.741+0000 7fd0c8a00640 1 --2- 172.21.15.19:0/2041987607 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd0a006b500 0x7fd0a006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.742+0000 7fd0c8a00640 1 --2- 172.21.15.19:0/2041987607 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd0a006b500 0x7fd0a006d9c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4034000 tx=0x7fd0b4007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.745+0000 7fd0c1600640 1 -- 172.21.15.19:0/2041987607 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd0bc025020 con 0x7fd0c415dee0 2024-03-08T06:04:37.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.978+0000 7fd0cb400640 1 -- 172.21.15.19:0/2041987607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd0c4067cb0 con 0x7fd0c415dee0 2024-03-08T06:04:37.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.979+0000 7fd0c1600640 1 -- 172.21.15.19:0/2041987607 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd0bc014350 con 0x7fd0c415dee0 2024-03-08T06:04:37.979 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-08T06:04:37.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.981+0000 7fd0cb400640 1 -- 172.21.15.19:0/2041987607 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd0a006b500 msgr2=0x7fd0a006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:37.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.981+0000 7fd0cb400640 1 --2- 172.21.15.19:0/2041987607 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd0a006b500 0x7fd0a006d9c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4034000 tx=0x7fd0b4007000 comp rx=0 tx=0).stop 2024-03-08T06:04:37.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.981+0000 7fd0cb400640 1 -- 172.21.15.19:0/2041987607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0c415dee0 msgr2=0x7fd0c415e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:37.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.981+0000 7fd0cb400640 1 --2- 172.21.15.19:0/2041987607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0c415dee0 0x7fd0c415e360 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd0c406f930 tx=0x7fd0bc0115a0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.981+0000 7fd0cb400640 1 -- 172.21.15.19:0/2041987607 shutdown_connections 2024-03-08T06:04:37.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.981+0000 7fd0cb400640 1 --2- 172.21.15.19:0/2041987607 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd0a006b500 0x7fd0a006d9c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.982+0000 7fd0cb400640 1 --2- 172.21.15.19:0/2041987607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0c415dee0 0x7fd0c415e360 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.982+0000 7fd0cb400640 1 --2- 172.21.15.19:0/2041987607 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd0c413b1f0 0x7fd0c41420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.982+0000 7fd0cb400640 1 --2- 172.21.15.19:0/2041987607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd0a80039b0 0x7fd0c413bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:37.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.982+0000 7fd0cb400640 1 -- 172.21.15.19:0/2041987607 >> 172.21.15.19:0/2041987607 conn(0x7fd0c406ae30 msgr2=0x7fd0c415ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:37.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.982+0000 7fd0cb400640 1 -- 172.21.15.19:0/2041987607 shutdown_connections 2024-03-08T06:04:37.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:37.982+0000 7fd0cb400640 1 -- 172.21.15.19:0/2041987607 wait complete. 2024-03-08T06:04:38.001 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-08T06:04:38.001 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-08T06:04:38.001 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-03-08T06:04:38.001 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-08T06:04:38.001 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-08T06:04:38.001 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-08T06:04:38.001 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-03-08T06:04:38.001 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-08T06:04:38.001 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-08T06:04:38.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:38.001 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-03-08T06:04:38.053 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-08T06:04:38.053 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-08T06:04:38.053 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-03-08T06:04:38.053 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:04:38.053 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-03-08T06:04:38.053 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:04:38.053 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T06:04:38.053 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-03-08T06:04:38.053 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-03-08T06:04:38.054 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T06:04:38.054 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-03-08T06:04:38.054 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-03-08T06:04:38.054 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-08T06:04:38.054 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-03-08T06:04:38.054 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-03-08T06:04:38.054 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-08T06:04:38.054 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42553sec preferred_lft 42553sec 2024-03-08T06:04:38.054 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link noprefixroute 2024-03-08T06:04:38.054 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:04:38.054 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T06:04:38.054 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-03-08T06:04:38.054 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-03-08T06:04:38.054 INFO:teuthology.orchestra.run.smithi019.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-08T06:04:38.054 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 4e:60:0d:1b:c8:aa brd ff:ff:ff:ff:ff:ff 2024-03-08T06:04:38.055 INFO:teuthology.orchestra.run.smithi019.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-08T06:04:38.055 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:04:38.055 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::d8f4:f9ff:fe64:b003/64 scope link 2024-03-08T06:04:38.055 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:04:38.055 INFO:teuthology.orchestra.run.smithi019.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-08T06:04:38.055 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 4e:60:0d:1b:c8:aa brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T06:04:38.055 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::4c60:dff:fe1b:c8aa/64 scope link 2024-03-08T06:04:38.055 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:04:38.055 INFO:teuthology.orchestra.run.smithi019.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-08T06:04:38.055 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 6e:22:69:c8:61:0b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-08T06:04:38.055 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::6c22:69ff:fec8:610b/64 scope link 2024-03-08T06:04:38.055 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:04:38.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:38.056 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-08T06:04:38.146 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-03-08T06:04:38.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:38.151 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-03-08T06:04:38.206 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-03-08T06:04:38.206 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-08T06:04:38.206 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-08T06:04:38.206 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-08T06:04:38.206 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-08T06:04:38.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:38.207 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec bash -c ' 2024-03-08T06:04:38.207 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-03-08T06:04:38.207 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-08T06:04:38.207 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-08T06:04:38.207 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-08T06:04:38.207 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-03-08T06:04:38.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:38.401 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-03-08T06:04:38.451 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-08T06:04:38.451 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-08T06:04:38.452 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-08T06:04:38.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:38.452 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-03-08T06:04:38.548 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T06:04:38.548 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-08T06:04:38.606 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-08T06:04:38.606 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T06:04:38.606 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-08T06:04:38.659 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-03-08T06:04:38.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:38.659 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T06:04:38.809 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T06:04:38.809 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-08T06:04:38.848 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T06:04:38.848 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-08T06:04:38.848 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.42:3300,172.21.15.42:3301" 2024-03-08T06:04:38.848 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with new device syntax: 0@d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd.cephfs=/ 2024-03-08T06:04:38.848 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.19:3300/172.21.15.42:3300/172.21.15.42:3301" will pass to kernel 2024-03-08T06:04:38.850 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-08T06:04:38.850 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-03-08T06:04:38.850 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-08T06:04:38.851 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-03-08T06:04:38.851 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-08T06:04:38.854 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-08T06:04:38.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:38.855 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-08T06:04:38.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:38.939 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-08T06:04:39.003 INFO:teuthology.orchestra.run.smithi019.stdout:client4646 2024-03-08T06:04:39.003 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:04:39.003 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:04:39.057 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-08T06:04:39.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.269+0000 7f98c9c00640 1 Processor -- start 2024-03-08T06:04:39.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.269+0000 7f98c9c00640 1 -- start start 2024-03-08T06:04:39.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.271+0000 7f98c9c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f98c40d11b0 0x7f98c40ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:39.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.271+0000 7f98c9c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f98c40b6bd0 0x7f98c4162400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:39.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.271+0000 7f98c9c00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c415e300 con 0x7f98c415df20 2024-03-08T06:04:39.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.271+0000 7f98c9c00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c40d3990 con 0x7f98c40b6bd0 2024-03-08T06:04:39.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.271+0000 7f98c9c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c4162940 con 0x7f98c40d11b0 2024-03-08T06:04:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.271+0000 7f98c9200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f98c40b6bd0 0x7f98c4162400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.271+0000 7f98c3e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f98c415df20 0x7f98c40d0aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44344/0 (socket says 172.21.15.19:44344) 2024-03-08T06:04:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.271+0000 7f98c3e00640 1 -- 172.21.15.19:0/3553228068 learned_addr learned my addr 172.21.15.19:0/3553228068 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.272+0000 7f98bbe00640 1 --2- 172.21.15.19:0/3553228068 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f98c40d11b0 0x7f98c40ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.272+0000 7f98c3400640 1 -- 172.21.15.19:0/3553228068 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79005294 0 0) 0x7f98c415e300 con 0x7f98c415df20 2024-03-08T06:04:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.272+0000 7f98c3400640 1 -- 172.21.15.19:0/3553228068 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98a8003520 con 0x7f98c415df20 2024-03-08T06:04:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.272+0000 7f98c9200640 1 -- 172.21.15.19:0/3553228068 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f98c40d11b0 msgr2=0x7f98c40ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.272+0000 7f98c9200640 1 --2- 172.21.15.19:0/3553228068 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f98c40d11b0 0x7f98c40ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.272+0000 7f98c9200640 1 -- 172.21.15.19:0/3553228068 >> v1:172.21.15.19:6789/0 conn(0x7f98c415df20 legacy=0x7f98c40d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.272+0000 7f98c9200640 1 -- 172.21.15.19:0/3553228068 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c40cf030 con 0x7f98c40b6bd0 2024-03-08T06:04:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.273+0000 7f98c9200640 1 --2- 172.21.15.19:0/3553228068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98c40b6bd0 0x7f98c4162400 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009d90 tx=0x7f98bc02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24265a5a135564f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.274+0000 7f98c3400640 1 -- 172.21.15.19:0/3553228068 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc039070 con 0x7f98c40b6bd0 2024-03-08T06:04:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.274+0000 7f98c3400640 1 -- 172.21.15.19:0/3553228068 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98bc02cce0 con 0x7f98c40b6bd0 2024-03-08T06:04:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.274+0000 7f98c3400640 1 -- 172.21.15.19:0/3553228068 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc034640 con 0x7f98c40b6bd0 2024-03-08T06:04:39.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.274+0000 7f98c9c00640 1 -- 172.21.15.19:0/3553228068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98c40b6bd0 msgr2=0x7f98c4162400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:39.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.274+0000 7f98c9c00640 1 --2- 172.21.15.19:0/3553228068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98c40b6bd0 0x7f98c4162400 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f98bc009d90 tx=0x7f98bc02bf30 comp rx=0 tx=0).stop 2024-03-08T06:04:39.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.275+0000 7f98c9c00640 1 -- 172.21.15.19:0/3553228068 shutdown_connections 2024-03-08T06:04:39.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.275+0000 7f98c9c00640 1 --2- 172.21.15.19:0/3553228068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98c40b6bd0 0x7f98c4162400 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:39.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.275+0000 7f98c9c00640 1 --2- 172.21.15.19:0/3553228068 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f98c40d11b0 0x7f98c40ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:39.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.275+0000 7f98c9c00640 1 -- 172.21.15.19:0/3553228068 >> 172.21.15.19:0/3553228068 conn(0x7f98c406c740 msgr2=0x7f98c406cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:39.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.275+0000 7f98c9c00640 1 -- 172.21.15.19:0/3553228068 shutdown_connections 2024-03-08T06:04:39.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.275+0000 7f98c9c00640 1 -- 172.21.15.19:0/3553228068 wait complete. 2024-03-08T06:04:39.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.276+0000 7f98c9c00640 1 Processor -- start 2024-03-08T06:04:39.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.277+0000 7f98c9c00640 1 -- start start 2024-03-08T06:04:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.278+0000 7f98c9c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98c40b6bd0 0x7f98c4150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.278+0000 7f98c9c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98c40d11b0 0x7f98c40cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.278+0000 7f98c9c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f98c415df20 0x7f98c40cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.278+0000 7f98c9c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c40d2180 con 0x7f98c40d11b0 2024-03-08T06:04:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.278+0000 7f98c9c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c40d1ea0 con 0x7f98c40b6bd0 2024-03-08T06:04:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.278+0000 7f98c9c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c40d2460 con 0x7f98c415df20 2024-03-08T06:04:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.278+0000 7f98bbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98c40d11b0 0x7f98c40cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.278+0000 7f98bbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98c40d11b0 0x7f98c40cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52332/0 (socket says 172.21.15.19:52332) 2024-03-08T06:04:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.278+0000 7f98bbe00640 1 -- 172.21.15.19:0/1808002756 learned_addr learned my addr 172.21.15.19:0/1808002756 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.278+0000 7f98c9200640 1 --2- 172.21.15.19:0/1808002756 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f98c415df20 0x7f98c40cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.278+0000 7f98c3e00640 1 --2- 172.21.15.19:0/1808002756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98c40b6bd0 0x7f98c4150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.279+0000 7f98bbe00640 1 -- 172.21.15.19:0/1808002756 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f98c415df20 msgr2=0x7f98c40cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.279+0000 7f98bbe00640 1 --2- 172.21.15.19:0/1808002756 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f98c415df20 0x7f98c40cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.279+0000 7f98bbe00640 1 -- 172.21.15.19:0/1808002756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98c40b6bd0 msgr2=0x7f98c4150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.279+0000 7f98bbe00640 1 --2- 172.21.15.19:0/1808002756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98c40b6bd0 0x7f98c4150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.279+0000 7f98bbe00640 1 -- 172.21.15.19:0/1808002756 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c41f3ca0 con 0x7f98c40d11b0 2024-03-08T06:04:39.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.279+0000 7f98c9200640 1 --2- 172.21.15.19:0/1808002756 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f98c415df20 0x7f98c40cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:04:39.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.279+0000 7f98bbe00640 1 --2- 172.21.15.19:0/1808002756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98c40d11b0 0x7f98c40cabe0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00d800 tx=0x7f98ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:39.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.279+0000 7f98c0c00640 1 -- 172.21.15.19:0/1808002756 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac00b6c0 con 0x7f98c40d11b0 2024-03-08T06:04:39.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.279+0000 7f98c0c00640 1 -- 172.21.15.19:0/1808002756 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac019070 con 0x7f98c40d11b0 2024-03-08T06:04:39.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.279+0000 7f98c0c00640 1 -- 172.21.15.19:0/1808002756 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac00ba80 con 0x7f98c40d11b0 2024-03-08T06:04:39.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.279+0000 7f98c9c00640 1 -- 172.21.15.19:0/1808002756 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c40cda90 con 0x7f98c40d11b0 2024-03-08T06:04:39.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.280+0000 7f98c9c00640 1 -- 172.21.15.19:0/1808002756 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c40c88e0 con 0x7f98c40d11b0 2024-03-08T06:04:39.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.281+0000 7f98c9c00640 1 -- 172.21.15.19:0/1808002756 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c4075100 con 0x7f98c40d11b0 2024-03-08T06:04:39.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.282+0000 7f98c0c00640 1 -- 172.21.15.19:0/1808002756 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f98ac00bc20 con 0x7f98c40d11b0 2024-03-08T06:04:39.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.283+0000 7f98c0c00640 1 --2- 172.21.15.19:0/1808002756 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f98a006b4d0 0x7f98a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:39.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.283+0000 7f98c0c00640 1 -- 172.21.15.19:0/1808002756 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98ac08a750 con 0x7f98c40d11b0 2024-03-08T06:04:39.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.283+0000 7f98c3e00640 1 --2- 172.21.15.19:0/1808002756 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f98a006b4d0 0x7f98a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:39.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.284+0000 7f98c3e00640 1 --2- 172.21.15.19:0/1808002756 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f98a006b4d0 0x7f98a006d990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f98b4005880 tx=0x7f98b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:39.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.287+0000 7f98c0c00640 1 -- 172.21.15.19:0/1808002756 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f98c41f3ca0 con 0x7f98c40d11b0 2024-03-08T06:04:39.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.525+0000 7f98c9c00640 1 -- 172.21.15.19:0/1808002756 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f98c40d16e0 con 0x7f98c40d11b0 2024-03-08T06:04:39.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.526+0000 7f98c0c00640 1 -- 172.21.15.19:0/1808002756 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f98ac059530 con 0x7f98c40d11b0 2024-03-08T06:04:39.527 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-08T06:04:39.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.529+0000 7f98c9c00640 1 -- 172.21.15.19:0/1808002756 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f98a006b4d0 msgr2=0x7f98a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:39.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.529+0000 7f98c9c00640 1 --2- 172.21.15.19:0/1808002756 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f98a006b4d0 0x7f98a006d990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f98b4005880 tx=0x7f98b4009040 comp rx=0 tx=0).stop 2024-03-08T06:04:39.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.529+0000 7f98c9c00640 1 -- 172.21.15.19:0/1808002756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98c40d11b0 msgr2=0x7f98c40cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:39.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.529+0000 7f98c9c00640 1 --2- 172.21.15.19:0/1808002756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98c40d11b0 0x7f98c40cabe0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00d800 tx=0x7f98ac00dcc0 comp rx=0 tx=0).stop 2024-03-08T06:04:39.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.529+0000 7f98c9c00640 1 -- 172.21.15.19:0/1808002756 shutdown_connections 2024-03-08T06:04:39.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.529+0000 7f98c9c00640 1 --2- 172.21.15.19:0/1808002756 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f98a006b4d0 0x7f98a006d990 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:39.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.529+0000 7f98c9c00640 1 --2- 172.21.15.19:0/1808002756 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f98c415df20 0x7f98c40cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:39.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.529+0000 7f98c9c00640 1 --2- 172.21.15.19:0/1808002756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98c40d11b0 0x7f98c40cabe0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:39.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.529+0000 7f98c9c00640 1 --2- 172.21.15.19:0/1808002756 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98c40b6bd0 0x7f98c4150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:39.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.529+0000 7f98c9c00640 1 -- 172.21.15.19:0/1808002756 >> 172.21.15.19:0/1808002756 conn(0x7f98c406c740 msgr2=0x7f98c40ce140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:39.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.529+0000 7f98c9c00640 1 -- 172.21.15.19:0/1808002756 shutdown_connections 2024-03-08T06:04:39.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:39.529+0000 7f98c9c00640 1 -- 172.21.15.19:0/1808002756 wait complete. 2024-03-08T06:04:39.548 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-08T06:04:39.548 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-08T06:04:39.548 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2024-03-08T06:04:39.548 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-08T06:04:39.548 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-08T06:04:39.548 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-08T06:04:39.548 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-03-08T06:04:39.548 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-08T06:04:39.548 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-08T06:04:39.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:39.549 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2024-03-08T06:04:39.609 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-08T06:04:39.609 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-08T06:04:39.609 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2024-03-08T06:04:39.609 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:04:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2024-03-08T06:04:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:04:39.610 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T06:04:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2024-03-08T06:04:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f0 2024-03-08T06:04:39.610 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T06:04:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2024-03-08T06:04:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp7s0f1 2024-03-08T06:04:39.610 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-08T06:04:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2024-03-08T06:04:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f0 2024-03-08T06:04:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-08T06:04:39.610 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 42494sec preferred_lft 42494sec 2024-03-08T06:04:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link noprefixroute 2024-03-08T06:04:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:04:39.611 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-08T06:04:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2024-03-08T06:04:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: altname enp1s0f1 2024-03-08T06:04:39.611 INFO:teuthology.orchestra.run.smithi042.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-08T06:04:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 1e:35:4a:d3:ff:30 brd ff:ff:ff:ff:ff:ff 2024-03-08T06:04:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-08T06:04:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:04:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::d861:66ff:feb9:1384/64 scope link 2024-03-08T06:04:39.611 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:04:39.612 INFO:teuthology.orchestra.run.smithi042.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-08T06:04:39.612 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 1e:35:4a:d3:ff:30 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-08T06:04:39.612 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::1c35:4aff:fed3:ff30/64 scope link 2024-03-08T06:04:39.612 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:04:39.612 INFO:teuthology.orchestra.run.smithi042.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-08T06:04:39.612 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether d6:42:d7:32:77:22 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-08T06:04:39.612 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::d442:d7ff:fe32:7722/64 scope link 2024-03-08T06:04:39.613 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2024-03-08T06:04:39.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:39.613 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-08T06:04:39.706 INFO:teuthology.orchestra.run.smithi042.stdout:1 2024-03-08T06:04:39.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:39.711 DEBUG:teuthology.orchestra.run.smithi042:> route 2024-03-08T06:04:39.767 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2024-03-08T06:04:39.767 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-08T06:04:39.767 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-08T06:04:39.767 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-08T06:04:39.767 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-08T06:04:39.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:39.768 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2024-03-08T06:04:39.768 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2024-03-08T06:04:39.768 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-08T06:04:39.769 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-08T06:04:39.769 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-08T06:04:39.769 DEBUG:teuthology.orchestra.run.smithi042:> ') 2024-03-08T06:04:39.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:39.963 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-03-08T06:04:40.016 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-08T06:04:40.016 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-03-08T06:04:40.017 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-08T06:04:40.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:40.017 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2024-03-08T06:04:40.121 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T06:04:40.121 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-08T06:04:40.176 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-08T06:04:40.176 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-08T06:04:40.176 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-08T06:04:40.229 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-03-08T06:04:40.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:40.229 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T06:04:40.376 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T06:04:40.377 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-08T06:04:40.415 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-08T06:04:40.415 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-08T06:04:40.415 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.42:3300,172.21.15.42:3301" 2024-03-08T06:04:40.415 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with new device syntax: 1@d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd.cephfs=/ 2024-03-08T06:04:40.415 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.19:3300/172.21.15.42:3300/172.21.15.42:3301" will pass to kernel 2024-03-08T06:04:40.418 INFO:teuthology.orchestra.run.smithi042.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-03-08T06:04:40.418 INFO:teuthology.orchestra.run.smithi042.stdout: You just mounted a file system that supports labels which does not 2024-03-08T06:04:40.418 INFO:teuthology.orchestra.run.smithi042.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-08T06:04:40.418 INFO:teuthology.orchestra.run.smithi042.stdout: applications will generate AVC messages and not be allowed access to 2024-03-08T06:04:40.418 INFO:teuthology.orchestra.run.smithi042.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-08T06:04:40.422 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-08T06:04:40.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:40.422 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-08T06:04:40.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:40.511 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-08T06:04:40.573 INFO:teuthology.orchestra.run.smithi042.stdout:client4655 2024-03-08T06:04:40.573 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:04:40.573 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:04:46.510 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T06:04:46.521 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T06:04:50.630 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-08T06:04:50.630 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 counter dump 2024-03-08T06:04:50.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.863+0000 7fb4f7600640 1 Processor -- start 2024-03-08T06:04:50.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.863+0000 7fb4f7600640 1 -- start start 2024-03-08T06:04:50.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.865+0000 7fb4f7600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb4f0072060 0x7fb4f015e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.865+0000 7fb4f7600640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f015f390 con 0x7fb4f015eb50 2024-03-08T06:04:50.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.865+0000 7fb4f7600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f006d820 con 0x7fb4f01584a0 2024-03-08T06:04:50.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.865+0000 7fb4f7600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f006db00 con 0x7fb4f0072060 2024-03-08T06:04:50.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.865+0000 7fb4f5600640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb4f015eb50 0x7fb4f00ae1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52422/0 (socket says 172.21.15.19:52422) 2024-03-08T06:04:50.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.865+0000 7fb4f5600640 1 -- 172.21.15.19:0/3118412567 learned_addr learned my addr 172.21.15.19:0/3118412567 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:04:50.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.866+0000 7fb4efe00640 1 --2- 172.21.15.19:0/3118412567 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb4f0072060 0x7fb4f015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:50.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.866+0000 7fb4ef400640 1 -- 172.21.15.19:0/3118412567 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226022734 0 0) 0x7fb4f015f390 con 0x7fb4f015eb50 2024-03-08T06:04:50.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.866+0000 7fb4ef400640 1 -- 172.21.15.19:0/3118412567 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4d8003520 con 0x7fb4f015eb50 2024-03-08T06:04:50.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.866+0000 7fb4ef400640 1 -- 172.21.15.19:0/3118412567 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2589717241 0 0) 0x7fb4d8003520 con 0x7fb4f015eb50 2024-03-08T06:04:50.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.866+0000 7fb4ef400640 1 -- 172.21.15.19:0/3118412567 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb4f0072060 msgr2=0x7fb4f015e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:50.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.866+0000 7fb4ef400640 1 --2- 172.21.15.19:0/3118412567 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb4f0072060 0x7fb4f015e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.866+0000 7fb4ef400640 1 -- 172.21.15.19:0/3118412567 >> v1:172.21.15.42:6789/0 conn(0x7fb4f01584a0 legacy=0x7fb4f0071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:50.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.866+0000 7fb4ef400640 1 -- 172.21.15.19:0/3118412567 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f006dde0 con 0x7fb4f015eb50 2024-03-08T06:04:50.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.866+0000 7fb4ef400640 1 -- 172.21.15.19:0/3118412567 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7fb4e80019f0 con 0x7fb4f015eb50 2024-03-08T06:04:50.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.866+0000 7fb4ef400640 1 -- 172.21.15.19:0/3118412567 >> v1:172.21.15.19:6789/0 conn(0x7fb4f015eb50 legacy=0x7fb4f00ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:50.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.866+0000 7fb4ef400640 1 --2- 172.21.15.19:0/3118412567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4d80039e0 0x7fb4d8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.866+0000 7fb4ef400640 1 --2- 172.21.15.19:0/3118412567 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb4f0072060 0x7fb4d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.866+0000 7fb4ef400640 1 --2- 172.21.15.19:0/3118412567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4d8004d40 0x7fb4d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.866+0000 7fb4ef400640 1 -- 172.21.15.19:0/3118412567 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f006db00 con 0x7fb4d8004d40 2024-03-08T06:04:50.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.866+0000 7fb4ef400640 1 -- 172.21.15.19:0/3118412567 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d800baf0 con 0x7fb4d80039e0 2024-03-08T06:04:50.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.866+0000 7fb4ef400640 1 -- 172.21.15.19:0/3118412567 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d800bcf0 con 0x7fb4f0072060 2024-03-08T06:04:50.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.867+0000 7fb4f5600640 1 --2- 172.21.15.19:0/3118412567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4d8004d40 0x7fb4d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:50.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.867+0000 7fb4f4c00640 1 --2- 172.21.15.19:0/3118412567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4d80039e0 0x7fb4d8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:50.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.867+0000 7fb4efe00640 1 --2- 172.21.15.19:0/3118412567 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb4f0072060 0x7fb4d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:50.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.867+0000 7fb4f5600640 1 -- 172.21.15.19:0/3118412567 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb4f0072060 msgr2=0x7fb4d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:50.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.867+0000 7fb4f5600640 1 --2- 172.21.15.19:0/3118412567 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb4f0072060 0x7fb4d8004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.867+0000 7fb4f5600640 1 -- 172.21.15.19:0/3118412567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4d80039e0 msgr2=0x7fb4d8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:50.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.867+0000 7fb4f5600640 1 --2- 172.21.15.19:0/3118412567 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4d80039e0 0x7fb4d8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.867+0000 7fb4f5600640 1 -- 172.21.15.19:0/3118412567 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d8003520 con 0x7fb4d8004d40 2024-03-08T06:04:50.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.868+0000 7fb4f5600640 1 --2- 172.21.15.19:0/3118412567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4d8004d40 0x7fb4d80051c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb4e800a840 tx=0x7fb4d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe103929be00651 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:50.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.868+0000 7fb4ef400640 1 -- 172.21.15.19:0/3118412567 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e800a460 con 0x7fb4d8004d40 2024-03-08T06:04:50.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.869+0000 7fb4ef400640 1 -- 172.21.15.19:0/3118412567 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e8034650 con 0x7fb4d8004d40 2024-03-08T06:04:50.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.869+0000 7fb4ef400640 1 -- 172.21.15.19:0/3118412567 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8034a40 con 0x7fb4d8004d40 2024-03-08T06:04:50.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.869+0000 7fb4f7600640 1 -- 172.21.15.19:0/3118412567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4d8004d40 msgr2=0x7fb4d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:50.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.869+0000 7fb4f7600640 1 --2- 172.21.15.19:0/3118412567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4d8004d40 0x7fb4d80051c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb4e800a840 tx=0x7fb4d8005830 comp rx=0 tx=0).stop 2024-03-08T06:04:50.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.869+0000 7fb4f5600640 1 -- 172.21.15.19:0/3118412567 reap_dead start 2024-03-08T06:04:50.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.869+0000 7fb4f7600640 1 -- 172.21.15.19:0/3118412567 shutdown_connections 2024-03-08T06:04:50.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.869+0000 7fb4f7600640 1 -- 172.21.15.19:0/3118412567 >> 172.21.15.19:0/3118412567 conn(0x7fb4f006ae30 msgr2=0x7fb4f006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:50.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.869+0000 7fb4f7600640 1 -- 172.21.15.19:0/3118412567 shutdown_connections 2024-03-08T06:04:50.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.869+0000 7fb4f7600640 1 -- 172.21.15.19:0/3118412567 wait complete. 2024-03-08T06:04:50.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.871+0000 7fb4f7600640 1 Processor -- start 2024-03-08T06:04:50.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.871+0000 7fb4f7600640 1 -- start start 2024-03-08T06:04:50.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.872+0000 7fb4f7600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4d8004d40 0x7fb4f01375f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.872+0000 7fb4f7600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb4f01e7330 0x7fb4f00ce360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.872+0000 7fb4f7600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4f01e8fd0 0x7fb4f01e9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.872+0000 7fb4f7600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f006e5e0 con 0x7fb4f01e8fd0 2024-03-08T06:04:50.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.872+0000 7fb4f7600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f015efe0 con 0x7fb4d8004d40 2024-03-08T06:04:50.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.872+0000 7fb4f7600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f01e8860 con 0x7fb4f01e7330 2024-03-08T06:04:50.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.873+0000 7fb4f5600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4f01e8fd0 0x7fb4f01e9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:50.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.873+0000 7fb4f5600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4f01e8fd0 0x7fb4f01e9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35270/0 (socket says 172.21.15.19:35270) 2024-03-08T06:04:50.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.873+0000 7fb4f5600640 1 -- 172.21.15.19:0/2439194362 learned_addr learned my addr 172.21.15.19:0/2439194362 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:50.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.873+0000 7fb4f4c00640 1 --2- 172.21.15.19:0/2439194362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4d8004d40 0x7fb4f01375f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:50.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.873+0000 7fb4efe00640 1 --2- 172.21.15.19:0/2439194362 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb4f01e7330 0x7fb4f00ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:50.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.873+0000 7fb4f5600640 1 -- 172.21.15.19:0/2439194362 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb4f01e7330 msgr2=0x7fb4f00ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:50.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.873+0000 7fb4f5600640 1 --2- 172.21.15.19:0/2439194362 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb4f01e7330 0x7fb4f00ce360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.873+0000 7fb4f5600640 1 -- 172.21.15.19:0/2439194362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4d8004d40 msgr2=0x7fb4f01375f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:50.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.873+0000 7fb4f5600640 1 --2- 172.21.15.19:0/2439194362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4d8004d40 0x7fb4f01375f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.873+0000 7fb4f5600640 1 -- 172.21.15.19:0/2439194362 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f01e9990 con 0x7fb4f01e8fd0 2024-03-08T06:04:50.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.873+0000 7fb4f4c00640 1 --2- 172.21.15.19:0/2439194362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4d8004d40 0x7fb4f01375f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:50.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.873+0000 7fb4efe00640 1 --2- 172.21.15.19:0/2439194362 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb4f01e7330 0x7fb4f00ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:04:50.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.873+0000 7fb4f5600640 1 --2- 172.21.15.19:0/2439194362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4f01e8fd0 0x7fb4f01e9450 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8000f80 tx=0x7fb4f006dfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:50.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.874+0000 7fb4ecc00640 1 -- 172.21.15.19:0/2439194362 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8001250 con 0x7fb4f01e8fd0 2024-03-08T06:04:50.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.874+0000 7fb4ecc00640 1 -- 172.21.15.19:0/2439194362 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e803a040 con 0x7fb4f01e8fd0 2024-03-08T06:04:50.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.874+0000 7fb4ecc00640 1 -- 172.21.15.19:0/2439194362 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8034a00 con 0x7fb4f01e8fd0 2024-03-08T06:04:50.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.874+0000 7fb4f7600640 1 -- 172.21.15.19:0/2439194362 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f01e77c0 con 0x7fb4f01e8fd0 2024-03-08T06:04:50.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.874+0000 7fb4f7600640 1 -- 172.21.15.19:0/2439194362 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f01e7d80 con 0x7fb4f01e8fd0 2024-03-08T06:04:50.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.876+0000 7fb4ecc00640 1 -- 172.21.15.19:0/2439194362 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fb4e8046030 con 0x7fb4f01e8fd0 2024-03-08T06:04:50.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.877+0000 7fb4ecc00640 1 --2- 172.21.15.19:0/2439194362 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb4d006b670 0x7fb4d006db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.877+0000 7fb4ecc00640 1 -- 172.21.15.19:0/2439194362 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4e80abd20 con 0x7fb4f01e8fd0 2024-03-08T06:04:50.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.877+0000 7fb4f4c00640 1 --2- 172.21.15.19:0/2439194362 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb4d006b670 0x7fb4d006db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:50.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.878+0000 7fb4fa243740 1 Processor -- start 2024-03-08T06:04:50.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.878+0000 7fb4fa243740 1 -- start start 2024-03-08T06:04:50.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.878+0000 7fb4f4c00640 1 --2- 172.21.15.19:0/2439194362 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb4d006b670 0x7fb4d006db30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40016b0 tx=0x7fb4e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:50.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.879+0000 7fb4fa243740 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d403cdad50 0x55d403cadcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.879+0000 7fb4fa243740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d403cdb130 0x55d403cddae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.879+0000 7fb4fa243740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cae230 0x55d403cde020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.879+0000 7fb4fa243740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d403c17d60 con 0x55d403cae230 2024-03-08T06:04:50.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.879+0000 7fb4fa243740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d403bc0cf0 con 0x55d403cdb130 2024-03-08T06:04:50.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.879+0000 7fb4fa243740 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d403c13e00 con 0x55d403cdad50 2024-03-08T06:04:50.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.879+0000 7fb4f5600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cae230 0x55d403cde020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:50.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.879+0000 7fb4f5600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cae230 0x55d403cde020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35282/0 (socket says 172.21.15.19:35282) 2024-03-08T06:04:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.879+0000 7fb4f5600640 1 -- 172.21.15.19:0/3916547490 learned_addr learned my addr 172.21.15.19:0/3916547490 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.880+0000 7fb4efe00640 1 --2- 172.21.15.19:0/3916547490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d403cdb130 0x55d403cddae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.880+0000 7fb4f4c00640 1 --2- 172.21.15.19:0/3916547490 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d403cdad50 0x55d403cadcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.880+0000 7fb4f5600640 1 -- 172.21.15.19:0/3916547490 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d403cdad50 msgr2=0x55d403cadcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.880+0000 7fb4f5600640 1 --2- 172.21.15.19:0/3916547490 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d403cdad50 0x55d403cadcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.880+0000 7fb4f5600640 1 -- 172.21.15.19:0/3916547490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d403cdb130 msgr2=0x55d403cddae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.880+0000 7fb4f5600640 1 --2- 172.21.15.19:0/3916547490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d403cdb130 0x55d403cddae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.880+0000 7fb4f5600640 1 -- 172.21.15.19:0/3916547490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d40392c3f0 con 0x55d403cae230 2024-03-08T06:04:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.880+0000 7fb4f5600640 1 --2- 172.21.15.19:0/3916547490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cae230 0x55d403cde020 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8076990 tx=0x7fb4e80767d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906ca6e1d8d04304 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.880+0000 7fb4e1200640 1 -- 172.21.15.19:0/3916547490 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8092080 con 0x55d403cae230 2024-03-08T06:04:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.880+0000 7fb4e1200640 1 -- 172.21.15.19:0/3916547490 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e807e680 con 0x55d403cae230 2024-03-08T06:04:50.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.880+0000 7fb4e1200640 1 -- 172.21.15.19:0/3916547490 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8082c40 con 0x55d403cae230 2024-03-08T06:04:50.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.881+0000 7fb4fa243740 1 -- 172.21.15.19:0/3916547490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cae230 msgr2=0x55d403cde020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:50.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.881+0000 7fb4fa243740 1 --2- 172.21.15.19:0/3916547490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cae230 0x55d403cde020 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8076990 tx=0x7fb4e80767d0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.881+0000 7fb4fa243740 1 -- 172.21.15.19:0/3916547490 shutdown_connections 2024-03-08T06:04:50.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.881+0000 7fb4fa243740 1 --2- 172.21.15.19:0/3916547490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cae230 0x55d403cde020 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.881+0000 7fb4fa243740 1 --2- 172.21.15.19:0/3916547490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d403cdb130 0x55d403cddae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.881+0000 7fb4fa243740 1 --2- 172.21.15.19:0/3916547490 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d403cdad50 0x55d403cadcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.881+0000 7fb4fa243740 1 -- 172.21.15.19:0/3916547490 >> 172.21.15.19:0/3916547490 conn(0x55d403caff60 msgr2=0x55d403cf8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.881+0000 7fb4fa243740 1 -- 172.21.15.19:0/3916547490 shutdown_connections 2024-03-08T06:04:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.881+0000 7fb4fa243740 1 -- 172.21.15.19:0/3916547490 wait complete. 2024-03-08T06:04:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.882+0000 7fb4fa243740 1 -- start start 2024-03-08T06:04:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.882+0000 7fb4fa243740 1 Processor -- start 2024-03-08T06:04:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.883+0000 7fb4fa243740 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d403cdad50 0x55d403ce1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.883+0000 7fb4fa243740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdb130 0x55d403ce2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.883+0000 7fb4fa243740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d403cd8320 0x55d403cd87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.883+0000 7fb4fa243740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d403bc0cf0 con 0x55d403cdb130 2024-03-08T06:04:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.883+0000 7fb4fa243740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d403bb6220 con 0x55d403cd8320 2024-03-08T06:04:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.883+0000 7fb4fa243740 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d403c17d60 con 0x55d403cdad50 2024-03-08T06:04:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.883+0000 7fb4fa243740 10 client.0 _ll_register_callbacks cb 0x55d40392bbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-08T06:04:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.884+0000 7fb4efe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdb130 0x55d403ce2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.884+0000 7fb4efe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdb130 0x55d403ce2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35294/0 (socket says 172.21.15.19:35294) 2024-03-08T06:04:50.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.884+0000 7fb4efe00640 1 -- 172.21.15.19:0/1636253980 learned_addr learned my addr 172.21.15.19:0/1636253980 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:50.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.884+0000 7fb4f4c00640 1 --2- 172.21.15.19:0/1636253980 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d403cdad50 0x55d403ce1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:50.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.884+0000 7fb4efe00640 1 -- 172.21.15.19:0/1636253980 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d403cdad50 msgr2=0x55d403ce1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:50.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.884+0000 7fb4efe00640 1 --2- 172.21.15.19:0/1636253980 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d403cdad50 0x55d403ce1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.884+0000 7fb4efe00640 1 -- 172.21.15.19:0/1636253980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d403cd8320 msgr2=0x55d403cd87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:50.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.884+0000 7fb4efe00640 1 --2- 172.21.15.19:0/1636253980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d403cd8320 0x55d403cd87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.884+0000 7fb4efe00640 1 -- 172.21.15.19:0/1636253980 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4039f67d0 con 0x55d403cdb130 2024-03-08T06:04:50.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.884+0000 7fb4efe00640 1 --2- 172.21.15.19:0/1636253980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdb130 0x55d403ce2410 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009c50 tx=0x7fb4dc0136b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756ff961befcfd09 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:50.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.884+0000 7fb4d5600640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-03-08T06:04:50.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.885+0000 7fb4d5600640 1 -- 172.21.15.19:0/1636253980 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc01a030 con 0x55d403cdb130 2024-03-08T06:04:50.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.885+0000 7fb4d5600640 1 -- 172.21.15.19:0/1636253980 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4dc016460 con 0x55d403cdb130 2024-03-08T06:04:50.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.885+0000 7fb4fa243740 1 -- 172.21.15.19:0/1636253980 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4e807e680 con 0x55d403cdb130 2024-03-08T06:04:50.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.885+0000 7fb4d5600640 1 -- 172.21.15.19:0/1636253980 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4dc026050 con 0x55d403cdb130 2024-03-08T06:04:50.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.885+0000 7fb4fa243740 10 client.5253 fetch_fsmap learned FSMap version 16 2024-03-08T06:04:50.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.885+0000 7fb4fa243740 1 -- 172.21.15.19:0/1636253980 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55d403ce3770 con 0x55d403cdb130 2024-03-08T06:04:50.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.885+0000 7fb4d5600640 1 -- 172.21.15.19:0/1636253980 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e807e680 con 0x55d403cdb130 2024-03-08T06:04:50.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.885+0000 7fb4d5600640 1 -- 172.21.15.19:0/1636253980 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb4dc029020 con 0x55d403cdb130 2024-03-08T06:04:50.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.885+0000 7fb4fa243740 10 client.5253 fetch_fsmap finished waiting for FSMap version 16 2024-03-08T06:04:50.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.885+0000 7fb4fa243740 10 client.5253 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-03-08T06:04:50.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.885+0000 7fb4fa243740 20 client.5253 populate_metadata read hostname 'smithi019' 2024-03-08T06:04:50.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.885+0000 7fb4fa243740 1 --2- 172.21.15.19:0/1636253980 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55d403cdf530 0x55d403cdf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.885+0000 7fb4fa243740 4 client.5253 mds_command: new command op to 5028 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-08T06:04:50.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.885+0000 7fb4fa243740 1 -- 172.21.15.19:0/1636253980 --> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d403c252a0 con 0x55d403cdf530 2024-03-08T06:04:50.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.886+0000 7fb4f4c00640 1 --2- 172.21.15.19:0/1636253980 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55d403cdf530 0x55d403cdf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:50.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.886+0000 7fb4d5600640 10 client.5253 ms_handle_connect on v2:172.21.15.19:6836/1359509141 2024-03-08T06:04:50.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.886+0000 7fb4f4c00640 1 --2- 172.21.15.19:0/1636253980 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55d403cdf530 0x55d403cdf940 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79d404fe35d97247 server_cookie=f7ee98eec33e528a in_seq=0 out_seq=0 2024-03-08T06:04:50.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.887+0000 7fb4d5600640 1 -- 172.21.15.19:0/1636253980 <== mds.0 v2:172.21.15.19:6836/1359509141 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d403c252a0 con 0x55d403cdf530 2024-03-08T06:04:50.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.887+0000 7fb4d5600640 10 client.5253 handle_command_reply: tid=0 2024-03-08T06:04:50.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.887+0000 7fb4fa243740 1 client.5253 shutdown 2024-03-08T06:04:50.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.887+0000 7fb4fa243740 1 -- 172.21.15.19:0/1636253980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdb130 msgr2=0x55d403ce2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:50.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.887+0000 7fb4fa243740 1 --2- 172.21.15.19:0/1636253980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdb130 0x55d403ce2410 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009c50 tx=0x7fb4dc0136b0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.887+0000 7fb4fa243740 1 -- 172.21.15.19:0/1636253980 shutdown_connections 2024-03-08T06:04:50.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.887+0000 7fb4fa243740 1 --2- 172.21.15.19:0/1636253980 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55d403cdf530 0x55d403cdf940 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.887+0000 7fb4fa243740 1 --2- 172.21.15.19:0/1636253980 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d403cd8320 0x55d403cd87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.887+0000 7fb4fa243740 1 --2- 172.21.15.19:0/1636253980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdb130 0x55d403ce2410 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.887+0000 7fb4fa243740 1 --2- 172.21.15.19:0/1636253980 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d403cdad50 0x55d403ce1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.887+0000 7fb4d5600640 0 client.5253 ms_handle_reset on v2:172.21.15.19:6836/1359509141 2024-03-08T06:04:50.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.887+0000 7fb4fa243740 1 -- 172.21.15.19:0/1636253980 >> 172.21.15.19:0/1636253980 conn(0x55d403cae230 msgr2=0x55d403cfc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:50.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.888+0000 7fb4fa243740 1 -- 172.21.15.19:0/1636253980 shutdown_connections 2024-03-08T06:04:50.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.888+0000 7fb4fa243740 1 -- 172.21.15.19:0/1636253980 wait complete. 2024-03-08T06:04:50.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.888+0000 7fb4fa243740 20 client.5253 trim_cache size 0 max 16384 2024-03-08T06:04:50.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.901+0000 7fb4fa243740 1 Processor -- start 2024-03-08T06:04:50.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.901+0000 7fb4fa243740 1 -- start start 2024-03-08T06:04:50.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.902+0000 7fb4fa243740 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d403cd8320 0x55d403cd7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.902+0000 7fb4fa243740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdad50 0x55d403cfbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.902+0000 7fb4fa243740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d403cdb130 0x55d403cfc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.902+0000 7fb4fa243740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d403cb4ba0 con 0x55d403cdad50 2024-03-08T06:04:50.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.902+0000 7fb4fa243740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f02008c0 con 0x55d403cdb130 2024-03-08T06:04:50.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.902+0000 7fb4fa243740 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f01ffa90 con 0x55d403cd8320 2024-03-08T06:04:50.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.902+0000 7fb4efe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdad50 0x55d403cfbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:50.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.902+0000 7fb4efe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdad50 0x55d403cfbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35306/0 (socket says 172.21.15.19:35306) 2024-03-08T06:04:50.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.902+0000 7fb4efe00640 1 -- 172.21.15.19:0/2613860246 learned_addr learned my addr 172.21.15.19:0/2613860246 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:50.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.902+0000 7fb4efe00640 1 -- 172.21.15.19:0/2613860246 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d403cd8320 msgr2=0x55d403cd7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:50.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.902+0000 7fb4efe00640 1 --2- 172.21.15.19:0/2613860246 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d403cd8320 0x55d403cd7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.902+0000 7fb4efe00640 1 -- 172.21.15.19:0/2613860246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d403cdb130 msgr2=0x55d403cfc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:50.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.902+0000 7fb4efe00640 1 --2- 172.21.15.19:0/2613860246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d403cdb130 0x55d403cfc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.902+0000 7fb4efe00640 1 -- 172.21.15.19:0/2613860246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d403cdfcb0 con 0x55d403cdad50 2024-03-08T06:04:50.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.903+0000 7fb4efe00640 1 --2- 172.21.15.19:0/2613860246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdad50 0x55d403cfbcb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc013ee0 tx=0x7fb4dc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7dd93f368fbf91 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:50.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.903+0000 7fb4d7e00640 1 -- 172.21.15.19:0/2613860246 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc000e60 con 0x55d403cdad50 2024-03-08T06:04:50.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.903+0000 7fb4d7e00640 1 -- 172.21.15.19:0/2613860246 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc016850 con 0x55d403cdad50 2024-03-08T06:04:50.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.903+0000 7fb4d7e00640 1 -- 172.21.15.19:0/2613860246 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc02e070 con 0x55d403cdad50 2024-03-08T06:04:50.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.904+0000 7fb4fa243740 1 -- 172.21.15.19:0/2613860246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdad50 msgr2=0x55d403cfbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:50.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.904+0000 7fb4fa243740 1 --2- 172.21.15.19:0/2613860246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdad50 0x55d403cfbcb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc013ee0 tx=0x7fb4dc011000 comp rx=0 tx=0).stop 2024-03-08T06:04:50.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.904+0000 7fb4fa243740 1 -- 172.21.15.19:0/2613860246 shutdown_connections 2024-03-08T06:04:50.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.904+0000 7fb4fa243740 1 --2- 172.21.15.19:0/2613860246 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d403cdb130 0x55d403cfc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.904+0000 7fb4fa243740 1 --2- 172.21.15.19:0/2613860246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdad50 0x55d403cfbcb0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.904+0000 7fb4fa243740 1 --2- 172.21.15.19:0/2613860246 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d403cd8320 0x55d403cd7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.904+0000 7fb4fa243740 1 -- 172.21.15.19:0/2613860246 >> 172.21.15.19:0/2613860246 conn(0x55d403cae230 msgr2=0x55d403cfc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:50.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.904+0000 7fb4fa243740 1 -- 172.21.15.19:0/2613860246 shutdown_connections 2024-03-08T06:04:50.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.904+0000 7fb4fa243740 1 -- 172.21.15.19:0/2613860246 wait complete. 2024-03-08T06:04:50.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.905+0000 7fb4fa243740 1 -- start start 2024-03-08T06:04:50.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.905+0000 7fb4fa243740 1 Processor -- start 2024-03-08T06:04:50.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.906+0000 7fb4fa243740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d403cd8320 0x55d403d0faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.906+0000 7fb4fa243740 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d403cdad50 0x55d403cb2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.906+0000 7fb4fa243740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdb130 0x55d403cb28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.906+0000 7fb4fa243740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f01ff520 con 0x55d403cdb130 2024-03-08T06:04:50.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.906+0000 7fb4fa243740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f00b3d80 con 0x55d403cd8320 2024-03-08T06:04:50.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.906+0000 7fb4fa243740 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d403cd7f20 con 0x55d403cdad50 2024-03-08T06:04:50.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.906+0000 7fb4fa243740 10 client.0 _ll_register_callbacks cb 0x7fb4e800a5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-08T06:04:50.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.906+0000 7fb4f5600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdb130 0x55d403cb28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:50.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.906+0000 7fb4f5600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdb130 0x55d403cb28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35308/0 (socket says 172.21.15.19:35308) 2024-03-08T06:04:50.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.906+0000 7fb4f5600640 1 -- 172.21.15.19:0/3807798405 learned_addr learned my addr 172.21.15.19:0/3807798405 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:04:50.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.906+0000 7fb4f4c00640 1 --2- 172.21.15.19:0/3807798405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d403cd8320 0x55d403d0faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:50.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.907+0000 7fb4efe00640 1 --2- 172.21.15.19:0/3807798405 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d403cdad50 0x55d403cb2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:50.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.907+0000 7fb4f5600640 1 -- 172.21.15.19:0/3807798405 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d403cdad50 msgr2=0x55d403cb2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:50.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.907+0000 7fb4f5600640 1 --2- 172.21.15.19:0/3807798405 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d403cdad50 0x55d403cb2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.907+0000 7fb4f5600640 1 -- 172.21.15.19:0/3807798405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d403cd8320 msgr2=0x55d403d0faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:04:50.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.907+0000 7fb4f5600640 1 --2- 172.21.15.19:0/3807798405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d403cd8320 0x55d403d0faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.907+0000 7fb4f5600640 1 -- 172.21.15.19:0/3807798405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d403cd8b10 con 0x55d403cdb130 2024-03-08T06:04:50.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.907+0000 7fb4f5600640 1 --2- 172.21.15.19:0/3807798405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdb130 0x55d403cb28b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8001580 tx=0x7fb4e8001ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240296ffbc050c97 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:04:50.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.907+0000 7fb4d5600640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-03-08T06:04:50.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.907+0000 7fb4d5600640 1 -- 172.21.15.19:0/3807798405 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e80a9070 con 0x55d403cdb130 2024-03-08T06:04:50.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.907+0000 7fb4d5600640 1 -- 172.21.15.19:0/3807798405 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4e8078830 con 0x55d403cdb130 2024-03-08T06:04:50.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.907+0000 7fb4fa243740 1 -- 172.21.15.19:0/3807798405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4dc016850 con 0x55d403cdb130 2024-03-08T06:04:50.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.908+0000 7fb4d5600640 1 -- 172.21.15.19:0/3807798405 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4e8092080 con 0x55d403cdb130 2024-03-08T06:04:50.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.908+0000 7fb4fa243740 10 client.5259 fetch_fsmap learned FSMap version 16 2024-03-08T06:04:50.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.908+0000 7fb4fa243740 1 -- 172.21.15.19:0/3807798405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55d403d10530 con 0x55d403cdb130 2024-03-08T06:04:50.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.908+0000 7fb4d5600640 1 -- 172.21.15.19:0/3807798405 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc016850 con 0x55d403cdb130 2024-03-08T06:04:50.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.908+0000 7fb4d5600640 1 -- 172.21.15.19:0/3807798405 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb4e8076ba0 con 0x55d403cdb130 2024-03-08T06:04:50.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.908+0000 7fb4fa243740 10 client.5259 fetch_fsmap finished waiting for FSMap version 16 2024-03-08T06:04:50.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.908+0000 7fb4fa243740 10 client.5259 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-03-08T06:04:50.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.908+0000 7fb4fa243740 20 client.5259 populate_metadata read hostname 'smithi019' 2024-03-08T06:04:50.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.908+0000 7fb4fa243740 1 --2- 172.21.15.19:0/3807798405 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55d403d0e3e0 0x55d403d6efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:04:50.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.908+0000 7fb4fa243740 4 client.5259 mds_command: new command op to 5028 tid=0 multi_id=0 [{"prefix": "counter dump"}] 2024-03-08T06:04:50.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.908+0000 7fb4fa243740 1 -- 172.21.15.19:0/3807798405 --> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] -- command(tid 0: {"prefix": "counter dump"}) v1 -- 0x55d403c1f5f0 con 0x55d403d0e3e0 2024-03-08T06:04:50.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.908+0000 7fb4f4c00640 1 --2- 172.21.15.19:0/3807798405 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55d403d0e3e0 0x55d403d6efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:04:50.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.909+0000 7fb4f4c00640 1 --2- 172.21.15.19:0/3807798405 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55d403d0e3e0 0x55d403d6efb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d9bf3cb1cd86b1 server_cookie=736401b207c8520f in_seq=0 out_seq=0 2024-03-08T06:04:50.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.909+0000 7fb4d5600640 10 client.5259 ms_handle_connect on v2:172.21.15.19:6836/1359509141 2024-03-08T06:04:50.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.910+0000 7fb4d5600640 1 -- 172.21.15.19:0/3807798405 <== mds.0 v2:172.21.15.19:6836/1359509141 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+26756 (crc 0 0 0) 0x55d403c1f5f0 con 0x55d403d0e3e0 2024-03-08T06:04:50.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.910+0000 7fb4d5600640 10 client.5259 handle_command_reply: tid=0 2024-03-08T06:04:50.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.910+0000 7fb4fa243740 1 client.5259 shutdown 2024-03-08T06:04:50.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.910+0000 7fb4fa243740 1 -- 172.21.15.19:0/3807798405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdb130 msgr2=0x55d403cb28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:50.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.910+0000 7fb4fa243740 1 --2- 172.21.15.19:0/3807798405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdb130 0x55d403cb28b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8001580 tx=0x7fb4e8001ef0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.910+0000 7fb4fa243740 1 -- 172.21.15.19:0/3807798405 shutdown_connections 2024-03-08T06:04:50.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.910+0000 7fb4fa243740 1 --2- 172.21.15.19:0/3807798405 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55d403d0e3e0 0x55d403d6efb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.910+0000 7fb4fa243740 1 --2- 172.21.15.19:0/3807798405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d403cdb130 0x55d403cb28b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.910+0000 7fb4fa243740 1 --2- 172.21.15.19:0/3807798405 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55d403cdad50 0x55d403cb2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.910+0000 7fb4fa243740 1 --2- 172.21.15.19:0/3807798405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55d403cd8320 0x55d403d0faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.910+0000 7fb4d5600640 0 client.5259 ms_handle_reset on v2:172.21.15.19:6836/1359509141 2024-03-08T06:04:50.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.910+0000 7fb4fa243740 1 -- 172.21.15.19:0/3807798405 >> 172.21.15.19:0/3807798405 conn(0x55d403cae230 msgr2=0x55d403cfc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:50.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.910+0000 7fb4fa243740 1 -- 172.21.15.19:0/3807798405 shutdown_connections 2024-03-08T06:04:50.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.910+0000 7fb4fa243740 1 -- 172.21.15.19:0/3807798405 wait complete. 2024-03-08T06:04:50.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.910+0000 7fb4fa243740 20 client.5259 trim_cache size 0 max 16384 2024-03-08T06:04:50.915 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-08T06:04:50.915 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker": [ 2024-03-08T06:04:50.915 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.915 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": { 2024-03-08T06:04:50.915 INFO:teuthology.orchestra.run.smithi019.stdout: "id": "0" 2024-03-08T06:04:50.915 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.915 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.915 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-08T06:04:50.915 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_connection_idle_timeouts": 0 2024-03-08T06:04:50.915 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.915 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.915 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.915 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": { 2024-03-08T06:04:50.916 INFO:teuthology.orchestra.run.smithi019.stdout: "id": "1" 2024-03-08T06:04:50.916 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.916 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.916 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-08T06:04:50.916 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_connection_idle_timeouts": 0 2024-03-08T06:04:50.916 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.916 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.916 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.916 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": { 2024-03-08T06:04:50.916 INFO:teuthology.orchestra.run.smithi019.stdout: "id": "2" 2024-03-08T06:04:50.916 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.916 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.916 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-08T06:04:50.916 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_connection_idle_timeouts": 0 2024-03-08T06:04:50.916 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.916 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.917 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.917 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-0": [ 2024-03-08T06:04:50.917 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.917 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.917 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.917 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 69, 2024-03-08T06:04:50.917 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 63, 2024-03-08T06:04:50.917 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 115491, 2024-03-08T06:04:50.917 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 35530, 2024-03-08T06:04:50.917 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 8, 2024-03-08T06:04:50.917 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 3, 2024-03-08T06:04:50.917 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.022398098, 2024-03-08T06:04:50.917 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.003750889, 2024-03-08T06:04:50.917 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.018160396, 2024-03-08T06:04:50.917 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000635097, 2024-03-08T06:04:50.918 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-03-08T06:04:50.918 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 62, 2024-03-08T06:04:50.918 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.116323000, 2024-03-08T06:04:50.918 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.001876177 2024-03-08T06:04:50.918 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.918 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-03-08T06:04:50.918 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 2, 2024-03-08T06:04:50.918 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000276, 2024-03-08T06:04:50.918 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000138 2024-03-08T06:04:50.918 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.918 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 113344, 2024-03-08T06:04:50.918 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 13488 2024-03-08T06:04:50.918 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.919 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.919 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.919 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-1": [ 2024-03-08T06:04:50.919 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.919 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.919 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.919 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 42, 2024-03-08T06:04:50.919 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 40, 2024-03-08T06:04:50.919 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 13087, 2024-03-08T06:04:50.919 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 127785, 2024-03-08T06:04:50.919 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 8, 2024-03-08T06:04:50.919 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 4, 2024-03-08T06:04:50.919 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.021310746, 2024-03-08T06:04:50.919 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.005934559, 2024-03-08T06:04:50.919 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.014683426, 2024-03-08T06:04:50.919 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.001046023, 2024-03-08T06:04:50.920 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-03-08T06:04:50.920 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 39, 2024-03-08T06:04:50.920 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.084911096, 2024-03-08T06:04:50.920 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.002177207 2024-03-08T06:04:50.920 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.920 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-03-08T06:04:50.920 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 59, 2024-03-08T06:04:50.920 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000016929, 2024-03-08T06:04:50.920 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000286 2024-03-08T06:04:50.920 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.920 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-08T06:04:50.920 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 94288 2024-03-08T06:04:50.920 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.921 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.921 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.921 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-2": [ 2024-03-08T06:04:50.921 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.921 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.921 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.921 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 47, 2024-03-08T06:04:50.921 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 37, 2024-03-08T06:04:50.921 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 14719, 2024-03-08T06:04:50.921 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 24277, 2024-03-08T06:04:50.921 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 6, 2024-03-08T06:04:50.921 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 4, 2024-03-08T06:04:50.921 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.015870120, 2024-03-08T06:04:50.921 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.002329702, 2024-03-08T06:04:50.921 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.011605164, 2024-03-08T06:04:50.922 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.001786903, 2024-03-08T06:04:50.922 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-03-08T06:04:50.922 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 36, 2024-03-08T06:04:50.922 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.478486066, 2024-03-08T06:04:50.922 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.013291279 2024-03-08T06:04:50.922 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.922 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-03-08T06:04:50.922 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 17, 2024-03-08T06:04:50.922 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000005878, 2024-03-08T06:04:50.922 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000345 2024-03-08T06:04:50.922 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.922 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-03-08T06:04:50.922 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 448 2024-03-08T06:04:50.923 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.923 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.923 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.923 INFO:teuthology.orchestra.run.smithi019.stdout: "cct": [ 2024-03-08T06:04:50.923 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.923 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.923 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.923 INFO:teuthology.orchestra.run.smithi019.stdout: "total_workers": 1, 2024-03-08T06:04:50.923 INFO:teuthology.orchestra.run.smithi019.stdout: "unhealthy_workers": 0 2024-03-08T06:04:50.923 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.923 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.923 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.923 INFO:teuthology.orchestra.run.smithi019.stdout: "finisher-MDSRank": [ 2024-03-08T06:04:50.923 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.923 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.923 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.924 INFO:teuthology.orchestra.run.smithi019.stdout: "queue_len": 0, 2024-03-08T06:04:50.924 INFO:teuthology.orchestra.run.smithi019.stdout: "complete_latency": { 2024-03-08T06:04:50.924 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 41, 2024-03-08T06:04:50.924 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.002942506, 2024-03-08T06:04:50.924 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000071768 2024-03-08T06:04:50.924 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.924 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.924 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.924 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.924 INFO:teuthology.orchestra.run.smithi019.stdout: "finisher-PurgeQueue": [ 2024-03-08T06:04:50.924 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.924 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.924 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.924 INFO:teuthology.orchestra.run.smithi019.stdout: "queue_len": 0, 2024-03-08T06:04:50.924 INFO:teuthology.orchestra.run.smithi019.stdout: "complete_latency": { 2024-03-08T06:04:50.925 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 2, 2024-03-08T06:04:50.925 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000030751, 2024-03-08T06:04:50.925 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000015375 2024-03-08T06:04:50.925 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.925 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.925 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.925 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.925 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": [ 2024-03-08T06:04:50.925 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.925 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.925 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.925 INFO:teuthology.orchestra.run.smithi019.stdout: "request": 25, 2024-03-08T06:04:50.925 INFO:teuthology.orchestra.run.smithi019.stdout: "reply": 25, 2024-03-08T06:04:50.925 INFO:teuthology.orchestra.run.smithi019.stdout: "reply_latency": { 2024-03-08T06:04:50.925 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 25, 2024-03-08T06:04:50.925 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.006936290, 2024-03-08T06:04:50.926 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000277451 2024-03-08T06:04:50.926 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.926 INFO:teuthology.orchestra.run.smithi019.stdout: "slow_reply": 0, 2024-03-08T06:04:50.926 INFO:teuthology.orchestra.run.smithi019.stdout: "forward": 0, 2024-03-08T06:04:50.926 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_fetch_complete": 0, 2024-03-08T06:04:50.926 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_fetch_keys": 0, 2024-03-08T06:04:50.926 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_commit": 12, 2024-03-08T06:04:50.926 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_split": 0, 2024-03-08T06:04:50.926 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_merge": 0, 2024-03-08T06:04:50.926 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes": 10, 2024-03-08T06:04:50.926 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_top": 0, 2024-03-08T06:04:50.926 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_bottom": 10, 2024-03-08T06:04:50.926 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_pin_tail": 0, 2024-03-08T06:04:50.926 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_pinned": 10, 2024-03-08T06:04:50.926 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_expired": 0, 2024-03-08T06:04:50.927 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_with_caps": 1, 2024-03-08T06:04:50.927 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": 2, 2024-03-08T06:04:50.927 INFO:teuthology.orchestra.run.smithi019.stdout: "subtrees": 2, 2024-03-08T06:04:50.927 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse": 49, 2024-03-08T06:04:50.927 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_hit": 49, 2024-03-08T06:04:50.927 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_forward": 0, 2024-03-08T06:04:50.927 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_discover": 0, 2024-03-08T06:04:50.927 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_dir_fetch": 0, 2024-03-08T06:04:50.927 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_remote_ino": 0, 2024-03-08T06:04:50.927 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_lock": 0, 2024-03-08T06:04:50.927 INFO:teuthology.orchestra.run.smithi019.stdout: "load_cent": 0, 2024-03-08T06:04:50.927 INFO:teuthology.orchestra.run.smithi019.stdout: "q": 0, 2024-03-08T06:04:50.927 INFO:teuthology.orchestra.run.smithi019.stdout: "exported": 0, 2024-03-08T06:04:50.927 INFO:teuthology.orchestra.run.smithi019.stdout: "exported_inodes": 0, 2024-03-08T06:04:50.927 INFO:teuthology.orchestra.run.smithi019.stdout: "imported": 0, 2024-03-08T06:04:50.927 INFO:teuthology.orchestra.run.smithi019.stdout: "imported_inodes": 0, 2024-03-08T06:04:50.927 INFO:teuthology.orchestra.run.smithi019.stdout: "openino_dir_fetch": 0, 2024-03-08T06:04:50.928 INFO:teuthology.orchestra.run.smithi019.stdout: "openino_backtrace_fetch": 0, 2024-03-08T06:04:50.928 INFO:teuthology.orchestra.run.smithi019.stdout: "openino_peer_discover": 0, 2024-03-08T06:04:50.928 INFO:teuthology.orchestra.run.smithi019.stdout: "root_rfiles": 0, 2024-03-08T06:04:50.928 INFO:teuthology.orchestra.run.smithi019.stdout: "root_rbytes": 0, 2024-03-08T06:04:50.928 INFO:teuthology.orchestra.run.smithi019.stdout: "root_rsnaps": 0, 2024-03-08T06:04:50.928 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_backtrace_fetch": 0, 2024-03-08T06:04:50.928 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_set_tag": 0, 2024-03-08T06:04:50.928 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_backtrace_repaired": 0, 2024-03-08T06:04:50.928 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_inotable_repaired": 0, 2024-03-08T06:04:50.928 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_dir_inodes": 0, 2024-03-08T06:04:50.928 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_dir_base_inodes": 0, 2024-03-08T06:04:50.928 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_dirfrag_rstats": 0, 2024-03-08T06:04:50.928 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_file_inodes": 0, 2024-03-08T06:04:50.928 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_inode_file_caps": 0, 2024-03-08T06:04:50.928 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_cap_op_revoke": 0, 2024-03-08T06:04:50.928 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_cap_op_grant": 0, 2024-03-08T06:04:50.929 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_cap_op_trunc": 0, 2024-03-08T06:04:50.929 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-08T06:04:50.929 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-08T06:04:50.929 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_client_caps": 0, 2024-03-08T06:04:50.929 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_client_caps_dirty": 0, 2024-03-08T06:04:50.929 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_client_cap_release": 0, 2024-03-08T06:04:50.929 INFO:teuthology.orchestra.run.smithi019.stdout: "process_request_cap_release": 1 2024-03-08T06:04:50.929 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.929 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.929 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.929 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache": [ 2024-03-08T06:04:50.929 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.929 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.929 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.929 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_update": 0, 2024-03-08T06:04:50.929 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_update_receipt": 0, 2024-03-08T06:04:50.929 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_try_discover": 0, 2024-03-08T06:04:50.930 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_send_discover": 0, 2024-03-08T06:04:50.930 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_handle_discover": 0, 2024-03-08T06:04:50.930 INFO:teuthology.orchestra.run.smithi019.stdout: "num_strays": 0, 2024-03-08T06:04:50.930 INFO:teuthology.orchestra.run.smithi019.stdout: "num_strays_delayed": 0, 2024-03-08T06:04:50.930 INFO:teuthology.orchestra.run.smithi019.stdout: "num_strays_enqueuing": 0, 2024-03-08T06:04:50.930 INFO:teuthology.orchestra.run.smithi019.stdout: "strays_created": 0, 2024-03-08T06:04:50.930 INFO:teuthology.orchestra.run.smithi019.stdout: "strays_enqueued": 0, 2024-03-08T06:04:50.930 INFO:teuthology.orchestra.run.smithi019.stdout: "strays_reintegrated": 0, 2024-03-08T06:04:50.930 INFO:teuthology.orchestra.run.smithi019.stdout: "strays_migrated": 0, 2024-03-08T06:04:50.930 INFO:teuthology.orchestra.run.smithi019.stdout: "num_recovering_processing": 0, 2024-03-08T06:04:50.930 INFO:teuthology.orchestra.run.smithi019.stdout: "num_recovering_enqueued": 0, 2024-03-08T06:04:50.930 INFO:teuthology.orchestra.run.smithi019.stdout: "num_recovering_prioritized": 0, 2024-03-08T06:04:50.930 INFO:teuthology.orchestra.run.smithi019.stdout: "recovery_started": 0, 2024-03-08T06:04:50.930 INFO:teuthology.orchestra.run.smithi019.stdout: "recovery_completed": 0, 2024-03-08T06:04:50.930 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_enqueue_scrub": 0, 2024-03-08T06:04:50.931 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_exportdir": 0, 2024-03-08T06:04:50.931 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_flush": 0, 2024-03-08T06:04:50.931 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_fragmentdir": 0, 2024-03-08T06:04:50.931 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_fragstats": 0, 2024-03-08T06:04:50.931 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_inodestats": 0 2024-03-08T06:04:50.931 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.931 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.931 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.931 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_client_metrics": [ 2024-03-08T06:04:50.931 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.931 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": { 2024-03-08T06:04:50.931 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-03-08T06:04:50.931 INFO:teuthology.orchestra.run.smithi019.stdout: "id": "5028" 2024-03-08T06:04:50.931 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.932 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.932 INFO:teuthology.orchestra.run.smithi019.stdout: "num_clients": 2 2024-03-08T06:04:50.932 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.932 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.932 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.932 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_client_metrics-cephfs": [ 2024-03-08T06:04:50.932 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.932 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": { 2024-03-08T06:04:50.932 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4646", 2024-03-08T06:04:50.932 INFO:teuthology.orchestra.run.smithi019.stdout: "rank": "0" 2024-03-08T06:04:50.932 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.932 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.932 INFO:teuthology.orchestra.run.smithi019.stdout: "cap_hits": 5, 2024-03-08T06:04:50.932 INFO:teuthology.orchestra.run.smithi019.stdout: "cap_miss": 18, 2024-03-08T06:04:50.932 INFO:teuthology.orchestra.run.smithi019.stdout: "avg_read_latency": 0.000000000, 2024-03-08T06:04:50.932 INFO:teuthology.orchestra.run.smithi019.stdout: "avg_write_latency": 0.000000000, 2024-03-08T06:04:50.933 INFO:teuthology.orchestra.run.smithi019.stdout: "avg_metadata_latency": 0.000000000, 2024-03-08T06:04:50.933 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_lease_hits": 0, 2024-03-08T06:04:50.933 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_lease_miss": 0, 2024-03-08T06:04:50.933 INFO:teuthology.orchestra.run.smithi019.stdout: "opened_files": 0, 2024-03-08T06:04:50.933 INFO:teuthology.orchestra.run.smithi019.stdout: "opened_inodes": 1, 2024-03-08T06:04:50.933 INFO:teuthology.orchestra.run.smithi019.stdout: "pinned_icaps": 1, 2024-03-08T06:04:50.933 INFO:teuthology.orchestra.run.smithi019.stdout: "total_inodes": 1, 2024-03-08T06:04:50.933 INFO:teuthology.orchestra.run.smithi019.stdout: "total_read_ops": 0, 2024-03-08T06:04:50.933 INFO:teuthology.orchestra.run.smithi019.stdout: "total_read_size": 0, 2024-03-08T06:04:50.933 INFO:teuthology.orchestra.run.smithi019.stdout: "total_write_ops": 0, 2024-03-08T06:04:50.933 INFO:teuthology.orchestra.run.smithi019.stdout: "total_write_size": 0 2024-03-08T06:04:50.933 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.933 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.933 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.933 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": { 2024-03-08T06:04:50.933 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4655", 2024-03-08T06:04:50.933 INFO:teuthology.orchestra.run.smithi019.stdout: "rank": "0" 2024-03-08T06:04:50.934 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.934 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.934 INFO:teuthology.orchestra.run.smithi019.stdout: "cap_hits": 23, 2024-03-08T06:04:50.934 INFO:teuthology.orchestra.run.smithi019.stdout: "cap_miss": 0, 2024-03-08T06:04:50.934 INFO:teuthology.orchestra.run.smithi019.stdout: "avg_read_latency": 0.000000000, 2024-03-08T06:04:50.934 INFO:teuthology.orchestra.run.smithi019.stdout: "avg_write_latency": 0.000000000, 2024-03-08T06:04:50.934 INFO:teuthology.orchestra.run.smithi019.stdout: "avg_metadata_latency": 0.000000000, 2024-03-08T06:04:50.934 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_lease_hits": 0, 2024-03-08T06:04:50.934 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_lease_miss": 0, 2024-03-08T06:04:50.934 INFO:teuthology.orchestra.run.smithi019.stdout: "opened_files": 0, 2024-03-08T06:04:50.934 INFO:teuthology.orchestra.run.smithi019.stdout: "opened_inodes": 1, 2024-03-08T06:04:50.934 INFO:teuthology.orchestra.run.smithi019.stdout: "pinned_icaps": 1, 2024-03-08T06:04:50.934 INFO:teuthology.orchestra.run.smithi019.stdout: "total_inodes": 1, 2024-03-08T06:04:50.934 INFO:teuthology.orchestra.run.smithi019.stdout: "total_read_ops": 0, 2024-03-08T06:04:50.934 INFO:teuthology.orchestra.run.smithi019.stdout: "total_read_size": 0, 2024-03-08T06:04:50.935 INFO:teuthology.orchestra.run.smithi019.stdout: "total_write_ops": 0, 2024-03-08T06:04:50.935 INFO:teuthology.orchestra.run.smithi019.stdout: "total_write_size": 0 2024-03-08T06:04:50.935 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.935 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.935 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.935 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log": [ 2024-03-08T06:04:50.935 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.935 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.935 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.935 INFO:teuthology.orchestra.run.smithi019.stdout: "evlrg": 0, 2024-03-08T06:04:50.935 INFO:teuthology.orchestra.run.smithi019.stdout: "evadd": 6, 2024-03-08T06:04:50.935 INFO:teuthology.orchestra.run.smithi019.stdout: "evex": 0, 2024-03-08T06:04:50.935 INFO:teuthology.orchestra.run.smithi019.stdout: "evtrm": 0, 2024-03-08T06:04:50.935 INFO:teuthology.orchestra.run.smithi019.stdout: "ev": 6, 2024-03-08T06:04:50.935 INFO:teuthology.orchestra.run.smithi019.stdout: "evexg": 0, 2024-03-08T06:04:50.935 INFO:teuthology.orchestra.run.smithi019.stdout: "evexd": 0, 2024-03-08T06:04:50.935 INFO:teuthology.orchestra.run.smithi019.stdout: "segadd": 2, 2024-03-08T06:04:50.936 INFO:teuthology.orchestra.run.smithi019.stdout: "segex": 0, 2024-03-08T06:04:50.936 INFO:teuthology.orchestra.run.smithi019.stdout: "segtrm": 0, 2024-03-08T06:04:50.936 INFO:teuthology.orchestra.run.smithi019.stdout: "seg": 2, 2024-03-08T06:04:50.936 INFO:teuthology.orchestra.run.smithi019.stdout: "segmjr": 2, 2024-03-08T06:04:50.936 INFO:teuthology.orchestra.run.smithi019.stdout: "segexg": 0, 2024-03-08T06:04:50.936 INFO:teuthology.orchestra.run.smithi019.stdout: "segexd": 0, 2024-03-08T06:04:50.936 INFO:teuthology.orchestra.run.smithi019.stdout: "expos": 4194304, 2024-03-08T06:04:50.936 INFO:teuthology.orchestra.run.smithi019.stdout: "wrpos": 4196747, 2024-03-08T06:04:50.936 INFO:teuthology.orchestra.run.smithi019.stdout: "rdpos": 0, 2024-03-08T06:04:50.936 INFO:teuthology.orchestra.run.smithi019.stdout: "jlat": { 2024-03-08T06:04:50.936 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 3, 2024-03-08T06:04:50.936 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.010278776, 2024-03-08T06:04:50.936 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.003426258 2024-03-08T06:04:50.936 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.936 INFO:teuthology.orchestra.run.smithi019.stdout: "replayed": 0 2024-03-08T06:04:50.936 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.937 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.937 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.937 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_mem": [ 2024-03-08T06:04:50.937 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.937 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.937 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.937 INFO:teuthology.orchestra.run.smithi019.stdout: "ino": 13, 2024-03-08T06:04:50.937 INFO:teuthology.orchestra.run.smithi019.stdout: "ino+": 13, 2024-03-08T06:04:50.937 INFO:teuthology.orchestra.run.smithi019.stdout: "ino-": 0, 2024-03-08T06:04:50.937 INFO:teuthology.orchestra.run.smithi019.stdout: "dir": 12, 2024-03-08T06:04:50.937 INFO:teuthology.orchestra.run.smithi019.stdout: "dir+": 12, 2024-03-08T06:04:50.937 INFO:teuthology.orchestra.run.smithi019.stdout: "dir-": 0, 2024-03-08T06:04:50.937 INFO:teuthology.orchestra.run.smithi019.stdout: "dn": 10, 2024-03-08T06:04:50.937 INFO:teuthology.orchestra.run.smithi019.stdout: "dn+": 10, 2024-03-08T06:04:50.937 INFO:teuthology.orchestra.run.smithi019.stdout: "dn-": 0, 2024-03-08T06:04:50.937 INFO:teuthology.orchestra.run.smithi019.stdout: "cap": 2, 2024-03-08T06:04:50.937 INFO:teuthology.orchestra.run.smithi019.stdout: "cap+": 2, 2024-03-08T06:04:50.938 INFO:teuthology.orchestra.run.smithi019.stdout: "cap-": 0, 2024-03-08T06:04:50.938 INFO:teuthology.orchestra.run.smithi019.stdout: "rss": 40320, 2024-03-08T06:04:50.938 INFO:teuthology.orchestra.run.smithi019.stdout: "heap": 215392 2024-03-08T06:04:50.938 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.938 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.938 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.938 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_server": [ 2024-03-08T06:04:50.938 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.938 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.938 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.938 INFO:teuthology.orchestra.run.smithi019.stdout: "dispatch_client_request": 25, 2024-03-08T06:04:50.938 INFO:teuthology.orchestra.run.smithi019.stdout: "dispatch_server_request": 0, 2024-03-08T06:04:50.938 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_client_request": 25, 2024-03-08T06:04:50.938 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_client_session": 2, 2024-03-08T06:04:50.938 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_peer_request": 0, 2024-03-08T06:04:50.939 INFO:teuthology.orchestra.run.smithi019.stdout: "req_create_latency": { 2024-03-08T06:04:50.939 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.939 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.939 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.939 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.939 INFO:teuthology.orchestra.run.smithi019.stdout: "req_getattr_latency": { 2024-03-08T06:04:50.939 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 24, 2024-03-08T06:04:50.939 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.006544905, 2024-03-08T06:04:50.939 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000272704 2024-03-08T06:04:50.939 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.939 INFO:teuthology.orchestra.run.smithi019.stdout: "req_getfilelock_latency": { 2024-03-08T06:04:50.939 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.939 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.939 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.939 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.939 INFO:teuthology.orchestra.run.smithi019.stdout: "req_link_latency": { 2024-03-08T06:04:50.940 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.940 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.940 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.940 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.940 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookup_latency": { 2024-03-08T06:04:50.940 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.940 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.940 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.940 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.940 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookuphash_latency": { 2024-03-08T06:04:50.940 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.940 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.940 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.940 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.940 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookupino_latency": { 2024-03-08T06:04:50.941 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.941 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.941 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.941 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.941 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookupname_latency": { 2024-03-08T06:04:50.941 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.941 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.941 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.941 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.941 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookupparent_latency": { 2024-03-08T06:04:50.941 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.941 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.941 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.941 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.941 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookupsnap_latency": { 2024-03-08T06:04:50.942 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.942 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.942 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.942 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lssnap_latency": { 2024-03-08T06:04:50.942 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.942 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.942 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.942 INFO:teuthology.orchestra.run.smithi019.stdout: "req_mkdir_latency": { 2024-03-08T06:04:50.942 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.942 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.942 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.942 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.942 INFO:teuthology.orchestra.run.smithi019.stdout: "req_mknod_latency": { 2024-03-08T06:04:50.943 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.943 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.943 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.943 INFO:teuthology.orchestra.run.smithi019.stdout: "req_mksnap_latency": { 2024-03-08T06:04:50.943 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.943 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.943 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.943 INFO:teuthology.orchestra.run.smithi019.stdout: "req_open_latency": { 2024-03-08T06:04:50.943 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.943 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.943 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.943 INFO:teuthology.orchestra.run.smithi019.stdout: "req_readdir_latency": { 2024-03-08T06:04:50.943 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.944 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.944 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.944 INFO:teuthology.orchestra.run.smithi019.stdout: "req_rename_latency": { 2024-03-08T06:04:50.944 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.944 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.944 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.944 INFO:teuthology.orchestra.run.smithi019.stdout: "req_renamesnap_latency": { 2024-03-08T06:04:50.944 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.944 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.944 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.944 INFO:teuthology.orchestra.run.smithi019.stdout: "req_snapdiff_latency": { 2024-03-08T06:04:50.944 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.944 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.945 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.945 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.945 INFO:teuthology.orchestra.run.smithi019.stdout: "req_rmdir_latency": { 2024-03-08T06:04:50.945 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.945 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.945 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.945 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.945 INFO:teuthology.orchestra.run.smithi019.stdout: "req_rmsnap_latency": { 2024-03-08T06:04:50.945 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.945 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.945 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.945 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.945 INFO:teuthology.orchestra.run.smithi019.stdout: "req_rmxattr_latency": { 2024-03-08T06:04:50.945 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.945 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.945 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.945 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.946 INFO:teuthology.orchestra.run.smithi019.stdout: "req_setattr_latency": { 2024-03-08T06:04:50.946 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 1, 2024-03-08T06:04:50.946 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000391385, 2024-03-08T06:04:50.946 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000391385 2024-03-08T06:04:50.946 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.946 INFO:teuthology.orchestra.run.smithi019.stdout: "req_setdirlayout_latency": { 2024-03-08T06:04:50.946 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.946 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.946 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.946 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.946 INFO:teuthology.orchestra.run.smithi019.stdout: "req_setfilelock_latency": { 2024-03-08T06:04:50.946 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.946 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.946 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.946 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.947 INFO:teuthology.orchestra.run.smithi019.stdout: "req_setlayout_latency": { 2024-03-08T06:04:50.947 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.947 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.947 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.947 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.947 INFO:teuthology.orchestra.run.smithi019.stdout: "req_setxattr_latency": { 2024-03-08T06:04:50.947 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.947 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.947 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.947 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.947 INFO:teuthology.orchestra.run.smithi019.stdout: "req_symlink_latency": { 2024-03-08T06:04:50.947 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.947 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.947 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.947 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.947 INFO:teuthology.orchestra.run.smithi019.stdout: "req_unlink_latency": { 2024-03-08T06:04:50.948 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.948 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.948 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.948 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.948 INFO:teuthology.orchestra.run.smithi019.stdout: "cap_revoke_eviction": 0, 2024-03-08T06:04:50.948 INFO:teuthology.orchestra.run.smithi019.stdout: "cap_acquisition_throttle": 0, 2024-03-08T06:04:50.948 INFO:teuthology.orchestra.run.smithi019.stdout: "req_getvxattr_latency": { 2024-03-08T06:04:50.948 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.948 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.948 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.948 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.948 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.948 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.948 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.948 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_sessions": [ 2024-03-08T06:04:50.949 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.949 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.949 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.949 INFO:teuthology.orchestra.run.smithi019.stdout: "session_count": 2, 2024-03-08T06:04:50.949 INFO:teuthology.orchestra.run.smithi019.stdout: "session_add": 2, 2024-03-08T06:04:50.949 INFO:teuthology.orchestra.run.smithi019.stdout: "session_remove": 0, 2024-03-08T06:04:50.949 INFO:teuthology.orchestra.run.smithi019.stdout: "sessions_open": 2, 2024-03-08T06:04:50.949 INFO:teuthology.orchestra.run.smithi019.stdout: "sessions_stale": 0, 2024-03-08T06:04:50.949 INFO:teuthology.orchestra.run.smithi019.stdout: "total_load": 24, 2024-03-08T06:04:50.949 INFO:teuthology.orchestra.run.smithi019.stdout: "average_load": 12, 2024-03-08T06:04:50.949 INFO:teuthology.orchestra.run.smithi019.stdout: "avg_session_uptime": 7, 2024-03-08T06:04:50.949 INFO:teuthology.orchestra.run.smithi019.stdout: "mdthresh_evicted": 0 2024-03-08T06:04:50.949 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.949 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.949 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.949 INFO:teuthology.orchestra.run.smithi019.stdout: "mempool": [ 2024-03-08T06:04:50.950 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.950 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.950 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.950 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_bytes": 0, 2024-03-08T06:04:50.950 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_items": 0, 2024-03-08T06:04:50.950 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_bytes": 0, 2024-03-08T06:04:50.950 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_items": 0, 2024-03-08T06:04:50.950 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_bytes": 0, 2024-03-08T06:04:50.950 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_items": 0, 2024-03-08T06:04:50.950 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-08T06:04:50.950 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_items": 0, 2024-03-08T06:04:50.950 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-08T06:04:50.950 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_items": 0, 2024-03-08T06:04:50.950 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_bytes": 0, 2024-03-08T06:04:50.951 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_items": 0, 2024-03-08T06:04:50.951 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-08T06:04:50.951 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_items": 0, 2024-03-08T06:04:50.951 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_bytes": 0, 2024-03-08T06:04:50.951 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_items": 0, 2024-03-08T06:04:50.951 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_bytes": 0, 2024-03-08T06:04:50.951 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_items": 0, 2024-03-08T06:04:50.951 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-08T06:04:50.951 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_items": 0, 2024-03-08T06:04:50.951 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-08T06:04:50.951 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_items": 0, 2024-03-08T06:04:50.951 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_bytes": 0, 2024-03-08T06:04:50.951 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_items": 0, 2024-03-08T06:04:50.951 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_bytes": 0, 2024-03-08T06:04:50.951 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_items": 0, 2024-03-08T06:04:50.952 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-08T06:04:50.952 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_items": 0, 2024-03-08T06:04:50.952 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_bytes": 0, 2024-03-08T06:04:50.952 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_items": 0, 2024-03-08T06:04:50.952 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_bytes": 0, 2024-03-08T06:04:50.952 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_items": 0, 2024-03-08T06:04:50.952 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_bytes": 0, 2024-03-08T06:04:50.952 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_items": 0, 2024-03-08T06:04:50.952 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_bytes": 0, 2024-03-08T06:04:50.952 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_items": 0, 2024-03-08T06:04:50.952 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_bytes": 225211, 2024-03-08T06:04:50.952 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_items": 87, 2024-03-08T06:04:50.952 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_bytes": 0, 2024-03-08T06:04:50.952 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_items": 0, 2024-03-08T06:04:50.952 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bytes": 0, 2024-03-08T06:04:50.952 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_items": 0, 2024-03-08T06:04:50.953 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_bytes": 0, 2024-03-08T06:04:50.953 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_items": 0, 2024-03-08T06:04:50.953 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_bytes": 0, 2024-03-08T06:04:50.953 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_items": 0, 2024-03-08T06:04:50.953 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_bytes": 5312, 2024-03-08T06:04:50.953 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_items": 75, 2024-03-08T06:04:50.953 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_bytes": 0, 2024-03-08T06:04:50.953 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_items": 0, 2024-03-08T06:04:50.953 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_bytes": 0, 2024-03-08T06:04:50.953 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_items": 0, 2024-03-08T06:04:50.953 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_bytes": 52240, 2024-03-08T06:04:50.953 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_items": 213, 2024-03-08T06:04:50.953 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_bytes": 0, 2024-03-08T06:04:50.953 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_items": 0, 2024-03-08T06:04:50.953 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_bytes": 0, 2024-03-08T06:04:50.953 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_items": 0 2024-03-08T06:04:50.954 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.954 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.954 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.954 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter": [ 2024-03-08T06:04:50.954 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.954 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.954 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.954 INFO:teuthology.orchestra.run.smithi019.stdout: "op_active": 0, 2024-03-08T06:04:50.954 INFO:teuthology.orchestra.run.smithi019.stdout: "op_laggy": 0, 2024-03-08T06:04:50.954 INFO:teuthology.orchestra.run.smithi019.stdout: "op_send": 41, 2024-03-08T06:04:50.954 INFO:teuthology.orchestra.run.smithi019.stdout: "op_send_bytes": 13563, 2024-03-08T06:04:50.954 INFO:teuthology.orchestra.run.smithi019.stdout: "op_resend": 37, 2024-03-08T06:04:50.954 INFO:teuthology.orchestra.run.smithi019.stdout: "op_reply": 41, 2024-03-08T06:04:50.954 INFO:teuthology.orchestra.run.smithi019.stdout: "op_latency": { 2024-03-08T06:04:50.955 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 41, 2024-03-08T06:04:50.955 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 1.404985877, 2024-03-08T06:04:50.955 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.034267948 2024-03-08T06:04:50.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.955 INFO:teuthology.orchestra.run.smithi019.stdout: "op_inflight": 0, 2024-03-08T06:04:50.955 INFO:teuthology.orchestra.run.smithi019.stdout: "oplen_avg": { 2024-03-08T06:04:50.955 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 41, 2024-03-08T06:04:50.955 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 65 2024-03-08T06:04:50.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:04:50.955 INFO:teuthology.orchestra.run.smithi019.stdout: "op": 41, 2024-03-08T06:04:50.955 INFO:teuthology.orchestra.run.smithi019.stdout: "op_r": 0, 2024-03-08T06:04:50.955 INFO:teuthology.orchestra.run.smithi019.stdout: "op_w": 41, 2024-03-08T06:04:50.955 INFO:teuthology.orchestra.run.smithi019.stdout: "op_rmw": 0, 2024-03-08T06:04:50.955 INFO:teuthology.orchestra.run.smithi019.stdout: "op_pg": 0, 2024-03-08T06:04:50.955 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_stat": 0, 2024-03-08T06:04:50.955 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_create": 11, 2024-03-08T06:04:50.955 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_read": 0, 2024-03-08T06:04:50.956 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_write": 3, 2024-03-08T06:04:50.956 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_writefull": 7, 2024-03-08T06:04:50.956 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_writesame": 0, 2024-03-08T06:04:50.956 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_append": 0, 2024-03-08T06:04:50.956 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_zero": 0, 2024-03-08T06:04:50.956 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_truncate": 0, 2024-03-08T06:04:50.956 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_delete": 6, 2024-03-08T06:04:50.956 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_mapext": 0, 2024-03-08T06:04:50.956 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_sparse_read": 0, 2024-03-08T06:04:50.956 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_clonerange": 0, 2024-03-08T06:04:50.956 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_getxattr": 0, 2024-03-08T06:04:50.956 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_setxattr": 22, 2024-03-08T06:04:50.956 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_cmpxattr": 0, 2024-03-08T06:04:50.956 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_rmxattr": 0, 2024-03-08T06:04:50.956 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_resetxattrs": 0, 2024-03-08T06:04:50.956 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_call": 0, 2024-03-08T06:04:50.957 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_watch": 0, 2024-03-08T06:04:50.957 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_notify": 0, 2024-03-08T06:04:50.957 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_src_cmpxattr": 0, 2024-03-08T06:04:50.957 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_pgls": 0, 2024-03-08T06:04:50.957 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_pgls_filter": 0, 2024-03-08T06:04:50.957 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_other": 0, 2024-03-08T06:04:50.957 INFO:teuthology.orchestra.run.smithi019.stdout: "linger_active": 0, 2024-03-08T06:04:50.957 INFO:teuthology.orchestra.run.smithi019.stdout: "linger_send": 0, 2024-03-08T06:04:50.957 INFO:teuthology.orchestra.run.smithi019.stdout: "linger_resend": 0, 2024-03-08T06:04:50.957 INFO:teuthology.orchestra.run.smithi019.stdout: "linger_ping": 0, 2024-03-08T06:04:50.957 INFO:teuthology.orchestra.run.smithi019.stdout: "poolop_active": 0, 2024-03-08T06:04:50.957 INFO:teuthology.orchestra.run.smithi019.stdout: "poolop_send": 0, 2024-03-08T06:04:50.957 INFO:teuthology.orchestra.run.smithi019.stdout: "poolop_resend": 0, 2024-03-08T06:04:50.957 INFO:teuthology.orchestra.run.smithi019.stdout: "poolstat_active": 0, 2024-03-08T06:04:50.957 INFO:teuthology.orchestra.run.smithi019.stdout: "poolstat_send": 0, 2024-03-08T06:04:50.957 INFO:teuthology.orchestra.run.smithi019.stdout: "poolstat_resend": 0, 2024-03-08T06:04:50.958 INFO:teuthology.orchestra.run.smithi019.stdout: "statfs_active": 0, 2024-03-08T06:04:50.958 INFO:teuthology.orchestra.run.smithi019.stdout: "statfs_send": 0, 2024-03-08T06:04:50.958 INFO:teuthology.orchestra.run.smithi019.stdout: "statfs_resend": 0, 2024-03-08T06:04:50.958 INFO:teuthology.orchestra.run.smithi019.stdout: "command_active": 0, 2024-03-08T06:04:50.958 INFO:teuthology.orchestra.run.smithi019.stdout: "command_send": 0, 2024-03-08T06:04:50.958 INFO:teuthology.orchestra.run.smithi019.stdout: "command_resend": 0, 2024-03-08T06:04:50.958 INFO:teuthology.orchestra.run.smithi019.stdout: "map_epoch": 34, 2024-03-08T06:04:50.958 INFO:teuthology.orchestra.run.smithi019.stdout: "map_full": 0, 2024-03-08T06:04:50.958 INFO:teuthology.orchestra.run.smithi019.stdout: "map_inc": 1, 2024-03-08T06:04:50.958 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_sessions": 7, 2024-03-08T06:04:50.958 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_session_open": 7, 2024-03-08T06:04:50.958 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_session_close": 0, 2024-03-08T06:04:50.958 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_laggy": 0, 2024-03-08T06:04:50.958 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_wr": 15, 2024-03-08T06:04:50.959 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_rd": 0, 2024-03-08T06:04:50.959 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_del": 1 2024-03-08T06:04:50.959 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.959 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.959 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.959 INFO:teuthology.orchestra.run.smithi019.stdout: "oft": [ 2024-03-08T06:04:50.959 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.959 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.959 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.959 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_total_objs": 1, 2024-03-08T06:04:50.959 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_total_kv_pairs": 0, 2024-03-08T06:04:50.959 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_total_updates": 0, 2024-03-08T06:04:50.959 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_total_removes": 0 2024-03-08T06:04:50.959 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.959 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.960 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.960 INFO:teuthology.orchestra.run.smithi019.stdout: "osd-slow-ops": [ 2024-03-08T06:04:50.960 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.960 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.960 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.960 INFO:teuthology.orchestra.run.smithi019.stdout: "slow_ops_count": 0 2024-03-08T06:04:50.960 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.960 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.960 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.960 INFO:teuthology.orchestra.run.smithi019.stdout: "purge_queue": [ 2024-03-08T06:04:50.960 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.960 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.960 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.960 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executing_ops": 0, 2024-03-08T06:04:50.961 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executing_ops_high_water": 0, 2024-03-08T06:04:50.961 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executing": 0, 2024-03-08T06:04:50.961 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executing_high_water": 0, 2024-03-08T06:04:50.961 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executed_ops": 0, 2024-03-08T06:04:50.961 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executed": 0, 2024-03-08T06:04:50.961 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_item_in_journal": 0 2024-03-08T06:04:50.961 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.961 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.961 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.961 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-msgr_dispatch_throttler-mds": [ 2024-03-08T06:04:50.961 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.961 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.961 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.961 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-03-08T06:04:50.961 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 104857600, 2024-03-08T06:04:50.961 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-03-08T06:04:50.962 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 154, 2024-03-08T06:04:50.962 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 125002, 2024-03-08T06:04:50.962 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-03-08T06:04:50.962 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 154, 2024-03-08T06:04:50.962 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-03-08T06:04:50.962 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-03-08T06:04:50.962 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 154, 2024-03-08T06:04:50.962 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 125002, 2024-03-08T06:04:50.962 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-03-08T06:04:50.962 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.962 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.962 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.962 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.963 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.963 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.963 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.963 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-objecter_bytes": [ 2024-03-08T06:04:50.963 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.963 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.963 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.963 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-03-08T06:04:50.963 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 104857600, 2024-03-08T06:04:50.963 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-03-08T06:04:50.963 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 0, 2024-03-08T06:04:50.963 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 0, 2024-03-08T06:04:50.963 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-03-08T06:04:50.963 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 0, 2024-03-08T06:04:50.963 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 41, 2024-03-08T06:04:50.964 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 13563, 2024-03-08T06:04:50.964 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 41, 2024-03-08T06:04:50.964 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 13563, 2024-03-08T06:04:50.964 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-03-08T06:04:50.964 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.964 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.964 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.964 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.964 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.964 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.964 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.964 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-objecter_ops": [ 2024-03-08T06:04:50.964 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.964 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.964 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.965 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-03-08T06:04:50.965 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 1024, 2024-03-08T06:04:50.965 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-03-08T06:04:50.965 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 0, 2024-03-08T06:04:50.965 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 0, 2024-03-08T06:04:50.965 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-03-08T06:04:50.965 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 0, 2024-03-08T06:04:50.965 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 41, 2024-03-08T06:04:50.965 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 41, 2024-03-08T06:04:50.965 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 41, 2024-03-08T06:04:50.965 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 41, 2024-03-08T06:04:50.965 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-03-08T06:04:50.965 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.965 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.965 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.965 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.965 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.966 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.966 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.966 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-write_buf_throttle": [ 2024-03-08T06:04:50.966 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.966 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.966 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.966 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-03-08T06:04:50.966 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 3758096384, 2024-03-08T06:04:50.966 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-03-08T06:04:50.966 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 0, 2024-03-08T06:04:50.966 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 0, 2024-03-08T06:04:50.966 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-03-08T06:04:50.966 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 0, 2024-03-08T06:04:50.966 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-03-08T06:04:50.966 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-03-08T06:04:50.967 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 0, 2024-03-08T06:04:50.967 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 0, 2024-03-08T06:04:50.967 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-03-08T06:04:50.967 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.967 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.967 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.967 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.967 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.967 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.967 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:04:50.967 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-write_buf_throttle-0x5589c2a426e0": [ 2024-03-08T06:04:50.967 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:04:50.967 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:04:50.967 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:04:50.967 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-03-08T06:04:50.968 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 3758096384, 2024-03-08T06:04:50.968 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-03-08T06:04:50.968 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 6, 2024-03-08T06:04:50.968 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 2443, 2024-03-08T06:04:50.968 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-03-08T06:04:50.968 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 6, 2024-03-08T06:04:50.968 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-03-08T06:04:50.968 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-03-08T06:04:50.968 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 3, 2024-03-08T06:04:50.968 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 2443, 2024-03-08T06:04:50.968 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-03-08T06:04:50.968 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:04:50.968 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:04:50.968 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:04:50.968 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.969 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.969 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:04:50.969 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-03-08T06:04:50.969 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-08T06:04:50.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.911+0000 7fb4f7600640 1 -- 172.21.15.19:0/2439194362 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb4d006b670 msgr2=0x7fb4d006db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:50.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.911+0000 7fb4f7600640 1 --2- 172.21.15.19:0/2439194362 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb4d006b670 0x7fb4d006db30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40016b0 tx=0x7fb4e4009040 comp rx=0 tx=0).stop 2024-03-08T06:04:50.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.911+0000 7fb4f7600640 1 -- 172.21.15.19:0/2439194362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4f01e8fd0 msgr2=0x7fb4f01e9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:04:50.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.911+0000 7fb4f7600640 1 --2- 172.21.15.19:0/2439194362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4f01e8fd0 0x7fb4f01e9450 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8000f80 tx=0x7fb4f006dfb0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.911+0000 7fb4f7600640 1 -- 172.21.15.19:0/2439194362 shutdown_connections 2024-03-08T06:04:50.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.911+0000 7fb4f7600640 1 --2- 172.21.15.19:0/2439194362 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fb4d006b670 0x7fb4d006db30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.911+0000 7fb4f7600640 1 --2- 172.21.15.19:0/2439194362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4f01e8fd0 0x7fb4f01e9450 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.911+0000 7fb4f7600640 1 --2- 172.21.15.19:0/2439194362 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fb4f01e7330 0x7fb4f00ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.911+0000 7fb4f7600640 1 --2- 172.21.15.19:0/2439194362 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb4d8004d40 0x7fb4f01375f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:04:50.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.911+0000 7fb4f7600640 1 -- 172.21.15.19:0/2439194362 >> 172.21.15.19:0/2439194362 conn(0x7fb4f006ae30 msgr2=0x7fb4f0160a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:04:50.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.911+0000 7fb4f7600640 1 -- 172.21.15.19:0/2439194362 shutdown_connections 2024-03-08T06:04:50.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:04:50.911+0000 7fb4f7600640 1 -- 172.21.15.19:0/2439194362 wait complete. 2024-03-08T06:04:50.971 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:04:50.972 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:04:51.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:51.030 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-08T06:04:51.088 INFO:teuthology.orchestra.run.smithi019.stdout:client4646 2024-03-08T06:04:51.089 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:04:51.089 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:04:51.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:04:51.151 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-08T06:04:51.213 INFO:teuthology.orchestra.run.smithi042.stdout:client4655 2024-03-08T06:04:51.213 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:04:51.214 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:04:51.274 DEBUG:teuthology.orchestra.run.smithi019:> stdin-killer -- python3 -c ' 2024-03-08T06:04:51.275 DEBUG:teuthology.orchestra.run.smithi019:> import os 2024-03-08T06:04:51.275 DEBUG:teuthology.orchestra.run.smithi019:> import uuid 2024-03-08T06:04:51.275 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-08T06:04:51.275 DEBUG:teuthology.orchestra.run.smithi019:> n = 1000 2024-03-08T06:04:51.275 DEBUG:teuthology.orchestra.run.smithi019:> create_hard_links = False 2024-03-08T06:04:51.275 DEBUG:teuthology.orchestra.run.smithi019:> if 0 > 0: 2024-03-08T06:04:51.275 DEBUG:teuthology.orchestra.run.smithi019:> create_hard_links = True 2024-03-08T06:04:51.275 DEBUG:teuthology.orchestra.run.smithi019:> path = "/home/ubuntu/cephtest/mnt.0/test_dir/test_file" 2024-03-08T06:04:51.275 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-08T06:04:51.275 DEBUG:teuthology.orchestra.run.smithi019:> dpath = os.path.dirname(path) 2024-03-08T06:04:51.275 DEBUG:teuthology.orchestra.run.smithi019:> fnameprefix = os.path.basename(path) 2024-03-08T06:04:51.275 DEBUG:teuthology.orchestra.run.smithi019:> os.makedirs(dpath, exist_ok=True) 2024-03-08T06:04:51.275 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-08T06:04:51.275 DEBUG:teuthology.orchestra.run.smithi019:> try: 2024-03-08T06:04:51.275 DEBUG:teuthology.orchestra.run.smithi019:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-03-08T06:04:51.275 DEBUG:teuthology.orchestra.run.smithi019:> 2024-03-08T06:04:51.275 DEBUG:teuthology.orchestra.run.smithi019:> for i in range(n): 2024-03-08T06:04:51.276 DEBUG:teuthology.orchestra.run.smithi019:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-03-08T06:04:51.276 DEBUG:teuthology.orchestra.run.smithi019:> with open(fpath, '"'"'w'"'"') as f: 2024-03-08T06:04:51.276 DEBUG:teuthology.orchestra.run.smithi019:> f.write(f"{i}") 2024-03-08T06:04:51.276 DEBUG:teuthology.orchestra.run.smithi019:> if True: 2024-03-08T06:04:51.276 DEBUG:teuthology.orchestra.run.smithi019:> f.flush() 2024-03-08T06:04:51.276 DEBUG:teuthology.orchestra.run.smithi019:> os.fsync(f.fileno()) 2024-03-08T06:04:51.276 DEBUG:teuthology.orchestra.run.smithi019:> if False: 2024-03-08T06:04:51.276 DEBUG:teuthology.orchestra.run.smithi019:> os.unlink(fpath) 2024-03-08T06:04:51.276 DEBUG:teuthology.orchestra.run.smithi019:> if False: 2024-03-08T06:04:51.276 DEBUG:teuthology.orchestra.run.smithi019:> os.fsync(dirfd) 2024-03-08T06:04:51.276 DEBUG:teuthology.orchestra.run.smithi019:> if create_hard_links: 2024-03-08T06:04:51.276 DEBUG:teuthology.orchestra.run.smithi019:> for j in range(0): 2024-03-08T06:04:51.276 DEBUG:teuthology.orchestra.run.smithi019:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-03-08T06:04:51.276 DEBUG:teuthology.orchestra.run.smithi019:> if False: 2024-03-08T06:04:51.276 DEBUG:teuthology.orchestra.run.smithi019:> os.fsync(dirfd) 2024-03-08T06:04:51.276 DEBUG:teuthology.orchestra.run.smithi019:> finally: 2024-03-08T06:04:51.276 DEBUG:teuthology.orchestra.run.smithi019:> os.close(dirfd) 2024-03-08T06:04:51.277 DEBUG:teuthology.orchestra.run.smithi019:> ' 2024-03-08T06:05:01.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-08T06:05:01.251 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-03-08T06:05:01.252 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 counter dump 2024-03-08T06:05:01.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.524+0000 7f371aa00640 1 Processor -- start 2024-03-08T06:05:01.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.524+0000 7f371aa00640 1 -- start start 2024-03-08T06:05:01.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.526+0000 7f371aa00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3714147040 0x7f371415e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:01.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.526+0000 7f371aa00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37140716e0 0x7f3714071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:01.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.526+0000 7f371aa00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371415e840 con 0x7f37140b2970 2024-03-08T06:05:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.526+0000 7f371aa00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f371415eb20 con 0x7f37140716e0 2024-03-08T06:05:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.526+0000 7f371aa00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371415ee00 con 0x7f3714147040 2024-03-08T06:05:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.527+0000 7f371a000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37140716e0 0x7f3714071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.527+0000 7f371a000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37140716e0 0x7f3714071b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58776/0 (socket says 172.21.15.19:58776) 2024-03-08T06:05:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.527+0000 7f371a000640 1 -- 172.21.15.19:0/2277051484 learned_addr learned my addr 172.21.15.19:0/2277051484 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.527+0000 7f3719600640 1 --2- 172.21.15.19:0/2277051484 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3714147040 0x7f371415e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.527+0000 7f371a000640 1 -- 172.21.15.19:0/2277051484 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3714147040 msgr2=0x7f371415e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.527+0000 7f371a000640 1 --2- 172.21.15.19:0/2277051484 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3714147040 0x7f371415e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.527+0000 7f371a000640 1 -- 172.21.15.19:0/2277051484 >> v1:172.21.15.19:6789/0 conn(0x7f37140b2970 legacy=0x7f371406e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.527+0000 7f371a000640 1 -- 172.21.15.19:0/2277051484 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37140ae0d0 con 0x7f37140716e0 2024-03-08T06:05:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.527+0000 7f3713e00640 1 -- 172.21.15.19:0/2277051484 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590020002 0 0) 0x7f371415e840 con 0x7f37140b2970 2024-03-08T06:05:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.529+0000 7f371a000640 1 --2- 172.21.15.19:0/2277051484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37140716e0 0x7f3714071b70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f370c009870 tx=0x7f370c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ead7dfb85a07b18 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.529+0000 7f3713e00640 1 -- 172.21.15.19:0/2277051484 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c034070 con 0x7f37140716e0 2024-03-08T06:05:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.529+0000 7f3713e00640 1 -- 172.21.15.19:0/2277051484 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c030840 con 0x7f37140716e0 2024-03-08T06:05:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.529+0000 7f3713e00640 1 -- 172.21.15.19:0/2277051484 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c030c10 con 0x7f37140716e0 2024-03-08T06:05:01.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.530+0000 7f371aa00640 1 -- 172.21.15.19:0/2277051484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37140716e0 msgr2=0x7f3714071b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:01.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.530+0000 7f371aa00640 1 --2- 172.21.15.19:0/2277051484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37140716e0 0x7f3714071b70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f370c009870 tx=0x7f370c02b980 comp rx=0 tx=0).stop 2024-03-08T06:05:01.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.530+0000 7f371aa00640 1 -- 172.21.15.19:0/2277051484 shutdown_connections 2024-03-08T06:05:01.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.530+0000 7f371aa00640 1 --2- 172.21.15.19:0/2277051484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37140716e0 0x7f3714071b70 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.530+0000 7f371aa00640 1 --2- 172.21.15.19:0/2277051484 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3714147040 0x7f371415e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.530+0000 7f371aa00640 1 -- 172.21.15.19:0/2277051484 >> 172.21.15.19:0/2277051484 conn(0x7f37140b1850 msgr2=0x7f37140b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:01.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.530+0000 7f371aa00640 1 -- 172.21.15.19:0/2277051484 shutdown_connections 2024-03-08T06:05:01.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.530+0000 7f371aa00640 1 -- 172.21.15.19:0/2277051484 wait complete. 2024-03-08T06:05:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.532+0000 7f371aa00640 1 Processor -- start 2024-03-08T06:05:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.532+0000 7f371aa00640 1 -- start start 2024-03-08T06:05:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.533+0000 7f371aa00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f37140716e0 0x7f37140c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.533+0000 7f371aa00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37140b2970 0x7f37140c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.533+0000 7f371aa00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3714147040 0x7f3714142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.533+0000 7f371aa00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37140ae770 con 0x7f3714147040 2024-03-08T06:05:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.533+0000 7f371aa00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37140ae5f0 con 0x7f37140b2970 2024-03-08T06:05:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.533+0000 7f371aa00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37140ae8f0 con 0x7f37140716e0 2024-03-08T06:05:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.533+0000 7f371a000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3714147040 0x7f3714142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.533+0000 7f371a000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3714147040 0x7f3714142120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58788/0 (socket says 172.21.15.19:58788) 2024-03-08T06:05:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.533+0000 7f371a000640 1 -- 172.21.15.19:0/4055348315 learned_addr learned my addr 172.21.15.19:0/4055348315 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:01.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.534+0000 7f3718c00640 1 --2- 172.21.15.19:0/4055348315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37140b2970 0x7f37140c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:01.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.534+0000 7f3719600640 1 --2- 172.21.15.19:0/4055348315 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f37140716e0 0x7f37140c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:01.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.534+0000 7f371a000640 1 -- 172.21.15.19:0/4055348315 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f37140716e0 msgr2=0x7f37140c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:01.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.534+0000 7f371a000640 1 --2- 172.21.15.19:0/4055348315 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f37140716e0 0x7f37140c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.534+0000 7f371a000640 1 -- 172.21.15.19:0/4055348315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37140b2970 msgr2=0x7f37140c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:01.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.534+0000 7f371a000640 1 --2- 172.21.15.19:0/4055348315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37140b2970 0x7f37140c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.534+0000 7f371a000640 1 -- 172.21.15.19:0/4055348315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3714142660 con 0x7f3714147040 2024-03-08T06:05:01.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.534+0000 7f371a000640 1 --2- 172.21.15.19:0/4055348315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3714147040 0x7f3714142120 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f370c02b9c0 tx=0x7f370c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:01.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.535+0000 7f3711600640 1 -- 172.21.15.19:0/4055348315 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c048070 con 0x7f3714147040 2024-03-08T06:05:01.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.535+0000 7f3711600640 1 -- 172.21.15.19:0/4055348315 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c030640 con 0x7f3714147040 2024-03-08T06:05:01.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.535+0000 7f3711600640 1 -- 172.21.15.19:0/4055348315 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c034040 con 0x7f3714147040 2024-03-08T06:05:01.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.535+0000 7f371aa00640 1 -- 172.21.15.19:0/4055348315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37140c5050 con 0x7f3714147040 2024-03-08T06:05:01.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.535+0000 7f371aa00640 1 -- 172.21.15.19:0/4055348315 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37140c5610 con 0x7f3714147040 2024-03-08T06:05:01.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.537+0000 7f3711600640 1 -- 172.21.15.19:0/4055348315 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f370c037070 con 0x7f3714147040 2024-03-08T06:05:01.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.538+0000 7f3711600640 1 --2- 172.21.15.19:0/4055348315 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f36f406b4d0 0x7f36f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:01.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.539+0000 7f3711600640 1 -- 172.21.15.19:0/4055348315 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f370c0abec0 con 0x7f3714147040 2024-03-08T06:05:01.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.539+0000 7f3719600640 1 --2- 172.21.15.19:0/4055348315 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f36f406b4d0 0x7f36f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:01.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.539+0000 7f371ee10740 1 Processor -- start 2024-03-08T06:05:01.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.539+0000 7f371ee10740 1 -- start start 2024-03-08T06:05:01.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.540+0000 7f3719600640 1 --2- 172.21.15.19:0/4055348315 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f36f406b4d0 0x7f36f406d990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f37141430d0 tx=0x7f370800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:01.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.540+0000 7f371ee10740 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55a1edaa1f20 0x55a1eda74ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:01.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.540+0000 7f371ee10740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1edaa2300 0x55a1edaa4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:01.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.540+0000 7f371ee10740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1eda75400 0x55a1edaa51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:01.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.540+0000 7f371ee10740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1ed9ded60 con 0x55a1edaa2300 2024-03-08T06:05:01.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.540+0000 7f371ee10740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1ed987cf0 con 0x55a1eda75400 2024-03-08T06:05:01.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.540+0000 7f371ee10740 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a1ed9dae00 con 0x55a1edaa1f20 2024-03-08T06:05:01.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.540+0000 7f3718c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1edaa2300 0x55a1edaa4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:01.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.541+0000 7f3718c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1edaa2300 0x55a1edaa4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58798/0 (socket says 172.21.15.19:58798) 2024-03-08T06:05:01.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.541+0000 7f3718c00640 1 -- 172.21.15.19:0/1468107426 learned_addr learned my addr 172.21.15.19:0/1468107426 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:01.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.541+0000 7f371a000640 1 --2- 172.21.15.19:0/1468107426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1eda75400 0x55a1edaa51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:01.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.541+0000 7f3719600640 1 --2- 172.21.15.19:0/1468107426 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55a1edaa1f20 0x55a1eda74ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:01.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.541+0000 7f3718c00640 1 -- 172.21.15.19:0/1468107426 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55a1edaa1f20 msgr2=0x55a1eda74ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:01.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.541+0000 7f3718c00640 1 --2- 172.21.15.19:0/1468107426 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55a1edaa1f20 0x55a1eda74ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.541+0000 7f3718c00640 1 -- 172.21.15.19:0/1468107426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1eda75400 msgr2=0x55a1edaa51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:01.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.541+0000 7f3718c00640 1 --2- 172.21.15.19:0/1468107426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1eda75400 0x55a1edaa51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.541+0000 7f3718c00640 1 -- 172.21.15.19:0/1468107426 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1ed6f33f0 con 0x55a1edaa2300 2024-03-08T06:05:01.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.541+0000 7f371a000640 1 --2- 172.21.15.19:0/1468107426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1eda75400 0x55a1edaa51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:01.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.541+0000 7f3718c00640 1 --2- 172.21.15.19:0/1468107426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1edaa2300 0x55a1edaa4cb0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f37000015c0 tx=0x7f3700001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e34c7f71da10cd server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:01.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.542+0000 7f3705c00640 1 -- 172.21.15.19:0/1468107426 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3700019070 con 0x55a1edaa2300 2024-03-08T06:05:01.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.542+0000 7f3705c00640 1 -- 172.21.15.19:0/1468107426 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37000050d0 con 0x55a1edaa2300 2024-03-08T06:05:01.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.542+0000 7f3705c00640 1 -- 172.21.15.19:0/1468107426 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370000e6e0 con 0x55a1edaa2300 2024-03-08T06:05:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.542+0000 7f371ee10740 1 -- 172.21.15.19:0/1468107426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1edaa2300 msgr2=0x55a1edaa4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.542+0000 7f371ee10740 1 --2- 172.21.15.19:0/1468107426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1edaa2300 0x55a1edaa4cb0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f37000015c0 tx=0x7f3700001a80 comp rx=0 tx=0).stop 2024-03-08T06:05:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.542+0000 7f371ee10740 1 -- 172.21.15.19:0/1468107426 shutdown_connections 2024-03-08T06:05:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.542+0000 7f371ee10740 1 --2- 172.21.15.19:0/1468107426 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1eda75400 0x55a1edaa51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.542+0000 7f371ee10740 1 --2- 172.21.15.19:0/1468107426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1edaa2300 0x55a1edaa4cb0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.542+0000 7f371ee10740 1 --2- 172.21.15.19:0/1468107426 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55a1edaa1f20 0x55a1eda74ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.542+0000 7f371ee10740 1 -- 172.21.15.19:0/1468107426 >> 172.21.15.19:0/1468107426 conn(0x55a1eda77130 msgr2=0x55a1edabfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.542+0000 7f371ee10740 1 -- 172.21.15.19:0/1468107426 shutdown_connections 2024-03-08T06:05:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.543+0000 7f371ee10740 1 -- 172.21.15.19:0/1468107426 wait complete. 2024-03-08T06:05:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.543+0000 7f371ee10740 1 -- start start 2024-03-08T06:05:01.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.543+0000 7f371ee10740 1 Processor -- start 2024-03-08T06:05:01.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.544+0000 7f371ee10740 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55a1edaa1f20 0x55a1edad0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:01.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.544+0000 7f371ee10740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1edaa2300 0x55a1eda9a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:01.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.544+0000 7f371ee10740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1eda9d080 0x55a1eda9acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:01.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.544+0000 7f371ee10740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1eda797d0 con 0x55a1eda9d080 2024-03-08T06:05:01.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.544+0000 7f371ee10740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1ed97d220 con 0x55a1edaa2300 2024-03-08T06:05:01.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.544+0000 7f371ee10740 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a1eda7c010 con 0x55a1edaa1f20 2024-03-08T06:05:01.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.545+0000 7f371ee10740 10 client.0 _ll_register_callbacks cb 0x55a1ed6f2be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-08T06:05:01.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.545+0000 7f371a000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1eda9d080 0x55a1eda9acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:01.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.545+0000 7f371a000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1eda9d080 0x55a1eda9acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58800/0 (socket says 172.21.15.19:58800) 2024-03-08T06:05:01.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.545+0000 7f371a000640 1 -- 172.21.15.19:0/1754025385 learned_addr learned my addr 172.21.15.19:0/1754025385 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.545+0000 7f3719600640 1 --2- 172.21.15.19:0/1754025385 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55a1edaa1f20 0x55a1edad0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.545+0000 7f371a000640 1 -- 172.21.15.19:0/1754025385 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55a1edaa1f20 msgr2=0x55a1edad0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.545+0000 7f371a000640 1 --2- 172.21.15.19:0/1754025385 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55a1edaa1f20 0x55a1edad0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.545+0000 7f371a000640 1 -- 172.21.15.19:0/1754025385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1edaa2300 msgr2=0x55a1eda9a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.545+0000 7f371a000640 1 --2- 172.21.15.19:0/1754025385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1edaa2300 0x55a1eda9a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.545+0000 7f371a000640 1 -- 172.21.15.19:0/1754025385 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a1ed7bd7d0 con 0x55a1eda9d080 2024-03-08T06:05:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.545+0000 7f371a000640 1 --2- 172.21.15.19:0/1754025385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1eda9d080 0x55a1eda9acc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f370c02bf10 tx=0x7f370c07adc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9373d18863b5cdc0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.545+0000 7f36fa000640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-03-08T06:05:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.546+0000 7f36fa000640 1 -- 172.21.15.19:0/1754025385 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c07e810 con 0x55a1eda9d080 2024-03-08T06:05:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.546+0000 7f36fa000640 1 -- 172.21.15.19:0/1754025385 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f370c08fd30 con 0x55a1eda9d080 2024-03-08T06:05:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.546+0000 7f371ee10740 1 -- 172.21.15.19:0/1754025385 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f37000050d0 con 0x55a1eda9d080 2024-03-08T06:05:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.546+0000 7f36fa000640 1 -- 172.21.15.19:0/1754025385 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f370c082dd0 con 0x55a1eda9d080 2024-03-08T06:05:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.546+0000 7f371ee10740 10 client.5274 fetch_fsmap learned FSMap version 16 2024-03-08T06:05:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.546+0000 7f371ee10740 1 -- 172.21.15.19:0/1754025385 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55a1eda9db40 con 0x55a1eda9d080 2024-03-08T06:05:01.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.547+0000 7f36fa000640 1 -- 172.21.15.19:0/1754025385 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37000050d0 con 0x55a1eda9d080 2024-03-08T06:05:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.547+0000 7f36fa000640 1 -- 172.21.15.19:0/1754025385 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f370c042070 con 0x55a1eda9d080 2024-03-08T06:05:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.547+0000 7f371ee10740 10 client.5274 fetch_fsmap finished waiting for FSMap version 16 2024-03-08T06:05:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.547+0000 7f371ee10740 10 client.5274 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-03-08T06:05:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.547+0000 7f371ee10740 20 client.5274 populate_metadata read hostname 'smithi019' 2024-03-08T06:05:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.547+0000 7f371ee10740 1 --2- 172.21.15.19:0/1754025385 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55a1edad3b30 0x55a1edad3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.547+0000 7f371ee10740 4 client.5274 mds_command: new command op to 5028 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-08T06:05:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.547+0000 7f371ee10740 1 -- 172.21.15.19:0/1754025385 --> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a1ed9ec2a0 con 0x55a1edad3b30 2024-03-08T06:05:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.547+0000 7f3719600640 1 --2- 172.21.15.19:0/1754025385 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55a1edad3b30 0x55a1edad3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:01.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.548+0000 7f3719600640 1 --2- 172.21.15.19:0/1754025385 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55a1edad3b30 0x55a1edad3f10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7db6c6aade80b7a0 server_cookie=4022ce12d984513b in_seq=0 out_seq=0 2024-03-08T06:05:01.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.548+0000 7f36fa000640 10 client.5274 ms_handle_connect on v2:172.21.15.19:6836/1359509141 2024-03-08T06:05:01.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.548+0000 7f36fa000640 1 -- 172.21.15.19:0/1754025385 <== mds.0 v2:172.21.15.19:6836/1359509141 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a1ed9ec2a0 con 0x55a1edad3b30 2024-03-08T06:05:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.548+0000 7f36fa000640 10 client.5274 handle_command_reply: tid=0 2024-03-08T06:05:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.548+0000 7f371ee10740 1 client.5274 shutdown 2024-03-08T06:05:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.549+0000 7f371ee10740 1 -- 172.21.15.19:0/1754025385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1eda9d080 msgr2=0x55a1eda9acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.549+0000 7f371ee10740 1 --2- 172.21.15.19:0/1754025385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1eda9d080 0x55a1eda9acc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f370c02bf10 tx=0x7f370c07adc0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.549+0000 7f371ee10740 1 -- 172.21.15.19:0/1754025385 shutdown_connections 2024-03-08T06:05:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.549+0000 7f371ee10740 1 --2- 172.21.15.19:0/1754025385 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55a1edad3b30 0x55a1edad3f10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.549+0000 7f371ee10740 1 --2- 172.21.15.19:0/1754025385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1eda9d080 0x55a1eda9acc0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.549+0000 7f371ee10740 1 --2- 172.21.15.19:0/1754025385 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1edaa2300 0x55a1eda9a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.549+0000 7f371ee10740 1 --2- 172.21.15.19:0/1754025385 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55a1edaa1f20 0x55a1edad0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.549+0000 7f371ee10740 1 -- 172.21.15.19:0/1754025385 >> 172.21.15.19:0/1754025385 conn(0x55a1eda75400 msgr2=0x55a1edac3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.549+0000 7f36fa000640 0 client.5274 ms_handle_reset on v2:172.21.15.19:6836/1359509141 2024-03-08T06:05:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.549+0000 7f371ee10740 1 -- 172.21.15.19:0/1754025385 shutdown_connections 2024-03-08T06:05:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.549+0000 7f371ee10740 1 -- 172.21.15.19:0/1754025385 wait complete. 2024-03-08T06:05:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.549+0000 7f371ee10740 20 client.5274 trim_cache size 0 max 16384 2024-03-08T06:05:01.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.562+0000 7f371ee10740 1 Processor -- start 2024-03-08T06:05:01.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.562+0000 7f371ee10740 1 -- start start 2024-03-08T06:05:01.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.563+0000 7f371ee10740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1eda9d080 0x55a1edad0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.563+0000 7f371ee10740 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55a1edaa1f20 0x55a1eda9bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.563+0000 7f371ee10740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1edaa2300 0x55a1eda9c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.563+0000 7f371ee10740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37141ffce0 con 0x55a1edaa2300 2024-03-08T06:05:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.563+0000 7f371ee10740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37140cc370 con 0x55a1eda9d080 2024-03-08T06:05:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.563+0000 7f371ee10740 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37140cb770 con 0x55a1edaa1f20 2024-03-08T06:05:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.563+0000 7f371a000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1edaa2300 0x55a1eda9c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.563+0000 7f371a000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1edaa2300 0x55a1eda9c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58810/0 (socket says 172.21.15.19:58810) 2024-03-08T06:05:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.563+0000 7f371a000640 1 -- 172.21.15.19:0/2702662282 learned_addr learned my addr 172.21.15.19:0/2702662282 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.564+0000 7f3719600640 1 --2- 172.21.15.19:0/2702662282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1eda9d080 0x55a1edad0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.564+0000 7f3718c00640 1 --2- 172.21.15.19:0/2702662282 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55a1edaa1f20 0x55a1eda9bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.564+0000 7f371a000640 1 -- 172.21.15.19:0/2702662282 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55a1edaa1f20 msgr2=0x55a1eda9bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.564+0000 7f371a000640 1 --2- 172.21.15.19:0/2702662282 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55a1edaa1f20 0x55a1eda9bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.564+0000 7f371a000640 1 -- 172.21.15.19:0/2702662282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1eda9d080 msgr2=0x55a1edad0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.564+0000 7f371a000640 1 --2- 172.21.15.19:0/2702662282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1eda9d080 0x55a1edad0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.564+0000 7f371a000640 1 -- 172.21.15.19:0/2702662282 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1eda76550 con 0x55a1edaa2300 2024-03-08T06:05:01.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.564+0000 7f371a000640 1 --2- 172.21.15.19:0/2702662282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1edaa2300 0x55a1eda9c240 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f370c039fd0 tx=0x7f370c044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7e28aaeb47f35e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.564+0000 7f3705200640 1 -- 172.21.15.19:0/2702662282 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c07e810 con 0x55a1edaa2300 2024-03-08T06:05:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.564+0000 7f3705200640 1 -- 172.21.15.19:0/2702662282 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c079b10 con 0x55a1edaa2300 2024-03-08T06:05:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.564+0000 7f3705200640 1 -- 172.21.15.19:0/2702662282 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c076410 con 0x55a1edaa2300 2024-03-08T06:05:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.565+0000 7f371ee10740 1 -- 172.21.15.19:0/2702662282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1edaa2300 msgr2=0x55a1eda9c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.565+0000 7f371ee10740 1 --2- 172.21.15.19:0/2702662282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1edaa2300 0x55a1eda9c240 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f370c039fd0 tx=0x7f370c044000 comp rx=0 tx=0).stop 2024-03-08T06:05:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.565+0000 7f371ee10740 1 -- 172.21.15.19:0/2702662282 shutdown_connections 2024-03-08T06:05:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.565+0000 7f371ee10740 1 --2- 172.21.15.19:0/2702662282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1edaa2300 0x55a1eda9c240 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.565+0000 7f371ee10740 1 --2- 172.21.15.19:0/2702662282 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55a1edaa1f20 0x55a1eda9bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.565+0000 7f371ee10740 1 --2- 172.21.15.19:0/2702662282 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1eda9d080 0x55a1edad0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.565+0000 7f371ee10740 1 -- 172.21.15.19:0/2702662282 >> 172.21.15.19:0/2702662282 conn(0x55a1eda75400 msgr2=0x55a1eda9a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.565+0000 7f371ee10740 1 -- 172.21.15.19:0/2702662282 shutdown_connections 2024-03-08T06:05:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.565+0000 7f371ee10740 1 -- 172.21.15.19:0/2702662282 wait complete. 2024-03-08T06:05:01.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.566+0000 7f371ee10740 1 -- start start 2024-03-08T06:05:01.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.566+0000 7f371ee10740 1 Processor -- start 2024-03-08T06:05:01.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.567+0000 7f371ee10740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1eda9d080 0x55a1edaa1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:01.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.567+0000 7f371ee10740 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55a1edaa1f20 0x55a1edac00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.567+0000 7f371ee10740 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1edaa2300 0x55a1eda9bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.567+0000 7f371ee10740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1eda9ab90 con 0x55a1eda9d080 2024-03-08T06:05:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.567+0000 7f371ee10740 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37140cbd70 con 0x55a1edaa2300 2024-03-08T06:05:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.567+0000 7f371ee10740 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a1eda7b390 con 0x55a1edaa1f20 2024-03-08T06:05:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.567+0000 7f371ee10740 10 client.0 _ll_register_callbacks cb 0x7f3700007d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-08T06:05:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.567+0000 7f3719600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1eda9d080 0x55a1edaa1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.567+0000 7f3719600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1eda9d080 0x55a1edaa1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58812/0 (socket says 172.21.15.19:58812) 2024-03-08T06:05:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.567+0000 7f3719600640 1 -- 172.21.15.19:0/1854917161 learned_addr learned my addr 172.21.15.19:0/1854917161 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.568+0000 7f3718c00640 1 --2- 172.21.15.19:0/1854917161 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55a1edaa1f20 0x55a1edac00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.568+0000 7f371a000640 1 --2- 172.21.15.19:0/1854917161 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1edaa2300 0x55a1eda9bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.568+0000 7f3719600640 1 -- 172.21.15.19:0/1854917161 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55a1edaa1f20 msgr2=0x55a1edac00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.568+0000 7f3719600640 1 --2- 172.21.15.19:0/1854917161 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55a1edaa1f20 0x55a1edac00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.568+0000 7f3719600640 1 -- 172.21.15.19:0/1854917161 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1edaa2300 msgr2=0x55a1eda9bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:01.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.568+0000 7f3719600640 1 --2- 172.21.15.19:0/1854917161 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1edaa2300 0x55a1eda9bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.568+0000 7f3719600640 1 -- 172.21.15.19:0/1854917161 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a1edb2af70 con 0x55a1eda9d080 2024-03-08T06:05:01.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.568+0000 7f3719600640 1 --2- 172.21.15.19:0/1854917161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1eda9d080 0x55a1edaa1170 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3708016a00 tx=0x7f3708004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe079ea554a15e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:01.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.568+0000 7f36fa000640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-03-08T06:05:01.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.568+0000 7f36fa000640 1 -- 172.21.15.19:0/1854917161 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708017bd0 con 0x55a1eda9d080 2024-03-08T06:05:01.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.568+0000 7f36fa000640 1 -- 172.21.15.19:0/1854917161 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3708017d70 con 0x55a1eda9d080 2024-03-08T06:05:01.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.568+0000 7f371ee10740 1 -- 172.21.15.19:0/1854917161 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f370c079b10 con 0x55a1eda9d080 2024-03-08T06:05:01.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.569+0000 7f36fa000640 1 -- 172.21.15.19:0/1854917161 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3708035050 con 0x55a1eda9d080 2024-03-08T06:05:01.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.569+0000 7f371ee10740 10 client.5280 fetch_fsmap learned FSMap version 16 2024-03-08T06:05:01.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.569+0000 7f371ee10740 1 -- 172.21.15.19:0/1854917161 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55a1edaa0360 con 0x55a1eda9d080 2024-03-08T06:05:01.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.569+0000 7f36fa000640 1 -- 172.21.15.19:0/1854917161 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c079b10 con 0x55a1eda9d080 2024-03-08T06:05:01.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.569+0000 7f36fa000640 1 -- 172.21.15.19:0/1854917161 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3708024ce0 con 0x55a1eda9d080 2024-03-08T06:05:01.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.569+0000 7f371ee10740 10 client.5280 fetch_fsmap finished waiting for FSMap version 16 2024-03-08T06:05:01.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.569+0000 7f371ee10740 10 client.5280 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-03-08T06:05:01.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.569+0000 7f371ee10740 20 client.5280 populate_metadata read hostname 'smithi019' 2024-03-08T06:05:01.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.569+0000 7f371ee10740 1 --2- 172.21.15.19:0/1854917161 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55a1eda9c160 0x55a1edaa6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:01.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.569+0000 7f371ee10740 4 client.5280 mds_command: new command op to 5028 tid=0 multi_id=0 [{"prefix": "counter dump"}] 2024-03-08T06:05:01.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.569+0000 7f371ee10740 1 -- 172.21.15.19:0/1854917161 --> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] -- command(tid 0: {"prefix": "counter dump"}) v1 -- 0x55a1ed9e65f0 con 0x55a1eda9c160 2024-03-08T06:05:01.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.569+0000 7f3718c00640 1 --2- 172.21.15.19:0/1854917161 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55a1eda9c160 0x55a1edaa6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:01.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.570+0000 7f3718c00640 1 --2- 172.21.15.19:0/1854917161 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55a1eda9c160 0x55a1edaa6df0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cde4f47bad5327d server_cookie=7114184af83f22ea in_seq=0 out_seq=0 2024-03-08T06:05:01.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.570+0000 7f36fa000640 10 client.5280 ms_handle_connect on v2:172.21.15.19:6836/1359509141 2024-03-08T06:05:01.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.571+0000 7f36fa000640 1 -- 172.21.15.19:0/1854917161 <== mds.0 v2:172.21.15.19:6836/1359509141 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+26929 (crc 0 0 0) 0x55a1ed9e65f0 con 0x55a1eda9c160 2024-03-08T06:05:01.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.571+0000 7f36fa000640 10 client.5280 handle_command_reply: tid=0 2024-03-08T06:05:01.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.571+0000 7f371ee10740 1 client.5280 shutdown 2024-03-08T06:05:01.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.571+0000 7f371ee10740 1 -- 172.21.15.19:0/1854917161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1eda9d080 msgr2=0x55a1edaa1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:01.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.571+0000 7f371ee10740 1 --2- 172.21.15.19:0/1854917161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1eda9d080 0x55a1edaa1170 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3708016a00 tx=0x7f3708004a40 comp rx=0 tx=0).stop 2024-03-08T06:05:01.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.571+0000 7f371ee10740 1 -- 172.21.15.19:0/1854917161 shutdown_connections 2024-03-08T06:05:01.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.571+0000 7f371ee10740 1 --2- 172.21.15.19:0/1854917161 >> [v2:172.21.15.19:6836/1359509141,v1:172.21.15.19:6837/1359509141] conn(0x55a1eda9c160 0x55a1edaa6df0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.571+0000 7f371ee10740 1 --2- 172.21.15.19:0/1854917161 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55a1edaa2300 0x55a1eda9bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.571+0000 7f371ee10740 1 --2- 172.21.15.19:0/1854917161 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x55a1edaa1f20 0x55a1edac00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.571+0000 7f371ee10740 1 --2- 172.21.15.19:0/1854917161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1eda9d080 0x55a1edaa1170 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.571+0000 7f36fa000640 0 client.5280 ms_handle_reset on v2:172.21.15.19:6836/1359509141 2024-03-08T06:05:01.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.571+0000 7f371ee10740 1 -- 172.21.15.19:0/1854917161 >> 172.21.15.19:0/1854917161 conn(0x55a1eda75400 msgr2=0x55a1edac28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:01.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.571+0000 7f371ee10740 1 -- 172.21.15.19:0/1854917161 shutdown_connections 2024-03-08T06:05:01.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.571+0000 7f371ee10740 1 -- 172.21.15.19:0/1854917161 wait complete. 2024-03-08T06:05:01.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.571+0000 7f371ee10740 20 client.5280 trim_cache size 0 max 16384 2024-03-08T06:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-08T06:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker": [ 2024-03-08T06:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": { 2024-03-08T06:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: "id": "0" 2024-03-08T06:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-08T06:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_connection_idle_timeouts": 0 2024-03-08T06:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": { 2024-03-08T06:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: "id": "1" 2024-03-08T06:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-08T06:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_connection_idle_timeouts": 0 2024-03-08T06:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": { 2024-03-08T06:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: "id": "2" 2024-03-08T06:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_connection_ready_timeouts": 0, 2024-03-08T06:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_connection_idle_timeouts": 0 2024-03-08T06:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-0": [ 2024-03-08T06:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 83, 2024-03-08T06:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 77, 2024-03-08T06:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 119247, 2024-03-08T06:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 150748, 2024-03-08T06:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 10, 2024-03-08T06:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 5, 2024-03-08T06:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.028980967, 2024-03-08T06:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.006787314, 2024-03-08T06:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.019920529, 2024-03-08T06:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.001744910, 2024-03-08T06:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-03-08T06:05:01.579 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 76, 2024-03-08T06:05:01.579 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.117831062, 2024-03-08T06:05:01.579 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.001550408 2024-03-08T06:05:01.579 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.579 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-03-08T06:05:01.579 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 4, 2024-03-08T06:05:01.579 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000587, 2024-03-08T06:05:01.579 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000146 2024-03-08T06:05:01.579 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.579 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 113888, 2024-03-08T06:05:01.579 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 14736 2024-03-08T06:05:01.579 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.579 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.579 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.579 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-1": [ 2024-03-08T06:05:01.579 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 3056, 2024-03-08T06:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 4047, 2024-03-08T06:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 862929, 2024-03-08T06:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 1921870, 2024-03-08T06:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 8, 2024-03-08T06:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 4, 2024-03-08T06:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 1.197573969, 2024-03-08T06:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.788677047, 2024-03-08T06:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.456113379, 2024-03-08T06:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.002006148, 2024-03-08T06:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-03-08T06:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 4046, 2024-03-08T06:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.402343793, 2024-03-08T06:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000099442 2024-03-08T06:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-03-08T06:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 5423, 2024-03-08T06:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.004680034, 2024-03-08T06:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000862 2024-03-08T06:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-08T06:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 97872 2024-03-08T06:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-2": [ 2024-03-08T06:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 1068, 2024-03-08T06:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 1047, 2024-03-08T06:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 268000, 2024-03-08T06:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 4550835, 2024-03-08T06:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 6, 2024-03-08T06:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 4, 2024-03-08T06:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.276704948, 2024-03-08T06:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.132842842, 2024-03-08T06:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.060973802, 2024-03-08T06:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.061203503, 2024-03-08T06:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-03-08T06:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 1046, 2024-03-08T06:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.559832826, 2024-03-08T06:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000535213 2024-03-08T06:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-03-08T06:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 35, 2024-03-08T06:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000011946, 2024-03-08T06:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000341 2024-03-08T06:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-03-08T06:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 448 2024-03-08T06:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: "cct": [ 2024-03-08T06:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: "total_workers": 1, 2024-03-08T06:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: "unhealthy_workers": 0 2024-03-08T06:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: "finisher-MDSRank": [ 2024-03-08T06:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: "queue_len": 0, 2024-03-08T06:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: "complete_latency": { 2024-03-08T06:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 2059, 2024-03-08T06:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 1.308961697, 2024-03-08T06:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000635726 2024-03-08T06:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: "finisher-PurgeQueue": [ 2024-03-08T06:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: "queue_len": 0, 2024-03-08T06:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: "complete_latency": { 2024-03-08T06:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 2, 2024-03-08T06:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000030751, 2024-03-08T06:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000015375 2024-03-08T06:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": [ 2024-03-08T06:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: "request": 1031, 2024-03-08T06:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "reply": 1031, 2024-03-08T06:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "reply_latency": { 2024-03-08T06:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 1031, 2024-03-08T06:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 1.661028918, 2024-03-08T06:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.001611085 2024-03-08T06:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "slow_reply": 0, 2024-03-08T06:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "forward": 0, 2024-03-08T06:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_fetch_complete": 0, 2024-03-08T06:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_fetch_keys": 0, 2024-03-08T06:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_commit": 12, 2024-03-08T06:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_split": 0, 2024-03-08T06:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_merge": 0, 2024-03-08T06:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes": 1011, 2024-03-08T06:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_top": 0, 2024-03-08T06:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_bottom": 1011, 2024-03-08T06:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_pin_tail": 0, 2024-03-08T06:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_pinned": 1011, 2024-03-08T06:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_expired": 0, 2024-03-08T06:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_with_caps": 1002, 2024-03-08T06:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": 1003, 2024-03-08T06:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "subtrees": 2, 2024-03-08T06:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse": 1061, 2024-03-08T06:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_hit": 1060, 2024-03-08T06:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_forward": 0, 2024-03-08T06:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_discover": 0, 2024-03-08T06:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_dir_fetch": 0, 2024-03-08T06:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_remote_ino": 0, 2024-03-08T06:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_lock": 0, 2024-03-08T06:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "load_cent": 0, 2024-03-08T06:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "q": 0, 2024-03-08T06:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "exported": 0, 2024-03-08T06:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "exported_inodes": 0, 2024-03-08T06:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "imported": 0, 2024-03-08T06:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "imported_inodes": 0, 2024-03-08T06:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "openino_dir_fetch": 0, 2024-03-08T06:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "openino_backtrace_fetch": 0, 2024-03-08T06:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "openino_peer_discover": 0, 2024-03-08T06:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "root_rfiles": 925, 2024-03-08T06:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "root_rbytes": 2662, 2024-03-08T06:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "root_rsnaps": 0, 2024-03-08T06:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_backtrace_fetch": 0, 2024-03-08T06:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_set_tag": 0, 2024-03-08T06:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_backtrace_repaired": 0, 2024-03-08T06:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_inotable_repaired": 0, 2024-03-08T06:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_dir_inodes": 0, 2024-03-08T06:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_dir_base_inodes": 0, 2024-03-08T06:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_dirfrag_rstats": 0, 2024-03-08T06:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_file_inodes": 0, 2024-03-08T06:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_inode_file_caps": 0, 2024-03-08T06:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_cap_op_revoke": 1, 2024-03-08T06:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_cap_op_grant": 1000, 2024-03-08T06:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_cap_op_trunc": 0, 2024-03-08T06:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-08T06:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-08T06:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_client_caps": 1001, 2024-03-08T06:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_client_caps_dirty": 1000, 2024-03-08T06:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_client_cap_release": 0, 2024-03-08T06:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: "process_request_cap_release": 3 2024-03-08T06:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache": [ 2024-03-08T06:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_update": 0, 2024-03-08T06:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_update_receipt": 0, 2024-03-08T06:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_try_discover": 0, 2024-03-08T06:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_send_discover": 0, 2024-03-08T06:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_handle_discover": 0, 2024-03-08T06:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "num_strays": 0, 2024-03-08T06:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "num_strays_delayed": 0, 2024-03-08T06:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "num_strays_enqueuing": 0, 2024-03-08T06:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "strays_created": 0, 2024-03-08T06:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "strays_enqueued": 0, 2024-03-08T06:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "strays_reintegrated": 0, 2024-03-08T06:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: "strays_migrated": 0, 2024-03-08T06:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: "num_recovering_processing": 0, 2024-03-08T06:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: "num_recovering_enqueued": 0, 2024-03-08T06:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: "num_recovering_prioritized": 0, 2024-03-08T06:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: "recovery_started": 0, 2024-03-08T06:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: "recovery_completed": 0, 2024-03-08T06:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_enqueue_scrub": 0, 2024-03-08T06:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_exportdir": 0, 2024-03-08T06:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_flush": 0, 2024-03-08T06:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_fragmentdir": 0, 2024-03-08T06:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_fragstats": 0, 2024-03-08T06:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_inodestats": 0 2024-03-08T06:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_client_metrics": [ 2024-03-08T06:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": { 2024-03-08T06:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-03-08T06:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: "id": "5028" 2024-03-08T06:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: "num_clients": 2 2024-03-08T06:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_client_metrics-cephfs": [ 2024-03-08T06:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": { 2024-03-08T06:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4646", 2024-03-08T06:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: "rank": "0" 2024-03-08T06:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "cap_hits": 8762, 2024-03-08T06:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "cap_miss": 19, 2024-03-08T06:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "avg_read_latency": 0.000000000, 2024-03-08T06:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "avg_write_latency": 0.000000000, 2024-03-08T06:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "avg_metadata_latency": 0.000000000, 2024-03-08T06:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_lease_hits": 874, 2024-03-08T06:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_lease_miss": 0, 2024-03-08T06:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "opened_files": 2, 2024-03-08T06:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "opened_inodes": 875, 2024-03-08T06:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "pinned_icaps": 875, 2024-03-08T06:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "total_inodes": 875, 2024-03-08T06:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "total_read_ops": 0, 2024-03-08T06:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "total_read_size": 0, 2024-03-08T06:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "total_write_ops": 872, 2024-03-08T06:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "total_write_size": 2506 2024-03-08T06:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": { 2024-03-08T06:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "client": "client.4655", 2024-03-08T06:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "rank": "0" 2024-03-08T06:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "cap_hits": 41, 2024-03-08T06:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "cap_miss": 0, 2024-03-08T06:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "avg_read_latency": 0.000000000, 2024-03-08T06:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "avg_write_latency": 0.000000000, 2024-03-08T06:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "avg_metadata_latency": 0.000000000, 2024-03-08T06:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_lease_hits": 0, 2024-03-08T06:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "dentry_lease_miss": 0, 2024-03-08T06:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "opened_files": 0, 2024-03-08T06:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "opened_inodes": 1, 2024-03-08T06:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: "pinned_icaps": 1, 2024-03-08T06:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: "total_inodes": 1, 2024-03-08T06:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: "total_read_ops": 0, 2024-03-08T06:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: "total_read_size": 0, 2024-03-08T06:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: "total_write_ops": 0, 2024-03-08T06:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: "total_write_size": 0 2024-03-08T06:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log": [ 2024-03-08T06:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: "evlrg": 0, 2024-03-08T06:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: "evadd": 2011, 2024-03-08T06:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: "evex": 0, 2024-03-08T06:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "evtrm": 0, 2024-03-08T06:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "ev": 2011, 2024-03-08T06:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "evexg": 0, 2024-03-08T06:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "evexd": 0, 2024-03-08T06:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "segadd": 4, 2024-03-08T06:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "segex": 0, 2024-03-08T06:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "segtrm": 0, 2024-03-08T06:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "seg": 4, 2024-03-08T06:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "segmjr": 2, 2024-03-08T06:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "segexg": 0, 2024-03-08T06:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "segexd": 0, 2024-03-08T06:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "expos": 4194304, 2024-03-08T06:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "wrpos": 8401849, 2024-03-08T06:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "rdpos": 0, 2024-03-08T06:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "jlat": { 2024-03-08T06:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 1007, 2024-03-08T06:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 4.957157011, 2024-03-08T06:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.004922698 2024-03-08T06:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: "replayed": 0 2024-03-08T06:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_mem": [ 2024-03-08T06:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: "ino": 1014, 2024-03-08T06:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: "ino+": 1014, 2024-03-08T06:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: "ino-": 0, 2024-03-08T06:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: "dir": 13, 2024-03-08T06:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: "dir+": 13, 2024-03-08T06:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: "dir-": 0, 2024-03-08T06:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: "dn": 1011, 2024-03-08T06:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: "dn+": 1011, 2024-03-08T06:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: "dn-": 0, 2024-03-08T06:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: "cap": 1003, 2024-03-08T06:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: "cap+": 1003, 2024-03-08T06:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: "cap-": 0, 2024-03-08T06:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: "rss": 53120, 2024-03-08T06:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: "heap": 215392 2024-03-08T06:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_server": [ 2024-03-08T06:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "dispatch_client_request": 1032, 2024-03-08T06:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "dispatch_server_request": 0, 2024-03-08T06:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_client_request": 1031, 2024-03-08T06:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_client_session": 1002, 2024-03-08T06:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_peer_request": 0, 2024-03-08T06:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "req_create_latency": { 2024-03-08T06:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 1000, 2024-03-08T06:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 1.645580871, 2024-03-08T06:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.001645580 2024-03-08T06:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "req_getattr_latency": { 2024-03-08T06:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 29, 2024-03-08T06:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.007910768, 2024-03-08T06:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000272785 2024-03-08T06:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: "req_getfilelock_latency": { 2024-03-08T06:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: "req_link_latency": { 2024-03-08T06:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookup_latency": { 2024-03-08T06:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookuphash_latency": { 2024-03-08T06:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookupino_latency": { 2024-03-08T06:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookupname_latency": { 2024-03-08T06:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookupparent_latency": { 2024-03-08T06:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookupsnap_latency": { 2024-03-08T06:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lssnap_latency": { 2024-03-08T06:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "req_mkdir_latency": { 2024-03-08T06:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 1, 2024-03-08T06:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.007145894, 2024-03-08T06:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.007145894 2024-03-08T06:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "req_mknod_latency": { 2024-03-08T06:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "req_mksnap_latency": { 2024-03-08T06:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "req_open_latency": { 2024-03-08T06:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: "req_readdir_latency": { 2024-03-08T06:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: "req_rename_latency": { 2024-03-08T06:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: "req_renamesnap_latency": { 2024-03-08T06:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "req_snapdiff_latency": { 2024-03-08T06:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "req_rmdir_latency": { 2024-03-08T06:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "req_rmsnap_latency": { 2024-03-08T06:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: "req_rmxattr_latency": { 2024-03-08T06:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: "req_setattr_latency": { 2024-03-08T06:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 1, 2024-03-08T06:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000391385, 2024-03-08T06:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000391385 2024-03-08T06:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: "req_setdirlayout_latency": { 2024-03-08T06:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: "req_setfilelock_latency": { 2024-03-08T06:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "req_setlayout_latency": { 2024-03-08T06:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "req_setxattr_latency": { 2024-03-08T06:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "req_symlink_latency": { 2024-03-08T06:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: "req_unlink_latency": { 2024-03-08T06:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: "cap_revoke_eviction": 0, 2024-03-08T06:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: "cap_acquisition_throttle": 0, 2024-03-08T06:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: "req_getvxattr_latency": { 2024-03-08T06:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_sessions": [ 2024-03-08T06:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: "session_count": 2, 2024-03-08T06:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: "session_add": 2, 2024-03-08T06:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: "session_remove": 0, 2024-03-08T06:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: "sessions_open": 2, 2024-03-08T06:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: "sessions_stale": 0, 2024-03-08T06:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: "total_load": 969, 2024-03-08T06:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: "average_load": 484, 2024-03-08T06:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: "avg_session_uptime": 17, 2024-03-08T06:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: "mdthresh_evicted": 0 2024-03-08T06:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "mempool": [ 2024-03-08T06:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_bytes": 0, 2024-03-08T06:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_items": 0, 2024-03-08T06:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_bytes": 0, 2024-03-08T06:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_items": 0, 2024-03-08T06:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_bytes": 0, 2024-03-08T06:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_items": 0, 2024-03-08T06:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-08T06:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_items": 0, 2024-03-08T06:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-08T06:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_items": 0, 2024-03-08T06:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_bytes": 0, 2024-03-08T06:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_items": 0, 2024-03-08T06:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-08T06:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_items": 0, 2024-03-08T06:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_bytes": 0, 2024-03-08T06:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_items": 0, 2024-03-08T06:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_bytes": 0, 2024-03-08T06:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_items": 0, 2024-03-08T06:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-08T06:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_items": 0, 2024-03-08T06:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-08T06:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_items": 0, 2024-03-08T06:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_bytes": 0, 2024-03-08T06:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_items": 0, 2024-03-08T06:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_bytes": 0, 2024-03-08T06:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_items": 0, 2024-03-08T06:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-08T06:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_items": 0, 2024-03-08T06:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_bytes": 0, 2024-03-08T06:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_items": 0, 2024-03-08T06:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_bytes": 0, 2024-03-08T06:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_items": 0, 2024-03-08T06:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_bytes": 0, 2024-03-08T06:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_items": 0, 2024-03-08T06:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_bytes": 0, 2024-03-08T06:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_items": 0, 2024-03-08T06:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_bytes": 283125, 2024-03-08T06:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_items": 659, 2024-03-08T06:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_bytes": 1760, 2024-03-08T06:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_items": 20, 2024-03-08T06:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bytes": 0, 2024-03-08T06:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_items": 0, 2024-03-08T06:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_bytes": 0, 2024-03-08T06:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_items": 0, 2024-03-08T06:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_bytes": 0, 2024-03-08T06:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_items": 0, 2024-03-08T06:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_bytes": 5312, 2024-03-08T06:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_items": 75, 2024-03-08T06:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_bytes": 0, 2024-03-08T06:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_items": 0, 2024-03-08T06:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_bytes": 0, 2024-03-08T06:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_items": 0, 2024-03-08T06:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_bytes": 1931498, 2024-03-08T06:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_items": 22071, 2024-03-08T06:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_bytes": 0, 2024-03-08T06:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_items": 0, 2024-03-08T06:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_bytes": 0, 2024-03-08T06:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_items": 0 2024-03-08T06:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter": [ 2024-03-08T06:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: "op_active": 0, 2024-03-08T06:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: "op_laggy": 0, 2024-03-08T06:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: "op_send": 1057, 2024-03-08T06:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: "op_send_bytes": 4283100, 2024-03-08T06:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: "op_resend": 37, 2024-03-08T06:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: "op_reply": 1057, 2024-03-08T06:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: "op_latency": { 2024-03-08T06:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 1057, 2024-03-08T06:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 6.367935980, 2024-03-08T06:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.006024537 2024-03-08T06:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "op_inflight": 0, 2024-03-08T06:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "oplen_avg": { 2024-03-08T06:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 1057, 2024-03-08T06:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 1091 2024-03-08T06:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-03-08T06:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "op": 1057, 2024-03-08T06:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "op_r": 0, 2024-03-08T06:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "op_w": 1057, 2024-03-08T06:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "op_rmw": 0, 2024-03-08T06:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "op_pg": 0, 2024-03-08T06:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_stat": 0, 2024-03-08T06:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_create": 11, 2024-03-08T06:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_read": 0, 2024-03-08T06:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_write": 1007, 2024-03-08T06:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_writefull": 8, 2024-03-08T06:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_writesame": 0, 2024-03-08T06:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_append": 0, 2024-03-08T06:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_zero": 0, 2024-03-08T06:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_truncate": 0, 2024-03-08T06:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_delete": 7, 2024-03-08T06:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_mapext": 0, 2024-03-08T06:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_sparse_read": 0, 2024-03-08T06:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_clonerange": 0, 2024-03-08T06:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_getxattr": 0, 2024-03-08T06:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_setxattr": 22, 2024-03-08T06:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_cmpxattr": 0, 2024-03-08T06:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_rmxattr": 0, 2024-03-08T06:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_resetxattrs": 0, 2024-03-08T06:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_call": 0, 2024-03-08T06:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_watch": 0, 2024-03-08T06:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_notify": 0, 2024-03-08T06:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_src_cmpxattr": 0, 2024-03-08T06:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_pgls": 0, 2024-03-08T06:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_pgls_filter": 0, 2024-03-08T06:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_other": 0, 2024-03-08T06:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "linger_active": 0, 2024-03-08T06:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "linger_send": 0, 2024-03-08T06:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "linger_resend": 0, 2024-03-08T06:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "linger_ping": 0, 2024-03-08T06:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "poolop_active": 0, 2024-03-08T06:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "poolop_send": 0, 2024-03-08T06:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "poolop_resend": 0, 2024-03-08T06:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "poolstat_active": 0, 2024-03-08T06:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "poolstat_send": 0, 2024-03-08T06:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "poolstat_resend": 0, 2024-03-08T06:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "statfs_active": 0, 2024-03-08T06:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "statfs_send": 0, 2024-03-08T06:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "statfs_resend": 0, 2024-03-08T06:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "command_active": 0, 2024-03-08T06:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "command_send": 0, 2024-03-08T06:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "command_resend": 0, 2024-03-08T06:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "map_epoch": 34, 2024-03-08T06:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "map_full": 0, 2024-03-08T06:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "map_inc": 1, 2024-03-08T06:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_sessions": 7, 2024-03-08T06:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_session_open": 7, 2024-03-08T06:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_session_close": 0, 2024-03-08T06:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_laggy": 0, 2024-03-08T06:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_wr": 35, 2024-03-08T06:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_rd": 0, 2024-03-08T06:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_del": 1 2024-03-08T06:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: "oft": [ 2024-03-08T06:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_total_objs": 1, 2024-03-08T06:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_total_kv_pairs": 0, 2024-03-08T06:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_total_updates": 0, 2024-03-08T06:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_total_removes": 0 2024-03-08T06:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: "osd-slow-ops": [ 2024-03-08T06:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: "slow_ops_count": 0 2024-03-08T06:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: "purge_queue": [ 2024-03-08T06:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executing_ops": 0, 2024-03-08T06:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executing_ops_high_water": 0, 2024-03-08T06:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executing": 0, 2024-03-08T06:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executing_high_water": 0, 2024-03-08T06:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executed_ops": 0, 2024-03-08T06:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executed": 0, 2024-03-08T06:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_item_in_journal": 0 2024-03-08T06:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-msgr_dispatch_throttler-mds": [ 2024-03-08T06:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-03-08T06:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 104857600, 2024-03-08T06:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-03-08T06:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 4203, 2024-03-08T06:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 867367, 2024-03-08T06:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-03-08T06:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 4203, 2024-03-08T06:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-03-08T06:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-03-08T06:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 4203, 2024-03-08T06:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 867367, 2024-03-08T06:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-03-08T06:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-objecter_bytes": [ 2024-03-08T06:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-03-08T06:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 104857600, 2024-03-08T06:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-03-08T06:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 0, 2024-03-08T06:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 0, 2024-03-08T06:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-03-08T06:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 0, 2024-03-08T06:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 1057, 2024-03-08T06:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 4283100, 2024-03-08T06:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 1057, 2024-03-08T06:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 4283100, 2024-03-08T06:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-03-08T06:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-objecter_ops": [ 2024-03-08T06:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-03-08T06:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 1024, 2024-03-08T06:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-03-08T06:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 0, 2024-03-08T06:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 0, 2024-03-08T06:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-03-08T06:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 0, 2024-03-08T06:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 1057, 2024-03-08T06:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 1057, 2024-03-08T06:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 1057, 2024-03-08T06:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 1057, 2024-03-08T06:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-03-08T06:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-write_buf_throttle": [ 2024-03-08T06:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-03-08T06:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 3758096384, 2024-03-08T06:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-03-08T06:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 0, 2024-03-08T06:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 0, 2024-03-08T06:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-03-08T06:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 0, 2024-03-08T06:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-03-08T06:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-03-08T06:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 0, 2024-03-08T06:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 0, 2024-03-08T06:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-03-08T06:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-03-08T06:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-write_buf_throttle-0x5589c2a426e0": [ 2024-03-08T06:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-03-08T06:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "labels": {}, 2024-03-08T06:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "counters": { 2024-03-08T06:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-03-08T06:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 3758096384, 2024-03-08T06:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-03-08T06:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 2011, 2024-03-08T06:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 4207545, 2024-03-08T06:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-03-08T06:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 2011, 2024-03-08T06:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-03-08T06:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-03-08T06:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 1007, 2024-03-08T06:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 4207545, 2024-03-08T06:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-03-08T06:05:01.628 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-03-08T06:05:01.628 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-03-08T06:05:01.628 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-03-08T06:05:01.628 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.628 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.628 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-03-08T06:05:01.628 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-03-08T06:05:01.628 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-08T06:05:01.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.572+0000 7f371aa00640 1 -- 172.21.15.19:0/4055348315 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f36f406b4d0 msgr2=0x7f36f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:01.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.572+0000 7f371aa00640 1 --2- 172.21.15.19:0/4055348315 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f36f406b4d0 0x7f36f406d990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f37141430d0 tx=0x7f370800b040 comp rx=0 tx=0).stop 2024-03-08T06:05:01.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.572+0000 7f371aa00640 1 -- 172.21.15.19:0/4055348315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3714147040 msgr2=0x7f3714142120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:01.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.572+0000 7f371aa00640 1 --2- 172.21.15.19:0/4055348315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3714147040 0x7f3714142120 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f370c02b9c0 tx=0x7f370c004730 comp rx=0 tx=0).stop 2024-03-08T06:05:01.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.572+0000 7f371aa00640 1 -- 172.21.15.19:0/4055348315 shutdown_connections 2024-03-08T06:05:01.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.572+0000 7f371aa00640 1 --2- 172.21.15.19:0/4055348315 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f36f406b4d0 0x7f36f406d990 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.572+0000 7f371aa00640 1 --2- 172.21.15.19:0/4055348315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3714147040 0x7f3714142120 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.572+0000 7f371aa00640 1 --2- 172.21.15.19:0/4055348315 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37140b2970 0x7f37140c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.572+0000 7f371aa00640 1 --2- 172.21.15.19:0/4055348315 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f37140716e0 0x7f37140c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:01.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.572+0000 7f371aa00640 1 -- 172.21.15.19:0/4055348315 >> 172.21.15.19:0/4055348315 conn(0x7f37140b1850 msgr2=0x7f371406ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:01.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.572+0000 7f371aa00640 1 -- 172.21.15.19:0/4055348315 shutdown_connections 2024-03-08T06:05:01.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:01.572+0000 7f371aa00640 1 -- 172.21.15.19:0/4055348315 wait complete. 2024-03-08T06:05:16.659 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T06:05:16.668 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T06:05:30.652 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-08T06:05:30.652 DEBUG:teuthology.orchestra.run.smithi019:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-08T06:05:30.772 DEBUG:teuthology.orchestra.run.smithi042:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-08T06:05:30.895 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-08T06:05:30.896 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:05:30.896 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:05:30.955 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:05:30.955 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:05:31.010 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:05:31.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.237+0000 7fe30f200640 1 Processor -- start 2024-03-08T06:05:31.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.238+0000 7fe30f200640 1 -- start start 2024-03-08T06:05:31.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.239+0000 7fe30f200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe31006ea40 0x7fe310165770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:31.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.239+0000 7fe30f200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3100cd020 con 0x7fe31015ed80 2024-03-08T06:05:31.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.239+0000 7fe30f200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3100cd300 con 0x7fe31015a770 2024-03-08T06:05:31.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.239+0000 7fe30f200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3100ccdd0 con 0x7fe31006ea40 2024-03-08T06:05:31.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.240+0000 7fe30e800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe31006ea40 0x7fe310165770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:31.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.240+0000 7fe305400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe31015ed80 0x7fe31006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35006/0 (socket says 172.21.15.19:35006) 2024-03-08T06:05:31.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.240+0000 7fe305400640 1 -- 172.21.15.19:0/3319009 learned_addr learned my addr 172.21.15.19:0/3319009 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:31.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.240+0000 7fe30e800640 1 -- 172.21.15.19:0/3319009 >> v1:172.21.15.42:6789/0 conn(0x7fe31015a770 legacy=0x7fe3100cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:31.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.240+0000 7fe30e800640 1 -- 172.21.15.19:0/3319009 >> v1:172.21.15.19:6789/0 conn(0x7fe31015ed80 legacy=0x7fe31006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:31.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.240+0000 7fe30e800640 1 -- 172.21.15.19:0/3319009 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31015e580 con 0x7fe31006ea40 2024-03-08T06:05:31.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.242+0000 7fe30e800640 1 --2- 172.21.15.19:0/3319009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe31006ea40 0x7fe310165770 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe3100ccf50 tx=0x7fe30802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afbe96c9546176 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:31.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.242+0000 7fe30d400640 1 -- 172.21.15.19:0/3319009 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308039070 con 0x7fe31006ea40 2024-03-08T06:05:31.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.242+0000 7fe30d400640 1 -- 172.21.15.19:0/3319009 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30802cc60 con 0x7fe31006ea40 2024-03-08T06:05:31.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.242+0000 7fe30d400640 1 -- 172.21.15.19:0/3319009 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308034660 con 0x7fe31006ea40 2024-03-08T06:05:31.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.242+0000 7fe30f200640 1 -- 172.21.15.19:0/3319009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe31006ea40 msgr2=0x7fe310165770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:31.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.242+0000 7fe30f200640 1 --2- 172.21.15.19:0/3319009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe31006ea40 0x7fe310165770 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe3100ccf50 tx=0x7fe30802beb0 comp rx=0 tx=0).stop 2024-03-08T06:05:31.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.243+0000 7fe30f200640 1 -- 172.21.15.19:0/3319009 shutdown_connections 2024-03-08T06:05:31.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.243+0000 7fe30f200640 1 --2- 172.21.15.19:0/3319009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe31006ea40 0x7fe310165770 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:31.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.243+0000 7fe30f200640 1 -- 172.21.15.19:0/3319009 >> 172.21.15.19:0/3319009 conn(0x7fe3100b1850 msgr2=0x7fe3100b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:31.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.243+0000 7fe30f200640 1 -- 172.21.15.19:0/3319009 shutdown_connections 2024-03-08T06:05:31.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.243+0000 7fe30f200640 1 -- 172.21.15.19:0/3319009 wait complete. 2024-03-08T06:05:31.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.244+0000 7fe30f200640 1 Processor -- start 2024-03-08T06:05:31.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.245+0000 7fe30f200640 1 -- start start 2024-03-08T06:05:31.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.245+0000 7fe30f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe31006ea40 0x7fe310155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:31.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.245+0000 7fe30f200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe31015a770 0x7fe310151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:31.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.245+0000 7fe30f200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe31015ed80 0x7fe310152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:31.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.245+0000 7fe30f200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3100b4e00 con 0x7fe31015ed80 2024-03-08T06:05:31.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.245+0000 7fe30f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31015e8f0 con 0x7fe31006ea40 2024-03-08T06:05:31.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.245+0000 7fe30f200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe310165cb0 con 0x7fe31015a770 2024-03-08T06:05:31.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.246+0000 7fe30e800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe31015ed80 0x7fe310152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:31.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.246+0000 7fe30e800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe31015ed80 0x7fe310152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45528/0 (socket says 172.21.15.19:45528) 2024-03-08T06:05:31.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.246+0000 7fe30e800640 1 -- 172.21.15.19:0/3859317603 learned_addr learned my addr 172.21.15.19:0/3859317603 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:31.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.246+0000 7fe30e800640 1 -- 172.21.15.19:0/3859317603 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe31015a770 msgr2=0x7fe310151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:31.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.246+0000 7fe30e800640 1 --2- 172.21.15.19:0/3859317603 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe31015a770 0x7fe310151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:31.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.246+0000 7fe30e800640 1 -- 172.21.15.19:0/3859317603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe31006ea40 msgr2=0x7fe310155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:31.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.246+0000 7fe30e800640 1 --2- 172.21.15.19:0/3859317603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe31006ea40 0x7fe310155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:31.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.246+0000 7fe30e800640 1 -- 172.21.15.19:0/3859317603 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3100b0b10 con 0x7fe31015ed80 2024-03-08T06:05:31.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.246+0000 7fe30e800640 1 --2- 172.21.15.19:0/3859317603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe31015ed80 0x7fe310152380 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe308037040 tx=0x7fe308004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:31.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.247+0000 7fe306a00640 1 -- 172.21.15.19:0/3859317603 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe308039050 con 0x7fe31015ed80 2024-03-08T06:05:31.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.247+0000 7fe306a00640 1 -- 172.21.15.19:0/3859317603 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe308045070 con 0x7fe31015ed80 2024-03-08T06:05:31.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.247+0000 7fe306a00640 1 -- 172.21.15.19:0/3859317603 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30803e810 con 0x7fe31015ed80 2024-03-08T06:05:31.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.247+0000 7fe30f200640 1 -- 172.21.15.19:0/3859317603 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3100ad5b0 con 0x7fe31015ed80 2024-03-08T06:05:31.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.247+0000 7fe30f200640 1 -- 172.21.15.19:0/3859317603 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3100adb70 con 0x7fe31015ed80 2024-03-08T06:05:31.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.248+0000 7fe30f200640 1 -- 172.21.15.19:0/3859317603 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe310075100 con 0x7fe31015ed80 2024-03-08T06:05:31.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.249+0000 7fe306a00640 1 -- 172.21.15.19:0/3859317603 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fe30803e9b0 con 0x7fe31015ed80 2024-03-08T06:05:31.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.250+0000 7fe306a00640 1 --2- 172.21.15.19:0/3859317603 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe2ec06b500 0x7fe2ec06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:31.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.250+0000 7fe306a00640 1 -- 172.21.15.19:0/3859317603 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3080acb30 con 0x7fe31015ed80 2024-03-08T06:05:31.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.250+0000 7fe30de00640 1 --2- 172.21.15.19:0/3859317603 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe2ec06b500 0x7fe2ec06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:31.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.251+0000 7fe30de00640 1 --2- 172.21.15.19:0/3859317603 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe2ec06b500 0x7fe2ec06d9c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe300003cc0 tx=0x7fe3000079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:31.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.257+0000 7fe306a00640 1 -- 172.21.15.19:0/3859317603 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe30804e020 con 0x7fe31015ed80 2024-03-08T06:05:31.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.456+0000 7fe30f200640 1 -- 172.21.15.19:0/3859317603 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3100aed90 con 0x7fe31015ed80 2024-03-08T06:05:31.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.458+0000 7fe306a00640 1 -- 172.21.15.19:0/3859317603 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16609 (secure 0 0 0) 0x7fe30807b910 con 0x7fe31015ed80 2024-03-08T06:05:31.459 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:05:31.459 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":34,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:04:31.685292+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:04:28.095112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-08T06:04:29.178532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:05:31.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.460+0000 7fe30f200640 1 -- 172.21.15.19:0/3859317603 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe2ec06b500 msgr2=0x7fe2ec06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:31.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.460+0000 7fe30f200640 1 --2- 172.21.15.19:0/3859317603 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe2ec06b500 0x7fe2ec06d9c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe300003cc0 tx=0x7fe3000079b0 comp rx=0 tx=0).stop 2024-03-08T06:05:31.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.460+0000 7fe30f200640 1 -- 172.21.15.19:0/3859317603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe31015ed80 msgr2=0x7fe310152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:31.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.460+0000 7fe30f200640 1 --2- 172.21.15.19:0/3859317603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe31015ed80 0x7fe310152380 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe308037040 tx=0x7fe308004a40 comp rx=0 tx=0).stop 2024-03-08T06:05:31.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.460+0000 7fe30f200640 1 -- 172.21.15.19:0/3859317603 shutdown_connections 2024-03-08T06:05:31.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.460+0000 7fe30f200640 1 --2- 172.21.15.19:0/3859317603 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fe2ec06b500 0x7fe2ec06d9c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:31.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.460+0000 7fe30f200640 1 --2- 172.21.15.19:0/3859317603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe31015ed80 0x7fe310152380 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:31.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.460+0000 7fe30f200640 1 --2- 172.21.15.19:0/3859317603 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fe31015a770 0x7fe310151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:31.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.460+0000 7fe30f200640 1 --2- 172.21.15.19:0/3859317603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe31006ea40 0x7fe310155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:31.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.460+0000 7fe30f200640 1 -- 172.21.15.19:0/3859317603 >> 172.21.15.19:0/3859317603 conn(0x7fe3100b1850 msgr2=0x7fe310159800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:31.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.461+0000 7fe30f200640 1 -- 172.21.15.19:0/3859317603 shutdown_connections 2024-03-08T06:05:31.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.461+0000 7fe30f200640 1 -- 172.21.15.19:0/3859317603 wait complete. 2024-03-08T06:05:31.482 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T06:03:14.149736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T06:04:28.095112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T06:04:29.178532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T06:05:31.482 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T06:05:31.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.702+0000 7f7042600640 1 Processor -- start 2024-03-08T06:05:31.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.703+0000 7f7042600640 1 -- start start 2024-03-08T06:05:31.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.704+0000 7f7042600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f703c15bfb0 0x7f703c0716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:31.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.705+0000 7f7042600640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703c15c460 con 0x7f703c145500 2024-03-08T06:05:31.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.705+0000 7f7042600640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703c15c740 con 0x7f703c071c20 2024-03-08T06:05:31.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.705+0000 7f7042600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703c072050 con 0x7f703c15bfb0 2024-03-08T06:05:31.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.705+0000 7f7041200640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f703c145500 0x7f703c06ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35022/0 (socket says 172.21.15.19:35022) 2024-03-08T06:05:31.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.705+0000 7f7041200640 1 -- 172.21.15.19:0/1948169954 learned_addr learned my addr 172.21.15.19:0/1948169954 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:31.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.705+0000 7f703be00640 1 --2- 172.21.15.19:0/1948169954 >> v2:172.21.15.42:3300/0 conn(0x7f703c15bfb0 0x7f703c0716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:31.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.705+0000 7f703b400640 1 -- 172.21.15.19:0/1948169954 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253456705 0 0) 0x7f703c15c460 con 0x7f703c145500 2024-03-08T06:05:31.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.705+0000 7f703b400640 1 -- 172.21.15.19:0/1948169954 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7024003520 con 0x7f703c145500 2024-03-08T06:05:31.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.706+0000 7f703b400640 1 -- 172.21.15.19:0/1948169954 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 964376833 0 0) 0x7f7024003520 con 0x7f703c145500 2024-03-08T06:05:31.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.706+0000 7f703b400640 1 -- 172.21.15.19:0/1948169954 >> v2:172.21.15.42:3300/0 conn(0x7f703c15bfb0 msgr2=0x7f703c0716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:31.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.706+0000 7f703b400640 1 --2- 172.21.15.19:0/1948169954 >> v2:172.21.15.42:3300/0 conn(0x7f703c15bfb0 0x7f703c0716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.706+0000 7f703b400640 1 -- 172.21.15.19:0/1948169954 >> v1:172.21.15.42:6789/0 conn(0x7f703c071c20 legacy=0x7f703c0cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.706+0000 7f703b400640 1 -- 172.21.15.19:0/1948169954 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c15ca20 con 0x7f703c145500 2024-03-08T06:05:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.706+0000 7f703b400640 1 -- 172.21.15.19:0/1948169954 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f7030001670 con 0x7f703c145500 2024-03-08T06:05:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.706+0000 7f703b400640 1 -- 172.21.15.19:0/1948169954 >> v1:172.21.15.19:6789/0 conn(0x7f703c145500 legacy=0x7f703c06ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.706+0000 7f703b400640 1 --2- 172.21.15.19:0/1948169954 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7024003a70 0x7f7024003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.706+0000 7f703b400640 1 --2- 172.21.15.19:0/1948169954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7024004800 0x7f7024004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.706+0000 7f703b400640 1 --2- 172.21.15.19:0/1948169954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70240052e0 0x7f702400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.706+0000 7f703b400640 1 -- 172.21.15.19:0/1948169954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c072050 con 0x7f70240052e0 2024-03-08T06:05:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.706+0000 7f703b400640 1 -- 172.21.15.19:0/1948169954 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702400c1b0 con 0x7f7024004800 2024-03-08T06:05:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.706+0000 7f703b400640 1 -- 172.21.15.19:0/1948169954 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702400c3b0 con 0x7f7024003a70 2024-03-08T06:05:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.706+0000 7f7041c00640 1 --2- 172.21.15.19:0/1948169954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70240052e0 0x7f702400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.707+0000 7f7041200640 1 --2- 172.21.15.19:0/1948169954 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7024003a70 0x7f7024003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:31.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.707+0000 7f703be00640 1 --2- 172.21.15.19:0/1948169954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7024004800 0x7f7024004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:31.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.707+0000 7f7041c00640 1 -- 172.21.15.19:0/1948169954 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7024003a70 msgr2=0x7f7024003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:31.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.707+0000 7f7041c00640 1 --2- 172.21.15.19:0/1948169954 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7024003a70 0x7f7024003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:31.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.707+0000 7f7041c00640 1 -- 172.21.15.19:0/1948169954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7024004800 msgr2=0x7f7024004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:31.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.707+0000 7f7041c00640 1 --2- 172.21.15.19:0/1948169954 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7024004800 0x7f7024004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:31.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.707+0000 7f7041c00640 1 -- 172.21.15.19:0/1948169954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7024003520 con 0x7f70240052e0 2024-03-08T06:05:31.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.707+0000 7f7041200640 1 --2- 172.21.15.19:0/1948169954 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7024003a70 0x7f7024003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:31.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.708+0000 7f7041c00640 1 -- 172.21.15.19:0/1948169954 reap_dead start 2024-03-08T06:05:31.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.708+0000 7f7041c00640 1 --2- 172.21.15.19:0/1948169954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70240052e0 0x7f702400b9c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7034001e50 tx=0x7f7024005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60dd2746ab08197b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:31.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.708+0000 7f703b400640 1 -- 172.21.15.19:0/1948169954 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034001a70 con 0x7f70240052e0 2024-03-08T06:05:31.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.708+0000 7f703b400640 1 -- 172.21.15.19:0/1948169954 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7034003bb0 con 0x7f70240052e0 2024-03-08T06:05:31.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.708+0000 7f703b400640 1 -- 172.21.15.19:0/1948169954 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70340050d0 con 0x7f70240052e0 2024-03-08T06:05:31.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.709+0000 7f7042600640 1 -- 172.21.15.19:0/1948169954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70240052e0 msgr2=0x7f702400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:31.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.709+0000 7f7042600640 1 --2- 172.21.15.19:0/1948169954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70240052e0 0x7f702400b9c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7034001e50 tx=0x7f7024005830 comp rx=0 tx=0).stop 2024-03-08T06:05:31.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.709+0000 7f7042600640 1 -- 172.21.15.19:0/1948169954 shutdown_connections 2024-03-08T06:05:31.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.709+0000 7f7042600640 1 --2- 172.21.15.19:0/1948169954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70240052e0 0x7f702400b9c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:31.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.709+0000 7f7042600640 1 -- 172.21.15.19:0/1948169954 >> 172.21.15.19:0/1948169954 conn(0x7f703c0b1850 msgr2=0x7f703c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:31.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.709+0000 7f7042600640 1 -- 172.21.15.19:0/1948169954 shutdown_connections 2024-03-08T06:05:31.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.709+0000 7f7042600640 1 -- 172.21.15.19:0/1948169954 wait complete. 2024-03-08T06:05:31.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.711+0000 7f7042600640 1 Processor -- start 2024-03-08T06:05:31.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.711+0000 7f7042600640 1 -- start start 2024-03-08T06:05:31.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.712+0000 7f7042600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70240052e0 0x7f703c0ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:31.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.712+0000 7f7042600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f703c0b31c0 0x7f703c0b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.712+0000 7f7042600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f703c0abd40 0x7f703c0ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.712+0000 7f7042600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c071860 con 0x7f70240052e0 2024-03-08T06:05:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.712+0000 7f7042600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0716e0 con 0x7f703c0abd40 2024-03-08T06:05:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.712+0000 7f7042600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703c0719e0 con 0x7f703c0b31c0 2024-03-08T06:05:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.712+0000 7f7041200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70240052e0 0x7f703c0ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.713+0000 7f7041200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70240052e0 0x7f703c0ae180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45540/0 (socket says 172.21.15.19:45540) 2024-03-08T06:05:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.713+0000 7f7041200640 1 -- 172.21.15.19:0/1060031876 learned_addr learned my addr 172.21.15.19:0/1060031876 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.713+0000 7f703be00640 1 --2- 172.21.15.19:0/1060031876 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f703c0b31c0 0x7f703c0b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.713+0000 7f7041c00640 1 --2- 172.21.15.19:0/1060031876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f703c0abd40 0x7f703c0ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.713+0000 7f7041200640 1 -- 172.21.15.19:0/1060031876 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f703c0b31c0 msgr2=0x7f703c0b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.713+0000 7f7041200640 1 --2- 172.21.15.19:0/1060031876 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f703c0b31c0 0x7f703c0b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.713+0000 7f7041200640 1 -- 172.21.15.19:0/1060031876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f703c0abd40 msgr2=0x7f703c0ac1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.713+0000 7f7041200640 1 --2- 172.21.15.19:0/1060031876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f703c0abd40 0x7f703c0ac1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.713+0000 7f7041200640 1 -- 172.21.15.19:0/1060031876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703c149fa0 con 0x7f70240052e0 2024-03-08T06:05:31.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.713+0000 7f703be00640 1 --2- 172.21.15.19:0/1060031876 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f703c0b31c0 0x7f703c0b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.713+0000 7f7041200640 1 --2- 172.21.15.19:0/1060031876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70240052e0 0x7f703c0ae180 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f703000d7a0 tx=0x7f703000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.714+0000 7f7038c00640 1 -- 172.21.15.19:0/1060031876 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030019070 con 0x7f70240052e0 2024-03-08T06:05:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.714+0000 7f7038c00640 1 -- 172.21.15.19:0/1060031876 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70300074e0 con 0x7f70240052e0 2024-03-08T06:05:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.714+0000 7f7042600640 1 -- 172.21.15.19:0/1060031876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703c14a280 con 0x7f70240052e0 2024-03-08T06:05:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.714+0000 7f7038c00640 1 -- 172.21.15.19:0/1060031876 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030004a20 con 0x7f70240052e0 2024-03-08T06:05:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.714+0000 7f7042600640 1 -- 172.21.15.19:0/1060031876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703c14a840 con 0x7f70240052e0 2024-03-08T06:05:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.715+0000 7f7042600640 1 -- 172.21.15.19:0/1060031876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703c075090 con 0x7f70240052e0 2024-03-08T06:05:31.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.717+0000 7f7038c00640 1 -- 172.21.15.19:0/1060031876 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f703001c070 con 0x7f70240052e0 2024-03-08T06:05:31.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.718+0000 7f7038c00640 1 --2- 172.21.15.19:0/1060031876 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f701c06b500 0x7f701c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:31.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.718+0000 7f7038c00640 1 -- 172.21.15.19:0/1060031876 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7030089cb0 con 0x7f70240052e0 2024-03-08T06:05:31.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.718+0000 7f703be00640 1 --2- 172.21.15.19:0/1060031876 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f701c06b500 0x7f701c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:31.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.719+0000 7f703be00640 1 --2- 172.21.15.19:0/1060031876 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f701c06b500 0x7f701c06d9c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f703c0b3f40 tx=0x7f7028008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:31.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.723+0000 7f7038c00640 1 -- 172.21.15.19:0/1060031876 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7030058a90 con 0x7f70240052e0 2024-03-08T06:05:31.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.928+0000 7f7042600640 1 -- 172.21.15.19:0/1060031876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f703c149ce0 con 0x7f70240052e0 2024-03-08T06:05:31.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.929+0000 7f7038c00640 1 -- 172.21.15.19:0/1060031876 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7030058390 con 0x7f70240052e0 2024-03-08T06:05:31.930 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-08T06:05:31.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.931+0000 7f7042600640 1 -- 172.21.15.19:0/1060031876 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f701c06b500 msgr2=0x7f701c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:31.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.931+0000 7f7042600640 1 --2- 172.21.15.19:0/1060031876 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f701c06b500 0x7f701c06d9c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f703c0b3f40 tx=0x7f7028008040 comp rx=0 tx=0).stop 2024-03-08T06:05:31.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.932+0000 7f7042600640 1 -- 172.21.15.19:0/1060031876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70240052e0 msgr2=0x7f703c0ae180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:31.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.932+0000 7f7042600640 1 --2- 172.21.15.19:0/1060031876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70240052e0 0x7f703c0ae180 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f703000d7a0 tx=0x7f703000dc60 comp rx=0 tx=0).stop 2024-03-08T06:05:31.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.932+0000 7f7042600640 1 -- 172.21.15.19:0/1060031876 shutdown_connections 2024-03-08T06:05:31.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.932+0000 7f7042600640 1 --2- 172.21.15.19:0/1060031876 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f701c06b500 0x7f701c06d9c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:31.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.932+0000 7f7042600640 1 --2- 172.21.15.19:0/1060031876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f703c0abd40 0x7f703c0ac1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:31.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.932+0000 7f7042600640 1 --2- 172.21.15.19:0/1060031876 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f703c0b31c0 0x7f703c0b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:31.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.932+0000 7f7042600640 1 --2- 172.21.15.19:0/1060031876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70240052e0 0x7f703c0ae180 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:31.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.932+0000 7f7042600640 1 -- 172.21.15.19:0/1060031876 >> 172.21.15.19:0/1060031876 conn(0x7f703c0b1850 msgr2=0x7f703c0cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:31.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.932+0000 7f7042600640 1 -- 172.21.15.19:0/1060031876 shutdown_connections 2024-03-08T06:05:31.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:31.932+0000 7f7042600640 1 -- 172.21.15.19:0/1060031876 wait complete. 2024-03-08T06:05:31.952 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T06:05:32.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.175+0000 7fa627200640 1 Processor -- start 2024-03-08T06:05:32.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.175+0000 7fa627200640 1 -- start start 2024-03-08T06:05:32.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.176+0000 7fa627200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa6280b42c0 0x7fa62806e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:32.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.176+0000 7fa627200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa62806e870 0x7fa62815e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:32.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.176+0000 7fa627200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6280cd3e0 con 0x7fa628144240 2024-03-08T06:05:32.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.176+0000 7fa627200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6280b3e30 con 0x7fa62806e870 2024-03-08T06:05:32.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.176+0000 7fa627200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280cd6c0 con 0x7fa6280b42c0 2024-03-08T06:05:32.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.177+0000 7fa625e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa628144240 0x7fa6280cc9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44480/0 (socket says 172.21.15.19:44480) 2024-03-08T06:05:32.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.177+0000 7fa625e00640 1 -- 172.21.15.19:0/3914053836 learned_addr learned my addr 172.21.15.19:0/3914053836 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:32.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.177+0000 7fa624a00640 1 -- 172.21.15.19:0/3914053836 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486434728 0 0) 0x7fa6280cd3e0 con 0x7fa628144240 2024-03-08T06:05:32.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.177+0000 7fa625400640 1 --2- 172.21.15.19:0/3914053836 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa6280b42c0 0x7fa62806e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:32.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.177+0000 7fa626800640 1 --2- 172.21.15.19:0/3914053836 >> v2:172.21.15.42:3300/0 conn(0x7fa62806e870 0x7fa62815e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:32.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.177+0000 7fa624a00640 1 -- 172.21.15.19:0/3914053836 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa60c005730 con 0x7fa628144240 2024-03-08T06:05:32.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.177+0000 7fa624a00640 1 -- 172.21.15.19:0/3914053836 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1361740369 0 0) 0x7fa60c005730 con 0x7fa628144240 2024-03-08T06:05:32.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.177+0000 7fa624a00640 1 -- 172.21.15.19:0/3914053836 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa6280b42c0 msgr2=0x7fa62806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:32.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.177+0000 7fa624a00640 1 --2- 172.21.15.19:0/3914053836 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa6280b42c0 0x7fa62806e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.177+0000 7fa624a00640 1 -- 172.21.15.19:0/3914053836 >> v2:172.21.15.42:3300/0 conn(0x7fa62806e870 msgr2=0x7fa62815e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:32.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.177+0000 7fa624a00640 1 --2- 172.21.15.19:0/3914053836 >> v2:172.21.15.42:3300/0 conn(0x7fa62806e870 0x7fa62815e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.177+0000 7fa624a00640 1 -- 172.21.15.19:0/3914053836 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6280b37e0 con 0x7fa628144240 2024-03-08T06:05:32.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.177+0000 7fa624a00640 1 -- 172.21.15.19:0/3914053836 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7fa6180019f0 con 0x7fa628144240 2024-03-08T06:05:32.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.178+0000 7fa624a00640 1 -- 172.21.15.19:0/3914053836 >> v1:172.21.15.19:6789/0 conn(0x7fa628144240 legacy=0x7fa6280cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:32.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.178+0000 7fa624a00640 1 --2- 172.21.15.19:0/3914053836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c005c30 0x7fa60c006050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:32.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.178+0000 7fa624a00640 1 --2- 172.21.15.19:0/3914053836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c006a10 0x7fa60c006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:32.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.178+0000 7fa624a00640 1 --2- 172.21.15.19:0/3914053836 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa60c0073d0 0x7fa60c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:32.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.178+0000 7fa624a00640 1 -- 172.21.15.19:0/3914053836 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280b3e30 con 0x7fa60c005c30 2024-03-08T06:05:32.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.178+0000 7fa624a00640 1 -- 172.21.15.19:0/3914053836 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280cd6c0 con 0x7fa60c006a10 2024-03-08T06:05:32.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.178+0000 7fa624a00640 1 -- 172.21.15.19:0/3914053836 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c00e110 con 0x7fa60c0073d0 2024-03-08T06:05:32.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.178+0000 7fa625e00640 1 --2- 172.21.15.19:0/3914053836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c005c30 0x7fa60c006050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:32.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.178+0000 7fa625400640 1 --2- 172.21.15.19:0/3914053836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c006a10 0x7fa60c006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:32.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.178+0000 7fa626800640 1 --2- 172.21.15.19:0/3914053836 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa60c0073d0 0x7fa60c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:32.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.178+0000 7fa625e00640 1 -- 172.21.15.19:0/3914053836 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa60c0073d0 msgr2=0x7fa60c00dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:32.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.178+0000 7fa625e00640 1 --2- 172.21.15.19:0/3914053836 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa60c0073d0 0x7fa60c00dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.178+0000 7fa625e00640 1 -- 172.21.15.19:0/3914053836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c006a10 msgr2=0x7fa60c006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:32.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.178+0000 7fa625e00640 1 --2- 172.21.15.19:0/3914053836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c006a10 0x7fa60c006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.178+0000 7fa625e00640 1 -- 172.21.15.19:0/3914053836 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c005730 con 0x7fa60c005c30 2024-03-08T06:05:32.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.178+0000 7fa625400640 1 --2- 172.21.15.19:0/3914053836 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa60c006a10 0x7fa60c006e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.179+0000 7fa625e00640 1 --2- 172.21.15.19:0/3914053836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c005c30 0x7fa60c006050 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa61800a7b0 tx=0x7fa60c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2435d5cf83f9a4ec server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.180+0000 7fa624a00640 1 -- 172.21.15.19:0/3914053836 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61800a3d0 con 0x7fa60c005c30 2024-03-08T06:05:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.180+0000 7fa624a00640 1 -- 172.21.15.19:0/3914053836 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa618034650 con 0x7fa60c005c30 2024-03-08T06:05:32.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.180+0000 7fa624a00640 1 -- 172.21.15.19:0/3914053836 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618034a40 con 0x7fa60c005c30 2024-03-08T06:05:32.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.180+0000 7fa627200640 1 -- 172.21.15.19:0/3914053836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c005c30 msgr2=0x7fa60c006050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:32.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.180+0000 7fa627200640 1 --2- 172.21.15.19:0/3914053836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c005c30 0x7fa60c006050 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa61800a7b0 tx=0x7fa60c007a40 comp rx=0 tx=0).stop 2024-03-08T06:05:32.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.180+0000 7fa626800640 1 -- 172.21.15.19:0/3914053836 reap_dead start 2024-03-08T06:05:32.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.181+0000 7fa627200640 1 -- 172.21.15.19:0/3914053836 shutdown_connections 2024-03-08T06:05:32.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.181+0000 7fa627200640 1 -- 172.21.15.19:0/3914053836 >> 172.21.15.19:0/3914053836 conn(0x7fa6280b1850 msgr2=0x7fa6280b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:32.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.181+0000 7fa627200640 1 -- 172.21.15.19:0/3914053836 shutdown_connections 2024-03-08T06:05:32.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.181+0000 7fa627200640 1 -- 172.21.15.19:0/3914053836 wait complete. 2024-03-08T06:05:32.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.182+0000 7fa627200640 1 Processor -- start 2024-03-08T06:05:32.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.183+0000 7fa627200640 1 -- start start 2024-03-08T06:05:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.183+0000 7fa627200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c005c30 0x7fa6281f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.184+0000 7fa627200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa628141900 0x7fa62813c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.184+0000 7fa627200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6281431e0 0x7fa628137ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.184+0000 7fa627200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa628144620 con 0x7fa60c005c30 2024-03-08T06:05:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.184+0000 7fa627200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280cd0c0 con 0x7fa6281431e0 2024-03-08T06:05:32.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.184+0000 7fa627200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280b4b30 con 0x7fa628141900 2024-03-08T06:05:32.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.184+0000 7fa625e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c005c30 0x7fa6281f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:32.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.184+0000 7fa625e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c005c30 0x7fa6281f38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40610/0 (socket says 172.21.15.19:40610) 2024-03-08T06:05:32.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.184+0000 7fa625e00640 1 -- 172.21.15.19:0/1181649634 learned_addr learned my addr 172.21.15.19:0/1181649634 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:32.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.184+0000 7fa626800640 1 --2- 172.21.15.19:0/1181649634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6281431e0 0x7fa628137ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:32.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.184+0000 7fa625400640 1 --2- 172.21.15.19:0/1181649634 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa628141900 0x7fa62813c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:32.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.184+0000 7fa625e00640 1 -- 172.21.15.19:0/1181649634 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa628141900 msgr2=0x7fa62813c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:32.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.184+0000 7fa625e00640 1 --2- 172.21.15.19:0/1181649634 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa628141900 0x7fa62813c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.184+0000 7fa625e00640 1 -- 172.21.15.19:0/1181649634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6281431e0 msgr2=0x7fa628137ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:32.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.184+0000 7fa625e00640 1 --2- 172.21.15.19:0/1181649634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6281431e0 0x7fa628137ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.184+0000 7fa625e00640 1 -- 172.21.15.19:0/1181649634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa628141d80 con 0x7fa60c005c30 2024-03-08T06:05:32.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.185+0000 7fa625e00640 1 --2- 172.21.15.19:0/1181649634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c005c30 0x7fa6281f38e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa618005c20 tx=0x7fa6280b39b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:32.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.185+0000 7fa61e000640 1 -- 172.21.15.19:0/1181649634 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618045070 con 0x7fa60c005c30 2024-03-08T06:05:32.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.185+0000 7fa61e000640 1 -- 172.21.15.19:0/1181649634 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61803a040 con 0x7fa60c005c30 2024-03-08T06:05:32.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.185+0000 7fa61e000640 1 -- 172.21.15.19:0/1181649634 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618034c00 con 0x7fa60c005c30 2024-03-08T06:05:32.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.185+0000 7fa627200640 1 -- 172.21.15.19:0/1181649634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa628143a50 con 0x7fa60c005c30 2024-03-08T06:05:32.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.185+0000 7fa627200640 1 -- 172.21.15.19:0/1181649634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa628140e20 con 0x7fa60c005c30 2024-03-08T06:05:32.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.186+0000 7fa627200640 1 -- 172.21.15.19:0/1181649634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa628075090 con 0x7fa60c005c30 2024-03-08T06:05:32.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.187+0000 7fa61e000640 1 -- 172.21.15.19:0/1181649634 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa618007070 con 0x7fa60c005c30 2024-03-08T06:05:32.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.188+0000 7fa61e000640 1 --2- 172.21.15.19:0/1181649634 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa60806b470 0x7fa60806d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:32.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.188+0000 7fa61e000640 1 -- 172.21.15.19:0/1181649634 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6180ac150 con 0x7fa60c005c30 2024-03-08T06:05:32.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.188+0000 7fa625400640 1 --2- 172.21.15.19:0/1181649634 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa60806b470 0x7fa60806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:32.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.189+0000 7fa625400640 1 --2- 172.21.15.19:0/1181649634 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa60806b470 0x7fa60806d930 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa6280cc520 tx=0x7fa614008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:32.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.193+0000 7fa61e000640 1 -- 172.21.15.19:0/1181649634 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa628141d80 con 0x7fa60c005c30 2024-03-08T06:05:32.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.389+0000 7fa627200640 1 -- 172.21.15.19:0/1181649634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa62806f160 con 0x7fa60c005c30 2024-03-08T06:05:32.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.390+0000 7fa61e000640 1 -- 172.21.15.19:0/1181649634 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa61807a8e0 con 0x7fa60c005c30 2024-03-08T06:05:32.391 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-08T06:05:32.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.393+0000 7fa627200640 1 -- 172.21.15.19:0/1181649634 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa60806b470 msgr2=0x7fa60806d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:32.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.393+0000 7fa627200640 1 --2- 172.21.15.19:0/1181649634 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa60806b470 0x7fa60806d930 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa6280cc520 tx=0x7fa614008040 comp rx=0 tx=0).stop 2024-03-08T06:05:32.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.393+0000 7fa627200640 1 -- 172.21.15.19:0/1181649634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c005c30 msgr2=0x7fa6281f38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:32.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.393+0000 7fa627200640 1 --2- 172.21.15.19:0/1181649634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c005c30 0x7fa6281f38e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa618005c20 tx=0x7fa6280b39b0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.393+0000 7fa627200640 1 -- 172.21.15.19:0/1181649634 shutdown_connections 2024-03-08T06:05:32.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.393+0000 7fa627200640 1 --2- 172.21.15.19:0/1181649634 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa60806b470 0x7fa60806d930 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.393+0000 7fa627200640 1 --2- 172.21.15.19:0/1181649634 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6281431e0 0x7fa628137ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.393+0000 7fa627200640 1 --2- 172.21.15.19:0/1181649634 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa628141900 0x7fa62813c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.393+0000 7fa627200640 1 --2- 172.21.15.19:0/1181649634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c005c30 0x7fa6281f38e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.393+0000 7fa627200640 1 -- 172.21.15.19:0/1181649634 >> 172.21.15.19:0/1181649634 conn(0x7fa6280b1850 msgr2=0x7fa62815b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:32.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.393+0000 7fa627200640 1 -- 172.21.15.19:0/1181649634 shutdown_connections 2024-03-08T06:05:32.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.393+0000 7fa627200640 1 -- 172.21.15.19:0/1181649634 wait complete. 2024-03-08T06:05:32.414 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T06:05:32.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.637+0000 7f1b9b200640 1 Processor -- start 2024-03-08T06:05:32.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.637+0000 7f1b9b200640 1 -- start start 2024-03-08T06:05:32.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.639+0000 7f1b9b200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1b9c145500 0x7f1b9c06ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:32.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.639+0000 7f1b9b200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b9c15bfb0 0x7f1b9c0716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:32.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.639+0000 7f1b9b200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9c15c460 con 0x7f1b9c071c20 2024-03-08T06:05:32.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.639+0000 7f1b9b200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9c072050 con 0x7f1b9c15bfb0 2024-03-08T06:05:32.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.639+0000 7f1b9b200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9c15c740 con 0x7f1b9c145500 2024-03-08T06:05:32.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.639+0000 7f1b99400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b9c15bfb0 0x7f1b9c0716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:32.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.640+0000 7f1b9a800640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1b9c071c20 0x7f1b9c06d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44482/0 (socket says 172.21.15.19:44482) 2024-03-08T06:05:32.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.640+0000 7f1b99400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b9c15bfb0 0x7f1b9c0716e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40616/0 (socket says 172.21.15.19:40616) 2024-03-08T06:05:32.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.640+0000 7f1b9a800640 1 -- 172.21.15.19:0/320007473 learned_addr learned my addr 172.21.15.19:0/320007473 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:32.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.640+0000 7f1b99e00640 1 --2- 172.21.15.19:0/320007473 >> v2:172.21.15.42:3300/0 conn(0x7f1b9c145500 0x7f1b9c06ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:32.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.640+0000 7f1b99400640 1 -- 172.21.15.19:0/320007473 >> v2:172.21.15.42:3300/0 conn(0x7f1b9c145500 msgr2=0x7f1b9c06ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:32.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.640+0000 7f1b99400640 1 --2- 172.21.15.19:0/320007473 >> v2:172.21.15.42:3300/0 conn(0x7f1b9c145500 0x7f1b9c06ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.640+0000 7f1b99400640 1 -- 172.21.15.19:0/320007473 >> v1:172.21.15.19:6789/0 conn(0x7f1b9c071c20 legacy=0x7f1b9c06d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:32.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.640+0000 7f1b99400640 1 -- 172.21.15.19:0/320007473 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c15ca20 con 0x7f1b9c15bfb0 2024-03-08T06:05:32.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.640+0000 7f1b98a00640 1 -- 172.21.15.19:0/320007473 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209864126 0 0) 0x7f1b9c15c460 con 0x7f1b9c071c20 2024-03-08T06:05:32.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.641+0000 7f1b99400640 1 --2- 172.21.15.19:0/320007473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c15bfb0 0x7f1b9c0716e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c0cf820 tx=0x7f1b8402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5cc5b62000acc6 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:32.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.642+0000 7f1b98a00640 1 -- 172.21.15.19:0/320007473 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b840315a0 con 0x7f1b9c15bfb0 2024-03-08T06:05:32.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.642+0000 7f1b98a00640 1 -- 172.21.15.19:0/320007473 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b84037070 con 0x7f1b9c15bfb0 2024-03-08T06:05:32.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.642+0000 7f1b98a00640 1 -- 172.21.15.19:0/320007473 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b84031960 con 0x7f1b9c15bfb0 2024-03-08T06:05:32.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.643+0000 7f1b9b200640 1 -- 172.21.15.19:0/320007473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c15bfb0 msgr2=0x7f1b9c0716e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:32.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.643+0000 7f1b9b200640 1 --2- 172.21.15.19:0/320007473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c15bfb0 0x7f1b9c0716e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c0cf820 tx=0x7f1b8402b840 comp rx=0 tx=0).stop 2024-03-08T06:05:32.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.643+0000 7f1b9b200640 1 -- 172.21.15.19:0/320007473 shutdown_connections 2024-03-08T06:05:32.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.643+0000 7f1b9b200640 1 --2- 172.21.15.19:0/320007473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c15bfb0 0x7f1b9c0716e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.643+0000 7f1b9b200640 1 --2- 172.21.15.19:0/320007473 >> v2:172.21.15.42:3300/0 conn(0x7f1b9c145500 0x7f1b9c06ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.643+0000 7f1b9b200640 1 -- 172.21.15.19:0/320007473 >> 172.21.15.19:0/320007473 conn(0x7f1b9c0b1850 msgr2=0x7f1b9c0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:32.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.643+0000 7f1b9b200640 1 -- 172.21.15.19:0/320007473 shutdown_connections 2024-03-08T06:05:32.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.643+0000 7f1b9b200640 1 -- 172.21.15.19:0/320007473 wait complete. 2024-03-08T06:05:32.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.645+0000 7f1b9b200640 1 Processor -- start 2024-03-08T06:05:32.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.645+0000 7f1b9b200640 1 -- start start 2024-03-08T06:05:32.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.647+0000 7f1b9b200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c071c20 0x7f1b9c13e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:32.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.647+0000 7f1b9b200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1b9c145500 0x7f1b9c13af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:32.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.647+0000 7f1b9b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b9c15bfb0 0x7f1b9c13f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:32.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.647+0000 7f1b9b200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c06f370 con 0x7f1b9c071c20 2024-03-08T06:05:32.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.647+0000 7f1b9b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c06f1f0 con 0x7f1b9c15bfb0 2024-03-08T06:05:32.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.647+0000 7f1b9b200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c0cd510 con 0x7f1b9c145500 2024-03-08T06:05:32.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.647+0000 7f1b99e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c071c20 0x7f1b9c13e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:32.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.647+0000 7f1b99e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c071c20 0x7f1b9c13e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40630/0 (socket says 172.21.15.19:40630) 2024-03-08T06:05:32.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.647+0000 7f1b99e00640 1 -- 172.21.15.19:0/2640916876 learned_addr learned my addr 172.21.15.19:0/2640916876 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.647+0000 7f1b99400640 1 --2- 172.21.15.19:0/2640916876 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1b9c145500 0x7f1b9c13af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.647+0000 7f1b9a800640 1 --2- 172.21.15.19:0/2640916876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b9c15bfb0 0x7f1b9c13f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.648+0000 7f1b99e00640 1 -- 172.21.15.19:0/2640916876 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1b9c145500 msgr2=0x7f1b9c13af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.648+0000 7f1b99e00640 1 --2- 172.21.15.19:0/2640916876 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1b9c145500 0x7f1b9c13af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.648+0000 7f1b99e00640 1 -- 172.21.15.19:0/2640916876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b9c15bfb0 msgr2=0x7f1b9c13f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.648+0000 7f1b99e00640 1 --2- 172.21.15.19:0/2640916876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b9c15bfb0 0x7f1b9c13f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.648+0000 7f1b99e00640 1 -- 172.21.15.19:0/2640916876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c13d000 con 0x7f1b9c071c20 2024-03-08T06:05:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.648+0000 7f1b99e00640 1 --2- 172.21.15.19:0/2640916876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c071c20 0x7f1b9c13e0a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00d800 tx=0x7f1b8c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.648+0000 7f1b92000640 1 -- 172.21.15.19:0/2640916876 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00b6c0 con 0x7f1b9c071c20 2024-03-08T06:05:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.648+0000 7f1b92000640 1 -- 172.21.15.19:0/2640916876 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c019070 con 0x7f1b9c071c20 2024-03-08T06:05:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.648+0000 7f1b92000640 1 -- 172.21.15.19:0/2640916876 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00ba80 con 0x7f1b9c071c20 2024-03-08T06:05:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.648+0000 7f1b9b200640 1 -- 172.21.15.19:0/2640916876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b9c13d2e0 con 0x7f1b9c071c20 2024-03-08T06:05:32.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.649+0000 7f1b9b200640 1 -- 172.21.15.19:0/2640916876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9c13d8a0 con 0x7f1b9c071c20 2024-03-08T06:05:32.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.650+0000 7f1b9b200640 1 -- 172.21.15.19:0/2640916876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9c075090 con 0x7f1b9c071c20 2024-03-08T06:05:32.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.651+0000 7f1b92000640 1 -- 172.21.15.19:0/2640916876 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1b8c00bc20 con 0x7f1b9c071c20 2024-03-08T06:05:32.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.652+0000 7f1b92000640 1 --2- 172.21.15.19:0/2640916876 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1b7806b4d0 0x7f1b7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:32.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.652+0000 7f1b92000640 1 -- 172.21.15.19:0/2640916876 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b8c08a780 con 0x7f1b9c071c20 2024-03-08T06:05:32.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.653+0000 7f1b99400640 1 --2- 172.21.15.19:0/2640916876 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1b7806b4d0 0x7f1b7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:32.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.653+0000 7f1b99400640 1 --2- 172.21.15.19:0/2640916876 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1b7806b4d0 0x7f1b7806d990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1b84036000 tx=0x7f1b8403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:32.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.657+0000 7f1b92000640 1 -- 172.21.15.19:0/2640916876 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1b8c059560 con 0x7f1b9c071c20 2024-03-08T06:05:32.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.858+0000 7f1b9b200640 1 -- 172.21.15.19:0/2640916876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1b9c0aec40 con 0x7f1b9c071c20 2024-03-08T06:05:32.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.859+0000 7f1b92000640 1 -- 172.21.15.19:0/2640916876 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1b8c058e60 con 0x7f1b9c071c20 2024-03-08T06:05:32.860 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-08T06:05:32.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.862+0000 7f1b9b200640 1 -- 172.21.15.19:0/2640916876 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1b7806b4d0 msgr2=0x7f1b7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:32.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.862+0000 7f1b9b200640 1 --2- 172.21.15.19:0/2640916876 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1b7806b4d0 0x7f1b7806d990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1b84036000 tx=0x7f1b8403d040 comp rx=0 tx=0).stop 2024-03-08T06:05:32.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.862+0000 7f1b9b200640 1 -- 172.21.15.19:0/2640916876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c071c20 msgr2=0x7f1b9c13e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:32.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.862+0000 7f1b9b200640 1 --2- 172.21.15.19:0/2640916876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c071c20 0x7f1b9c13e0a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00d800 tx=0x7f1b8c00dcc0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.862+0000 7f1b9b200640 1 -- 172.21.15.19:0/2640916876 shutdown_connections 2024-03-08T06:05:32.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.862+0000 7f1b9b200640 1 --2- 172.21.15.19:0/2640916876 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1b7806b4d0 0x7f1b7806d990 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.862+0000 7f1b9b200640 1 --2- 172.21.15.19:0/2640916876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1b9c15bfb0 0x7f1b9c13f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.862+0000 7f1b9b200640 1 --2- 172.21.15.19:0/2640916876 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1b9c145500 0x7f1b9c13af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.862+0000 7f1b9b200640 1 --2- 172.21.15.19:0/2640916876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c071c20 0x7f1b9c13e0a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:32.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.862+0000 7f1b9b200640 1 -- 172.21.15.19:0/2640916876 >> 172.21.15.19:0/2640916876 conn(0x7f1b9c0b1850 msgr2=0x7f1b9c0b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:32.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.862+0000 7f1b9b200640 1 -- 172.21.15.19:0/2640916876 shutdown_connections 2024-03-08T06:05:32.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:32.862+0000 7f1b9b200640 1 -- 172.21.15.19:0/2640916876 wait complete. 2024-03-08T06:05:32.883 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-08T06:05:33.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.104+0000 7fd73e800640 1 Processor -- start 2024-03-08T06:05:33.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.104+0000 7fd73e800640 1 -- start start 2024-03-08T06:05:33.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.106+0000 7fd73e800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd7380cdd50 0x7fd7380ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:33.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.106+0000 7fd73e800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd73815d050 0x7fd73815fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:33.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.106+0000 7fd73e800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73806edb0 con 0x7fd7380b21d0 2024-03-08T06:05:33.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.106+0000 7fd73e800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73806e920 con 0x7fd7380cdd50 2024-03-08T06:05:33.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.106+0000 7fd73e800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7380ce670 con 0x7fd73815d050 2024-03-08T06:05:33.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.107+0000 7fd736a00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd7380b21d0 0x7fd73815f610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44492/0 (socket says 172.21.15.19:44492) 2024-03-08T06:05:33.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.107+0000 7fd736a00640 1 -- 172.21.15.19:0/1865163300 learned_addr learned my addr 172.21.15.19:0/1865163300 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:33.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.107+0000 7fd736000640 1 -- 172.21.15.19:0/1865163300 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009879043 0 0) 0x7fd73806edb0 con 0x7fd7380b21d0 2024-03-08T06:05:33.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.107+0000 7fd736000640 1 -- 172.21.15.19:0/1865163300 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd71c003520 con 0x7fd7380b21d0 2024-03-08T06:05:33.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.107+0000 7fd737e00640 1 --2- 172.21.15.19:0/1865163300 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd73815d050 0x7fd73815fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:33.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.107+0000 7fd736000640 1 -- 172.21.15.19:0/1865163300 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1860893456 0 0) 0x7fd71c003520 con 0x7fd7380b21d0 2024-03-08T06:05:33.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.107+0000 7fd736000640 1 -- 172.21.15.19:0/1865163300 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd73815d050 msgr2=0x7fd73815fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:33.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.107+0000 7fd736000640 1 --2- 172.21.15.19:0/1865163300 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd73815d050 0x7fd73815fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:33.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.107+0000 7fd736000640 1 -- 172.21.15.19:0/1865163300 >> v2:172.21.15.42:3300/0 conn(0x7fd7380cdd50 msgr2=0x7fd7380ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:33.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.107+0000 7fd736000640 1 --2- 172.21.15.19:0/1865163300 >> v2:172.21.15.42:3300/0 conn(0x7fd7380cdd50 0x7fd7380ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:33.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.108+0000 7fd736000640 1 -- 172.21.15.19:0/1865163300 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73806dff0 con 0x7fd7380b21d0 2024-03-08T06:05:33.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.108+0000 7fd736000640 1 -- 172.21.15.19:0/1865163300 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7fd724001670 con 0x7fd7380b21d0 2024-03-08T06:05:33.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.108+0000 7fd736000640 1 -- 172.21.15.19:0/1865163300 >> v1:172.21.15.19:6789/0 conn(0x7fd7380b21d0 legacy=0x7fd73815f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:33.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.108+0000 7fd736000640 1 --2- 172.21.15.19:0/1865163300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd71c0039b0 0x7fd71c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:33.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.108+0000 7fd736000640 1 --2- 172.21.15.19:0/1865163300 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd71c004800 0x7fd71c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:33.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.108+0000 7fd736000640 1 --2- 172.21.15.19:0/1865163300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd71c005180 0x7fd71c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:33.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.108+0000 7fd736000640 1 -- 172.21.15.19:0/1865163300 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73806e920 con 0x7fd71c005180 2024-03-08T06:05:33.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.108+0000 7fd736000640 1 -- 172.21.15.19:0/1865163300 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7380ce670 con 0x7fd71c0039b0 2024-03-08T06:05:33.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.108+0000 7fd736000640 1 -- 172.21.15.19:0/1865163300 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c00bf50 con 0x7fd71c004800 2024-03-08T06:05:33.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.108+0000 7fd737e00640 1 --2- 172.21.15.19:0/1865163300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd71c005180 0x7fd71c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.108+0000 7fd736a00640 1 --2- 172.21.15.19:0/1865163300 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd71c004800 0x7fd71c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.108+0000 7fd737400640 1 --2- 172.21.15.19:0/1865163300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd71c0039b0 0x7fd71c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.108+0000 7fd737e00640 1 -- 172.21.15.19:0/1865163300 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd71c004800 msgr2=0x7fd71c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.108+0000 7fd737e00640 1 --2- 172.21.15.19:0/1865163300 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd71c004800 0x7fd71c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.108+0000 7fd737e00640 1 -- 172.21.15.19:0/1865163300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd71c0039b0 msgr2=0x7fd71c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.108+0000 7fd737e00640 1 --2- 172.21.15.19:0/1865163300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd71c0039b0 0x7fd71c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.109+0000 7fd737e00640 1 -- 172.21.15.19:0/1865163300 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c003520 con 0x7fd71c005180 2024-03-08T06:05:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.109+0000 7fd737400640 1 --2- 172.21.15.19:0/1865163300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd71c0039b0 0x7fd71c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:33.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.110+0000 7fd737e00640 1 --2- 172.21.15.19:0/1865163300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd71c005180 0x7fd71c00b9c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd730007330 tx=0x7fd71c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc825d355364b43b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:33.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.110+0000 7fd736000640 1 -- 172.21.15.19:0/1865163300 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd730039070 con 0x7fd71c005180 2024-03-08T06:05:33.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.110+0000 7fd736000640 1 -- 172.21.15.19:0/1865163300 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73002cca0 con 0x7fd71c005180 2024-03-08T06:05:33.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.110+0000 7fd736000640 1 -- 172.21.15.19:0/1865163300 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd730009be0 con 0x7fd71c005180 2024-03-08T06:05:33.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.110+0000 7fd73e800640 1 -- 172.21.15.19:0/1865163300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd71c005180 msgr2=0x7fd71c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:33.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.110+0000 7fd73e800640 1 --2- 172.21.15.19:0/1865163300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd71c005180 0x7fd71c00b9c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd730007330 tx=0x7fd71c005830 comp rx=0 tx=0).stop 2024-03-08T06:05:33.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.110+0000 7fd737e00640 1 -- 172.21.15.19:0/1865163300 reap_dead start 2024-03-08T06:05:33.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.111+0000 7fd73e800640 1 -- 172.21.15.19:0/1865163300 shutdown_connections 2024-03-08T06:05:33.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.111+0000 7fd73e800640 1 -- 172.21.15.19:0/1865163300 >> 172.21.15.19:0/1865163300 conn(0x7fd7380b16e0 msgr2=0x7fd7380b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:33.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.111+0000 7fd73e800640 1 -- 172.21.15.19:0/1865163300 shutdown_connections 2024-03-08T06:05:33.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.111+0000 7fd73e800640 1 -- 172.21.15.19:0/1865163300 wait complete. 2024-03-08T06:05:33.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.113+0000 7fd73e800640 1 Processor -- start 2024-03-08T06:05:33.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.113+0000 7fd73e800640 1 -- start start 2024-03-08T06:05:33.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.114+0000 7fd73e800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd71c005180 0x7fd7381f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:33.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.114+0000 7fd73e800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7381e3580 0x7fd7381e3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:33.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.114+0000 7fd73e800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7380b3580 0x7fd7380b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:33.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.114+0000 7fd73e800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd738144bd0 con 0x7fd7381e3580 2024-03-08T06:05:33.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.114+0000 7fd73e800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73806e5b0 con 0x7fd7380b3580 2024-03-08T06:05:33.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.114+0000 7fd73e800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd738145480 con 0x7fd71c005180 2024-03-08T06:05:33.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.114+0000 7fd736a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7381e3580 0x7fd7381e3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:33.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.114+0000 7fd736a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7381e3580 0x7fd7381e3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40658/0 (socket says 172.21.15.19:40658) 2024-03-08T06:05:33.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.114+0000 7fd736a00640 1 -- 172.21.15.19:0/1571186607 learned_addr learned my addr 172.21.15.19:0/1571186607 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:33.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.114+0000 7fd737400640 1 --2- 172.21.15.19:0/1571186607 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd71c005180 0x7fd7381f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:33.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.115+0000 7fd737e00640 1 --2- 172.21.15.19:0/1571186607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7380b3580 0x7fd7380b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:33.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.115+0000 7fd736a00640 1 -- 172.21.15.19:0/1571186607 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd71c005180 msgr2=0x7fd7381f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:33.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.115+0000 7fd736a00640 1 --2- 172.21.15.19:0/1571186607 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd71c005180 0x7fd7381f2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:33.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.115+0000 7fd736a00640 1 -- 172.21.15.19:0/1571186607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7380b3580 msgr2=0x7fd7380b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:33.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.115+0000 7fd736a00640 1 --2- 172.21.15.19:0/1571186607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7380b3580 0x7fd7380b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:33.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.115+0000 7fd736a00640 1 -- 172.21.15.19:0/1571186607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380b4340 con 0x7fd7381e3580 2024-03-08T06:05:33.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.115+0000 7fd736a00640 1 --2- 172.21.15.19:0/1571186607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7381e3580 0x7fd7381e3a00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd72400e8c0 tx=0x7fd72400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:33.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.115+0000 7fd72f400640 1 -- 172.21.15.19:0/1571186607 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72400c8d0 con 0x7fd7381e3580 2024-03-08T06:05:33.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.115+0000 7fd72f400640 1 -- 172.21.15.19:0/1571186607 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72400cab0 con 0x7fd7381e3580 2024-03-08T06:05:33.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.115+0000 7fd72f400640 1 -- 172.21.15.19:0/1571186607 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72400cca0 con 0x7fd7381e3580 2024-03-08T06:05:33.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.115+0000 7fd73e800640 1 -- 172.21.15.19:0/1571186607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7381e0c30 con 0x7fd7381e3580 2024-03-08T06:05:33.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.115+0000 7fd73e800640 1 -- 172.21.15.19:0/1571186607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7381e11f0 con 0x7fd7381e3580 2024-03-08T06:05:33.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.117+0000 7fd73e800640 1 -- 172.21.15.19:0/1571186607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd738067cb0 con 0x7fd7381e3580 2024-03-08T06:05:33.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.118+0000 7fd72f400640 1 -- 172.21.15.19:0/1571186607 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd72401a030 con 0x7fd7381e3580 2024-03-08T06:05:33.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.119+0000 7fd72f400640 1 --2- 172.21.15.19:0/1571186607 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd71806b500 0x7fd71806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:33.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.119+0000 7fd72f400640 1 -- 172.21.15.19:0/1571186607 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd724089ad0 con 0x7fd7381e3580 2024-03-08T06:05:33.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.119+0000 7fd737400640 1 --2- 172.21.15.19:0/1571186607 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd71806b500 0x7fd71806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:33.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.120+0000 7fd737400640 1 --2- 172.21.15.19:0/1571186607 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd71806b500 0x7fd71806d9c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd728006fd0 tx=0x7fd728008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:33.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.123+0000 7fd72f400640 1 -- 172.21.15.19:0/1571186607 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd724021020 con 0x7fd7381e3580 2024-03-08T06:05:33.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.337+0000 7fd73e800640 1 -- 172.21.15.19:0/1571186607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd7381401a0 con 0x7fd7381e3580 2024-03-08T06:05:33.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.338+0000 7fd72f400640 1 -- 172.21.15.19:0/1571186607 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd7240589e0 con 0x7fd7381e3580 2024-03-08T06:05:33.339 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-08T06:05:33.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.341+0000 7fd73e800640 1 -- 172.21.15.19:0/1571186607 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd71806b500 msgr2=0x7fd71806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:33.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.341+0000 7fd73e800640 1 --2- 172.21.15.19:0/1571186607 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd71806b500 0x7fd71806d9c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd728006fd0 tx=0x7fd728008040 comp rx=0 tx=0).stop 2024-03-08T06:05:33.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.341+0000 7fd73e800640 1 -- 172.21.15.19:0/1571186607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7381e3580 msgr2=0x7fd7381e3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:33.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.341+0000 7fd73e800640 1 --2- 172.21.15.19:0/1571186607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7381e3580 0x7fd7381e3a00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd72400e8c0 tx=0x7fd72400ed80 comp rx=0 tx=0).stop 2024-03-08T06:05:33.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.341+0000 7fd73e800640 1 -- 172.21.15.19:0/1571186607 shutdown_connections 2024-03-08T06:05:33.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.341+0000 7fd73e800640 1 --2- 172.21.15.19:0/1571186607 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd71806b500 0x7fd71806d9c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:33.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.341+0000 7fd73e800640 1 --2- 172.21.15.19:0/1571186607 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7380b3580 0x7fd7380b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:33.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.341+0000 7fd73e800640 1 --2- 172.21.15.19:0/1571186607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7381e3580 0x7fd7381e3a00 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:33.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.341+0000 7fd73e800640 1 --2- 172.21.15.19:0/1571186607 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd71c005180 0x7fd7381f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:33.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.341+0000 7fd73e800640 1 -- 172.21.15.19:0/1571186607 >> 172.21.15.19:0/1571186607 conn(0x7fd7380b16e0 msgr2=0x7fd738142600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:33.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.341+0000 7fd73e800640 1 -- 172.21.15.19:0/1571186607 shutdown_connections 2024-03-08T06:05:33.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:33.341+0000 7fd73e800640 1 -- 172.21.15.19:0/1571186607 wait complete. 2024-03-08T06:05:33.359 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-08T06:05:33.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:05:33.359 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-08T06:05:33.828 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-03-08T06:05:33.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:05:33.828 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-08T06:05:33.869 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:05:33.869 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:05:33.928 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:05:33.929 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:05:33.981 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:05:34.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.183+0000 7f57c8a00640 1 Processor -- start 2024-03-08T06:05:34.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.183+0000 7f57c8a00640 1 -- start start 2024-03-08T06:05:34.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.185+0000 7f57c8a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f57c4161740 0x7f57c40b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:34.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.185+0000 7f57c8a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f57c40716e0 0x7f57c4071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:34.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.185+0000 7f57c8a00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c4161d20 con 0x7f57c415b6c0 2024-03-08T06:05:34.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.185+0000 7f57c8a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c415e280 con 0x7f57c40716e0 2024-03-08T06:05:34.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.185+0000 7f57c8a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c40b4740 con 0x7f57c4161740 2024-03-08T06:05:34.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.185+0000 7f57c3200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f57c40716e0 0x7f57c4071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:34.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.185+0000 7f57c3200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f57c40716e0 0x7f57c4071b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40670/0 (socket says 172.21.15.19:40670) 2024-03-08T06:05:34.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.185+0000 7f57c2800640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f57c415b6c0 0x7f57c40adec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44496/0 (socket says 172.21.15.19:44496) 2024-03-08T06:05:34.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.185+0000 7f57c3200640 1 -- 172.21.15.19:0/2364601437 learned_addr learned my addr 172.21.15.19:0/2364601437 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:34.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.185+0000 7f57bbe00640 1 --2- 172.21.15.19:0/2364601437 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f57c4161740 0x7f57c40b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:34.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.186+0000 7f57c3200640 1 -- 172.21.15.19:0/2364601437 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f57c4161740 msgr2=0x7f57c40b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:34.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.186+0000 7f57c3200640 1 --2- 172.21.15.19:0/2364601437 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f57c4161740 0x7f57c40b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:34.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.186+0000 7f57c3200640 1 -- 172.21.15.19:0/2364601437 >> v1:172.21.15.19:6789/0 conn(0x7f57c415b6c0 legacy=0x7f57c40adec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:34.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.186+0000 7f57c3200640 1 -- 172.21.15.19:0/2364601437 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c4162000 con 0x7f57c40716e0 2024-03-08T06:05:34.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.186+0000 7f57c1e00640 1 -- 172.21.15.19:0/2364601437 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113694600 0 0) 0x7f57c4161d20 con 0x7f57c415b6c0 2024-03-08T06:05:34.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.187+0000 7f57c3200640 1 --2- 172.21.15.19:0/2364601437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c40716e0 0x7f57c4071b70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f57bc009e50 tx=0x7f57bc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93ff054c47ac960 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:34.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.187+0000 7f57c1e00640 1 -- 172.21.15.19:0/2364601437 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc02cb00 con 0x7f57c40716e0 2024-03-08T06:05:34.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.187+0000 7f57c1e00640 1 -- 172.21.15.19:0/2364601437 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc02cca0 con 0x7f57c40716e0 2024-03-08T06:05:34.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.187+0000 7f57c1e00640 1 -- 172.21.15.19:0/2364601437 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc034610 con 0x7f57c40716e0 2024-03-08T06:05:34.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.188+0000 7f57c8a00640 1 -- 172.21.15.19:0/2364601437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c40716e0 msgr2=0x7f57c4071b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:34.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.188+0000 7f57c8a00640 1 --2- 172.21.15.19:0/2364601437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c40716e0 0x7f57c4071b70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f57bc009e50 tx=0x7f57bc02bf60 comp rx=0 tx=0).stop 2024-03-08T06:05:34.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.188+0000 7f57c8a00640 1 -- 172.21.15.19:0/2364601437 shutdown_connections 2024-03-08T06:05:34.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.188+0000 7f57c8a00640 1 --2- 172.21.15.19:0/2364601437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c40716e0 0x7f57c4071b70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:34.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.188+0000 7f57c8a00640 1 --2- 172.21.15.19:0/2364601437 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f57c4161740 0x7f57c40b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:34.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.188+0000 7f57c8a00640 1 -- 172.21.15.19:0/2364601437 >> 172.21.15.19:0/2364601437 conn(0x7f57c40b1850 msgr2=0x7f57c40b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:34.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.188+0000 7f57c8a00640 1 -- 172.21.15.19:0/2364601437 shutdown_connections 2024-03-08T06:05:34.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.188+0000 7f57c8a00640 1 -- 172.21.15.19:0/2364601437 wait complete. 2024-03-08T06:05:34.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.190+0000 7f57c8a00640 1 Processor -- start 2024-03-08T06:05:34.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.190+0000 7f57c8a00640 1 -- start start 2024-03-08T06:05:34.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.191+0000 7f57c8a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f57c40716e0 0x7f57c40ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:34.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.191+0000 7f57c8a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c415b6c0 0x7f57c414d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:34.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.191+0000 7f57c8a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57c4161740 0x7f57c40b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:34.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.191+0000 7f57c8a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c415baa0 con 0x7f57c415b6c0 2024-03-08T06:05:34.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.191+0000 7f57c8a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c41625c0 con 0x7f57c4161740 2024-03-08T06:05:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.191+0000 7f57c8a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c40ae5d0 con 0x7f57c40716e0 2024-03-08T06:05:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.191+0000 7f57bbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c415b6c0 0x7f57c414d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.191+0000 7f57bbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c415b6c0 0x7f57c414d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40678/0 (socket says 172.21.15.19:40678) 2024-03-08T06:05:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.191+0000 7f57bbe00640 1 -- 172.21.15.19:0/2959203074 learned_addr learned my addr 172.21.15.19:0/2959203074 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.191+0000 7f57c2800640 1 --2- 172.21.15.19:0/2959203074 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f57c40716e0 0x7f57c40ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.191+0000 7f57bbe00640 1 -- 172.21.15.19:0/2959203074 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f57c40716e0 msgr2=0x7f57c40ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.191+0000 7f57bbe00640 1 --2- 172.21.15.19:0/2959203074 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f57c40716e0 0x7f57c40ce3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.192+0000 7f57bbe00640 1 -- 172.21.15.19:0/2959203074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57c4161740 msgr2=0x7f57c40b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.192+0000 7f57c3200640 1 --2- 172.21.15.19:0/2959203074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57c4161740 0x7f57c40b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.192+0000 7f57bbe00640 1 --2- 172.21.15.19:0/2959203074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57c4161740 0x7f57c40b0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.192+0000 7f57bbe00640 1 -- 172.21.15.19:0/2959203074 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c40cc070 con 0x7f57c415b6c0 2024-03-08T06:05:34.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.192+0000 7f57bbe00640 1 --2- 172.21.15.19:0/2959203074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c415b6c0 0x7f57c414d150 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00d800 tx=0x7f57ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.192+0000 7f57baa00640 1 -- 172.21.15.19:0/2959203074 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00b6c0 con 0x7f57c415b6c0 2024-03-08T06:05:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.192+0000 7f57baa00640 1 -- 172.21.15.19:0/2959203074 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac019070 con 0x7f57c415b6c0 2024-03-08T06:05:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.192+0000 7f57baa00640 1 -- 172.21.15.19:0/2959203074 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00ba80 con 0x7f57c415b6c0 2024-03-08T06:05:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.192+0000 7f57c8a00640 1 -- 172.21.15.19:0/2959203074 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c40cc350 con 0x7f57c415b6c0 2024-03-08T06:05:34.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.192+0000 7f57c8a00640 1 -- 172.21.15.19:0/2959203074 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c40cc910 con 0x7f57c415b6c0 2024-03-08T06:05:34.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.193+0000 7f57c8a00640 1 -- 172.21.15.19:0/2959203074 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c4075100 con 0x7f57c415b6c0 2024-03-08T06:05:34.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.194+0000 7f57baa00640 1 -- 172.21.15.19:0/2959203074 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f57ac00bc20 con 0x7f57c415b6c0 2024-03-08T06:05:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.195+0000 7f57baa00640 1 --2- 172.21.15.19:0/2959203074 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f57a006b4d0 0x7f57a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.195+0000 7f57baa00640 1 -- 172.21.15.19:0/2959203074 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57ac08a6c0 con 0x7f57c415b6c0 2024-03-08T06:05:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.195+0000 7f57c2800640 1 --2- 172.21.15.19:0/2959203074 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f57a006b4d0 0x7f57a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:34.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.196+0000 7f57c2800640 1 --2- 172.21.15.19:0/2959203074 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f57a006b4d0 0x7f57a006d990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f57b4000f60 tx=0x7f57b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:34.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.199+0000 7f57baa00640 1 -- 172.21.15.19:0/2959203074 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f57ac059530 con 0x7f57c415b6c0 2024-03-08T06:05:34.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.398+0000 7f57c8a00640 1 -- 172.21.15.19:0/2959203074 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57c40ae960 con 0x7f57c415b6c0 2024-03-08T06:05:34.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.400+0000 7f57baa00640 1 -- 172.21.15.19:0/2959203074 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16609 (secure 0 0 0) 0x7f57ac058e30 con 0x7f57c415b6c0 2024-03-08T06:05:34.401 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:05:34.401 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":34,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:04:31.685292+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:04:28.095112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-08T06:04:29.178532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:05:34.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.403+0000 7f57c8a00640 1 -- 172.21.15.19:0/2959203074 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f57a006b4d0 msgr2=0x7f57a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:34.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.403+0000 7f57c8a00640 1 --2- 172.21.15.19:0/2959203074 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f57a006b4d0 0x7f57a006d990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f57b4000f60 tx=0x7f57b4009040 comp rx=0 tx=0).stop 2024-03-08T06:05:34.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.403+0000 7f57c8a00640 1 -- 172.21.15.19:0/2959203074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c415b6c0 msgr2=0x7f57c414d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:34.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.403+0000 7f57c8a00640 1 --2- 172.21.15.19:0/2959203074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c415b6c0 0x7f57c414d150 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00d800 tx=0x7f57ac00dcc0 comp rx=0 tx=0).stop 2024-03-08T06:05:34.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.403+0000 7f57c8a00640 1 -- 172.21.15.19:0/2959203074 shutdown_connections 2024-03-08T06:05:34.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.403+0000 7f57c8a00640 1 --2- 172.21.15.19:0/2959203074 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f57a006b4d0 0x7f57a006d990 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:34.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.403+0000 7f57c8a00640 1 --2- 172.21.15.19:0/2959203074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57c4161740 0x7f57c40b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:34.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.403+0000 7f57c8a00640 1 --2- 172.21.15.19:0/2959203074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57c415b6c0 0x7f57c414d150 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:34.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.403+0000 7f57c8a00640 1 --2- 172.21.15.19:0/2959203074 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f57c40716e0 0x7f57c40ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:34.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.403+0000 7f57c8a00640 1 -- 172.21.15.19:0/2959203074 >> 172.21.15.19:0/2959203074 conn(0x7f57c40b1850 msgr2=0x7f57c406d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:34.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.403+0000 7f57c8a00640 1 -- 172.21.15.19:0/2959203074 shutdown_connections 2024-03-08T06:05:34.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.403+0000 7f57c8a00640 1 -- 172.21.15.19:0/2959203074 wait complete. 2024-03-08T06:05:34.421 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T06:03:14.149736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T06:04:28.095112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T06:04:29.178532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T06:05:34.422 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T06:05:34.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.631+0000 7f6a93e00640 1 Processor -- start 2024-03-08T06:05:34.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.631+0000 7f6a93e00640 1 -- start start 2024-03-08T06:05:34.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.633+0000 7f6a93e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6a940b2970 0x7f6a9415e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:34.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.633+0000 7f6a93e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9415e840 con 0x7f6a940716e0 2024-03-08T06:05:34.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.633+0000 7f6a93e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9415eb20 con 0x7f6a94147040 2024-03-08T06:05:34.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.633+0000 7f6a93e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9415ee00 con 0x7f6a940b2970 2024-03-08T06:05:34.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.634+0000 7f6a92000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6a940b2970 0x7f6a9415e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:34.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.634+0000 7f6a92000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6a940b2970 0x7f6a9415e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40688/0 (socket says 172.21.15.19:40688) 2024-03-08T06:05:34.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.634+0000 7f6a92000640 1 -- 172.21.15.19:0/1491715743 learned_addr learned my addr 172.21.15.19:0/1491715743 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:34.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.634+0000 7f6a92000640 1 -- 172.21.15.19:0/1491715743 >> v1:172.21.15.42:6789/0 conn(0x7f6a94147040 legacy=0x7f6a9406e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:34.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.634+0000 7f6a92000640 1 -- 172.21.15.19:0/1491715743 >> v1:172.21.15.19:6789/0 conn(0x7f6a940716e0 legacy=0x7f6a940ae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:34.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.634+0000 7f6a92000640 1 -- 172.21.15.19:0/1491715743 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a940ae0d0 con 0x7f6a940b2970 2024-03-08T06:05:34.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.636+0000 7f6a92000640 1 --2- 172.21.15.19:0/1491715743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a940b2970 0x7f6a9415e1a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6a800098a0 tx=0x7f6a8002ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7180adf328375de9 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:34.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.636+0000 7f6a91600640 1 -- 172.21.15.19:0/1491715743 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8002f830 con 0x7f6a940b2970 2024-03-08T06:05:34.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.636+0000 7f6a91600640 1 -- 172.21.15.19:0/1491715743 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8002f9d0 con 0x7f6a940b2970 2024-03-08T06:05:34.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.636+0000 7f6a91600640 1 -- 172.21.15.19:0/1491715743 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8002fda0 con 0x7f6a940b2970 2024-03-08T06:05:34.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.637+0000 7f6a93e00640 1 -- 172.21.15.19:0/1491715743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a940b2970 msgr2=0x7f6a9415e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:34.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.637+0000 7f6a93e00640 1 --2- 172.21.15.19:0/1491715743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a940b2970 0x7f6a9415e1a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6a800098a0 tx=0x7f6a8002ba10 comp rx=0 tx=0).stop 2024-03-08T06:05:34.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.637+0000 7f6a93e00640 1 -- 172.21.15.19:0/1491715743 shutdown_connections 2024-03-08T06:05:34.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.637+0000 7f6a93e00640 1 --2- 172.21.15.19:0/1491715743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a940b2970 0x7f6a9415e1a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:34.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.637+0000 7f6a93e00640 1 -- 172.21.15.19:0/1491715743 >> 172.21.15.19:0/1491715743 conn(0x7f6a940b1850 msgr2=0x7f6a940b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:34.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.637+0000 7f6a93e00640 1 -- 172.21.15.19:0/1491715743 shutdown_connections 2024-03-08T06:05:34.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.637+0000 7f6a93e00640 1 -- 172.21.15.19:0/1491715743 wait complete. 2024-03-08T06:05:34.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.639+0000 7f6a93e00640 1 Processor -- start 2024-03-08T06:05:34.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.639+0000 7f6a93e00640 1 -- start start 2024-03-08T06:05:34.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.640+0000 7f6a93e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a940716e0 0x7f6a940afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:34.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.640+0000 7f6a93e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6a940b2970 0x7f6a94143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:34.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.640+0000 7f6a93e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a94147040 0x7f6a94138b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:34.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.640+0000 7f6a93e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a94071cd0 con 0x7f6a940716e0 2024-03-08T06:05:34.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.640+0000 7f6a93e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a94071b50 con 0x7f6a94147040 2024-03-08T06:05:34.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.640+0000 7f6a93e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a94071e50 con 0x7f6a940b2970 2024-03-08T06:05:34.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.640+0000 7f6a92a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a940716e0 0x7f6a940afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:34.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.640+0000 7f6a92a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a940716e0 0x7f6a940afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40700/0 (socket says 172.21.15.19:40700) 2024-03-08T06:05:34.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.640+0000 7f6a92a00640 1 -- 172.21.15.19:0/598801233 learned_addr learned my addr 172.21.15.19:0/598801233 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:34.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.641+0000 7f6a92000640 1 --2- 172.21.15.19:0/598801233 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6a940b2970 0x7f6a94143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:34.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.641+0000 7f6a93400640 1 --2- 172.21.15.19:0/598801233 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a94147040 0x7f6a94138b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:34.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.641+0000 7f6a92a00640 1 -- 172.21.15.19:0/598801233 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6a940b2970 msgr2=0x7f6a94143380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:34.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.641+0000 7f6a92a00640 1 --2- 172.21.15.19:0/598801233 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6a940b2970 0x7f6a94143380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:34.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.641+0000 7f6a92a00640 1 -- 172.21.15.19:0/598801233 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a94147040 msgr2=0x7f6a94138b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:34.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.641+0000 7f6a92a00640 1 --2- 172.21.15.19:0/598801233 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a94147040 0x7f6a94138b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:34.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.641+0000 7f6a92a00640 1 -- 172.21.15.19:0/598801233 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a941f83b0 con 0x7f6a940716e0 2024-03-08T06:05:34.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.641+0000 7f6a92a00640 1 --2- 172.21.15.19:0/598801233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a940716e0 0x7f6a940afc80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400c400 tx=0x7f6a8400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:34.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.641+0000 7f6a8aa00640 1 -- 172.21.15.19:0/598801233 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a840052d0 con 0x7f6a940716e0 2024-03-08T06:05:34.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.641+0000 7f6a8aa00640 1 -- 172.21.15.19:0/598801233 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a84005490 con 0x7f6a940716e0 2024-03-08T06:05:34.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.641+0000 7f6a8aa00640 1 -- 172.21.15.19:0/598801233 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a84007260 con 0x7f6a940716e0 2024-03-08T06:05:34.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.641+0000 7f6a93e00640 1 -- 172.21.15.19:0/598801233 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a941f7830 con 0x7f6a940716e0 2024-03-08T06:05:34.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.642+0000 7f6a93e00640 1 -- 172.21.15.19:0/598801233 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a941f7df0 con 0x7f6a940716e0 2024-03-08T06:05:34.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.643+0000 7f6a93e00640 1 -- 172.21.15.19:0/598801233 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a940accb0 con 0x7f6a940716e0 2024-03-08T06:05:34.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.644+0000 7f6a8aa00640 1 -- 172.21.15.19:0/598801233 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6a84007400 con 0x7f6a940716e0 2024-03-08T06:05:34.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.645+0000 7f6a8aa00640 1 --2- 172.21.15.19:0/598801233 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6a7406b4d0 0x7f6a7406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:34.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.645+0000 7f6a8aa00640 1 -- 172.21.15.19:0/598801233 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a840897f0 con 0x7f6a940716e0 2024-03-08T06:05:34.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.645+0000 7f6a92000640 1 --2- 172.21.15.19:0/598801233 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6a7406b4d0 0x7f6a7406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:34.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.646+0000 7f6a92000640 1 --2- 172.21.15.19:0/598801233 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6a7406b4d0 0x7f6a7406d990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6a80036000 tx=0x7f6a80008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:34.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.649+0000 7f6a8aa00640 1 -- 172.21.15.19:0/598801233 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6a940accb0 con 0x7f6a940716e0 2024-03-08T06:05:34.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.855+0000 7f6a93e00640 1 -- 172.21.15.19:0/598801233 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a941397c0 con 0x7f6a940716e0 2024-03-08T06:05:34.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.856+0000 7f6a8aa00640 1 -- 172.21.15.19:0/598801233 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a840585d0 con 0x7f6a940716e0 2024-03-08T06:05:34.857 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-08T06:05:34.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.859+0000 7f6a93e00640 1 -- 172.21.15.19:0/598801233 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6a7406b4d0 msgr2=0x7f6a7406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:34.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.859+0000 7f6a93e00640 1 --2- 172.21.15.19:0/598801233 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6a7406b4d0 0x7f6a7406d990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6a80036000 tx=0x7f6a80008030 comp rx=0 tx=0).stop 2024-03-08T06:05:34.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.859+0000 7f6a93e00640 1 -- 172.21.15.19:0/598801233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a940716e0 msgr2=0x7f6a940afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:34.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.859+0000 7f6a93e00640 1 --2- 172.21.15.19:0/598801233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a940716e0 0x7f6a940afc80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400c400 tx=0x7f6a8400c8c0 comp rx=0 tx=0).stop 2024-03-08T06:05:34.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.859+0000 7f6a93e00640 1 -- 172.21.15.19:0/598801233 shutdown_connections 2024-03-08T06:05:34.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.859+0000 7f6a93e00640 1 --2- 172.21.15.19:0/598801233 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6a7406b4d0 0x7f6a7406d990 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:34.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.859+0000 7f6a93e00640 1 --2- 172.21.15.19:0/598801233 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6a94147040 0x7f6a94138b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:34.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.859+0000 7f6a93e00640 1 --2- 172.21.15.19:0/598801233 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6a940b2970 0x7f6a94143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:34.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.859+0000 7f6a93e00640 1 --2- 172.21.15.19:0/598801233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a940716e0 0x7f6a940afc80 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:34.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.859+0000 7f6a93e00640 1 -- 172.21.15.19:0/598801233 >> 172.21.15.19:0/598801233 conn(0x7f6a940b1850 msgr2=0x7f6a9406e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:34.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.859+0000 7f6a93e00640 1 -- 172.21.15.19:0/598801233 shutdown_connections 2024-03-08T06:05:34.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:34.859+0000 7f6a93e00640 1 -- 172.21.15.19:0/598801233 wait complete. 2024-03-08T06:05:34.879 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T06:05:35.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.092+0000 7f711a000640 1 Processor -- start 2024-03-08T06:05:35.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.092+0000 7f711a000640 1 -- start start 2024-03-08T06:05:35.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.093+0000 7f711a000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f71141455b0 0x7f711415c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:35.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.093+0000 7f711a000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7114071950 0x7f7114071d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:35.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.093+0000 7f711a000640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71140cd5a0 con 0x7f71141604f0 2024-03-08T06:05:35.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.093+0000 7f711a000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71140ccda0 con 0x7f71141455b0 2024-03-08T06:05:35.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.093+0000 7f711a000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71140cdc20 con 0x7f7114071950 2024-03-08T06:05:35.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.094+0000 7f7113e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7114071950 0x7f7114071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:35.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.094+0000 7f7113400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f71141455b0 0x7f711415c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:35.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.094+0000 7f7113e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7114071950 0x7f7114071d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.19:44790/0 (socket says 172.21.15.19:44790) 2024-03-08T06:05:35.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.094+0000 7f7113400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f71141455b0 0x7f711415c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.19:53920/0 (socket says 172.21.15.19:53920) 2024-03-08T06:05:35.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.094+0000 7f7112a00640 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f71141604f0 0x7f71140cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.19:55128/0 (socket says 172.21.15.19:55128) 2024-03-08T06:05:35.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.094+0000 7f7113e00640 1 -- 172.21.15.19:0/3312222306 learned_addr learned my addr 172.21.15.19:0/3312222306 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:35.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.095+0000 7f7113e00640 1 -- 172.21.15.19:0/3312222306 >> v2:172.21.15.42:3300/0 conn(0x7f71141455b0 msgr2=0x7f711415c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:35.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.095+0000 7f7113e00640 1 --2- 172.21.15.19:0/3312222306 >> v2:172.21.15.42:3300/0 conn(0x7f71141455b0 0x7f711415c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:35.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.095+0000 7f7113e00640 1 -- 172.21.15.19:0/3312222306 >> v1:172.21.15.42:6789/0 conn(0x7f71141604f0 legacy=0x7f71140cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:35.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.095+0000 7f7113e00640 1 -- 172.21.15.19:0/3312222306 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71140ccfe0 con 0x7f7114071950 2024-03-08T06:05:35.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.096+0000 7f7113e00640 1 --2- 172.21.15.19:0/3312222306 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7114071950 0x7f7114071d90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f710c009e50 tx=0x7f710c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cee5cea1e72e058b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:35.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.097+0000 7f7112000640 1 -- 172.21.15.19:0/3312222306 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c02cb00 con 0x7f7114071950 2024-03-08T06:05:35.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.097+0000 7f7112000640 1 -- 172.21.15.19:0/3312222306 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c02cca0 con 0x7f7114071950 2024-03-08T06:05:35.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.097+0000 7f7112000640 1 -- 172.21.15.19:0/3312222306 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c034610 con 0x7f7114071950 2024-03-08T06:05:35.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.098+0000 7f711a000640 1 -- 172.21.15.19:0/3312222306 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7114071950 msgr2=0x7f7114071d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:35.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.098+0000 7f711a000640 1 --2- 172.21.15.19:0/3312222306 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7114071950 0x7f7114071d90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f710c009e50 tx=0x7f710c02bf60 comp rx=0 tx=0).stop 2024-03-08T06:05:35.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.098+0000 7f711a000640 1 -- 172.21.15.19:0/3312222306 shutdown_connections 2024-03-08T06:05:35.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.098+0000 7f711a000640 1 --2- 172.21.15.19:0/3312222306 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7114071950 0x7f7114071d90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:35.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.098+0000 7f711a000640 1 --2- 172.21.15.19:0/3312222306 >> v2:172.21.15.42:3300/0 conn(0x7f71141455b0 0x7f711415c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:35.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.098+0000 7f711a000640 1 -- 172.21.15.19:0/3312222306 >> 172.21.15.19:0/3312222306 conn(0x7f711406ae30 msgr2=0x7f711406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:35.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.098+0000 7f711a000640 1 -- 172.21.15.19:0/3312222306 shutdown_connections 2024-03-08T06:05:35.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.098+0000 7f711a000640 1 -- 172.21.15.19:0/3312222306 wait complete. 2024-03-08T06:05:35.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.100+0000 7f711a000640 1 Processor -- start 2024-03-08T06:05:35.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.100+0000 7f711a000640 1 -- start start 2024-03-08T06:05:35.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.101+0000 7f711a000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7114071950 0x7f711413c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:35.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.101+0000 7f711a000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71141455b0 0x7f7114141970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:35.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.101+0000 7f711a000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71141604f0 0x7f71141f6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:35.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.101+0000 7f711a000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71140cd8b0 con 0x7f71141604f0 2024-03-08T06:05:35.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.101+0000 7f711a000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71140722d0 con 0x7f71141455b0 2024-03-08T06:05:35.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.101+0000 7f711a000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711415c710 con 0x7f7114071950 2024-03-08T06:05:35.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.101+0000 7f7113e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71141604f0 0x7f71141f6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:35.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.101+0000 7f7113e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71141604f0 0x7f71141f6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40708/0 (socket says 172.21.15.19:40708) 2024-03-08T06:05:35.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.101+0000 7f7113e00640 1 -- 172.21.15.19:0/3472525702 learned_addr learned my addr 172.21.15.19:0/3472525702 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.101+0000 7f7113400640 1 --2- 172.21.15.19:0/3472525702 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7114071950 0x7f711413c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.101+0000 7f7113e00640 1 -- 172.21.15.19:0/3472525702 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7114071950 msgr2=0x7f711413c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.101+0000 7f7113e00640 1 --2- 172.21.15.19:0/3472525702 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7114071950 0x7f711413c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.102+0000 7f7113e00640 1 -- 172.21.15.19:0/3472525702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71141455b0 msgr2=0x7f7114141970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.102+0000 7f7112a00640 1 --2- 172.21.15.19:0/3472525702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71141455b0 0x7f7114141970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.102+0000 7f7113e00640 1 --2- 172.21.15.19:0/3472525702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71141455b0 0x7f7114141970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.102+0000 7f7113e00640 1 -- 172.21.15.19:0/3472525702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71141422a0 con 0x7f71141604f0 2024-03-08T06:05:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.102+0000 7f7112a00640 1 --2- 172.21.15.19:0/3472525702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71141455b0 0x7f7114141970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.102+0000 7f7113e00640 1 --2- 172.21.15.19:0/3472525702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71141604f0 0x7f71141f6e60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f710c036040 tx=0x7f710c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.102+0000 7f710b400640 1 -- 172.21.15.19:0/3472525702 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c043020 con 0x7f71141604f0 2024-03-08T06:05:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.102+0000 7f710b400640 1 -- 172.21.15.19:0/3472525702 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c02ce50 con 0x7f71141604f0 2024-03-08T06:05:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.102+0000 7f711a000640 1 -- 172.21.15.19:0/3472525702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7114142580 con 0x7f71141604f0 2024-03-08T06:05:35.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.102+0000 7f710b400640 1 -- 172.21.15.19:0/3472525702 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c009510 con 0x7f71141604f0 2024-03-08T06:05:35.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.102+0000 7f711a000640 1 -- 172.21.15.19:0/3472525702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7114142b40 con 0x7f71141604f0 2024-03-08T06:05:35.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.103+0000 7f711a000640 1 -- 172.21.15.19:0/3472525702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7114067cb0 con 0x7f71141604f0 2024-03-08T06:05:35.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.104+0000 7f710b400640 1 -- 172.21.15.19:0/3472525702 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f710c005d10 con 0x7f71141604f0 2024-03-08T06:05:35.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.105+0000 7f710b400640 1 --2- 172.21.15.19:0/3472525702 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f70f406b4d0 0x7f70f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:35.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.105+0000 7f710b400640 1 -- 172.21.15.19:0/3472525702 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f710c0acbb0 con 0x7f71141604f0 2024-03-08T06:05:35.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.106+0000 7f7113400640 1 --2- 172.21.15.19:0/3472525702 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f70f406b4d0 0x7f70f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:35.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.106+0000 7f7113400640 1 --2- 172.21.15.19:0/3472525702 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f70f406b4d0 0x7f70f406d990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7104009a10 tx=0x7f7104008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:35.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.110+0000 7f710b400640 1 -- 172.21.15.19:0/3472525702 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f710c07b910 con 0x7f71141604f0 2024-03-08T06:05:35.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.307+0000 7f711a000640 1 -- 172.21.15.19:0/3472525702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f71140729c0 con 0x7f71141604f0 2024-03-08T06:05:35.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.308+0000 7f710b400640 1 -- 172.21.15.19:0/3472525702 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f710c07b210 con 0x7f71141604f0 2024-03-08T06:05:35.309 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-08T06:05:35.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.310+0000 7f711a000640 1 -- 172.21.15.19:0/3472525702 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f70f406b4d0 msgr2=0x7f70f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:35.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.310+0000 7f711a000640 1 --2- 172.21.15.19:0/3472525702 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f70f406b4d0 0x7f70f406d990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7104009a10 tx=0x7f7104008040 comp rx=0 tx=0).stop 2024-03-08T06:05:35.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.310+0000 7f711a000640 1 -- 172.21.15.19:0/3472525702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71141604f0 msgr2=0x7f71141f6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:35.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.310+0000 7f711a000640 1 --2- 172.21.15.19:0/3472525702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71141604f0 0x7f71141f6e60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f710c036040 tx=0x7f710c004a40 comp rx=0 tx=0).stop 2024-03-08T06:05:35.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.311+0000 7f711a000640 1 -- 172.21.15.19:0/3472525702 shutdown_connections 2024-03-08T06:05:35.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.311+0000 7f711a000640 1 --2- 172.21.15.19:0/3472525702 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f70f406b4d0 0x7f70f406d990 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:35.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.311+0000 7f711a000640 1 --2- 172.21.15.19:0/3472525702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71141604f0 0x7f71141f6e60 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:35.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.311+0000 7f711a000640 1 --2- 172.21.15.19:0/3472525702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f71141455b0 0x7f7114141970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:35.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.311+0000 7f711a000640 1 --2- 172.21.15.19:0/3472525702 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7114071950 0x7f711413c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:35.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.311+0000 7f711a000640 1 -- 172.21.15.19:0/3472525702 >> 172.21.15.19:0/3472525702 conn(0x7f711406ae30 msgr2=0x7f711406d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:35.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.311+0000 7f711a000640 1 -- 172.21.15.19:0/3472525702 shutdown_connections 2024-03-08T06:05:35.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.311+0000 7f711a000640 1 -- 172.21.15.19:0/3472525702 wait complete. 2024-03-08T06:05:35.332 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T06:05:35.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.554+0000 7f4d2b200640 1 Processor -- start 2024-03-08T06:05:35.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.554+0000 7f4d2b200640 1 -- start start 2024-03-08T06:05:35.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.555+0000 7f4d2b200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4d2c0cffd0 0x7f4d2c0d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:35.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.555+0000 7f4d2b200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4d2c15bfa0 0x7f4d2c0cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:35.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.555+0000 7f4d2b200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2c0d08f0 con 0x7f4d2c15f6c0 2024-03-08T06:05:35.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.555+0000 7f4d2b200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2c09a9f0 con 0x7f4d2c0cffd0 2024-03-08T06:05:35.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.555+0000 7f4d2b200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2c15c4a0 con 0x7f4d2c15bfa0 2024-03-08T06:05:35.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.555+0000 7f4d29e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4d2c0cffd0 0x7f4d2c0d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:35.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.555+0000 7f4d2a800640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4d2c15f6c0 0x7f4d2c15faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44506/0 (socket says 172.21.15.19:44506) 2024-03-08T06:05:35.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.555+0000 7f4d2a800640 1 -- 172.21.15.19:0/1834713676 learned_addr learned my addr 172.21.15.19:0/1834713676 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:35.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.556+0000 7f4d29400640 1 --2- 172.21.15.19:0/1834713676 >> v2:172.21.15.42:3300/0 conn(0x7f4d2c15bfa0 0x7f4d2c0cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:35.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.556+0000 7f4d29e00640 1 -- 172.21.15.19:0/1834713676 >> v2:172.21.15.42:3300/0 conn(0x7f4d2c15bfa0 msgr2=0x7f4d2c0cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:35.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.556+0000 7f4d29e00640 1 --2- 172.21.15.19:0/1834713676 >> v2:172.21.15.42:3300/0 conn(0x7f4d2c15bfa0 0x7f4d2c0cf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:35.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.556+0000 7f4d29e00640 1 -- 172.21.15.19:0/1834713676 >> v1:172.21.15.19:6789/0 conn(0x7f4d2c15f6c0 legacy=0x7f4d2c15faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:35.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.556+0000 7f4d29e00640 1 -- 172.21.15.19:0/1834713676 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c15c780 con 0x7f4d2c0cffd0 2024-03-08T06:05:35.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.556+0000 7f4d29400640 1 --2- 172.21.15.19:0/1834713676 >> v2:172.21.15.42:3300/0 conn(0x7f4d2c15bfa0 0x7f4d2c0cf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:35.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.557+0000 7f4d29e00640 1 --2- 172.21.15.19:0/1834713676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d2c0cffd0 0x7f4d2c0d03b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0b1060 tx=0x7f4d1c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b732fc9a0c029b9f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:35.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.557+0000 7f4d28a00640 1 -- 172.21.15.19:0/1834713676 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c035020 con 0x7f4d2c0cffd0 2024-03-08T06:05:35.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.557+0000 7f4d28a00640 1 -- 172.21.15.19:0/1834713676 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c031830 con 0x7f4d2c0cffd0 2024-03-08T06:05:35.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.558+0000 7f4d28a00640 1 -- 172.21.15.19:0/1834713676 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c031c00 con 0x7f4d2c0cffd0 2024-03-08T06:05:35.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.558+0000 7f4d2b200640 1 -- 172.21.15.19:0/1834713676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d2c0cffd0 msgr2=0x7f4d2c0d03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:35.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.558+0000 7f4d2b200640 1 --2- 172.21.15.19:0/1834713676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d2c0cffd0 0x7f4d2c0d03b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0b1060 tx=0x7f4d1c02b8d0 comp rx=0 tx=0).stop 2024-03-08T06:05:35.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.558+0000 7f4d2b200640 1 -- 172.21.15.19:0/1834713676 shutdown_connections 2024-03-08T06:05:35.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.558+0000 7f4d2b200640 1 --2- 172.21.15.19:0/1834713676 >> v2:172.21.15.42:3300/0 conn(0x7f4d2c15bfa0 0x7f4d2c0cf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:35.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.558+0000 7f4d2b200640 1 --2- 172.21.15.19:0/1834713676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d2c0cffd0 0x7f4d2c0d03b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:35.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.558+0000 7f4d2b200640 1 -- 172.21.15.19:0/1834713676 >> 172.21.15.19:0/1834713676 conn(0x7f4d2c0b34e0 msgr2=0x7f4d2c0b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:35.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.558+0000 7f4d2b200640 1 -- 172.21.15.19:0/1834713676 shutdown_connections 2024-03-08T06:05:35.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.558+0000 7f4d2b200640 1 -- 172.21.15.19:0/1834713676 wait complete. 2024-03-08T06:05:35.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.560+0000 7f4d2b200640 1 Processor -- start 2024-03-08T06:05:35.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.560+0000 7f4d2b200640 1 -- start start 2024-03-08T06:05:35.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.561+0000 7f4d2b200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d2c0cffd0 0x7f4d2c0c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:35.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.561+0000 7f4d2b200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4d2c15bfa0 0x7f4d2c1579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:35.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.561+0000 7f4d2b200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d2c15f6c0 0x7f4d2c14adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:35.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.561+0000 7f4d2b200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c15d020 con 0x7f4d2c0cffd0 2024-03-08T06:05:35.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.561+0000 7f4d2b200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c15cd40 con 0x7f4d2c15f6c0 2024-03-08T06:05:35.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.561+0000 7f4d2b200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c0cfb00 con 0x7f4d2c15bfa0 2024-03-08T06:05:35.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.561+0000 7f4d29e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d2c0cffd0 0x7f4d2c0c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:35.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.562+0000 7f4d29e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d2c0cffd0 0x7f4d2c0c5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40736/0 (socket says 172.21.15.19:40736) 2024-03-08T06:05:35.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.562+0000 7f4d29e00640 1 -- 172.21.15.19:0/1002326425 learned_addr learned my addr 172.21.15.19:0/1002326425 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.562+0000 7f4d29400640 1 --2- 172.21.15.19:0/1002326425 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4d2c15bfa0 0x7f4d2c1579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.562+0000 7f4d2a800640 1 --2- 172.21.15.19:0/1002326425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d2c15f6c0 0x7f4d2c14adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.562+0000 7f4d29e00640 1 -- 172.21.15.19:0/1002326425 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4d2c15bfa0 msgr2=0x7f4d2c1579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.562+0000 7f4d29e00640 1 --2- 172.21.15.19:0/1002326425 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4d2c15bfa0 0x7f4d2c1579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.562+0000 7f4d29e00640 1 -- 172.21.15.19:0/1002326425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d2c15f6c0 msgr2=0x7f4d2c14adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.562+0000 7f4d29e00640 1 --2- 172.21.15.19:0/1002326425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d2c15f6c0 0x7f4d2c14adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.562+0000 7f4d29e00640 1 -- 172.21.15.19:0/1002326425 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c15dd50 con 0x7f4d2c0cffd0 2024-03-08T06:05:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.562+0000 7f4d29400640 1 --2- 172.21.15.19:0/1002326425 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4d2c15bfa0 0x7f4d2c1579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:35.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.562+0000 7f4d29e00640 1 --2- 172.21.15.19:0/1002326425 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d2c0cffd0 0x7f4d2c0c5500 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c02bee0 tx=0x7f4d1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.563+0000 7f4d22000640 1 -- 172.21.15.19:0/1002326425 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c041070 con 0x7f4d2c0cffd0 2024-03-08T06:05:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.563+0000 7f4d22000640 1 -- 172.21.15.19:0/1002326425 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c03aa30 con 0x7f4d2c0cffd0 2024-03-08T06:05:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.563+0000 7f4d22000640 1 -- 172.21.15.19:0/1002326425 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c035040 con 0x7f4d2c0cffd0 2024-03-08T06:05:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.563+0000 7f4d2b200640 1 -- 172.21.15.19:0/1002326425 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2c15e030 con 0x7f4d2c0cffd0 2024-03-08T06:05:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.563+0000 7f4d2b200640 1 -- 172.21.15.19:0/1002326425 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2c15e5f0 con 0x7f4d2c0cffd0 2024-03-08T06:05:35.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.564+0000 7f4d2b200640 1 -- 172.21.15.19:0/1002326425 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d2c075090 con 0x7f4d2c0cffd0 2024-03-08T06:05:35.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.565+0000 7f4d22000640 1 -- 172.21.15.19:0/1002326425 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f4d1c038020 con 0x7f4d2c0cffd0 2024-03-08T06:05:35.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.566+0000 7f4d22000640 1 --2- 172.21.15.19:0/1002326425 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f4d0c06b4d0 0x7f4d0c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:35.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.566+0000 7f4d22000640 1 -- 172.21.15.19:0/1002326425 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d1c0ab9e0 con 0x7f4d2c0cffd0 2024-03-08T06:05:35.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.566+0000 7f4d29400640 1 --2- 172.21.15.19:0/1002326425 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f4d0c06b4d0 0x7f4d0c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:35.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.567+0000 7f4d29400640 1 --2- 172.21.15.19:0/1002326425 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f4d0c06b4d0 0x7f4d0c06d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0c8540 tx=0x7f4d18008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.571+0000 7f4d22000640 1 -- 172.21.15.19:0/1002326425 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4d1c07a7c0 con 0x7f4d2c0cffd0 2024-03-08T06:05:35.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.771+0000 7f4d2b200640 1 -- 172.21.15.19:0/1002326425 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d2c0b3e60 con 0x7f4d2c0cffd0 2024-03-08T06:05:35.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.772+0000 7f4d22000640 1 -- 172.21.15.19:0/1002326425 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4d1c07a0c0 con 0x7f4d2c0cffd0 2024-03-08T06:05:35.773 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-08T06:05:35.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.775+0000 7f4d2b200640 1 -- 172.21.15.19:0/1002326425 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f4d0c06b4d0 msgr2=0x7f4d0c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:35.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.776+0000 7f4d2b200640 1 --2- 172.21.15.19:0/1002326425 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f4d0c06b4d0 0x7f4d0c06d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0c8540 tx=0x7f4d18008040 comp rx=0 tx=0).stop 2024-03-08T06:05:35.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.776+0000 7f4d2b200640 1 -- 172.21.15.19:0/1002326425 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d2c0cffd0 msgr2=0x7f4d2c0c5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:35.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.776+0000 7f4d2b200640 1 --2- 172.21.15.19:0/1002326425 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d2c0cffd0 0x7f4d2c0c5500 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c02bee0 tx=0x7f4d1c0046c0 comp rx=0 tx=0).stop 2024-03-08T06:05:35.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.776+0000 7f4d2b200640 1 -- 172.21.15.19:0/1002326425 shutdown_connections 2024-03-08T06:05:35.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.776+0000 7f4d2b200640 1 --2- 172.21.15.19:0/1002326425 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f4d0c06b4d0 0x7f4d0c06d990 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:35.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.776+0000 7f4d2b200640 1 --2- 172.21.15.19:0/1002326425 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4d2c15f6c0 0x7f4d2c14adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:35.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.776+0000 7f4d2b200640 1 --2- 172.21.15.19:0/1002326425 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f4d2c15bfa0 0x7f4d2c1579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:35.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.776+0000 7f4d2b200640 1 --2- 172.21.15.19:0/1002326425 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d2c0cffd0 0x7f4d2c0c5500 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:35.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.776+0000 7f4d2b200640 1 -- 172.21.15.19:0/1002326425 >> 172.21.15.19:0/1002326425 conn(0x7f4d2c0b34e0 msgr2=0x7f4d2c0b15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:35.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.776+0000 7f4d2b200640 1 -- 172.21.15.19:0/1002326425 shutdown_connections 2024-03-08T06:05:35.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:35.776+0000 7f4d2b200640 1 -- 172.21.15.19:0/1002326425 wait complete. 2024-03-08T06:05:35.796 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-08T06:05:36.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.008+0000 7f81ff200640 1 Processor -- start 2024-03-08T06:05:36.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.008+0000 7f81ff200640 1 -- start start 2024-03-08T06:05:36.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.009+0000 7f81ff200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f82001611f0 0x7f82000b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:36.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.009+0000 7f81ff200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82000d3410 con 0x7f82000d0ff0 2024-03-08T06:05:36.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.009+0000 7f81ff200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82000d36f0 con 0x7f82000b5bf0 2024-03-08T06:05:36.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.009+0000 7f81ff200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82000d1480 con 0x7f82001611f0 2024-03-08T06:05:36.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.010+0000 7f81fd400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f82000d0ff0 0x7f82000b54e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44508/0 (socket says 172.21.15.19:44508) 2024-03-08T06:05:36.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.010+0000 7f81fd400640 1 -- 172.21.15.19:0/698950950 learned_addr learned my addr 172.21.15.19:0/698950950 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:36.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.010+0000 7f81fde00640 1 --2- 172.21.15.19:0/698950950 >> v2:172.21.15.42:3300/0 conn(0x7f82001611f0 0x7f82000b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:36.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.010+0000 7f81fca00640 1 -- 172.21.15.19:0/698950950 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769976093 0 0) 0x7f82000d3410 con 0x7f82000d0ff0 2024-03-08T06:05:36.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.010+0000 7f81fca00640 1 -- 172.21.15.19:0/698950950 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81e4003520 con 0x7f82000d0ff0 2024-03-08T06:05:36.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.011+0000 7f81fca00640 1 -- 172.21.15.19:0/698950950 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1747930652 0 0) 0x7f81e4003520 con 0x7f82000d0ff0 2024-03-08T06:05:36.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.011+0000 7f81fca00640 1 -- 172.21.15.19:0/698950950 >> v2:172.21.15.42:3300/0 conn(0x7f82001611f0 msgr2=0x7f82000b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:36.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.011+0000 7f81fca00640 1 --2- 172.21.15.19:0/698950950 >> v2:172.21.15.42:3300/0 conn(0x7f82001611f0 0x7f82000b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:36.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.011+0000 7f81fca00640 1 -- 172.21.15.19:0/698950950 >> v1:172.21.15.42:6789/0 conn(0x7f82000b5bf0 legacy=0x7f82000d1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:36.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.011+0000 7f81fca00640 1 -- 172.21.15.19:0/698950950 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82000ced10 con 0x7f82000d0ff0 2024-03-08T06:05:36.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.011+0000 7f81fca00640 1 -- 172.21.15.19:0/698950950 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f81ec001670 con 0x7f82000d0ff0 2024-03-08T06:05:36.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.011+0000 7f81fca00640 1 -- 172.21.15.19:0/698950950 >> v1:172.21.15.19:6789/0 conn(0x7f82000d0ff0 legacy=0x7f82000b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:36.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.011+0000 7f81fca00640 1 --2- 172.21.15.19:0/698950950 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f81e4003a90 0x7f81e4003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:36.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.011+0000 7f81fca00640 1 --2- 172.21.15.19:0/698950950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81e4004800 0x7f81e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:36.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.011+0000 7f81fca00640 1 --2- 172.21.15.19:0/698950950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81e40053c0 0x7f81e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:36.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.011+0000 7f81fca00640 1 -- 172.21.15.19:0/698950950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e400c250 con 0x7f81e40053c0 2024-03-08T06:05:36.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.011+0000 7f81fca00640 1 -- 172.21.15.19:0/698950950 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e400c400 con 0x7f81e4004800 2024-03-08T06:05:36.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.011+0000 7f81fca00640 1 -- 172.21.15.19:0/698950950 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e400c600 con 0x7f81e4003a90 2024-03-08T06:05:36.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.011+0000 7f81fe800640 1 --2- 172.21.15.19:0/698950950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81e40053c0 0x7f81e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:36.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.011+0000 7f81fde00640 1 --2- 172.21.15.19:0/698950950 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f81e4003a90 0x7f81e4003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:36.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.012+0000 7f81fd400640 1 --2- 172.21.15.19:0/698950950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81e4004800 0x7f81e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:36.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.012+0000 7f81fe800640 1 -- 172.21.15.19:0/698950950 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f81e4003a90 msgr2=0x7f81e4003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:36.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.012+0000 7f81fe800640 1 --2- 172.21.15.19:0/698950950 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f81e4003a90 0x7f81e4003eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:36.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.012+0000 7f81fe800640 1 -- 172.21.15.19:0/698950950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81e4004800 msgr2=0x7f81e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:36.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.012+0000 7f81fe800640 1 --2- 172.21.15.19:0/698950950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81e4004800 0x7f81e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:36.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.012+0000 7f81fe800640 1 -- 172.21.15.19:0/698950950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e4003520 con 0x7f81e40053c0 2024-03-08T06:05:36.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.012+0000 7f81fd400640 1 --2- 172.21.15.19:0/698950950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81e4004800 0x7f81e4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:36.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.013+0000 7f81fe800640 1 -- 172.21.15.19:0/698950950 reap_dead start 2024-03-08T06:05:36.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.013+0000 7f81fe800640 1 --2- 172.21.15.19:0/698950950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81e40053c0 0x7f81e400b9c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f81f8001e20 tx=0x7f81e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb12786006f2b8d4 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:36.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.013+0000 7f81fca00640 1 -- 172.21.15.19:0/698950950 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f8001a70 con 0x7f81e40053c0 2024-03-08T06:05:36.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.013+0000 7f81fca00640 1 -- 172.21.15.19:0/698950950 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f8003b70 con 0x7f81e40053c0 2024-03-08T06:05:36.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.013+0000 7f81fca00640 1 -- 172.21.15.19:0/698950950 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f80050d0 con 0x7f81e40053c0 2024-03-08T06:05:36.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.013+0000 7f81ff200640 1 -- 172.21.15.19:0/698950950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81e40053c0 msgr2=0x7f81e400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:36.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.013+0000 7f81ff200640 1 --2- 172.21.15.19:0/698950950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81e40053c0 0x7f81e400b9c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f81f8001e20 tx=0x7f81e4005830 comp rx=0 tx=0).stop 2024-03-08T06:05:36.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.014+0000 7f81ff200640 1 -- 172.21.15.19:0/698950950 shutdown_connections 2024-03-08T06:05:36.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.014+0000 7f81ff200640 1 --2- 172.21.15.19:0/698950950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81e40053c0 0x7f81e400b9c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:36.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.014+0000 7f81ff200640 1 -- 172.21.15.19:0/698950950 >> 172.21.15.19:0/698950950 conn(0x7f820006c700 msgr2=0x7f820006cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:36.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.014+0000 7f81ff200640 1 -- 172.21.15.19:0/698950950 shutdown_connections 2024-03-08T06:05:36.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.014+0000 7f81ff200640 1 -- 172.21.15.19:0/698950950 wait complete. 2024-03-08T06:05:36.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.016+0000 7f81ff200640 1 Processor -- start 2024-03-08T06:05:36.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.016+0000 7f81ff200640 1 -- start start 2024-03-08T06:05:36.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.017+0000 7f81ff200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81e40053c0 0x7f82001e6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:36.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.017+0000 7f81ff200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f82000c9020 0x7f82000b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:36.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.017+0000 7f81ff200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82000c9480 0x7f82000b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:36.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.017+0000 7f81ff200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82000ceac0 con 0x7f82000c9480 2024-03-08T06:05:36.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.017+0000 7f81ff200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82000cf080 con 0x7f81e40053c0 2024-03-08T06:05:36.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.017+0000 7f81ff200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82000b27a0 con 0x7f82000c9020 2024-03-08T06:05:36.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.017+0000 7f81fe800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82000c9480 0x7f82000b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:36.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.017+0000 7f81fe800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82000c9480 0x7f82000b5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40762/0 (socket says 172.21.15.19:40762) 2024-03-08T06:05:36.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.017+0000 7f81fe800640 1 -- 172.21.15.19:0/37944399 learned_addr learned my addr 172.21.15.19:0/37944399 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:36.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.017+0000 7f81fde00640 1 --2- 172.21.15.19:0/37944399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81e40053c0 0x7f82001e6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:36.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.018+0000 7f81fd400640 1 --2- 172.21.15.19:0/37944399 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f82000c9020 0x7f82000b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:36.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.018+0000 7f81fe800640 1 -- 172.21.15.19:0/37944399 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f82000c9020 msgr2=0x7f82000b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:36.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.018+0000 7f81fe800640 1 --2- 172.21.15.19:0/37944399 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f82000c9020 0x7f82000b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:36.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.018+0000 7f81fe800640 1 -- 172.21.15.19:0/37944399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81e40053c0 msgr2=0x7f82001e6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:36.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.018+0000 7f81fe800640 1 --2- 172.21.15.19:0/37944399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81e40053c0 0x7f82001e6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:36.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.018+0000 7f81fe800640 1 -- 172.21.15.19:0/37944399 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8200149b80 con 0x7f82000c9480 2024-03-08T06:05:36.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.018+0000 7f81fd400640 1 --2- 172.21.15.19:0/37944399 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f82000c9020 0x7f82000b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:36.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.018+0000 7f81fe800640 1 --2- 172.21.15.19:0/37944399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82000c9480 0x7f82000b5180 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f81f8000f80 tx=0x7f81f80014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:36.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.018+0000 7f81f6000640 1 -- 172.21.15.19:0/37944399 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f8007db0 con 0x7f82000c9480 2024-03-08T06:05:36.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.018+0000 7f81f6000640 1 -- 172.21.15.19:0/37944399 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f8006b50 con 0x7f82000c9480 2024-03-08T06:05:36.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.018+0000 7f81f6000640 1 -- 172.21.15.19:0/37944399 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f8007030 con 0x7f82000c9480 2024-03-08T06:05:36.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.018+0000 7f81ff200640 1 -- 172.21.15.19:0/37944399 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8200149e60 con 0x7f82000c9480 2024-03-08T06:05:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.019+0000 7f81ff200640 1 -- 172.21.15.19:0/37944399 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820014a420 con 0x7f82000c9480 2024-03-08T06:05:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.020+0000 7f81ff200640 1 -- 172.21.15.19:0/37944399 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8200075090 con 0x7f82000c9480 2024-03-08T06:05:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.021+0000 7f81f6000640 1 -- 172.21.15.19:0/37944399 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f81f80071d0 con 0x7f82000c9480 2024-03-08T06:05:36.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.022+0000 7f81f6000640 1 --2- 172.21.15.19:0/37944399 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f81e006b520 0x7f81e006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:36.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.022+0000 7f81f6000640 1 -- 172.21.15.19:0/37944399 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81f80abc30 con 0x7f82000c9480 2024-03-08T06:05:36.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.022+0000 7f81fde00640 1 --2- 172.21.15.19:0/37944399 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f81e006b520 0x7f81e006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:36.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.023+0000 7f81fde00640 1 --2- 172.21.15.19:0/37944399 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f81e006b520 0x7f81e006d9e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f81f0009a10 tx=0x7f81f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:36.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.027+0000 7f81f6000640 1 -- 172.21.15.19:0/37944399 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f81f8033030 con 0x7f82000c9480 2024-03-08T06:05:36.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.237+0000 7f81ff200640 1 -- 172.21.15.19:0/37944399 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f82000ca880 con 0x7f82000c9480 2024-03-08T06:05:36.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.238+0000 7f81f6000640 1 -- 172.21.15.19:0/37944399 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) v1 ==== 80+0+0 (secure 0 0 0) 0x7f81f807ab20 con 0x7f82000c9480 2024-03-08T06:05:36.239 INFO:teuthology.orchestra.run.smithi019.stderr:listed 0 entries 2024-03-08T06:05:36.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.240+0000 7f81ff200640 1 -- 172.21.15.19:0/37944399 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f81e006b520 msgr2=0x7f81e006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.240+0000 7f81ff200640 1 --2- 172.21.15.19:0/37944399 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f81e006b520 0x7f81e006d9e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f81f0009a10 tx=0x7f81f0008040 comp rx=0 tx=0).stop 2024-03-08T06:05:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.240+0000 7f81ff200640 1 -- 172.21.15.19:0/37944399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82000c9480 msgr2=0x7f82000b5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.240+0000 7f81ff200640 1 --2- 172.21.15.19:0/37944399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82000c9480 0x7f82000b5180 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f81f8000f80 tx=0x7f81f80014a0 comp rx=0 tx=0).stop 2024-03-08T06:05:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.241+0000 7f81ff200640 1 -- 172.21.15.19:0/37944399 shutdown_connections 2024-03-08T06:05:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.241+0000 7f81ff200640 1 --2- 172.21.15.19:0/37944399 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f81e006b520 0x7f81e006d9e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.241+0000 7f81ff200640 1 --2- 172.21.15.19:0/37944399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82000c9480 0x7f82000b5180 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.241+0000 7f81ff200640 1 --2- 172.21.15.19:0/37944399 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f82000c9020 0x7f82000b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.241+0000 7f81ff200640 1 --2- 172.21.15.19:0/37944399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f81e40053c0 0x7f82001e6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.241+0000 7f81ff200640 1 -- 172.21.15.19:0/37944399 >> 172.21.15.19:0/37944399 conn(0x7f820006c700 msgr2=0x7f82000b6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:36.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.241+0000 7f81ff200640 1 -- 172.21.15.19:0/37944399 shutdown_connections 2024-03-08T06:05:36.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.241+0000 7f81ff200640 1 -- 172.21.15.19:0/37944399 wait complete. 2024-03-08T06:05:36.260 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-08T06:05:36.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:05:36.260 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-03-08T06:05:36.382 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2024-03-08T06:05:36.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:05:36.382 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-08T06:05:36.439 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:05:36.439 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:05:36.500 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054202,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249800k,nr_inodes=812450,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-08T06:05:36.500 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:05:36.500 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:05:36.561 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054202,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249800k,nr_inodes=812450,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-08T06:05:36.562 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T06:05:36.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.791+0000 7f7bcec00640 1 Processor -- start 2024-03-08T06:05:36.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.791+0000 7f7bcec00640 1 -- start start 2024-03-08T06:05:36.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.793+0000 7f7bcec00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7bc806e280 0x7f7bc8071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:36.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.793+0000 7f7bcec00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7bc80b46a0 0x7f7bc8071d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:36.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.793+0000 7f7bcec00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc815cbb0 con 0x7f7bc815c7d0 2024-03-08T06:05:36.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.793+0000 7f7bcec00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc806ddf0 con 0x7f7bc806e280 2024-03-08T06:05:36.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.793+0000 7f7bcec00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc80b4c40 con 0x7f7bc80b46a0 2024-03-08T06:05:36.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.793+0000 7f7bc7400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7bc806e280 0x7f7bc8071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:36.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.793+0000 7f7bc7e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7bc815c7d0 0x7f7bc8163160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44512/0 (socket says 172.21.15.19:44512) 2024-03-08T06:05:36.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.793+0000 7f7bc7400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7bc806e280 0x7f7bc8071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40764/0 (socket says 172.21.15.19:40764) 2024-03-08T06:05:36.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.793+0000 7f7bc7e00640 1 -- 172.21.15.19:0/2335590855 learned_addr learned my addr 172.21.15.19:0/2335590855 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:36.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.794+0000 7f7bccc00640 1 --2- 172.21.15.19:0/2335590855 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7bc80b46a0 0x7f7bc8071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:36.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.794+0000 7f7bc7400640 1 -- 172.21.15.19:0/2335590855 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7bc80b46a0 msgr2=0x7f7bc8071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:36.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.794+0000 7f7bc7400640 1 --2- 172.21.15.19:0/2335590855 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7bc80b46a0 0x7f7bc8071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:36.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.794+0000 7f7bc7400640 1 -- 172.21.15.19:0/2335590855 >> v1:172.21.15.19:6789/0 conn(0x7f7bc815c7d0 legacy=0x7f7bc8163160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:36.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.794+0000 7f7bc7400640 1 -- 172.21.15.19:0/2335590855 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc806d7a0 con 0x7f7bc806e280 2024-03-08T06:05:36.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.795+0000 7f7bc7400640 1 --2- 172.21.15.19:0/2335590855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bc806e280 0x7f7bc8071840 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7bb40097a0 tx=0x7f7bb402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a8f6dbc32bb18e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:36.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.795+0000 7f7bc6a00640 1 -- 172.21.15.19:0/2335590855 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4031780 con 0x7f7bc806e280 2024-03-08T06:05:36.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.795+0000 7f7bc6a00640 1 -- 172.21.15.19:0/2335590855 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb4037070 con 0x7f7bc806e280 2024-03-08T06:05:36.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.795+0000 7f7bc6a00640 1 -- 172.21.15.19:0/2335590855 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4031b40 con 0x7f7bc806e280 2024-03-08T06:05:36.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.796+0000 7f7bcec00640 1 -- 172.21.15.19:0/2335590855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bc806e280 msgr2=0x7f7bc8071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:36.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.796+0000 7f7bcec00640 1 --2- 172.21.15.19:0/2335590855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bc806e280 0x7f7bc8071840 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7bb40097a0 tx=0x7f7bb402b820 comp rx=0 tx=0).stop 2024-03-08T06:05:36.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.796+0000 7f7bcec00640 1 -- 172.21.15.19:0/2335590855 shutdown_connections 2024-03-08T06:05:36.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.796+0000 7f7bcec00640 1 --2- 172.21.15.19:0/2335590855 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7bc80b46a0 0x7f7bc8071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:36.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.796+0000 7f7bcec00640 1 --2- 172.21.15.19:0/2335590855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bc806e280 0x7f7bc8071840 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:36.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.796+0000 7f7bcec00640 1 -- 172.21.15.19:0/2335590855 >> 172.21.15.19:0/2335590855 conn(0x7f7bc806ae30 msgr2=0x7f7bc806b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:36.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.796+0000 7f7bcec00640 1 -- 172.21.15.19:0/2335590855 shutdown_connections 2024-03-08T06:05:36.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.796+0000 7f7bcec00640 1 -- 172.21.15.19:0/2335590855 wait complete. 2024-03-08T06:05:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.798+0000 7f7bcec00640 1 Processor -- start 2024-03-08T06:05:36.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.798+0000 7f7bcec00640 1 -- start start 2024-03-08T06:05:36.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.799+0000 7f7bcec00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bc806e280 0x7f7bc8159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:36.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.799+0000 7f7bcec00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bc80b46a0 0x7f7bc8151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:36.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.799+0000 7f7bcec00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7bc815c7d0 0x7f7bc8155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:36.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.799+0000 7f7bcec00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc80b2af0 con 0x7f7bc80b46a0 2024-03-08T06:05:36.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.799+0000 7f7bcec00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc80b2970 con 0x7f7bc806e280 2024-03-08T06:05:36.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.799+0000 7f7bcec00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc80b2c70 con 0x7f7bc815c7d0 2024-03-08T06:05:36.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.799+0000 7f7bc7400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bc80b46a0 0x7f7bc8151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:36.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.799+0000 7f7bc7400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bc80b46a0 0x7f7bc8151de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40768/0 (socket says 172.21.15.19:40768) 2024-03-08T06:05:36.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.799+0000 7f7bc7400640 1 -- 172.21.15.19:0/2092542859 learned_addr learned my addr 172.21.15.19:0/2092542859 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:36.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.800+0000 7f7bc7e00640 1 --2- 172.21.15.19:0/2092542859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bc806e280 0x7f7bc8159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:36.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.800+0000 7f7bc7400640 1 -- 172.21.15.19:0/2092542859 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7bc815c7d0 msgr2=0x7f7bc8155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:36.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.800+0000 7f7bc7400640 1 --2- 172.21.15.19:0/2092542859 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7bc815c7d0 0x7f7bc8155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:36.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.800+0000 7f7bc7400640 1 -- 172.21.15.19:0/2092542859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bc806e280 msgr2=0x7f7bc8159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:36.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.800+0000 7f7bc7400640 1 --2- 172.21.15.19:0/2092542859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bc806e280 0x7f7bc8159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:36.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.800+0000 7f7bc7400640 1 -- 172.21.15.19:0/2092542859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc8152320 con 0x7f7bc80b46a0 2024-03-08T06:05:36.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.800+0000 7f7bc7e00640 1 --2- 172.21.15.19:0/2092542859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bc806e280 0x7f7bc8159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:36.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.800+0000 7f7bc7400640 1 --2- 172.21.15.19:0/2092542859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bc80b46a0 0x7f7bc8151de0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4034040 tx=0x7f7bb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.801+0000 7f7bbfe00640 1 -- 172.21.15.19:0/2092542859 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4032610 con 0x7f7bc80b46a0 2024-03-08T06:05:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.801+0000 7f7bbfe00640 1 -- 172.21.15.19:0/2092542859 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb40327b0 con 0x7f7bc80b46a0 2024-03-08T06:05:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.801+0000 7f7bbfe00640 1 -- 172.21.15.19:0/2092542859 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4032ba0 con 0x7f7bc80b46a0 2024-03-08T06:05:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.801+0000 7f7bcec00640 1 -- 172.21.15.19:0/2092542859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc81559b0 con 0x7f7bc80b46a0 2024-03-08T06:05:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.801+0000 7f7bcec00640 1 -- 172.21.15.19:0/2092542859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc80b0090 con 0x7f7bc80b46a0 2024-03-08T06:05:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.802+0000 7f7bcec00640 1 -- 172.21.15.19:0/2092542859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc8067cb0 con 0x7f7bc80b46a0 2024-03-08T06:05:36.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.803+0000 7f7bbfe00640 1 -- 172.21.15.19:0/2092542859 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f7bb404e440 con 0x7f7bc80b46a0 2024-03-08T06:05:36.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.804+0000 7f7bbfe00640 1 --2- 172.21.15.19:0/2092542859 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7ba806b500 0x7f7ba806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:36.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.804+0000 7f7bbfe00640 1 -- 172.21.15.19:0/2092542859 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7bb40ac2a0 con 0x7f7bc80b46a0 2024-03-08T06:05:36.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.804+0000 7f7bc7e00640 1 --2- 172.21.15.19:0/2092542859 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7ba806b500 0x7f7ba806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:36.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.805+0000 7f7bc7e00640 1 --2- 172.21.15.19:0/2092542859 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7ba806b500 0x7f7ba806d9c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8000f60 tx=0x7f7bb8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:36.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:36.808+0000 7f7bbfe00640 1 -- 172.21.15.19:0/2092542859 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7bc81559b0 con 0x7f7bc80b46a0 2024-03-08T06:05:37.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.046+0000 7f7bcec00640 1 -- 172.21.15.19:0/2092542859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7bc806b590 con 0x7f7bc80b46a0 2024-03-08T06:05:37.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.047+0000 7f7bbfe00640 1 -- 172.21.15.19:0/2092542859 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f7bb4040070 con 0x7f7bc80b46a0 2024-03-08T06:05:37.048 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:05:37.048 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3542863285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3542863285},{"type":"v1","addr":"172.21.15.42:6833","nonce":3542863285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4708,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1679053115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1679053115},{"type":"v1","addr":"172.21.15.42:6835","nonce":1679053115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5022,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/717236359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":717236359},{"type":"v1","addr":"172.21.15.19:6835","nonce":717236359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T06:04:30.148899+0000","modified":"2024-03-08T06:04:33.195351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6837/1359509141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1359509141},{"type":"v1","addr":"172.21.15.19:6837","nonce":1359509141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-08T06:05:37.048 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 16 2024-03-08T06:05:37.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.049+0000 7f7bcec00640 1 -- 172.21.15.19:0/2092542859 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7ba806b500 msgr2=0x7f7ba806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:37.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.049+0000 7f7bcec00640 1 --2- 172.21.15.19:0/2092542859 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7ba806b500 0x7f7ba806d9c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8000f60 tx=0x7f7bb8009040 comp rx=0 tx=0).stop 2024-03-08T06:05:37.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.050+0000 7f7bcec00640 1 -- 172.21.15.19:0/2092542859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bc80b46a0 msgr2=0x7f7bc8151de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:37.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.050+0000 7f7bcec00640 1 --2- 172.21.15.19:0/2092542859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bc80b46a0 0x7f7bc8151de0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4034040 tx=0x7f7bb40046c0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.050+0000 7f7bcec00640 1 -- 172.21.15.19:0/2092542859 shutdown_connections 2024-03-08T06:05:37.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.050+0000 7f7bcec00640 1 --2- 172.21.15.19:0/2092542859 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f7ba806b500 0x7f7ba806d9c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.050+0000 7f7bcec00640 1 --2- 172.21.15.19:0/2092542859 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f7bc815c7d0 0x7f7bc8155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.050+0000 7f7bcec00640 1 --2- 172.21.15.19:0/2092542859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bc80b46a0 0x7f7bc8151de0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.050+0000 7f7bcec00640 1 --2- 172.21.15.19:0/2092542859 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7bc806e280 0x7f7bc8159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.050+0000 7f7bcec00640 1 -- 172.21.15.19:0/2092542859 >> 172.21.15.19:0/2092542859 conn(0x7f7bc806ae30 msgr2=0x7f7bc8162570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.050+0000 7f7bcec00640 1 -- 172.21.15.19:0/2092542859 shutdown_connections 2024-03-08T06:05:37.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.050+0000 7f7bcec00640 1 -- 172.21.15.19:0/2092542859 wait complete. 2024-03-08T06:05:37.069 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:05:37.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.276+0000 7fab75c00640 1 Processor -- start 2024-03-08T06:05:37.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.276+0000 7fab75c00640 1 -- start start 2024-03-08T06:05:37.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.277+0000 7fab75c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fab70161740 0x7fab700b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:37.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.277+0000 7fab75c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fab700716e0 0x7fab70071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:37.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.278+0000 7fab75c00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab70161d20 con 0x7fab7015b6c0 2024-03-08T06:05:37.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.278+0000 7fab75c00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab7015e280 con 0x7fab700716e0 2024-03-08T06:05:37.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.278+0000 7fab75c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab700b4740 con 0x7fab70161740 2024-03-08T06:05:37.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.278+0000 7fab6fe00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fab7015b6c0 0x7fab700adec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44528/0 (socket says 172.21.15.19:44528) 2024-03-08T06:05:37.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.278+0000 7fab6fe00640 1 -- 172.21.15.19:0/3377953697 learned_addr learned my addr 172.21.15.19:0/3377953697 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:37.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.278+0000 7fab75200640 1 --2- 172.21.15.19:0/3377953697 >> v2:172.21.15.42:3300/0 conn(0x7fab700716e0 0x7fab70071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:37.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.278+0000 7fab6ea00640 1 -- 172.21.15.19:0/3377953697 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615417032 0 0) 0x7fab70161d20 con 0x7fab7015b6c0 2024-03-08T06:05:37.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.278+0000 7fab6ea00640 1 -- 172.21.15.19:0/3377953697 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab54003520 con 0x7fab7015b6c0 2024-03-08T06:05:37.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.278+0000 7fab6f400640 1 --2- 172.21.15.19:0/3377953697 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fab70161740 0x7fab700b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:37.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.279+0000 7fab6ea00640 1 -- 172.21.15.19:0/3377953697 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4070955373 0 0) 0x7fab54003520 con 0x7fab7015b6c0 2024-03-08T06:05:37.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.279+0000 7fab6ea00640 1 -- 172.21.15.19:0/3377953697 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fab70161740 msgr2=0x7fab700b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:37.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.279+0000 7fab6ea00640 1 --2- 172.21.15.19:0/3377953697 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fab70161740 0x7fab700b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.279+0000 7fab6ea00640 1 -- 172.21.15.19:0/3377953697 >> v2:172.21.15.42:3300/0 conn(0x7fab700716e0 msgr2=0x7fab70071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:37.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.279+0000 7fab6ea00640 1 --2- 172.21.15.19:0/3377953697 >> v2:172.21.15.42:3300/0 conn(0x7fab700716e0 0x7fab70071b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.279+0000 7fab6ea00640 1 -- 172.21.15.19:0/3377953697 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab70162000 con 0x7fab7015b6c0 2024-03-08T06:05:37.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.279+0000 7fab6ea00640 1 -- 172.21.15.19:0/3377953697 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7fab60001670 con 0x7fab7015b6c0 2024-03-08T06:05:37.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.279+0000 7fab6ea00640 1 -- 172.21.15.19:0/3377953697 >> v1:172.21.15.19:6789/0 conn(0x7fab7015b6c0 legacy=0x7fab700adec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:37.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.279+0000 7fab6ea00640 1 --2- 172.21.15.19:0/3377953697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab540039b0 0x7fab54003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:37.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.279+0000 7fab6ea00640 1 --2- 172.21.15.19:0/3377953697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab54004800 0x7fab54004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:37.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.279+0000 7fab6ea00640 1 --2- 172.21.15.19:0/3377953697 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fab540051c0 0x7fab5400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:37.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.279+0000 7fab6ea00640 1 -- 172.21.15.19:0/3377953697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7015e280 con 0x7fab540039b0 2024-03-08T06:05:37.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.279+0000 7fab6ea00640 1 -- 172.21.15.19:0/3377953697 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab700b4740 con 0x7fab54004800 2024-03-08T06:05:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.279+0000 7fab6ea00640 1 -- 172.21.15.19:0/3377953697 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5400bfb0 con 0x7fab540051c0 2024-03-08T06:05:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.279+0000 7fab6f400640 1 --2- 172.21.15.19:0/3377953697 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fab70161740 0x7fab700b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:05:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.279+0000 7fab6fe00640 1 --2- 172.21.15.19:0/3377953697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab540039b0 0x7fab54003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.280+0000 7fab6fe00640 1 -- 172.21.15.19:0/3377953697 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fab540051c0 msgr2=0x7fab5400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.280+0000 7fab6fe00640 1 --2- 172.21.15.19:0/3377953697 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fab540051c0 0x7fab5400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.280+0000 7fab6fe00640 1 -- 172.21.15.19:0/3377953697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab54004800 msgr2=0x7fab54004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.280+0000 7fab6fe00640 1 --2- 172.21.15.19:0/3377953697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab54004800 0x7fab54004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.280+0000 7fab6fe00640 1 -- 172.21.15.19:0/3377953697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab54003520 con 0x7fab540039b0 2024-03-08T06:05:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.281+0000 7fab6fe00640 1 --2- 172.21.15.19:0/3377953697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab540039b0 0x7fab54003dd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fab6000c190 tx=0x7fab54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5fc1e399e5af0fb server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.281+0000 7fab6ea00640 1 -- 172.21.15.19:0/3377953697 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab60007c80 con 0x7fab540039b0 2024-03-08T06:05:37.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.281+0000 7fab6ea00640 1 -- 172.21.15.19:0/3377953697 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab60030070 con 0x7fab540039b0 2024-03-08T06:05:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.281+0000 7fab6ea00640 1 -- 172.21.15.19:0/3377953697 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab60005d30 con 0x7fab540039b0 2024-03-08T06:05:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.282+0000 7fab75c00640 1 -- 172.21.15.19:0/3377953697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab540039b0 msgr2=0x7fab54003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.282+0000 7fab75c00640 1 --2- 172.21.15.19:0/3377953697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab540039b0 0x7fab54003dd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fab6000c190 tx=0x7fab54005830 comp rx=0 tx=0).stop 2024-03-08T06:05:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.282+0000 7fab75200640 1 -- 172.21.15.19:0/3377953697 reap_dead start 2024-03-08T06:05:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.282+0000 7fab75c00640 1 -- 172.21.15.19:0/3377953697 shutdown_connections 2024-03-08T06:05:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.282+0000 7fab75c00640 1 -- 172.21.15.19:0/3377953697 >> 172.21.15.19:0/3377953697 conn(0x7fab700b1850 msgr2=0x7fab700b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.282+0000 7fab75c00640 1 -- 172.21.15.19:0/3377953697 shutdown_connections 2024-03-08T06:05:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.282+0000 7fab75c00640 1 -- 172.21.15.19:0/3377953697 wait complete. 2024-03-08T06:05:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.284+0000 7fab75c00640 1 Processor -- start 2024-03-08T06:05:37.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.284+0000 7fab75c00640 1 -- start start 2024-03-08T06:05:37.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.285+0000 7fab75c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab540039b0 0x7fab700cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:37.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.285+0000 7fab75c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fab700c6d00 0x7fab700ce450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:37.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.285+0000 7fab75c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab701599d0 0x7fab70159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:37.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.285+0000 7fab75c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7015baa0 con 0x7fab701599d0 2024-03-08T06:05:37.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.285+0000 7fab75c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab701625c0 con 0x7fab540039b0 2024-03-08T06:05:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.285+0000 7fab75c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab700ae5d0 con 0x7fab700c6d00 2024-03-08T06:05:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.285+0000 7fab75200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab701599d0 0x7fab70159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.285+0000 7fab75200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab701599d0 0x7fab70159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40790/0 (socket says 172.21.15.19:40790) 2024-03-08T06:05:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.285+0000 7fab75200640 1 -- 172.21.15.19:0/579670483 learned_addr learned my addr 172.21.15.19:0/579670483 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.285+0000 7fab6fe00640 1 --2- 172.21.15.19:0/579670483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab540039b0 0x7fab700cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.285+0000 7fab6f400640 1 --2- 172.21.15.19:0/579670483 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fab700c6d00 0x7fab700ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.286+0000 7fab75200640 1 -- 172.21.15.19:0/579670483 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fab700c6d00 msgr2=0x7fab700ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.286+0000 7fab75200640 1 --2- 172.21.15.19:0/579670483 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fab700c6d00 0x7fab700ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.286+0000 7fab75200640 1 -- 172.21.15.19:0/579670483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab540039b0 msgr2=0x7fab700cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.286+0000 7fab75200640 1 --2- 172.21.15.19:0/579670483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab540039b0 0x7fab700cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.286+0000 7fab75200640 1 -- 172.21.15.19:0/579670483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab700ccc50 con 0x7fab701599d0 2024-03-08T06:05:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.286+0000 7fab75200640 1 --2- 172.21.15.19:0/579670483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab701599d0 0x7fab70159e50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fab700b4080 tx=0x7fab6800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.286+0000 7fab67e00640 1 -- 172.21.15.19:0/579670483 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6800bae0 con 0x7fab701599d0 2024-03-08T06:05:37.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.286+0000 7fab67e00640 1 -- 172.21.15.19:0/579670483 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6801a070 con 0x7fab701599d0 2024-03-08T06:05:37.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.286+0000 7fab67e00640 1 -- 172.21.15.19:0/579670483 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab68014400 con 0x7fab701599d0 2024-03-08T06:05:37.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.286+0000 7fab75c00640 1 -- 172.21.15.19:0/579670483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab700ccf30 con 0x7fab701599d0 2024-03-08T06:05:37.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.286+0000 7fab75c00640 1 -- 172.21.15.19:0/579670483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab700cd4f0 con 0x7fab701599d0 2024-03-08T06:05:37.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.287+0000 7fab75c00640 1 -- 172.21.15.19:0/579670483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab70075100 con 0x7fab701599d0 2024-03-08T06:05:37.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.289+0000 7fab67e00640 1 -- 172.21.15.19:0/579670483 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fab68005d10 con 0x7fab701599d0 2024-03-08T06:05:37.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.289+0000 7fab67e00640 1 --2- 172.21.15.19:0/579670483 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fab5006b4d0 0x7fab5006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:37.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.290+0000 7fab67e00640 1 -- 172.21.15.19:0/579670483 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab6808a430 con 0x7fab701599d0 2024-03-08T06:05:37.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.290+0000 7fab6fe00640 1 --2- 172.21.15.19:0/579670483 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fab5006b4d0 0x7fab5006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:37.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.290+0000 7fab6fe00640 1 --2- 172.21.15.19:0/579670483 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fab5006b4d0 0x7fab5006d990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fab60034000 tx=0x7fab60007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:37.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.294+0000 7fab67e00640 1 -- 172.21.15.19:0/579670483 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fab68024020 con 0x7fab701599d0 2024-03-08T06:05:37.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.494+0000 7fab75c00640 1 -- 172.21.15.19:0/579670483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab700b4ca0 con 0x7fab701599d0 2024-03-08T06:05:37.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.496+0000 7fab67e00640 1 -- 172.21.15.19:0/579670483 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16609 (secure 0 0 0) 0x7fab68059210 con 0x7fab701599d0 2024-03-08T06:05:37.498 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:05:37.498 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":34,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:04:31.685292+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:04:28.095112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-08T06:04:29.178532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:05:37.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.499+0000 7fab75c00640 1 -- 172.21.15.19:0/579670483 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fab5006b4d0 msgr2=0x7fab5006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.499+0000 7fab75c00640 1 --2- 172.21.15.19:0/579670483 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fab5006b4d0 0x7fab5006d990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fab60034000 tx=0x7fab60007000 comp rx=0 tx=0).stop 2024-03-08T06:05:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.499+0000 7fab75c00640 1 -- 172.21.15.19:0/579670483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab701599d0 msgr2=0x7fab70159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.499+0000 7fab75c00640 1 --2- 172.21.15.19:0/579670483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab701599d0 0x7fab70159e50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fab700b4080 tx=0x7fab6800b480 comp rx=0 tx=0).stop 2024-03-08T06:05:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.499+0000 7fab75c00640 1 -- 172.21.15.19:0/579670483 shutdown_connections 2024-03-08T06:05:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.499+0000 7fab75c00640 1 --2- 172.21.15.19:0/579670483 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fab5006b4d0 0x7fab5006d990 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.499+0000 7fab75c00640 1 --2- 172.21.15.19:0/579670483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab701599d0 0x7fab70159e50 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.499+0000 7fab75c00640 1 --2- 172.21.15.19:0/579670483 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fab700c6d00 0x7fab700ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.499+0000 7fab75c00640 1 --2- 172.21.15.19:0/579670483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fab540039b0 0x7fab700cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.499+0000 7fab75c00640 1 -- 172.21.15.19:0/579670483 >> 172.21.15.19:0/579670483 conn(0x7fab700b1850 msgr2=0x7fab700af960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.499+0000 7fab75c00640 1 -- 172.21.15.19:0/579670483 shutdown_connections 2024-03-08T06:05:37.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.499+0000 7fab75c00640 1 -- 172.21.15.19:0/579670483 wait complete. 2024-03-08T06:05:37.519 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-08T06:03:14.149736+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-08T06:04:28.095112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-08T06:04:29.178532+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-08T06:05:37.520 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-08T06:05:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.742+0000 7f3215e00640 1 Processor -- start 2024-03-08T06:05:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.742+0000 7f3215e00640 1 -- start start 2024-03-08T06:05:37.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.743+0000 7f3215e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3210145500 0x7f321006ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:37.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.743+0000 7f3215e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f321015bfb0 0x7f32100716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:37.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.744+0000 7f3215e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3210071c20 0x7f321006d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:37.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.744+0000 7f3215e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3210072050 con 0x7f3210071c20 2024-03-08T06:05:37.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.744+0000 7f3215e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321015c460 con 0x7f321015bfb0 2024-03-08T06:05:37.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.744+0000 7f3215e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321015c740 con 0x7f3210145500 2024-03-08T06:05:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.744+0000 7f3215400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3210071c20 0x7f321006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.744+0000 7f3215400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3210071c20 0x7f321006d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40804/0 (socket says 172.21.15.19:40804) 2024-03-08T06:05:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.744+0000 7f3215400640 1 -- 172.21.15.19:0/625259006 learned_addr learned my addr 172.21.15.19:0/625259006 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.744+0000 7f3215400640 1 -- 172.21.15.19:0/625259006 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3210145500 msgr2=0x7f321006ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.744+0000 7f3214a00640 1 --2- 172.21.15.19:0/625259006 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3210145500 0x7f321006ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.744+0000 7f3215400640 1 --2- 172.21.15.19:0/625259006 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3210145500 0x7f321006ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.744+0000 7f3215400640 1 -- 172.21.15.19:0/625259006 >> v2:172.21.15.42:3300/0 conn(0x7f321015bfb0 msgr2=0x7f32100716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.744+0000 7f3207e00640 1 --2- 172.21.15.19:0/625259006 >> v2:172.21.15.42:3300/0 conn(0x7f321015bfb0 0x7f32100716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.745+0000 7f3215400640 1 --2- 172.21.15.19:0/625259006 >> v2:172.21.15.42:3300/0 conn(0x7f321015bfb0 0x7f32100716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.745+0000 7f3215400640 1 -- 172.21.15.19:0/625259006 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321015ca20 con 0x7f3210071c20 2024-03-08T06:05:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.745+0000 7f3207e00640 1 --2- 172.21.15.19:0/625259006 >> v2:172.21.15.42:3300/0 conn(0x7f321015bfb0 0x7f32100716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.746+0000 7f3215400640 1 --2- 172.21.15.19:0/625259006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3210071c20 0x7f321006d220 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f321006f9b0 tx=0x7f320802b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b07b0cb1fb355d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.746+0000 7f320fe00640 1 -- 172.21.15.19:0/625259006 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32080317d0 con 0x7f3210071c20 2024-03-08T06:05:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.746+0000 7f320fe00640 1 -- 172.21.15.19:0/625259006 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3208037070 con 0x7f3210071c20 2024-03-08T06:05:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.746+0000 7f320fe00640 1 -- 172.21.15.19:0/625259006 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3208031b90 con 0x7f3210071c20 2024-03-08T06:05:37.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.746+0000 7f3215e00640 1 -- 172.21.15.19:0/625259006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3210071c20 msgr2=0x7f321006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:37.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.746+0000 7f3215e00640 1 --2- 172.21.15.19:0/625259006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3210071c20 0x7f321006d220 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f321006f9b0 tx=0x7f320802b870 comp rx=0 tx=0).stop 2024-03-08T06:05:37.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.747+0000 7f3215e00640 1 -- 172.21.15.19:0/625259006 shutdown_connections 2024-03-08T06:05:37.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.747+0000 7f3215e00640 1 --2- 172.21.15.19:0/625259006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3210071c20 0x7f321006d220 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.747+0000 7f3215e00640 1 --2- 172.21.15.19:0/625259006 >> v2:172.21.15.42:3300/0 conn(0x7f321015bfb0 0x7f32100716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.747+0000 7f3215e00640 1 --2- 172.21.15.19:0/625259006 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3210145500 0x7f321006ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.747+0000 7f3215e00640 1 -- 172.21.15.19:0/625259006 >> 172.21.15.19:0/625259006 conn(0x7f32100b1850 msgr2=0x7f32100b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:37.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.747+0000 7f3215e00640 1 -- 172.21.15.19:0/625259006 shutdown_connections 2024-03-08T06:05:37.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.747+0000 7f3215e00640 1 -- 172.21.15.19:0/625259006 wait complete. 2024-03-08T06:05:37.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.748+0000 7f3215e00640 1 Processor -- start 2024-03-08T06:05:37.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.748+0000 7f3215e00640 1 -- start start 2024-03-08T06:05:37.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.749+0000 7f3215e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3210071c20 0x7f32101f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:37.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.749+0000 7f3215e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3210145500 0x7f3210139a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:37.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.749+0000 7f3215e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f321015bfb0 0x7f321013c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:37.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.749+0000 7f3215e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321006f370 con 0x7f3210071c20 2024-03-08T06:05:37.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.749+0000 7f3215e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321006f1f0 con 0x7f3210145500 2024-03-08T06:05:37.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.749+0000 7f3215e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321006d760 con 0x7f321015bfb0 2024-03-08T06:05:37.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.750+0000 7f3214a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3210071c20 0x7f32101f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:37.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.750+0000 7f3214a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3210071c20 0x7f32101f6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40816/0 (socket says 172.21.15.19:40816) 2024-03-08T06:05:37.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.750+0000 7f3214a00640 1 -- 172.21.15.19:0/1849213257 learned_addr learned my addr 172.21.15.19:0/1849213257 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:37.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.750+0000 7f3215400640 1 --2- 172.21.15.19:0/1849213257 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f321015bfb0 0x7f321013c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:37.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.750+0000 7f3214a00640 1 -- 172.21.15.19:0/1849213257 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f321015bfb0 msgr2=0x7f321013c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:37.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.750+0000 7f3207e00640 1 --2- 172.21.15.19:0/1849213257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3210145500 0x7f3210139a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.750+0000 7f3214a00640 1 --2- 172.21.15.19:0/1849213257 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f321015bfb0 0x7f321013c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.750+0000 7f3214a00640 1 -- 172.21.15.19:0/1849213257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3210145500 msgr2=0x7f3210139a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.750+0000 7f3214a00640 1 --2- 172.21.15.19:0/1849213257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3210145500 0x7f3210139a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.750+0000 7f3214a00640 1 -- 172.21.15.19:0/1849213257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32101f7010 con 0x7f3210071c20 2024-03-08T06:05:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.750+0000 7f3215400640 1 --2- 172.21.15.19:0/1849213257 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f321015bfb0 0x7f321013c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.750+0000 7f3207e00640 1 --2- 172.21.15.19:0/1849213257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3210145500 0x7f3210139a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.751+0000 7f3214a00640 1 --2- 172.21.15.19:0/1849213257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3210071c20 0x7f32101f6ad0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f320000ce40 tx=0x7f320000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.751+0000 7f320d600640 1 -- 172.21.15.19:0/1849213257 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200003b90 con 0x7f3210071c20 2024-03-08T06:05:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.751+0000 7f320d600640 1 -- 172.21.15.19:0/1849213257 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3200003d30 con 0x7f3210071c20 2024-03-08T06:05:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.751+0000 7f3215e00640 1 -- 172.21.15.19:0/1849213257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321013f000 con 0x7f3210071c20 2024-03-08T06:05:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.751+0000 7f320d600640 1 -- 172.21.15.19:0/1849213257 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200004260 con 0x7f3210071c20 2024-03-08T06:05:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.751+0000 7f3215e00640 1 -- 172.21.15.19:0/1849213257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321013f5c0 con 0x7f3210071c20 2024-03-08T06:05:37.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.752+0000 7f3215e00640 1 -- 172.21.15.19:0/1849213257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3210075090 con 0x7f3210071c20 2024-03-08T06:05:37.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.753+0000 7f320d600640 1 -- 172.21.15.19:0/1849213257 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3200004400 con 0x7f3210071c20 2024-03-08T06:05:37.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.754+0000 7f320d600640 1 --2- 172.21.15.19:0/1849213257 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f31ec06b4d0 0x7f31ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:37.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.754+0000 7f320d600640 1 -- 172.21.15.19:0/1849213257 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f320008ae60 con 0x7f3210071c20 2024-03-08T06:05:37.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.754+0000 7f3207e00640 1 --2- 172.21.15.19:0/1849213257 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f31ec06b4d0 0x7f31ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:37.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.755+0000 7f3207e00640 1 --2- 172.21.15.19:0/1849213257 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f31ec06b4d0 0x7f31ec06d990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f31f8006fd0 tx=0x7f31f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:37.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.758+0000 7f320d600640 1 -- 172.21.15.19:0/1849213257 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f32101f7010 con 0x7f3210071c20 2024-03-08T06:05:37.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.958+0000 7f3215e00640 1 -- 172.21.15.19:0/1849213257 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32100b1fb0 con 0x7f3210071c20 2024-03-08T06:05:37.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.959+0000 7f320d600640 1 -- 172.21.15.19:0/1849213257 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3200059bb0 con 0x7f3210071c20 2024-03-08T06:05:37.960 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-03-08T06:05:37.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.962+0000 7f3215e00640 1 -- 172.21.15.19:0/1849213257 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f31ec06b4d0 msgr2=0x7f31ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:37.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.962+0000 7f3215e00640 1 --2- 172.21.15.19:0/1849213257 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f31ec06b4d0 0x7f31ec06d990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f31f8006fd0 tx=0x7f31f8008040 comp rx=0 tx=0).stop 2024-03-08T06:05:37.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.962+0000 7f3215e00640 1 -- 172.21.15.19:0/1849213257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3210071c20 msgr2=0x7f32101f6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:37.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.962+0000 7f3215e00640 1 --2- 172.21.15.19:0/1849213257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3210071c20 0x7f32101f6ad0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f320000ce40 tx=0x7f320000a660 comp rx=0 tx=0).stop 2024-03-08T06:05:37.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.962+0000 7f3215e00640 1 -- 172.21.15.19:0/1849213257 shutdown_connections 2024-03-08T06:05:37.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.962+0000 7f3215e00640 1 --2- 172.21.15.19:0/1849213257 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f31ec06b4d0 0x7f31ec06d990 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.962+0000 7f3215e00640 1 --2- 172.21.15.19:0/1849213257 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f321015bfb0 0x7f321013c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.962+0000 7f3215e00640 1 --2- 172.21.15.19:0/1849213257 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3210145500 0x7f3210139a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.962+0000 7f3215e00640 1 --2- 172.21.15.19:0/1849213257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3210071c20 0x7f32101f6ad0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:37.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.962+0000 7f3215e00640 1 -- 172.21.15.19:0/1849213257 >> 172.21.15.19:0/1849213257 conn(0x7f32100b1850 msgr2=0x7f32100cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:37.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.962+0000 7f3215e00640 1 -- 172.21.15.19:0/1849213257 shutdown_connections 2024-03-08T06:05:37.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:37.962+0000 7f3215e00640 1 -- 172.21.15.19:0/1849213257 wait complete. 2024-03-08T06:05:37.986 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-08T06:05:38.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.214+0000 7f6c13e00640 1 Processor -- start 2024-03-08T06:05:38.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.215+0000 7f6c13e00640 1 -- start start 2024-03-08T06:05:38.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.216+0000 7f6c13e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6c1415de60 0x7f6c14161930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:38.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.216+0000 7f6c13e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6c140b9630 0x7f6c140ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:38.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.216+0000 7f6c13e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1415e240 con 0x7f6c140cee60 2024-03-08T06:05:38.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.216+0000 7f6c13e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c140cf2d0 con 0x7f6c140b9630 2024-03-08T06:05:38.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.216+0000 7f6c13e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c14162030 con 0x7f6c1415de60 2024-03-08T06:05:38.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.217+0000 7f6c12000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6c140b9630 0x7f6c140ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:38.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.217+0000 7f6c12000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6c140b9630 0x7f6c140ce920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40830/0 (socket says 172.21.15.19:40830) 2024-03-08T06:05:38.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.217+0000 7f6c12000640 1 -- 172.21.15.19:0/1481718187 learned_addr learned my addr 172.21.15.19:0/1481718187 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:38.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.217+0000 7f6c12a00640 1 --2- 172.21.15.19:0/1481718187 >> v2:172.21.15.42:3300/0 conn(0x7f6c1415de60 0x7f6c14161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:38.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.218+0000 7f6c12000640 1 -- 172.21.15.19:0/1481718187 >> v2:172.21.15.42:3300/0 conn(0x7f6c1415de60 msgr2=0x7f6c14161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:38.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.218+0000 7f6c12000640 1 --2- 172.21.15.19:0/1481718187 >> v2:172.21.15.42:3300/0 conn(0x7f6c1415de60 0x7f6c14161930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.218+0000 7f6c12000640 1 -- 172.21.15.19:0/1481718187 >> v1:172.21.15.42:6789/0 conn(0x7f6c140cee60 legacy=0x7f6c140b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:38.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.218+0000 7f6c12000640 1 -- 172.21.15.19:0/1481718187 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c14162310 con 0x7f6c140b9630 2024-03-08T06:05:38.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.219+0000 7f6c12000640 1 --2- 172.21.15.19:0/1481718187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c140b9630 0x7f6c140ce920 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6c140b6740 tx=0x7f6c0002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad4d97bccd3cc9e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:38.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.219+0000 7f6c11600640 1 -- 172.21.15.19:0/1481718187 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c00034070 con 0x7f6c140b9630 2024-03-08T06:05:38.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.219+0000 7f6c11600640 1 -- 172.21.15.19:0/1481718187 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c00030860 con 0x7f6c140b9630 2024-03-08T06:05:38.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.219+0000 7f6c11600640 1 -- 172.21.15.19:0/1481718187 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c00030c30 con 0x7f6c140b9630 2024-03-08T06:05:38.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.220+0000 7f6c13e00640 1 -- 172.21.15.19:0/1481718187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c140b9630 msgr2=0x7f6c140ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:38.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.220+0000 7f6c13e00640 1 --2- 172.21.15.19:0/1481718187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c140b9630 0x7f6c140ce920 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6c140b6740 tx=0x7f6c0002b9a0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.220+0000 7f6c13e00640 1 -- 172.21.15.19:0/1481718187 shutdown_connections 2024-03-08T06:05:38.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.220+0000 7f6c13e00640 1 --2- 172.21.15.19:0/1481718187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c140b9630 0x7f6c140ce920 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.220+0000 7f6c13e00640 1 --2- 172.21.15.19:0/1481718187 >> v2:172.21.15.42:3300/0 conn(0x7f6c1415de60 0x7f6c14161930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.220+0000 7f6c13e00640 1 -- 172.21.15.19:0/1481718187 >> 172.21.15.19:0/1481718187 conn(0x7f6c1406c500 msgr2=0x7f6c1406c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:38.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.220+0000 7f6c13e00640 1 -- 172.21.15.19:0/1481718187 shutdown_connections 2024-03-08T06:05:38.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.220+0000 7f6c13e00640 1 -- 172.21.15.19:0/1481718187 wait complete. 2024-03-08T06:05:38.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.222+0000 7f6c13e00640 1 Processor -- start 2024-03-08T06:05:38.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.222+0000 7f6c13e00640 1 -- start start 2024-03-08T06:05:38.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.223+0000 7f6c13e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6c140b9630 0x7f6c140b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:38.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.223+0000 7f6c13e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c140cee60 0x7f6c140b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:38.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.223+0000 7f6c13e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c1415de60 0x7f6c14160060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:38.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.223+0000 7f6c13e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c140b9a90 con 0x7f6c140cee60 2024-03-08T06:05:38.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.223+0000 7f6c13e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c140d20c0 con 0x7f6c1415de60 2024-03-08T06:05:38.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.223+0000 7f6c13e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c140d35f0 con 0x7f6c140b9630 2024-03-08T06:05:38.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.223+0000 7f6c12000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c140cee60 0x7f6c140b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:38.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.223+0000 7f6c12000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c140cee60 0x7f6c140b35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40844/0 (socket says 172.21.15.19:40844) 2024-03-08T06:05:38.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.223+0000 7f6c12000640 1 -- 172.21.15.19:0/3391230702 learned_addr learned my addr 172.21.15.19:0/3391230702 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:38.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.224+0000 7f6c13400640 1 --2- 172.21.15.19:0/3391230702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c1415de60 0x7f6c14160060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:38.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.224+0000 7f6c12a00640 1 --2- 172.21.15.19:0/3391230702 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6c140b9630 0x7f6c140b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:38.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.224+0000 7f6c12000640 1 -- 172.21.15.19:0/3391230702 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6c140b9630 msgr2=0x7f6c140b5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:38.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.224+0000 7f6c12000640 1 --2- 172.21.15.19:0/3391230702 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6c140b9630 0x7f6c140b5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.224+0000 7f6c12000640 1 -- 172.21.15.19:0/3391230702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c1415de60 msgr2=0x7f6c14160060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:38.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.224+0000 7f6c12000640 1 --2- 172.21.15.19:0/3391230702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c1415de60 0x7f6c14160060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.224+0000 7f6c12000640 1 -- 172.21.15.19:0/3391230702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c140b48a0 con 0x7f6c140cee60 2024-03-08T06:05:38.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.224+0000 7f6c12a00640 1 --2- 172.21.15.19:0/3391230702 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6c140b9630 0x7f6c140b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:38.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.224+0000 7f6c13400640 1 --2- 172.21.15.19:0/3391230702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c1415de60 0x7f6c14160060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:38.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.224+0000 7f6c12000640 1 --2- 172.21.15.19:0/3391230702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c140cee60 0x7f6c140b35b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6c00000c00 tx=0x7f6c00004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:38.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.224+0000 7f6c0aa00640 1 -- 172.21.15.19:0/3391230702 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c00048070 con 0x7f6c140cee60 2024-03-08T06:05:38.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.225+0000 7f6c0aa00640 1 -- 172.21.15.19:0/3391230702 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c00030660 con 0x7f6c140cee60 2024-03-08T06:05:38.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.225+0000 7f6c0aa00640 1 -- 172.21.15.19:0/3391230702 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c00034040 con 0x7f6c140cee60 2024-03-08T06:05:38.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.225+0000 7f6c13e00640 1 -- 172.21.15.19:0/3391230702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c140b4000 con 0x7f6c140cee60 2024-03-08T06:05:38.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.225+0000 7f6c13e00640 1 -- 172.21.15.19:0/3391230702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c14154460 con 0x7f6c140cee60 2024-03-08T06:05:38.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.226+0000 7f6c13e00640 1 -- 172.21.15.19:0/3391230702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c140b43f0 con 0x7f6c140cee60 2024-03-08T06:05:38.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.227+0000 7f6c0aa00640 1 -- 172.21.15.19:0/3391230702 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6c0004b070 con 0x7f6c140cee60 2024-03-08T06:05:38.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.228+0000 7f6c0aa00640 1 --2- 172.21.15.19:0/3391230702 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6bf406b4d0 0x7f6bf406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:38.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.228+0000 7f6c0aa00640 1 -- 172.21.15.19:0/3391230702 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c000ac4c0 con 0x7f6c140cee60 2024-03-08T06:05:38.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.228+0000 7f6c12a00640 1 --2- 172.21.15.19:0/3391230702 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6bf406b4d0 0x7f6bf406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:38.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.229+0000 7f6c12a00640 1 --2- 172.21.15.19:0/3391230702 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6bf406b4d0 0x7f6bf406d990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6c04006fd0 tx=0x7f6c04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:38.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.233+0000 7f6c0aa00640 1 -- 172.21.15.19:0/3391230702 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6c0007b3c0 con 0x7f6c140cee60 2024-03-08T06:05:38.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.433+0000 7f6c13e00640 1 -- 172.21.15.19:0/3391230702 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c140d17f0 con 0x7f6c140cee60 2024-03-08T06:05:38.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.434+0000 7f6c0aa00640 1 -- 172.21.15.19:0/3391230702 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c0007acc0 con 0x7f6c140cee60 2024-03-08T06:05:38.435 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-03-08T06:05:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.437+0000 7f6c13e00640 1 -- 172.21.15.19:0/3391230702 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6bf406b4d0 msgr2=0x7f6bf406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.437+0000 7f6c13e00640 1 --2- 172.21.15.19:0/3391230702 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6bf406b4d0 0x7f6bf406d990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6c04006fd0 tx=0x7f6c04008040 comp rx=0 tx=0).stop 2024-03-08T06:05:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.437+0000 7f6c13e00640 1 -- 172.21.15.19:0/3391230702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c140cee60 msgr2=0x7f6c140b35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.437+0000 7f6c13e00640 1 --2- 172.21.15.19:0/3391230702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c140cee60 0x7f6c140b35b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6c00000c00 tx=0x7f6c00004730 comp rx=0 tx=0).stop 2024-03-08T06:05:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.437+0000 7f6c13e00640 1 -- 172.21.15.19:0/3391230702 shutdown_connections 2024-03-08T06:05:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.437+0000 7f6c13e00640 1 --2- 172.21.15.19:0/3391230702 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6bf406b4d0 0x7f6bf406d990 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.437+0000 7f6c13e00640 1 --2- 172.21.15.19:0/3391230702 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6c1415de60 0x7f6c14160060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.437+0000 7f6c13e00640 1 --2- 172.21.15.19:0/3391230702 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c140cee60 0x7f6c140b35b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.437+0000 7f6c13e00640 1 --2- 172.21.15.19:0/3391230702 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6c140b9630 0x7f6c140b5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.437+0000 7f6c13e00640 1 -- 172.21.15.19:0/3391230702 >> 172.21.15.19:0/3391230702 conn(0x7f6c1406c500 msgr2=0x7f6c1406c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:38.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.437+0000 7f6c13e00640 1 -- 172.21.15.19:0/3391230702 shutdown_connections 2024-03-08T06:05:38.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.437+0000 7f6c13e00640 1 -- 172.21.15.19:0/3391230702 wait complete. 2024-03-08T06:05:38.458 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-08T06:05:38.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.682+0000 7f387f200640 1 Processor -- start 2024-03-08T06:05:38.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.683+0000 7f387f200640 1 -- start start 2024-03-08T06:05:38.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.684+0000 7f387f200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3880147040 0x7f388015e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:38.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.684+0000 7f387f200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f38800b2970 0x7f388006e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:38.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.684+0000 7f387f200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f38800716e0 0x7f3880071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:38.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.684+0000 7f387f200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f388015e840 con 0x7f38800b2970 2024-03-08T06:05:38.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.684+0000 7f387f200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f388015eb20 con 0x7f38800716e0 2024-03-08T06:05:38.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.684+0000 7f387f200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388015ee00 con 0x7f3880147040 2024-03-08T06:05:38.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.685+0000 7f3875400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f38800b2970 0x7f388006e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:38.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.685+0000 7f3875400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f38800b2970 0x7f388006e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40852/0 (socket says 172.21.15.19:40852) 2024-03-08T06:05:38.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.685+0000 7f3875400640 1 -- 172.21.15.19:0/2445510512 learned_addr learned my addr 172.21.15.19:0/2445510512 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:38.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.685+0000 7f387e800640 1 --2- 172.21.15.19:0/2445510512 >> v2:172.21.15.42:3300/0 conn(0x7f38800716e0 0x7f3880071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:38.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.685+0000 7f3875400640 1 -- 172.21.15.19:0/2445510512 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3880147040 msgr2=0x7f388015e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:38.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.685+0000 7f387de00640 1 --2- 172.21.15.19:0/2445510512 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3880147040 0x7f388015e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:38.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.685+0000 7f3875400640 1 --2- 172.21.15.19:0/2445510512 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3880147040 0x7f388015e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.685+0000 7f3875400640 1 -- 172.21.15.19:0/2445510512 >> v2:172.21.15.42:3300/0 conn(0x7f38800716e0 msgr2=0x7f3880071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:38.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.685+0000 7f3875400640 1 --2- 172.21.15.19:0/2445510512 >> v2:172.21.15.42:3300/0 conn(0x7f38800716e0 0x7f3880071b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.685+0000 7f3875400640 1 -- 172.21.15.19:0/2445510512 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38800ae0d0 con 0x7f38800b2970 2024-03-08T06:05:38.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.685+0000 7f387e800640 1 --2- 172.21.15.19:0/2445510512 >> v2:172.21.15.42:3300/0 conn(0x7f38800716e0 0x7f3880071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:38.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.686+0000 7f3875400640 1 --2- 172.21.15.19:0/2445510512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38800b2970 0x7f388006e880 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f38800b4fc0 tx=0x7f386802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b098edef4df91811 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:38.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.687+0000 7f387d400640 1 -- 172.21.15.19:0/2445510512 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3868035020 con 0x7f38800b2970 2024-03-08T06:05:38.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.687+0000 7f387d400640 1 -- 172.21.15.19:0/2445510512 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3868031870 con 0x7f38800b2970 2024-03-08T06:05:38.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.687+0000 7f387d400640 1 -- 172.21.15.19:0/2445510512 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3868031c40 con 0x7f38800b2970 2024-03-08T06:05:38.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.687+0000 7f387f200640 1 -- 172.21.15.19:0/2445510512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38800b2970 msgr2=0x7f388006e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:38.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.687+0000 7f387f200640 1 --2- 172.21.15.19:0/2445510512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38800b2970 0x7f388006e880 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f38800b4fc0 tx=0x7f386802b910 comp rx=0 tx=0).stop 2024-03-08T06:05:38.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.687+0000 7f387f200640 1 -- 172.21.15.19:0/2445510512 shutdown_connections 2024-03-08T06:05:38.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.687+0000 7f387f200640 1 --2- 172.21.15.19:0/2445510512 >> v2:172.21.15.42:3300/0 conn(0x7f38800716e0 0x7f3880071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.687+0000 7f387f200640 1 --2- 172.21.15.19:0/2445510512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38800b2970 0x7f388006e880 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.687+0000 7f387f200640 1 --2- 172.21.15.19:0/2445510512 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3880147040 0x7f388015e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.687+0000 7f387f200640 1 -- 172.21.15.19:0/2445510512 >> 172.21.15.19:0/2445510512 conn(0x7f38800b1850 msgr2=0x7f38800b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:38.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.688+0000 7f387f200640 1 -- 172.21.15.19:0/2445510512 shutdown_connections 2024-03-08T06:05:38.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.688+0000 7f387f200640 1 -- 172.21.15.19:0/2445510512 wait complete. 2024-03-08T06:05:38.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.690+0000 7f387f200640 1 Processor -- start 2024-03-08T06:05:38.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.690+0000 7f387f200640 1 -- start start 2024-03-08T06:05:38.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.691+0000 7f387f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38800716e0 0x7f3880135f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:38.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.691+0000 7f387f200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38800b2970 0x7f38801332b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:38.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.691+0000 7f387f200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3880147040 0x7f38800c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:38.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.691+0000 7f387f200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38800ae5f0 con 0x7f38800b2970 2024-03-08T06:05:38.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.691+0000 7f387f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388006edc0 con 0x7f38800716e0 2024-03-08T06:05:38.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.691+0000 7f387f200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38800ae770 con 0x7f3880147040 2024-03-08T06:05:38.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.691+0000 7f3875400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38800b2970 0x7f38801332b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:38.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.691+0000 7f3875400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38800b2970 0x7f38801332b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40864/0 (socket says 172.21.15.19:40864) 2024-03-08T06:05:38.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.691+0000 7f3875400640 1 -- 172.21.15.19:0/561385560 learned_addr learned my addr 172.21.15.19:0/561385560 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:38.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.692+0000 7f387de00640 1 --2- 172.21.15.19:0/561385560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38800716e0 0x7f3880135f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:38.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.692+0000 7f3875400640 1 -- 172.21.15.19:0/561385560 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3880147040 msgr2=0x7f38800c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:38.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.692+0000 7f387e800640 1 --2- 172.21.15.19:0/561385560 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3880147040 0x7f38800c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:38.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.692+0000 7f3875400640 1 --2- 172.21.15.19:0/561385560 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3880147040 0x7f38800c8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.692+0000 7f3875400640 1 -- 172.21.15.19:0/561385560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38800716e0 msgr2=0x7f3880135f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:38.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.692+0000 7f3875400640 1 --2- 172.21.15.19:0/561385560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38800716e0 0x7f3880135f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.692+0000 7f3875400640 1 -- 172.21.15.19:0/561385560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38801337f0 con 0x7f38800b2970 2024-03-08T06:05:38.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.692+0000 7f387de00640 1 --2- 172.21.15.19:0/561385560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38800716e0 0x7f3880135f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:38.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.692+0000 7f3875400640 1 --2- 172.21.15.19:0/561385560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38800b2970 0x7f38801332b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3868000c00 tx=0x7f38680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:38.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.693+0000 7f3876a00640 1 -- 172.21.15.19:0/561385560 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38680443f0 con 0x7f38800b2970 2024-03-08T06:05:38.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.693+0000 7f3876a00640 1 -- 172.21.15.19:0/561385560 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3868044590 con 0x7f38800b2970 2024-03-08T06:05:38.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.693+0000 7f387f200640 1 -- 172.21.15.19:0/561385560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38800c8ed0 con 0x7f38800b2970 2024-03-08T06:05:38.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.693+0000 7f3876a00640 1 -- 172.21.15.19:0/561385560 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3868044980 con 0x7f38800b2970 2024-03-08T06:05:38.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.693+0000 7f387f200640 1 -- 172.21.15.19:0/561385560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3880133d70 con 0x7f38800b2970 2024-03-08T06:05:38.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.694+0000 7f387f200640 1 -- 172.21.15.19:0/561385560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3880075090 con 0x7f38800b2970 2024-03-08T06:05:38.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.695+0000 7f3876a00640 1 -- 172.21.15.19:0/561385560 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f386804b060 con 0x7f38800b2970 2024-03-08T06:05:38.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.696+0000 7f3876a00640 1 --2- 172.21.15.19:0/561385560 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f385c06b500 0x7f385c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:38.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.696+0000 7f3876a00640 1 -- 172.21.15.19:0/561385560 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38680ac4e0 con 0x7f38800b2970 2024-03-08T06:05:38.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.696+0000 7f387de00640 1 --2- 172.21.15.19:0/561385560 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f385c06b500 0x7f385c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:38.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.697+0000 7f387de00640 1 --2- 172.21.15.19:0/561385560 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f385c06b500 0x7f385c06d9c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f387000b800 tx=0x7f3870008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:38.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.701+0000 7f3876a00640 1 -- 172.21.15.19:0/561385560 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f386803f070 con 0x7f38800b2970 2024-03-08T06:05:38.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.904+0000 7f387f200640 1 -- 172.21.15.19:0/561385560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f38800ad420 con 0x7f38800b2970 2024-03-08T06:05:38.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.905+0000 7f3876a00640 1 -- 172.21.15.19:0/561385560 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f386807b360 con 0x7f38800b2970 2024-03-08T06:05:38.906 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-03-08T06:05:38.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.908+0000 7f387f200640 1 -- 172.21.15.19:0/561385560 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f385c06b500 msgr2=0x7f385c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:38.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.908+0000 7f387f200640 1 --2- 172.21.15.19:0/561385560 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f385c06b500 0x7f385c06d9c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f387000b800 tx=0x7f3870008040 comp rx=0 tx=0).stop 2024-03-08T06:05:38.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.908+0000 7f387f200640 1 -- 172.21.15.19:0/561385560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38800b2970 msgr2=0x7f38801332b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:38.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.908+0000 7f387f200640 1 --2- 172.21.15.19:0/561385560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38800b2970 0x7f38801332b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3868000c00 tx=0x7f38680046c0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.908+0000 7f387f200640 1 -- 172.21.15.19:0/561385560 shutdown_connections 2024-03-08T06:05:38.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.908+0000 7f387f200640 1 --2- 172.21.15.19:0/561385560 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f385c06b500 0x7f385c06d9c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.908+0000 7f387f200640 1 --2- 172.21.15.19:0/561385560 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3880147040 0x7f38800c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.908+0000 7f387f200640 1 --2- 172.21.15.19:0/561385560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38800b2970 0x7f38801332b0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.908+0000 7f387f200640 1 --2- 172.21.15.19:0/561385560 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f38800716e0 0x7f3880135f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:38.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.908+0000 7f387f200640 1 -- 172.21.15.19:0/561385560 >> 172.21.15.19:0/561385560 conn(0x7f38800b1850 msgr2=0x7f3880145120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:38.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.908+0000 7f387f200640 1 -- 172.21.15.19:0/561385560 shutdown_connections 2024-03-08T06:05:38.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:38.908+0000 7f387f200640 1 -- 172.21.15.19:0/561385560 wait complete. 2024-03-08T06:05:38.927 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T06:05:39.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.150+0000 7ff10d800640 1 Processor -- start 2024-03-08T06:05:39.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.151+0000 7ff10d800640 1 -- start start 2024-03-08T06:05:39.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.152+0000 7ff10d800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff1080d1800 0x7ff1080b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:39.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.152+0000 7ff10d800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10815e100 con 0x7ff10815dd20 2024-03-08T06:05:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.152+0000 7ff10d800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1080d29c0 con 0x7ff1080b5bf0 2024-03-08T06:05:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.152+0000 7ff10d800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1080d3a60 con 0x7ff1080d1800 2024-03-08T06:05:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.152+0000 7ff106a00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff10815dd20 0x7ff1080cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44530/0 (socket says 172.21.15.19:44530) 2024-03-08T06:05:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.152+0000 7ff106a00640 1 -- 172.21.15.19:0/391535728 learned_addr learned my addr 172.21.15.19:0/391535728 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.153+0000 7ff106000640 1 --2- 172.21.15.19:0/391535728 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff1080d1800 0x7ff1080b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.153+0000 7ff105600640 1 -- 172.21.15.19:0/391535728 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341851077 0 0) 0x7ff10815e100 con 0x7ff10815dd20 2024-03-08T06:05:39.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.153+0000 7ff105600640 1 -- 172.21.15.19:0/391535728 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0ec003520 con 0x7ff10815dd20 2024-03-08T06:05:39.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.153+0000 7ff105600640 1 -- 172.21.15.19:0/391535728 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2357114445 0 0) 0x7ff0ec003520 con 0x7ff10815dd20 2024-03-08T06:05:39.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.153+0000 7ff105600640 1 -- 172.21.15.19:0/391535728 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff1080d1800 msgr2=0x7ff1080b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:39.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.153+0000 7ff105600640 1 --2- 172.21.15.19:0/391535728 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff1080d1800 0x7ff1080b56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:39.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.153+0000 7ff105600640 1 -- 172.21.15.19:0/391535728 >> v1:172.21.15.42:6789/0 conn(0x7ff1080b5bf0 legacy=0x7ff1080b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:39.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.153+0000 7ff105600640 1 -- 172.21.15.19:0/391535728 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1080d2ca0 con 0x7ff10815dd20 2024-03-08T06:05:39.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.153+0000 7ff105600640 1 -- 172.21.15.19:0/391535728 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7ff0f8001670 con 0x7ff10815dd20 2024-03-08T06:05:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.153+0000 7ff105600640 1 -- 172.21.15.19:0/391535728 >> v1:172.21.15.19:6789/0 conn(0x7ff10815dd20 legacy=0x7ff1080cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.153+0000 7ff105600640 1 --2- 172.21.15.19:0/391535728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0ec0039e0 0x7ff0ec003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.153+0000 7ff105600640 1 --2- 172.21.15.19:0/391535728 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0ec004800 0x7ff0ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.153+0000 7ff105600640 1 --2- 172.21.15.19:0/391535728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0ec0051c0 0x7ff0ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.153+0000 7ff105600640 1 -- 172.21.15.19:0/391535728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1080d3a60 con 0x7ff0ec0051c0 2024-03-08T06:05:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.153+0000 7ff105600640 1 -- 172.21.15.19:0/391535728 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec00bfc0 con 0x7ff0ec0039e0 2024-03-08T06:05:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.153+0000 7ff105600640 1 -- 172.21.15.19:0/391535728 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec00c1c0 con 0x7ff0ec004800 2024-03-08T06:05:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.154+0000 7ff107400640 1 --2- 172.21.15.19:0/391535728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0ec0051c0 0x7ff0ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.155+0000 7ff106a00640 1 --2- 172.21.15.19:0/391535728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0ec0039e0 0x7ff0ec003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.155+0000 7ff107400640 1 -- 172.21.15.19:0/391535728 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0ec004800 msgr2=0x7ff0ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.155+0000 7ff107400640 1 --2- 172.21.15.19:0/391535728 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff0ec004800 0x7ff0ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.155+0000 7ff107400640 1 -- 172.21.15.19:0/391535728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0ec0039e0 msgr2=0x7ff0ec003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.155+0000 7ff107400640 1 --2- 172.21.15.19:0/391535728 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0ec0039e0 0x7ff0ec003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:39.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.155+0000 7ff107400640 1 -- 172.21.15.19:0/391535728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1080d2ca0 con 0x7ff0ec0051c0 2024-03-08T06:05:39.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.156+0000 7ff107400640 1 --2- 172.21.15.19:0/391535728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0ec0051c0 0x7ff0ec00b9c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff100001e00 tx=0x7ff0ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9f2e5604bacd7d server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:39.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.156+0000 7ff105600640 1 -- 172.21.15.19:0/391535728 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff100001a50 con 0x7ff0ec0051c0 2024-03-08T06:05:39.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.156+0000 7ff105600640 1 -- 172.21.15.19:0/391535728 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff100003b90 con 0x7ff0ec0051c0 2024-03-08T06:05:39.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.156+0000 7ff105600640 1 -- 172.21.15.19:0/391535728 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1000050d0 con 0x7ff0ec0051c0 2024-03-08T06:05:39.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.157+0000 7ff10d800640 1 -- 172.21.15.19:0/391535728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0ec0051c0 msgr2=0x7ff0ec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:39.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.157+0000 7ff10d800640 1 --2- 172.21.15.19:0/391535728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0ec0051c0 0x7ff0ec00b9c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff100001e00 tx=0x7ff0ec005830 comp rx=0 tx=0).stop 2024-03-08T06:05:39.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.157+0000 7ff107400640 1 -- 172.21.15.19:0/391535728 reap_dead start 2024-03-08T06:05:39.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.157+0000 7ff10d800640 1 -- 172.21.15.19:0/391535728 shutdown_connections 2024-03-08T06:05:39.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.157+0000 7ff10d800640 1 -- 172.21.15.19:0/391535728 >> 172.21.15.19:0/391535728 conn(0x7ff108067240 msgr2=0x7ff1080d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:39.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.157+0000 7ff10d800640 1 -- 172.21.15.19:0/391535728 shutdown_connections 2024-03-08T06:05:39.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.157+0000 7ff10d800640 1 -- 172.21.15.19:0/391535728 wait complete. 2024-03-08T06:05:39.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.159+0000 7ff10d800640 1 Processor -- start 2024-03-08T06:05:39.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.159+0000 7ff10d800640 1 -- start start 2024-03-08T06:05:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.160+0000 7ff10d800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff10815d410 0x7ff1081e8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.160+0000 7ff10d800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1080ab170 0x7ff1081f3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.160+0000 7ff10d800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff10806c1a0 0x7ff10806c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.160+0000 7ff10d800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1080d35d0 con 0x7ff1080ab170 2024-03-08T06:05:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.160+0000 7ff10d800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1080d3260 con 0x7ff10815d410 2024-03-08T06:05:39.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.160+0000 7ff10d800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1080b56b0 con 0x7ff10806c1a0 2024-03-08T06:05:39.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.160+0000 7ff106000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1080ab170 0x7ff1081f3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:39.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.160+0000 7ff106000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1080ab170 0x7ff1081f3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40878/0 (socket says 172.21.15.19:40878) 2024-03-08T06:05:39.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.160+0000 7ff106000640 1 -- 172.21.15.19:0/323629160 learned_addr learned my addr 172.21.15.19:0/323629160 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:39.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.161+0000 7ff106000640 1 -- 172.21.15.19:0/323629160 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff10806c1a0 msgr2=0x7ff10806c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:39.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.161+0000 7ff106000640 1 --2- 172.21.15.19:0/323629160 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff10806c1a0 0x7ff10806c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:39.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.161+0000 7ff106000640 1 -- 172.21.15.19:0/323629160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff10815d410 msgr2=0x7ff1081e8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:39.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.161+0000 7ff106a00640 1 --2- 172.21.15.19:0/323629160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff10815d410 0x7ff1081e8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:39.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.161+0000 7ff106000640 1 --2- 172.21.15.19:0/323629160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff10815d410 0x7ff1081e8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:39.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.161+0000 7ff106000640 1 -- 172.21.15.19:0/323629160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1081e9930 con 0x7ff1080ab170 2024-03-08T06:05:39.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.161+0000 7ff106000640 1 --2- 172.21.15.19:0/323629160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1080ab170 0x7ff1081f3e00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4004650 tx=0x7ff0f400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:39.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.161+0000 7ff0fea00640 1 -- 172.21.15.19:0/323629160 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4017070 con 0x7ff1080ab170 2024-03-08T06:05:39.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.162+0000 7ff0fea00640 1 -- 172.21.15.19:0/323629160 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f400c7e0 con 0x7ff1080ab170 2024-03-08T06:05:39.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.162+0000 7ff0fea00640 1 -- 172.21.15.19:0/323629160 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f400cbb0 con 0x7ff1080ab170 2024-03-08T06:05:39.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.162+0000 7ff10d800640 1 -- 172.21.15.19:0/323629160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1081e9090 con 0x7ff1080ab170 2024-03-08T06:05:39.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.162+0000 7ff10d800640 1 -- 172.21.15.19:0/323629160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1081e9650 con 0x7ff1080ab170 2024-03-08T06:05:39.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.163+0000 7ff10d800640 1 -- 172.21.15.19:0/323629160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff108067cb0 con 0x7ff1080ab170 2024-03-08T06:05:39.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.164+0000 7ff0fea00640 1 -- 172.21.15.19:0/323629160 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff0f401a070 con 0x7ff1080ab170 2024-03-08T06:05:39.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.164+0000 7ff0fea00640 1 --2- 172.21.15.19:0/323629160 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff0e806b4d0 0x7ff0e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:39.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.165+0000 7ff0fea00640 1 -- 172.21.15.19:0/323629160 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0f408a0e0 con 0x7ff1080ab170 2024-03-08T06:05:39.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.165+0000 7ff106a00640 1 --2- 172.21.15.19:0/323629160 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff0e806b4d0 0x7ff0e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:39.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.165+0000 7ff106a00640 1 --2- 172.21.15.19:0/323629160 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff0e806b4d0 0x7ff0e806d990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff0f80011e0 tx=0x7ff0f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.169+0000 7ff0fea00640 1 -- 172.21.15.19:0/323629160 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff0f4058ec0 con 0x7ff1080ab170 2024-03-08T06:05:39.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.410+0000 7ff10d800640 1 -- 172.21.15.19:0/323629160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1081e8720 con 0x7ff1080ab170 2024-03-08T06:05:39.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.411+0000 7ff0fea00640 1 -- 172.21.15.19:0/323629160 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4935 (secure 0 0 0) 0x7ff0f40587c0 con 0x7ff1080ab170 2024-03-08T06:05:39.412 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:05:39.412 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3542863285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3542863285},{"type":"v1","addr":"172.21.15.42:6833","nonce":3542863285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4708,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1679053115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1679053115},{"type":"v1","addr":"172.21.15.42:6835","nonce":1679053115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5022,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/717236359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":717236359},{"type":"v1","addr":"172.21.15.19:6835","nonce":717236359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T06:04:30.148899+0000","modified":"2024-03-08T06:04:33.195351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6837/1359509141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1359509141},{"type":"v1","addr":"172.21.15.19:6837","nonce":1359509141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-08T06:05:39.412 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 16 2024-03-08T06:05:39.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.413+0000 7ff10d800640 1 -- 172.21.15.19:0/323629160 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff0e806b4d0 msgr2=0x7ff0e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:39.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.413+0000 7ff10d800640 1 --2- 172.21.15.19:0/323629160 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff0e806b4d0 0x7ff0e806d990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff0f80011e0 tx=0x7ff0f8009040 comp rx=0 tx=0).stop 2024-03-08T06:05:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.413+0000 7ff10d800640 1 -- 172.21.15.19:0/323629160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1080ab170 msgr2=0x7ff1081f3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.413+0000 7ff10d800640 1 --2- 172.21.15.19:0/323629160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1080ab170 0x7ff1081f3e00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4004650 tx=0x7ff0f400ec70 comp rx=0 tx=0).stop 2024-03-08T06:05:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.413+0000 7ff10d800640 1 -- 172.21.15.19:0/323629160 shutdown_connections 2024-03-08T06:05:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.413+0000 7ff10d800640 1 --2- 172.21.15.19:0/323629160 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff0e806b4d0 0x7ff0e806d990 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.413+0000 7ff10d800640 1 --2- 172.21.15.19:0/323629160 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff10806c1a0 0x7ff10806c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.413+0000 7ff10d800640 1 --2- 172.21.15.19:0/323629160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1080ab170 0x7ff1081f3e00 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.413+0000 7ff10d800640 1 --2- 172.21.15.19:0/323629160 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff10815d410 0x7ff1081e8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.413+0000 7ff10d800640 1 -- 172.21.15.19:0/323629160 >> 172.21.15.19:0/323629160 conn(0x7ff108067240 msgr2=0x7ff1080b38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.414+0000 7ff10d800640 1 -- 172.21.15.19:0/323629160 shutdown_connections 2024-03-08T06:05:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.414+0000 7ff10d800640 1 -- 172.21.15.19:0/323629160 wait complete. 2024-03-08T06:05:39.435 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:05:39.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.656+0000 7f2ee7200640 1 Processor -- start 2024-03-08T06:05:39.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.656+0000 7f2ee7200640 1 -- start start 2024-03-08T06:05:39.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.658+0000 7f2ee7200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2ee01614f0 0x7f2ee00ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:39.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.658+0000 7f2ee7200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2ee00d3630 0x7f2ee00cee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:39.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.658+0000 7f2ee7200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee00d2b90 con 0x7f2ee00d1130 2024-03-08T06:05:39.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.658+0000 7f2ee7200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee00b6d50 con 0x7f2ee00d3630 2024-03-08T06:05:39.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.658+0000 7f2ee7200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee00d3370 con 0x7f2ee01614f0 2024-03-08T06:05:39.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.659+0000 7f2edf400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2ee00d3630 0x7f2ee00cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:39.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.659+0000 7f2edf400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2ee00d3630 0x7f2ee00cee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40888/0 (socket says 172.21.15.19:40888) 2024-03-08T06:05:39.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.659+0000 7f2edf400640 1 -- 172.21.15.19:0/2207049180 learned_addr learned my addr 172.21.15.19:0/2207049180 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:39.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.659+0000 7f2ee5200640 1 --1- 172.21.15.19:0/2207049180 >> v1:172.21.15.19:6789/0 conn(0x7f2ee00d1130 0x7f2ee0161be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44538/0 (socket says 172.21.15.19:44538) 2024-03-08T06:05:39.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.659+0000 7f2edfe00640 1 --2- 172.21.15.19:0/2207049180 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2ee01614f0 0x7f2ee00ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:39.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.659+0000 7f2edf400640 1 -- 172.21.15.19:0/2207049180 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2ee01614f0 msgr2=0x7f2ee00ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:39.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.659+0000 7f2edf400640 1 --2- 172.21.15.19:0/2207049180 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2ee01614f0 0x7f2ee00ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:39.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.659+0000 7f2edf400640 1 -- 172.21.15.19:0/2207049180 >> v1:172.21.15.19:6789/0 conn(0x7f2ee00d1130 legacy=0x7f2ee0161be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:39.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.659+0000 7f2edf400640 1 -- 172.21.15.19:0/2207049180 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee00b9820 con 0x7f2ee00d3630 2024-03-08T06:05:39.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.660+0000 7f2edf400640 1 --2- 172.21.15.19:0/2207049180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee00d3630 0x7f2ee00cee50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009870 tx=0x7f2ecc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42091eb6c15b8e96 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:39.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.661+0000 7f2edea00640 1 -- 172.21.15.19:0/2207049180 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc035020 con 0x7f2ee00d3630 2024-03-08T06:05:39.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.661+0000 7f2edea00640 1 -- 172.21.15.19:0/2207049180 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ecc031640 con 0x7f2ee00d3630 2024-03-08T06:05:39.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.661+0000 7f2edea00640 1 -- 172.21.15.19:0/2207049180 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc02d040 con 0x7f2ee00d3630 2024-03-08T06:05:39.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.661+0000 7f2ee7200640 1 -- 172.21.15.19:0/2207049180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee00d3630 msgr2=0x7f2ee00cee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:39.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.661+0000 7f2ee7200640 1 --2- 172.21.15.19:0/2207049180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee00d3630 0x7f2ee00cee50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009870 tx=0x7f2ecc02b8f0 comp rx=0 tx=0).stop 2024-03-08T06:05:39.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.661+0000 7f2ee7200640 1 -- 172.21.15.19:0/2207049180 shutdown_connections 2024-03-08T06:05:39.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.661+0000 7f2ee7200640 1 --2- 172.21.15.19:0/2207049180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee00d3630 0x7f2ee00cee50 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:39.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.661+0000 7f2ee7200640 1 --2- 172.21.15.19:0/2207049180 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2ee01614f0 0x7f2ee00ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:39.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.661+0000 7f2ee7200640 1 -- 172.21.15.19:0/2207049180 >> 172.21.15.19:0/2207049180 conn(0x7f2ee006c8f0 msgr2=0x7f2ee006cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:39.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.661+0000 7f2ee7200640 1 -- 172.21.15.19:0/2207049180 shutdown_connections 2024-03-08T06:05:39.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.661+0000 7f2ee7200640 1 -- 172.21.15.19:0/2207049180 wait complete. 2024-03-08T06:05:39.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.663+0000 7f2ee7200640 1 Processor -- start 2024-03-08T06:05:39.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.663+0000 7f2ee7200640 1 -- start start 2024-03-08T06:05:39.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.664+0000 7f2ee7200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee00d1130 0x7f2ee01585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:39.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.664+0000 7f2ee7200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ee00d3630 0x7f2ee0155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:39.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.664+0000 7f2ee7200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2ee01614f0 0x7f2ee00cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:39.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.664+0000 7f2ee7200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee00d2ee0 con 0x7f2ee00d1130 2024-03-08T06:05:39.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.664+0000 7f2ee7200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee00b95d0 con 0x7f2ee00d3630 2024-03-08T06:05:39.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.664+0000 7f2ee7200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee01618d0 con 0x7f2ee01614f0 2024-03-08T06:05:39.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.665+0000 7f2edfe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee00d1130 0x7f2ee01585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:39.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.665+0000 7f2edfe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee00d1130 0x7f2ee01585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40902/0 (socket says 172.21.15.19:40902) 2024-03-08T06:05:39.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.665+0000 7f2edfe00640 1 -- 172.21.15.19:0/666329816 learned_addr learned my addr 172.21.15.19:0/666329816 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:39.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.665+0000 7f2edfe00640 1 -- 172.21.15.19:0/666329816 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2ee01614f0 msgr2=0x7f2ee00cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:39.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.665+0000 7f2ee5200640 1 --2- 172.21.15.19:0/666329816 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2ee01614f0 0x7f2ee00cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:39.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.665+0000 7f2edf400640 1 --2- 172.21.15.19:0/666329816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ee00d3630 0x7f2ee0155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:39.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.665+0000 7f2edfe00640 1 --2- 172.21.15.19:0/666329816 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2ee01614f0 0x7f2ee00cd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:39.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.665+0000 7f2edfe00640 1 -- 172.21.15.19:0/666329816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ee00d3630 msgr2=0x7f2ee0155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:39.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.665+0000 7f2edfe00640 1 --2- 172.21.15.19:0/666329816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ee00d3630 0x7f2ee0155a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:39.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.665+0000 7f2edfe00640 1 -- 172.21.15.19:0/666329816 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee0158c30 con 0x7f2ee00d1130 2024-03-08T06:05:39.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.665+0000 7f2edfe00640 1 --2- 172.21.15.19:0/666329816 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee00d1130 0x7f2ee01585c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000d830 tx=0x7f2ed000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:39.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.666+0000 7f2ed7e00640 1 -- 172.21.15.19:0/666329816 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed000b6c0 con 0x7f2ee00d1130 2024-03-08T06:05:39.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.666+0000 7f2ed7e00640 1 -- 172.21.15.19:0/666329816 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed0019070 con 0x7f2ee00d1130 2024-03-08T06:05:39.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.666+0000 7f2ee7200640 1 -- 172.21.15.19:0/666329816 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee0158f10 con 0x7f2ee00d1130 2024-03-08T06:05:39.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.666+0000 7f2ed7e00640 1 -- 172.21.15.19:0/666329816 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed000ba80 con 0x7f2ee00d1130 2024-03-08T06:05:39.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.666+0000 7f2ee7200640 1 -- 172.21.15.19:0/666329816 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee01594d0 con 0x7f2ee00d1130 2024-03-08T06:05:39.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.667+0000 7f2ee7200640 1 -- 172.21.15.19:0/666329816 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee0067cb0 con 0x7f2ee00d1130 2024-03-08T06:05:39.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.668+0000 7f2ed7e00640 1 -- 172.21.15.19:0/666329816 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2ed001e460 con 0x7f2ee00d1130 2024-03-08T06:05:39.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.669+0000 7f2ed7e00640 1 --2- 172.21.15.19:0/666329816 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f2ec006b4d0 0x7f2ec006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:39.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.669+0000 7f2ed7e00640 1 -- 172.21.15.19:0/666329816 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ed008a940 con 0x7f2ee00d1130 2024-03-08T06:05:39.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.669+0000 7f2edf400640 1 --2- 172.21.15.19:0/666329816 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f2ec006b4d0 0x7f2ec006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:39.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.670+0000 7f2edf400640 1 --2- 172.21.15.19:0/666329816 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f2ec006b4d0 0x7f2ec006d990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc036000 tx=0x7f2ecc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:39.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.673+0000 7f2ed7e00640 1 -- 172.21.15.19:0/666329816 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2ed00597b0 con 0x7f2ee00d1130 2024-03-08T06:05:39.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.875+0000 7f2ee7200640 1 -- 172.21.15.19:0/666329816 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ee00b64e0 con 0x7f2ee00d1130 2024-03-08T06:05:39.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.878+0000 7f2ed7e00640 1 -- 172.21.15.19:0/666329816 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16609 (secure 0 0 0) 0x7f2ed00590b0 con 0x7f2ee00d1130 2024-03-08T06:05:39.879 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:05:39.879 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":34,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:04:31.685292+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:04:28.095112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-08T06:04:29.178532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:05:39.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.881+0000 7f2ee7200640 1 -- 172.21.15.19:0/666329816 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f2ec006b4d0 msgr2=0x7f2ec006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:39.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.881+0000 7f2ee7200640 1 --2- 172.21.15.19:0/666329816 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f2ec006b4d0 0x7f2ec006d990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc036000 tx=0x7f2ecc008030 comp rx=0 tx=0).stop 2024-03-08T06:05:39.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.881+0000 7f2ee7200640 1 -- 172.21.15.19:0/666329816 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee00d1130 msgr2=0x7f2ee01585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:39.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.881+0000 7f2ee7200640 1 --2- 172.21.15.19:0/666329816 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee00d1130 0x7f2ee01585c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000d830 tx=0x7f2ed000dcf0 comp rx=0 tx=0).stop 2024-03-08T06:05:39.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.881+0000 7f2ee7200640 1 -- 172.21.15.19:0/666329816 shutdown_connections 2024-03-08T06:05:39.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.882+0000 7f2ee7200640 1 --2- 172.21.15.19:0/666329816 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f2ec006b4d0 0x7f2ec006d990 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:39.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.882+0000 7f2ee7200640 1 --2- 172.21.15.19:0/666329816 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2ee01614f0 0x7f2ee00cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:39.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.882+0000 7f2ee7200640 1 --2- 172.21.15.19:0/666329816 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ee00d3630 0x7f2ee0155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:39.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.882+0000 7f2ee7200640 1 --2- 172.21.15.19:0/666329816 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee00d1130 0x7f2ee01585c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:39.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.882+0000 7f2ee7200640 1 -- 172.21.15.19:0/666329816 >> 172.21.15.19:0/666329816 conn(0x7f2ee006c8f0 msgr2=0x7f2ee00b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:39.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.882+0000 7f2ee7200640 1 -- 172.21.15.19:0/666329816 shutdown_connections 2024-03-08T06:05:39.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:39.882+0000 7f2ee7200640 1 -- 172.21.15.19:0/666329816 wait complete. 2024-03-08T06:05:39.901 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-08T06:05:39.902 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T06:05:40.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.124+0000 7fcd1b000640 1 Processor -- start 2024-03-08T06:05:40.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.125+0000 7fcd1b000640 1 -- start start 2024-03-08T06:05:40.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.126+0000 7fcd1b000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcd14161a90 0x7fcd140b9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:40.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.126+0000 7fcd1b000640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd14161e90 con 0x7fcd140cf190 2024-03-08T06:05:40.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.126+0000 7fcd1b000640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd14162100 con 0x7fcd1415df30 2024-03-08T06:05:40.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.126+0000 7fcd1b000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd140b9cd0 con 0x7fcd14161a90 2024-03-08T06:05:40.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.126+0000 7fcd13400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcd140cf190 0x7fcd140d2740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44548/0 (socket says 172.21.15.19:44548) 2024-03-08T06:05:40.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.126+0000 7fcd13400640 1 -- 172.21.15.19:0/1868989539 learned_addr learned my addr 172.21.15.19:0/1868989539 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:40.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.127+0000 7fcd12a00640 1 -- 172.21.15.19:0/1868989539 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929579462 0 0) 0x7fcd14161e90 con 0x7fcd140cf190 2024-03-08T06:05:40.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.127+0000 7fcd12a00640 1 -- 172.21.15.19:0/1868989539 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccf8003520 con 0x7fcd140cf190 2024-03-08T06:05:40.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.127+0000 7fcd19000640 1 --2- 172.21.15.19:0/1868989539 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcd14161a90 0x7fcd140b9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:40.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.127+0000 7fcd12a00640 1 -- 172.21.15.19:0/1868989539 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1828117235 0 0) 0x7fccf8003520 con 0x7fcd140cf190 2024-03-08T06:05:40.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.127+0000 7fcd12a00640 1 -- 172.21.15.19:0/1868989539 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcd14161a90 msgr2=0x7fcd140b9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:40.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.127+0000 7fcd12a00640 1 --2- 172.21.15.19:0/1868989539 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcd14161a90 0x7fcd140b9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:40.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.127+0000 7fcd12a00640 1 -- 172.21.15.19:0/1868989539 >> v1:172.21.15.42:6789/0 conn(0x7fcd1415df30 legacy=0x7fcd140cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:40.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.127+0000 7fcd12a00640 1 -- 172.21.15.19:0/1868989539 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd141623e0 con 0x7fcd140cf190 2024-03-08T06:05:40.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.127+0000 7fcd12a00640 1 -- 172.21.15.19:0/1868989539 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7fcd00001670 con 0x7fcd140cf190 2024-03-08T06:05:40.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.127+0000 7fcd12a00640 1 -- 172.21.15.19:0/1868989539 >> v1:172.21.15.19:6789/0 conn(0x7fcd140cf190 legacy=0x7fcd140d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:40.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.127+0000 7fcd12a00640 1 --2- 172.21.15.19:0/1868989539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccf80039e0 0x7fccf8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:40.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.127+0000 7fcd12a00640 1 --2- 172.21.15.19:0/1868989539 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcd14161a90 0x7fccf8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:40.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.127+0000 7fcd12a00640 1 --2- 172.21.15.19:0/1868989539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccf8004d40 0x7fccf80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:40.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.127+0000 7fcd12a00640 1 -- 172.21.15.19:0/1868989539 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd140b9cd0 con 0x7fccf80039e0 2024-03-08T06:05:40.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.127+0000 7fcd12a00640 1 -- 172.21.15.19:0/1868989539 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf800bc40 con 0x7fccf8004d40 2024-03-08T06:05:40.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.127+0000 7fcd12a00640 1 -- 172.21.15.19:0/1868989539 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf800be40 con 0x7fcd14161a90 2024-03-08T06:05:40.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.128+0000 7fcd13e00640 1 --2- 172.21.15.19:0/1868989539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccf80039e0 0x7fccf8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:40.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.128+0000 7fcd13400640 1 --2- 172.21.15.19:0/1868989539 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcd14161a90 0x7fccf8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:40.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.128+0000 7fcd19000640 1 --2- 172.21.15.19:0/1868989539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccf8004d40 0x7fccf80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:40.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.128+0000 7fcd13e00640 1 -- 172.21.15.19:0/1868989539 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcd14161a90 msgr2=0x7fccf8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:40.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.128+0000 7fcd13e00640 1 --2- 172.21.15.19:0/1868989539 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcd14161a90 0x7fccf8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:40.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.128+0000 7fcd13e00640 1 -- 172.21.15.19:0/1868989539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccf8004d40 msgr2=0x7fccf80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:40.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.128+0000 7fcd13e00640 1 --2- 172.21.15.19:0/1868989539 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccf8004d40 0x7fccf80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:40.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.128+0000 7fcd13e00640 1 -- 172.21.15.19:0/1868989539 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf8003520 con 0x7fccf80039e0 2024-03-08T06:05:40.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.129+0000 7fcd13e00640 1 --2- 172.21.15.19:0/1868989539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccf80039e0 0x7fccf8003e00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcd04001750 tx=0x7fccf8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c974173aa3e931 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:40.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.130+0000 7fcd12a00640 1 -- 172.21.15.19:0/1868989539 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04001370 con 0x7fccf80039e0 2024-03-08T06:05:40.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.130+0000 7fcd12a00640 1 -- 172.21.15.19:0/1868989539 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd040052d0 con 0x7fccf80039e0 2024-03-08T06:05:40.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.130+0000 7fcd12a00640 1 -- 172.21.15.19:0/1868989539 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04003830 con 0x7fccf80039e0 2024-03-08T06:05:40.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.130+0000 7fcd1b000640 1 -- 172.21.15.19:0/1868989539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccf80039e0 msgr2=0x7fccf8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:40.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.130+0000 7fcd1b000640 1 --2- 172.21.15.19:0/1868989539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccf80039e0 0x7fccf8003e00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcd04001750 tx=0x7fccf8005830 comp rx=0 tx=0).stop 2024-03-08T06:05:40.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.130+0000 7fcd19000640 1 -- 172.21.15.19:0/1868989539 reap_dead start 2024-03-08T06:05:40.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.130+0000 7fcd1b000640 1 -- 172.21.15.19:0/1868989539 shutdown_connections 2024-03-08T06:05:40.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.130+0000 7fcd1b000640 1 -- 172.21.15.19:0/1868989539 >> 172.21.15.19:0/1868989539 conn(0x7fcd1406c600 msgr2=0x7fcd1406ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:40.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.130+0000 7fcd1b000640 1 -- 172.21.15.19:0/1868989539 shutdown_connections 2024-03-08T06:05:40.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.131+0000 7fcd1b000640 1 -- 172.21.15.19:0/1868989539 wait complete. 2024-03-08T06:05:40.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.132+0000 7fcd1b000640 1 Processor -- start 2024-03-08T06:05:40.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.133+0000 7fcd1b000640 1 -- start start 2024-03-08T06:05:40.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.134+0000 7fcd1b000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccf80039e0 0x7fcd140cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:40.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.134+0000 7fcd1b000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd141f8550 0x7fcd1414e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:40.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.134+0000 7fcd1b000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcd1414f140 0x7fcd140b80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:40.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.134+0000 7fcd1b000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd140d2220 con 0x7fcd141f8550 2024-03-08T06:05:40.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.134+0000 7fcd1b000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd141629a0 con 0x7fccf80039e0 2024-03-08T06:05:40.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.134+0000 7fcd1b000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1415e310 con 0x7fcd1414f140 2024-03-08T06:05:40.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.134+0000 7fcd13400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd141f8550 0x7fcd1414e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:40.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.134+0000 7fcd13400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd141f8550 0x7fcd1414e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40920/0 (socket says 172.21.15.19:40920) 2024-03-08T06:05:40.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.134+0000 7fcd13400640 1 -- 172.21.15.19:0/2757435535 learned_addr learned my addr 172.21.15.19:0/2757435535 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:40.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.135+0000 7fcd13e00640 1 --2- 172.21.15.19:0/2757435535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccf80039e0 0x7fcd140cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:40.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.135+0000 7fcd19000640 1 --2- 172.21.15.19:0/2757435535 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcd1414f140 0x7fcd140b80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:40.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.135+0000 7fcd13400640 1 -- 172.21.15.19:0/2757435535 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcd1414f140 msgr2=0x7fcd140b80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:40.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.135+0000 7fcd13400640 1 --2- 172.21.15.19:0/2757435535 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcd1414f140 0x7fcd140b80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:40.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.135+0000 7fcd13400640 1 -- 172.21.15.19:0/2757435535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccf80039e0 msgr2=0x7fcd140cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:40.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.135+0000 7fcd13400640 1 --2- 172.21.15.19:0/2757435535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccf80039e0 0x7fcd140cad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:40.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.135+0000 7fcd13400640 1 -- 172.21.15.19:0/2757435535 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd141f4d40 con 0x7fcd141f8550 2024-03-08T06:05:40.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.135+0000 7fcd19000640 1 --2- 172.21.15.19:0/2757435535 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcd1414f140 0x7fcd140b80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:40.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.135+0000 7fcd13400640 1 --2- 172.21.15.19:0/2757435535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd141f8550 0x7fcd1414e810 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcd00007290 tx=0x7fcd00007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:40.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.136+0000 7fcd0be00640 1 -- 172.21.15.19:0/2757435535 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0000f9c0 con 0x7fcd141f8550 2024-03-08T06:05:40.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.136+0000 7fcd0be00640 1 -- 172.21.15.19:0/2757435535 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd00018070 con 0x7fcd141f8550 2024-03-08T06:05:40.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.136+0000 7fcd0be00640 1 -- 172.21.15.19:0/2757435535 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0000fe00 con 0x7fcd141f8550 2024-03-08T06:05:40.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.136+0000 7fcd1b000640 1 -- 172.21.15.19:0/2757435535 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd141f4ff0 con 0x7fcd141f8550 2024-03-08T06:05:40.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.136+0000 7fcd1b000640 1 -- 172.21.15.19:0/2757435535 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd141f7d70 con 0x7fcd141f8550 2024-03-08T06:05:40.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.137+0000 7fcd1b000640 1 -- 172.21.15.19:0/2757435535 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd14067cb0 con 0x7fcd141f8550 2024-03-08T06:05:40.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.138+0000 7fcd0be00640 1 -- 172.21.15.19:0/2757435535 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fcd0001d460 con 0x7fcd141f8550 2024-03-08T06:05:40.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.139+0000 7fcd0be00640 1 --2- 172.21.15.19:0/2757435535 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fccf406b500 0x7fccf406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:40.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.139+0000 7fcd0be00640 1 -- 172.21.15.19:0/2757435535 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd0008a350 con 0x7fcd141f8550 2024-03-08T06:05:40.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.139+0000 7fcd13e00640 1 --2- 172.21.15.19:0/2757435535 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fccf406b500 0x7fccf406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:40.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.140+0000 7fcd13e00640 1 --2- 172.21.15.19:0/2757435535 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fccf406b500 0x7fccf406d9c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcd04033000 tx=0x7fcd04009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:40.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.144+0000 7fcd0be00640 1 -- 172.21.15.19:0/2757435535 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcd00058ae0 con 0x7fcd141f8550 2024-03-08T06:05:40.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.381+0000 7fcd1b000640 1 -- 172.21.15.19:0/2757435535 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd141613a0 con 0x7fcd141f8550 2024-03-08T06:05:40.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.382+0000 7fcd0be00640 1 -- 172.21.15.19:0/2757435535 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4935 (secure 0 0 0) 0x7fcd0005cb80 con 0x7fcd141f8550 2024-03-08T06:05:40.383 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:05:40.383 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3542863285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3542863285},{"type":"v1","addr":"172.21.15.42:6833","nonce":3542863285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4708,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1679053115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1679053115},{"type":"v1","addr":"172.21.15.42:6835","nonce":1679053115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5022,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/717236359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":717236359},{"type":"v1","addr":"172.21.15.19:6835","nonce":717236359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T06:04:30.148899+0000","modified":"2024-03-08T06:04:33.195351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6837/1359509141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1359509141},{"type":"v1","addr":"172.21.15.19:6837","nonce":1359509141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-08T06:05:40.383 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 16 2024-03-08T06:05:40.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.385+0000 7fcd1b000640 1 -- 172.21.15.19:0/2757435535 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fccf406b500 msgr2=0x7fccf406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:40.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.385+0000 7fcd1b000640 1 --2- 172.21.15.19:0/2757435535 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fccf406b500 0x7fccf406d9c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcd04033000 tx=0x7fcd04009030 comp rx=0 tx=0).stop 2024-03-08T06:05:40.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.385+0000 7fcd1b000640 1 -- 172.21.15.19:0/2757435535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd141f8550 msgr2=0x7fcd1414e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:40.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.385+0000 7fcd1b000640 1 --2- 172.21.15.19:0/2757435535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd141f8550 0x7fcd1414e810 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcd00007290 tx=0x7fcd00007690 comp rx=0 tx=0).stop 2024-03-08T06:05:40.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.385+0000 7fcd1b000640 1 -- 172.21.15.19:0/2757435535 shutdown_connections 2024-03-08T06:05:40.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.385+0000 7fcd1b000640 1 --2- 172.21.15.19:0/2757435535 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fccf406b500 0x7fccf406d9c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:40.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.385+0000 7fcd1b000640 1 --2- 172.21.15.19:0/2757435535 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fcd1414f140 0x7fcd140b80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:40.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.385+0000 7fcd1b000640 1 --2- 172.21.15.19:0/2757435535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd141f8550 0x7fcd1414e810 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:40.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.385+0000 7fcd1b000640 1 --2- 172.21.15.19:0/2757435535 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccf80039e0 0x7fcd140cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:40.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.385+0000 7fcd1b000640 1 -- 172.21.15.19:0/2757435535 >> 172.21.15.19:0/2757435535 conn(0x7fcd1406c600 msgr2=0x7fcd14160ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:40.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.385+0000 7fcd1b000640 1 -- 172.21.15.19:0/2757435535 shutdown_connections 2024-03-08T06:05:40.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.385+0000 7fcd1b000640 1 -- 172.21.15.19:0/2757435535 wait complete. 2024-03-08T06:05:40.404 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T06:05:40.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.610+0000 7f1cf3200640 1 Processor -- start 2024-03-08T06:05:40.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.610+0000 7f1cf3200640 1 -- start start 2024-03-08T06:05:40.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.612+0000 7f1cf3200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1cf4145520 0x7f1cf415d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:40.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.612+0000 7f1cf3200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf415ceb0 con 0x7f1cf4071df0 2024-03-08T06:05:40.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.612+0000 7f1cf3200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf415c330 con 0x7f1cf415bea0 2024-03-08T06:05:40.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.612+0000 7f1cf3200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf415c610 con 0x7f1cf4145520 2024-03-08T06:05:40.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.612+0000 7f1cf2800640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1cf4071df0 0x7f1cf406d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44560/0 (socket says 172.21.15.19:44560) 2024-03-08T06:05:40.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.612+0000 7f1cf2800640 1 -- 172.21.15.19:0/2545663972 learned_addr learned my addr 172.21.15.19:0/2545663972 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:40.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.612+0000 7f1cf1e00640 1 --2- 172.21.15.19:0/2545663972 >> v2:172.21.15.42:3300/0 conn(0x7f1cf4145520 0x7f1cf415d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:40.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.613+0000 7f1cf1400640 1 -- 172.21.15.19:0/2545663972 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380451053 0 0) 0x7f1cf415ceb0 con 0x7f1cf4071df0 2024-03-08T06:05:40.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.613+0000 7f1cf1400640 1 -- 172.21.15.19:0/2545663972 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cd8003520 con 0x7f1cf4071df0 2024-03-08T06:05:40.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.613+0000 7f1cf1400640 1 -- 172.21.15.19:0/2545663972 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2785594509 0 0) 0x7f1cd8003520 con 0x7f1cf4071df0 2024-03-08T06:05:40.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.613+0000 7f1cf1400640 1 -- 172.21.15.19:0/2545663972 >> v2:172.21.15.42:3300/0 conn(0x7f1cf4145520 msgr2=0x7f1cf415d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:40.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.613+0000 7f1cf1400640 1 --2- 172.21.15.19:0/2545663972 >> v2:172.21.15.42:3300/0 conn(0x7f1cf4145520 0x7f1cf415d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:40.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.613+0000 7f1cf1400640 1 -- 172.21.15.19:0/2545663972 >> v1:172.21.15.42:6789/0 conn(0x7f1cf415bea0 legacy=0x7f1cf40716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:40.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.613+0000 7f1cf1400640 1 -- 172.21.15.19:0/2545663972 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf415c8f0 con 0x7f1cf4071df0 2024-03-08T06:05:40.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.613+0000 7f1cf1400640 1 -- 172.21.15.19:0/2545663972 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f1cec0019f0 con 0x7f1cf4071df0 2024-03-08T06:05:40.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.613+0000 7f1cf1400640 1 -- 172.21.15.19:0/2545663972 >> v1:172.21.15.19:6789/0 conn(0x7f1cf4071df0 legacy=0x7f1cf406d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:40.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.613+0000 7f1cf1400640 1 --2- 172.21.15.19:0/2545663972 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1cd80039b0 0x7f1cd8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:40.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.613+0000 7f1cf1400640 1 --2- 172.21.15.19:0/2545663972 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cd8004800 0x7f1cd8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:40.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.613+0000 7f1cf1400640 1 --2- 172.21.15.19:0/2545663972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cd80051c0 0x7f1cd800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:40.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.613+0000 7f1cf1400640 1 -- 172.21.15.19:0/2545663972 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf415c610 con 0x7f1cd80051c0 2024-03-08T06:05:40.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.613+0000 7f1cf1400640 1 -- 172.21.15.19:0/2545663972 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd800c110 con 0x7f1cd8004800 2024-03-08T06:05:40.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.613+0000 7f1cf1400640 1 -- 172.21.15.19:0/2545663972 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd800c310 con 0x7f1cd80039b0 2024-03-08T06:05:40.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.613+0000 7f1cf2800640 1 --2- 172.21.15.19:0/2545663972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cd80051c0 0x7f1cd800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:40.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.614+0000 7f1ce9400640 1 --2- 172.21.15.19:0/2545663972 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cd8004800 0x7f1cd8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:40.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.614+0000 7f1cf1e00640 1 --2- 172.21.15.19:0/2545663972 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1cd80039b0 0x7f1cd8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:40.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.614+0000 7f1cf2800640 1 -- 172.21.15.19:0/2545663972 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1cd80039b0 msgr2=0x7f1cd8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:40.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.614+0000 7f1cf2800640 1 --2- 172.21.15.19:0/2545663972 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1cd80039b0 0x7f1cd8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:40.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.614+0000 7f1cf2800640 1 -- 172.21.15.19:0/2545663972 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cd8004800 msgr2=0x7f1cd8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:40.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.614+0000 7f1cf2800640 1 --2- 172.21.15.19:0/2545663972 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cd8004800 0x7f1cd8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:40.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.614+0000 7f1cf2800640 1 -- 172.21.15.19:0/2545663972 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd8003520 con 0x7f1cd80051c0 2024-03-08T06:05:40.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.615+0000 7f1cf2800640 1 -- 172.21.15.19:0/2545663972 reap_dead start 2024-03-08T06:05:40.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.615+0000 7f1cf2800640 1 --2- 172.21.15.19:0/2545663972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cd80051c0 0x7f1cd800b9c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40b2a20 tx=0x7f1cd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3493ea7563bc9fb2 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:40.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.615+0000 7f1cf1400640 1 -- 172.21.15.19:0/2545663972 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec00a460 con 0x7f1cd80051c0 2024-03-08T06:05:40.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.615+0000 7f1cf1400640 1 -- 172.21.15.19:0/2545663972 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec034650 con 0x7f1cd80051c0 2024-03-08T06:05:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.615+0000 7f1cf1400640 1 -- 172.21.15.19:0/2545663972 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec034a40 con 0x7f1cd80051c0 2024-03-08T06:05:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.616+0000 7f1cf3200640 1 -- 172.21.15.19:0/2545663972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cd80051c0 msgr2=0x7f1cd800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.616+0000 7f1cf3200640 1 --2- 172.21.15.19:0/2545663972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cd80051c0 0x7f1cd800b9c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40b2a20 tx=0x7f1cd8005830 comp rx=0 tx=0).stop 2024-03-08T06:05:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.616+0000 7f1cf3200640 1 -- 172.21.15.19:0/2545663972 shutdown_connections 2024-03-08T06:05:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.616+0000 7f1cf3200640 1 --2- 172.21.15.19:0/2545663972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cd80051c0 0x7f1cd800b9c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.616+0000 7f1cf3200640 1 -- 172.21.15.19:0/2545663972 >> 172.21.15.19:0/2545663972 conn(0x7f1cf40b1850 msgr2=0x7f1cf40b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.616+0000 7f1cf3200640 1 -- 172.21.15.19:0/2545663972 shutdown_connections 2024-03-08T06:05:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.616+0000 7f1cf3200640 1 -- 172.21.15.19:0/2545663972 wait complete. 2024-03-08T06:05:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.618+0000 7f1cf3200640 1 Processor -- start 2024-03-08T06:05:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.618+0000 7f1cf3200640 1 -- start start 2024-03-08T06:05:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.619+0000 7f1cf3200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1cd80051c0 0x7f1cf41f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.619+0000 7f1cf3200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cf413aa30 0x7f1cf413ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.619+0000 7f1cf3200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cf414e010 0x7f1cf414e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.619+0000 7f1cf3200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40af1c0 con 0x7f1cf414e010 2024-03-08T06:05:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.619+0000 7f1cf3200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40af040 con 0x7f1cf413aa30 2024-03-08T06:05:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.619+0000 7f1cf3200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf406e410 con 0x7f1cd80051c0 2024-03-08T06:05:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.619+0000 7f1cf2800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cf414e010 0x7f1cf414e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.619+0000 7f1cf2800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cf414e010 0x7f1cf414e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40926/0 (socket says 172.21.15.19:40926) 2024-03-08T06:05:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.619+0000 7f1cf2800640 1 -- 172.21.15.19:0/541460955 learned_addr learned my addr 172.21.15.19:0/541460955 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.620+0000 7f1cf1e00640 1 --2- 172.21.15.19:0/541460955 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1cd80051c0 0x7f1cf41f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.620+0000 7f1ce9400640 1 --2- 172.21.15.19:0/541460955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cf413aa30 0x7f1cf413ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:40.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.620+0000 7f1cf2800640 1 -- 172.21.15.19:0/541460955 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1cd80051c0 msgr2=0x7f1cf41f6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:40.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.620+0000 7f1cf2800640 1 --2- 172.21.15.19:0/541460955 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1cd80051c0 0x7f1cf41f6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:40.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.620+0000 7f1cf2800640 1 -- 172.21.15.19:0/541460955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cf413aa30 msgr2=0x7f1cf413ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:40.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.620+0000 7f1cf2800640 1 --2- 172.21.15.19:0/541460955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cf413aa30 0x7f1cf413ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:40.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.620+0000 7f1cf2800640 1 -- 172.21.15.19:0/541460955 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf4150cb0 con 0x7f1cf414e010 2024-03-08T06:05:40.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.620+0000 7f1cf2800640 1 --2- 172.21.15.19:0/541460955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cf414e010 0x7f1cf414e490 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00a900 tx=0x7f1cf406d220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:40.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.620+0000 7f1ceaa00640 1 -- 172.21.15.19:0/541460955 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec039040 con 0x7f1cf414e010 2024-03-08T06:05:40.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.620+0000 7f1ceaa00640 1 -- 172.21.15.19:0/541460955 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec0017b0 con 0x7f1cf414e010 2024-03-08T06:05:40.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.620+0000 7f1ceaa00640 1 -- 172.21.15.19:0/541460955 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec004b60 con 0x7f1cf414e010 2024-03-08T06:05:40.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.620+0000 7f1cf3200640 1 -- 172.21.15.19:0/541460955 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf4150f90 con 0x7f1cf414e010 2024-03-08T06:05:40.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.621+0000 7f1cf3200640 1 -- 172.21.15.19:0/541460955 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf413a230 con 0x7f1cf414e010 2024-03-08T06:05:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.622+0000 7f1cf3200640 1 -- 172.21.15.19:0/541460955 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf4075100 con 0x7f1cf414e010 2024-03-08T06:05:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.623+0000 7f1ceaa00640 1 -- 172.21.15.19:0/541460955 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1cec046020 con 0x7f1cf414e010 2024-03-08T06:05:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.624+0000 7f1ceaa00640 1 --2- 172.21.15.19:0/541460955 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1cd006b500 0x7f1cd006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.624+0000 7f1ceaa00640 1 -- 172.21.15.19:0/541460955 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cec0aba90 con 0x7f1cf414e010 2024-03-08T06:05:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.624+0000 7f1cf1e00640 1 --2- 172.21.15.19:0/541460955 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1cd006b500 0x7f1cd006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.625+0000 7f1cf1e00640 1 --2- 172.21.15.19:0/541460955 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1cd006b500 0x7f1cd006d9c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4006fd0 tx=0x7f1ce4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:40.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.628+0000 7f1ceaa00640 1 -- 172.21.15.19:0/541460955 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1cec03d370 con 0x7f1cf414e010 2024-03-08T06:05:40.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.865+0000 7f1cf3200640 1 -- 172.21.15.19:0/541460955 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cf40ce640 con 0x7f1cf414e010 2024-03-08T06:05:40.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.867+0000 7f1ceaa00640 1 -- 172.21.15.19:0/541460955 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4935 (secure 0 0 0) 0x7f1cec07aa30 con 0x7f1cf414e010 2024-03-08T06:05:40.868 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:05:40.868 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3542863285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3542863285},{"type":"v1","addr":"172.21.15.42:6833","nonce":3542863285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4708,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1679053115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1679053115},{"type":"v1","addr":"172.21.15.42:6835","nonce":1679053115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5022,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/717236359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":717236359},{"type":"v1","addr":"172.21.15.19:6835","nonce":717236359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-08T06:04:30.148899+0000","modified":"2024-03-08T06:04:33.195351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5028":{"gid":5028,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.19:6837/1359509141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1359509141},{"type":"v1","addr":"172.21.15.19:6837","nonce":1359509141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-08T06:05:40.868 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 16 2024-03-08T06:05:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.869+0000 7f1cf3200640 1 -- 172.21.15.19:0/541460955 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1cd006b500 msgr2=0x7f1cd006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.869+0000 7f1cf3200640 1 --2- 172.21.15.19:0/541460955 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1cd006b500 0x7f1cd006d9c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4006fd0 tx=0x7f1ce4008040 comp rx=0 tx=0).stop 2024-03-08T06:05:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.869+0000 7f1cf3200640 1 -- 172.21.15.19:0/541460955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cf414e010 msgr2=0x7f1cf414e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.869+0000 7f1cf3200640 1 --2- 172.21.15.19:0/541460955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cf414e010 0x7f1cf414e490 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00a900 tx=0x7f1cf406d220 comp rx=0 tx=0).stop 2024-03-08T06:05:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.869+0000 7f1cf3200640 1 -- 172.21.15.19:0/541460955 shutdown_connections 2024-03-08T06:05:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.869+0000 7f1cf3200640 1 --2- 172.21.15.19:0/541460955 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1cd006b500 0x7f1cd006d9c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.869+0000 7f1cf3200640 1 --2- 172.21.15.19:0/541460955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cf414e010 0x7f1cf414e490 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.869+0000 7f1cf3200640 1 --2- 172.21.15.19:0/541460955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cf413aa30 0x7f1cf413ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.869+0000 7f1cf3200640 1 --2- 172.21.15.19:0/541460955 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1cd80051c0 0x7f1cf41f6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.869+0000 7f1cf3200640 1 -- 172.21.15.19:0/541460955 >> 172.21.15.19:0/541460955 conn(0x7f1cf40b1850 msgr2=0x7f1cf40b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.870+0000 7f1cf3200640 1 -- 172.21.15.19:0/541460955 shutdown_connections 2024-03-08T06:05:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:40.870+0000 7f1cf3200640 1 -- 172.21.15.19:0/541460955 wait complete. 2024-03-08T06:05:40.887 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:05:41.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.112+0000 7f3565200640 1 Processor -- start 2024-03-08T06:05:41.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.112+0000 7f3565200640 1 -- start start 2024-03-08T06:05:41.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.114+0000 7f3565200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3560071ab0 0x7f356015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:41.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.114+0000 7f3565200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f356006d600 0x7f3560144d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:41.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.114+0000 7f3565200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3560071e90 0x7f35601452a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:41.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.114+0000 7f3565200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f356006ef40 con 0x7f356006d600 2024-03-08T06:05:41.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.114+0000 7f3565200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35601457e0 con 0x7f3560071e90 2024-03-08T06:05:41.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.114+0000 7f3565200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356015d0c0 con 0x7f3560071ab0 2024-03-08T06:05:41.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.114+0000 7f3555400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f356006d600 0x7f3560144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:41.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.115+0000 7f3555400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f356006d600 0x7f3560144d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40942/0 (socket says 172.21.15.19:40942) 2024-03-08T06:05:41.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.115+0000 7f3555400640 1 -- 172.21.15.19:0/4029072208 learned_addr learned my addr 172.21.15.19:0/4029072208 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:41.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.115+0000 7f355e800640 1 --2- 172.21.15.19:0/4029072208 >> v2:172.21.15.42:3300/0 conn(0x7f3560071e90 0x7f35601452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:41.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.115+0000 7f355de00640 1 --2- 172.21.15.19:0/4029072208 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3560071ab0 0x7f356015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:41.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.115+0000 7f3555400640 1 -- 172.21.15.19:0/4029072208 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3560071ab0 msgr2=0x7f356015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:41.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.115+0000 7f3555400640 1 --2- 172.21.15.19:0/4029072208 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3560071ab0 0x7f356015cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.115+0000 7f3555400640 1 -- 172.21.15.19:0/4029072208 >> v2:172.21.15.42:3300/0 conn(0x7f3560071e90 msgr2=0x7f35601452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:41.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.115+0000 7f3555400640 1 --2- 172.21.15.19:0/4029072208 >> v2:172.21.15.42:3300/0 conn(0x7f3560071e90 0x7f35601452a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.115+0000 7f3555400640 1 -- 172.21.15.19:0/4029072208 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356006da80 con 0x7f356006d600 2024-03-08T06:05:41.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.116+0000 7f3555400640 1 --2- 172.21.15.19:0/4029072208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f356006d600 0x7f3560144d60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f356015d270 tx=0x7f354802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534f16db8d904a00 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:41.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.117+0000 7f355d400640 1 -- 172.21.15.19:0/4029072208 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548035020 con 0x7f356006d600 2024-03-08T06:05:41.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.117+0000 7f355d400640 1 -- 172.21.15.19:0/4029072208 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3548031640 con 0x7f356006d600 2024-03-08T06:05:41.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.117+0000 7f355d400640 1 -- 172.21.15.19:0/4029072208 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354802d040 con 0x7f356006d600 2024-03-08T06:05:41.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.118+0000 7f3565200640 1 -- 172.21.15.19:0/4029072208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f356006d600 msgr2=0x7f3560144d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:41.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.118+0000 7f3565200640 1 --2- 172.21.15.19:0/4029072208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f356006d600 0x7f3560144d60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f356015d270 tx=0x7f354802b8f0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.118+0000 7f3565200640 1 -- 172.21.15.19:0/4029072208 shutdown_connections 2024-03-08T06:05:41.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.118+0000 7f3565200640 1 --2- 172.21.15.19:0/4029072208 >> v2:172.21.15.42:3300/0 conn(0x7f3560071e90 0x7f35601452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.118+0000 7f3565200640 1 --2- 172.21.15.19:0/4029072208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f356006d600 0x7f3560144d60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.118+0000 7f3565200640 1 --2- 172.21.15.19:0/4029072208 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3560071ab0 0x7f356015cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.118+0000 7f3565200640 1 -- 172.21.15.19:0/4029072208 >> 172.21.15.19:0/4029072208 conn(0x7f356006ae30 msgr2=0x7f356006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.118+0000 7f3565200640 1 -- 172.21.15.19:0/4029072208 shutdown_connections 2024-03-08T06:05:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.118+0000 7f3565200640 1 -- 172.21.15.19:0/4029072208 wait complete. 2024-03-08T06:05:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.120+0000 7f3565200640 1 Processor -- start 2024-03-08T06:05:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.120+0000 7f3565200640 1 -- start start 2024-03-08T06:05:41.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.121+0000 7f3565200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f356006d600 0x7f356015b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:41.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.121+0000 7f3565200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3560071ab0 0x7f35600a8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:41.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.121+0000 7f3565200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3560071e90 0x7f356013fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:41.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.121+0000 7f3565200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356006e320 con 0x7f3560071ab0 2024-03-08T06:05:41.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.121+0000 7f3565200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356006e040 con 0x7f3560071e90 2024-03-08T06:05:41.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.121+0000 7f3565200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356006e600 con 0x7f356006d600 2024-03-08T06:05:41.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.121+0000 7f3555400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3560071ab0 0x7f35600a8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:41.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.121+0000 7f3555400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3560071ab0 0x7f35600a8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40954/0 (socket says 172.21.15.19:40954) 2024-03-08T06:05:41.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.121+0000 7f3555400640 1 -- 172.21.15.19:0/1205243822 learned_addr learned my addr 172.21.15.19:0/1205243822 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:41.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.121+0000 7f355de00640 1 --2- 172.21.15.19:0/1205243822 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f356006d600 0x7f356015b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:41.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.121+0000 7f355e800640 1 --2- 172.21.15.19:0/1205243822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3560071e90 0x7f356013fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:41.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.121+0000 7f3555400640 1 -- 172.21.15.19:0/1205243822 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f356006d600 msgr2=0x7f356015b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:41.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.121+0000 7f3555400640 1 --2- 172.21.15.19:0/1205243822 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f356006d600 0x7f356015b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.121+0000 7f3555400640 1 -- 172.21.15.19:0/1205243822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3560071e90 msgr2=0x7f356013fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:41.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.121+0000 7f3555400640 1 --2- 172.21.15.19:0/1205243822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3560071e90 0x7f356013fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.122+0000 7f3555400640 1 -- 172.21.15.19:0/1205243822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356013ecd0 con 0x7f3560071ab0 2024-03-08T06:05:41.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.122+0000 7f3555400640 1 --2- 172.21.15.19:0/1205243822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3560071ab0 0x7f35600a8a50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3548000c00 tx=0x7f35480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:41.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.122+0000 7f3556a00640 1 -- 172.21.15.19:0/1205243822 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548040070 con 0x7f3560071ab0 2024-03-08T06:05:41.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.122+0000 7f3556a00640 1 -- 172.21.15.19:0/1205243822 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3548039c10 con 0x7f3560071ab0 2024-03-08T06:05:41.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.122+0000 7f3565200640 1 -- 172.21.15.19:0/1205243822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356013efb0 con 0x7f3560071ab0 2024-03-08T06:05:41.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.122+0000 7f3556a00640 1 -- 172.21.15.19:0/1205243822 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548035040 con 0x7f3560071ab0 2024-03-08T06:05:41.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.122+0000 7f3565200640 1 -- 172.21.15.19:0/1205243822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356013f570 con 0x7f3560071ab0 2024-03-08T06:05:41.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.124+0000 7f3565200640 1 -- 172.21.15.19:0/1205243822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3560067cb0 con 0x7f3560071ab0 2024-03-08T06:05:41.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.124+0000 7f3556a00640 1 -- 172.21.15.19:0/1205243822 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3548038020 con 0x7f3560071ab0 2024-03-08T06:05:41.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.125+0000 7f3556a00640 1 --2- 172.21.15.19:0/1205243822 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f353c06b500 0x7f353c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:41.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.125+0000 7f3556a00640 1 -- 172.21.15.19:0/1205243822 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35480abbc0 con 0x7f3560071ab0 2024-03-08T06:05:41.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.126+0000 7f355de00640 1 --2- 172.21.15.19:0/1205243822 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f353c06b500 0x7f353c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:41.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.126+0000 7f355de00640 1 --2- 172.21.15.19:0/1205243822 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f353c06b500 0x7f353c06d9c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3550006fd0 tx=0x7f3550008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:41.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.130+0000 7f3556a00640 1 -- 172.21.15.19:0/1205243822 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f354807aa30 con 0x7f3560071ab0 2024-03-08T06:05:41.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.328+0000 7f3565200640 1 -- 172.21.15.19:0/1205243822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3560142570 con 0x7f3560071ab0 2024-03-08T06:05:41.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.330+0000 7f3556a00640 1 -- 172.21.15.19:0/1205243822 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16609 (secure 0 0 0) 0x7f354807a330 con 0x7f3560071ab0 2024-03-08T06:05:41.331 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:05:41.331 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":34,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:04:31.685292+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-08T06:04:28.095112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-08T06:04:29.178532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:05:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.332+0000 7f3565200640 1 -- 172.21.15.19:0/1205243822 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f353c06b500 msgr2=0x7f353c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.333+0000 7f3565200640 1 --2- 172.21.15.19:0/1205243822 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f353c06b500 0x7f353c06d9c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3550006fd0 tx=0x7f3550008040 comp rx=0 tx=0).stop 2024-03-08T06:05:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.333+0000 7f3565200640 1 -- 172.21.15.19:0/1205243822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3560071ab0 msgr2=0x7f35600a8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.333+0000 7f3565200640 1 --2- 172.21.15.19:0/1205243822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3560071ab0 0x7f35600a8a50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3548000c00 tx=0x7f35480046c0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.333+0000 7f3565200640 1 -- 172.21.15.19:0/1205243822 shutdown_connections 2024-03-08T06:05:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.333+0000 7f3565200640 1 --2- 172.21.15.19:0/1205243822 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f353c06b500 0x7f353c06d9c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.333+0000 7f3565200640 1 --2- 172.21.15.19:0/1205243822 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3560071e90 0x7f356013fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.333+0000 7f3565200640 1 --2- 172.21.15.19:0/1205243822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3560071ab0 0x7f35600a8a50 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.333+0000 7f3565200640 1 --2- 172.21.15.19:0/1205243822 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f356006d600 0x7f356015b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.333+0000 7f3565200640 1 -- 172.21.15.19:0/1205243822 >> 172.21.15.19:0/1205243822 conn(0x7f356006ae30 msgr2=0x7f3560144b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.333+0000 7f3565200640 1 -- 172.21.15.19:0/1205243822 shutdown_connections 2024-03-08T06:05:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.333+0000 7f3565200640 1 -- 172.21.15.19:0/1205243822 wait complete. 2024-03-08T06:05:41.352 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-08T06:05:41.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.572+0000 7f1cf8c00640 1 Processor -- start 2024-03-08T06:05:41.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.573+0000 7f1cf8c00640 1 -- start start 2024-03-08T06:05:41.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.574+0000 7f1cf8c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1cf40cd2c0 0x7f1cf406e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:41.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.574+0000 7f1cf8c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1cf40cd6a0 0x7f1cf406e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:41.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.574+0000 7f1cf8c00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf415b290 con 0x7f1cf40b3880 2024-03-08T06:05:41.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.574+0000 7f1cf8c00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf415b570 con 0x7f1cf40cd2c0 2024-03-08T06:05:41.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.574+0000 7f1cf8c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf415b850 con 0x7f1cf40cd6a0 2024-03-08T06:05:41.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.575+0000 7f1ce9400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1cf40cd6a0 0x7f1cf406e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:41.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.575+0000 7f1cf1e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1cf40cd2c0 0x7f1cf406e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:41.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.575+0000 7f1ce9400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1cf40cd6a0 0x7f1cf406e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.19:45026/0 (socket says 172.21.15.19:45026) 2024-03-08T06:05:41.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.575+0000 7f1ce9400640 1 -- 172.21.15.19:0/3558589899 learned_addr learned my addr 172.21.15.19:0/3558589899 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:41.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.576+0000 7f1cf1e00640 1 -- 172.21.15.19:0/3558589899 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1cf40cd6a0 msgr2=0x7f1cf406e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:41.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.576+0000 7f1cf1e00640 1 --2- 172.21.15.19:0/3558589899 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1cf40cd6a0 0x7f1cf406e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.576+0000 7f1cf1e00640 1 -- 172.21.15.19:0/3558589899 >> v1:172.21.15.42:6789/0 conn(0x7f1cf40b3880 legacy=0x7f1cf40ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:41.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.576+0000 7f1cf1e00640 1 -- 172.21.15.19:0/3558589899 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf415bb30 con 0x7f1cf40cd2c0 2024-03-08T06:05:41.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.577+0000 7f1cf1e00640 1 --2- 172.21.15.19:0/3558589899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cf40cd2c0 0x7f1cf406e450 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1ce40097a0 tx=0x7f1ce402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0072913cc1a81a8 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:41.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.577+0000 7f1cf1400640 1 -- 172.21.15.19:0/3558589899 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4035020 con 0x7f1cf40cd2c0 2024-03-08T06:05:41.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.578+0000 7f1cf1400640 1 -- 172.21.15.19:0/3558589899 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce4031810 con 0x7f1cf40cd2c0 2024-03-08T06:05:41.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.578+0000 7f1cf1400640 1 -- 172.21.15.19:0/3558589899 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4031be0 con 0x7f1cf40cd2c0 2024-03-08T06:05:41.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.578+0000 7f1cf8c00640 1 -- 172.21.15.19:0/3558589899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cf40cd2c0 msgr2=0x7f1cf406e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:41.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.578+0000 7f1cf8c00640 1 --2- 172.21.15.19:0/3558589899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cf40cd2c0 0x7f1cf406e450 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1ce40097a0 tx=0x7f1ce402b8b0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.578+0000 7f1cf8c00640 1 -- 172.21.15.19:0/3558589899 shutdown_connections 2024-03-08T06:05:41.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.578+0000 7f1cf8c00640 1 --2- 172.21.15.19:0/3558589899 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1cf40cd6a0 0x7f1cf406e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.578+0000 7f1cf8c00640 1 --2- 172.21.15.19:0/3558589899 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cf40cd2c0 0x7f1cf406e450 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.578+0000 7f1cf8c00640 1 -- 172.21.15.19:0/3558589899 >> 172.21.15.19:0/3558589899 conn(0x7f1cf406ae30 msgr2=0x7f1cf406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:41.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.578+0000 7f1cf8c00640 1 -- 172.21.15.19:0/3558589899 shutdown_connections 2024-03-08T06:05:41.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.578+0000 7f1cf8c00640 1 -- 172.21.15.19:0/3558589899 wait complete. 2024-03-08T06:05:41.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.580+0000 7f1cf8c00640 1 Processor -- start 2024-03-08T06:05:41.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.580+0000 7f1cf8c00640 1 -- start start 2024-03-08T06:05:41.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.581+0000 7f1cf8c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1cf40b3880 0x7f1cf414f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:41.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.581+0000 7f1cf8c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cf40cd2c0 0x7f1cf4154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:41.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.581+0000 7f1cf8c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cf40cd6a0 0x7f1cf4154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:41.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.581+0000 7f1cf8c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40cf5b0 con 0x7f1cf40cd2c0 2024-03-08T06:05:41.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.581+0000 7f1cf8c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40cf430 con 0x7f1cf40cd6a0 2024-03-08T06:05:41.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.581+0000 7f1cf8c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40cf730 con 0x7f1cf40b3880 2024-03-08T06:05:41.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.582+0000 7f1ce9400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cf40cd2c0 0x7f1cf4154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:41.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.582+0000 7f1ce9400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cf40cd2c0 0x7f1cf4154300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40962/0 (socket says 172.21.15.19:40962) 2024-03-08T06:05:41.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.582+0000 7f1ce9400640 1 -- 172.21.15.19:0/1321585580 learned_addr learned my addr 172.21.15.19:0/1321585580 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:41.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.582+0000 7f1cf1e00640 1 --2- 172.21.15.19:0/1321585580 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1cf40b3880 0x7f1cf414f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:41.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.582+0000 7f1cf2800640 1 --2- 172.21.15.19:0/1321585580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cf40cd6a0 0x7f1cf4154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:41.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.582+0000 7f1ce9400640 1 -- 172.21.15.19:0/1321585580 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1cf40b3880 msgr2=0x7f1cf414f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:41.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.582+0000 7f1ce9400640 1 --2- 172.21.15.19:0/1321585580 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1cf40b3880 0x7f1cf414f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.582+0000 7f1ce9400640 1 -- 172.21.15.19:0/1321585580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cf40cd6a0 msgr2=0x7f1cf4154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:41.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.582+0000 7f1ce9400640 1 --2- 172.21.15.19:0/1321585580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cf40cd6a0 0x7f1cf4154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.582+0000 7f1ce9400640 1 -- 172.21.15.19:0/1321585580 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf41f78b0 con 0x7f1cf40cd2c0 2024-03-08T06:05:41.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.583+0000 7f1ce9400640 1 --2- 172.21.15.19:0/1321585580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cf40cd2c0 0x7f1cf4154300 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00eb30 tx=0x7f1cdc00d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:41.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.583+0000 7f1ceaa00640 1 -- 172.21.15.19:0/1321585580 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc019480 con 0x7f1cf40cd2c0 2024-03-08T06:05:41.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.583+0000 7f1ceaa00640 1 -- 172.21.15.19:0/1321585580 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc019620 con 0x7f1cf40cd2c0 2024-03-08T06:05:41.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.583+0000 7f1ceaa00640 1 -- 172.21.15.19:0/1321585580 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc0199f0 con 0x7f1cf40cd2c0 2024-03-08T06:05:41.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.583+0000 7f1cf8c00640 1 -- 172.21.15.19:0/1321585580 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf40aa5f0 con 0x7f1cf40cd2c0 2024-03-08T06:05:41.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.583+0000 7f1cf8c00640 1 -- 172.21.15.19:0/1321585580 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf41522b0 con 0x7f1cf40cd2c0 2024-03-08T06:05:41.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.584+0000 7f1cf8c00640 1 -- 172.21.15.19:0/1321585580 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf41520c0 con 0x7f1cf40cd2c0 2024-03-08T06:05:41.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.586+0000 7f1ceaa00640 1 -- 172.21.15.19:0/1321585580 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f1cdc019b90 con 0x7f1cf40cd2c0 2024-03-08T06:05:41.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.586+0000 7f1ceaa00640 1 --2- 172.21.15.19:0/1321585580 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1cd006b4d0 0x7f1cd006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:41.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.587+0000 7f1ceaa00640 1 -- 172.21.15.19:0/1321585580 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cdc08ad80 con 0x7f1cf40cd2c0 2024-03-08T06:05:41.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.587+0000 7f1cf1e00640 1 --2- 172.21.15.19:0/1321585580 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1cd006b4d0 0x7f1cd006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:41.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.587+0000 7f1cf1e00640 1 --2- 172.21.15.19:0/1321585580 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1cd006b4d0 0x7f1cd006d990 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4036000 tx=0x7f1ce4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:41.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.591+0000 7f1ceaa00640 1 -- 172.21.15.19:0/1321585580 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1cf41f78b0 con 0x7f1cf40cd2c0 2024-03-08T06:05:41.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.833+0000 7f1cf8c00640 1 -- 172.21.15.19:0/1321585580 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1cf4067cb0 con 0x7f1cf40cd2c0 2024-03-08T06:05:41.835 INFO:tasks.ceph.mon.a.smithi019.stderr:2024-03-08T06:05:41.834+0000 7f6070c00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-08T06:05:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.837+0000 7f1ceaa00640 1 -- 172.21.15.19:0/1321585580 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1cdc059bf0 con 0x7f1cf40cd2c0 2024-03-08T06:05:41.838 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-08T06:05:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.841+0000 7f1cf8c00640 1 -- 172.21.15.19:0/1321585580 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1cd006b4d0 msgr2=0x7f1cd006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.841+0000 7f1cf8c00640 1 --2- 172.21.15.19:0/1321585580 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1cd006b4d0 0x7f1cd006d990 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4036000 tx=0x7f1ce4008030 comp rx=0 tx=0).stop 2024-03-08T06:05:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.841+0000 7f1cf8c00640 1 -- 172.21.15.19:0/1321585580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cf40cd2c0 msgr2=0x7f1cf4154300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.841+0000 7f1cf8c00640 1 --2- 172.21.15.19:0/1321585580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cf40cd2c0 0x7f1cf4154300 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00eb30 tx=0x7f1cdc00d350 comp rx=0 tx=0).stop 2024-03-08T06:05:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.842+0000 7f1cf8c00640 1 -- 172.21.15.19:0/1321585580 shutdown_connections 2024-03-08T06:05:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.842+0000 7f1cf8c00640 1 --2- 172.21.15.19:0/1321585580 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f1cd006b4d0 0x7f1cd006d990 secure :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4036000 tx=0x7f1ce4008030 comp rx=0 tx=0).stop 2024-03-08T06:05:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.842+0000 7f1cf8c00640 1 --2- 172.21.15.19:0/1321585580 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1cf40cd6a0 0x7f1cf4154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.842+0000 7f1cf8c00640 1 --2- 172.21.15.19:0/1321585580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1cf40cd2c0 0x7f1cf4154300 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.842+0000 7f1cf8c00640 1 --2- 172.21.15.19:0/1321585580 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f1cf40b3880 0x7f1cf414f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.842+0000 7f1cf8c00640 1 -- 172.21.15.19:0/1321585580 >> 172.21.15.19:0/1321585580 conn(0x7f1cf406ae30 msgr2=0x7f1cf4159e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:41.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.843+0000 7f1cf8c00640 1 -- 172.21.15.19:0/1321585580 shutdown_connections 2024-03-08T06:05:41.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:41.843+0000 7f1cf8c00640 1 -- 172.21.15.19:0/1321585580 wait complete. 2024-03-08T06:05:41.863 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-08T06:05:41.947 INFO:tasks.ceph.mds.c.smithi019.stdout:starting mds.c at 2024-03-08T06:05:42.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.061+0000 7f6d4f200640 1 Processor -- start 2024-03-08T06:05:42.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.061+0000 7f6d4f200640 1 -- start start 2024-03-08T06:05:42.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.063+0000 7f6d4f200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6d48071fa0 0x7f6d480cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:42.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.063+0000 7f6d4f200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4815ebd0 con 0x7f6d48071bc0 2024-03-08T06:05:42.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.063+0000 7f6d4f200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4815ee70 con 0x7f6d4815e760 2024-03-08T06:05:42.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.063+0000 7f6d4f200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4815f150 con 0x7f6d48071fa0 2024-03-08T06:05:42.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.063+0000 7f6d47e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6d48071bc0 0x7f6d4815b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42750/0 (socket says 172.21.15.19:42750) 2024-03-08T06:05:42.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.063+0000 7f6d47e00640 1 -- 172.21.15.19:0/1266598479 learned_addr learned my addr 172.21.15.19:0/1266598479 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:42.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.063+0000 7f6d47400640 1 --2- 172.21.15.19:0/1266598479 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6d48071fa0 0x7f6d480cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:42.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.063+0000 7f6d46a00640 1 -- 172.21.15.19:0/1266598479 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79803092 0 0) 0x7f6d4815ebd0 con 0x7f6d48071bc0 2024-03-08T06:05:42.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.063+0000 7f6d46a00640 1 -- 172.21.15.19:0/1266598479 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d2c003520 con 0x7f6d48071bc0 2024-03-08T06:05:42.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.064+0000 7f6d46a00640 1 -- 172.21.15.19:0/1266598479 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1246989509 0 0) 0x7f6d2c003520 con 0x7f6d48071bc0 2024-03-08T06:05:42.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.064+0000 7f6d46a00640 1 -- 172.21.15.19:0/1266598479 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6d48071fa0 msgr2=0x7f6d480cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:42.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.064+0000 7f6d46a00640 1 --2- 172.21.15.19:0/1266598479 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6d48071fa0 0x7f6d480cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:42.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.064+0000 7f6d46a00640 1 -- 172.21.15.19:0/1266598479 >> v1:172.21.15.42:6789/0 conn(0x7f6d4815e760 legacy=0x7f6d48144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:42.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.064+0000 7f6d46a00640 1 -- 172.21.15.19:0/1266598479 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4815f430 con 0x7f6d48071bc0 2024-03-08T06:05:42.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.064+0000 7f6d46a00640 1 -- 172.21.15.19:0/1266598479 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f6d38001a10 con 0x7f6d48071bc0 2024-03-08T06:05:42.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.064+0000 7f6d47400640 1 --2- 172.21.15.19:0/1266598479 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6d48071fa0 0x7f6d480cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:05:42.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.064+0000 7f6d46a00640 1 -- 172.21.15.19:0/1266598479 >> v1:172.21.15.19:6789/0 conn(0x7f6d48071bc0 legacy=0x7f6d4815b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:42.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.064+0000 7f6d46a00640 1 --2- 172.21.15.19:0/1266598479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2c0039e0 0x7f6d2c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:42.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.064+0000 7f6d46a00640 1 --2- 172.21.15.19:0/1266598479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c004800 0x7f6d2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:42.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.064+0000 7f6d46a00640 1 --2- 172.21.15.19:0/1266598479 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6d48071fa0 0x7f6d2c0052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:42.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.064+0000 7f6d46a00640 1 -- 172.21.15.19:0/1266598479 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4815f150 con 0x7f6d2c0039e0 2024-03-08T06:05:42.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.064+0000 7f6d46a00640 1 -- 172.21.15.19:0/1266598479 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c00bbd0 con 0x7f6d2c004800 2024-03-08T06:05:42.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.064+0000 7f6d46a00640 1 -- 172.21.15.19:0/1266598479 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c00bdd0 con 0x7f6d48071fa0 2024-03-08T06:05:42.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.064+0000 7f6d47e00640 1 --2- 172.21.15.19:0/1266598479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2c0039e0 0x7f6d2c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:42.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.065+0000 7f6d47400640 1 --2- 172.21.15.19:0/1266598479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c004800 0x7f6d2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:42.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.065+0000 7f6d47e00640 1 -- 172.21.15.19:0/1266598479 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6d48071fa0 msgr2=0x7f6d2c0052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:42.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.065+0000 7f6d4d200640 1 --2- 172.21.15.19:0/1266598479 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6d48071fa0 0x7f6d2c0052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:42.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.065+0000 7f6d47e00640 1 --2- 172.21.15.19:0/1266598479 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6d48071fa0 0x7f6d2c0052b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:42.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.065+0000 7f6d47e00640 1 -- 172.21.15.19:0/1266598479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c004800 msgr2=0x7f6d2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:42.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.065+0000 7f6d47e00640 1 --2- 172.21.15.19:0/1266598479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c004800 0x7f6d2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:42.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.065+0000 7f6d47e00640 1 -- 172.21.15.19:0/1266598479 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c003520 con 0x7f6d2c0039e0 2024-03-08T06:05:42.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.065+0000 7f6d47400640 1 --2- 172.21.15.19:0/1266598479 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c004800 0x7f6d2c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:42.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.065+0000 7f6d4d200640 1 --2- 172.21.15.19:0/1266598479 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6d48071fa0 0x7f6d2c0052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:42.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.066+0000 7f6d47e00640 1 --2- 172.21.15.19:0/1266598479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2c0039e0 0x7f6d2c003e00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800a370 tx=0x7f6d2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e244a79a89a03c64 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:42.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.066+0000 7f6d46a00640 1 -- 172.21.15.19:0/1266598479 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3800a3b0 con 0x7f6d2c0039e0 2024-03-08T06:05:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.066+0000 7f6d46a00640 1 -- 172.21.15.19:0/1266598479 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d38007270 con 0x7f6d2c0039e0 2024-03-08T06:05:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.066+0000 7f6d46a00640 1 -- 172.21.15.19:0/1266598479 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d38007660 con 0x7f6d2c0039e0 2024-03-08T06:05:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.067+0000 7f6d4f200640 1 -- 172.21.15.19:0/1266598479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2c0039e0 msgr2=0x7f6d2c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.067+0000 7f6d4f200640 1 --2- 172.21.15.19:0/1266598479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2c0039e0 0x7f6d2c003e00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800a370 tx=0x7f6d2c005830 comp rx=0 tx=0).stop 2024-03-08T06:05:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.067+0000 7f6d4d200640 1 -- 172.21.15.19:0/1266598479 reap_dead start 2024-03-08T06:05:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.067+0000 7f6d4f200640 1 -- 172.21.15.19:0/1266598479 shutdown_connections 2024-03-08T06:05:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.067+0000 7f6d4f200640 1 -- 172.21.15.19:0/1266598479 >> 172.21.15.19:0/1266598479 conn(0x7f6d4806ae30 msgr2=0x7f6d4806b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.067+0000 7f6d4f200640 1 -- 172.21.15.19:0/1266598479 shutdown_connections 2024-03-08T06:05:42.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.067+0000 7f6d4f200640 1 -- 172.21.15.19:0/1266598479 wait complete. 2024-03-08T06:05:42.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.069+0000 7f6d4f200640 1 Processor -- start 2024-03-08T06:05:42.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.069+0000 7f6d4f200640 1 -- start start 2024-03-08T06:05:42.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.070+0000 7f6d4f200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2c0039e0 0x7f6d4813e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.070+0000 7f6d4f200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6d481395a0 0x7f6d4813abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.070+0000 7f6d4f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d48137a40 0x7f6d4806eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.070+0000 7f6d4f200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480cf5b0 con 0x7f6d2c0039e0 2024-03-08T06:05:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.070+0000 7f6d4f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d481449a0 con 0x7f6d48137a40 2024-03-08T06:05:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.070+0000 7f6d4f200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d480cf730 con 0x7f6d481395a0 2024-03-08T06:05:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.070+0000 7f6d47e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2c0039e0 0x7f6d4813e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.070+0000 7f6d47e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2c0039e0 0x7f6d4813e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42212/0 (socket says 172.21.15.19:42212) 2024-03-08T06:05:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.070+0000 7f6d47e00640 1 -- 172.21.15.19:0/3279844844 learned_addr learned my addr 172.21.15.19:0/3279844844 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.071+0000 7f6d4d200640 1 --2- 172.21.15.19:0/3279844844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d48137a40 0x7f6d4806eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.071+0000 7f6d47400640 1 --2- 172.21.15.19:0/3279844844 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6d481395a0 0x7f6d4813abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.071+0000 7f6d47e00640 1 -- 172.21.15.19:0/3279844844 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6d481395a0 msgr2=0x7f6d4813abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.071+0000 7f6d47e00640 1 --2- 172.21.15.19:0/3279844844 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6d481395a0 0x7f6d4813abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.071+0000 7f6d47e00640 1 -- 172.21.15.19:0/3279844844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d48137a40 msgr2=0x7f6d4806eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.071+0000 7f6d47e00640 1 --2- 172.21.15.19:0/3279844844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d48137a40 0x7f6d4806eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:42.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.071+0000 7f6d47e00640 1 -- 172.21.15.19:0/3279844844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d48139b10 con 0x7f6d2c0039e0 2024-03-08T06:05:42.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.071+0000 7f6d4d200640 1 --2- 172.21.15.19:0/3279844844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d48137a40 0x7f6d4806eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:42.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.071+0000 7f6d47e00640 1 --2- 172.21.15.19:0/3279844844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2c0039e0 0x7f6d4813e510 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800a820 tx=0x7f6d4815f600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:42.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.071+0000 7f6d3fe00640 1 -- 172.21.15.19:0/3279844844 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3800a3b0 con 0x7f6d2c0039e0 2024-03-08T06:05:42.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.071+0000 7f6d3fe00640 1 -- 172.21.15.19:0/3279844844 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d38047070 con 0x7f6d2c0039e0 2024-03-08T06:05:42.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.071+0000 7f6d3fe00640 1 -- 172.21.15.19:0/3279844844 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d38001f00 con 0x7f6d2c0039e0 2024-03-08T06:05:42.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.071+0000 7f6d4f200640 1 -- 172.21.15.19:0/3279844844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d48139df0 con 0x7f6d2c0039e0 2024-03-08T06:05:42.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.072+0000 7f6d4f200640 1 -- 172.21.15.19:0/3279844844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4813a3b0 con 0x7f6d2c0039e0 2024-03-08T06:05:42.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.073+0000 7f6d4f200640 1 -- 172.21.15.19:0/3279844844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d48067cb0 con 0x7f6d2c0039e0 2024-03-08T06:05:42.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.074+0000 7f6d3fe00640 1 -- 172.21.15.19:0/3279844844 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f6d3804c460 con 0x7f6d2c0039e0 2024-03-08T06:05:42.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.074+0000 7f6d3fe00640 1 --2- 172.21.15.19:0/3279844844 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6d2406b4d0 0x7f6d2406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:42.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.075+0000 7f6d3fe00640 1 -- 172.21.15.19:0/3279844844 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6d380ae9c0 con 0x7f6d2c0039e0 2024-03-08T06:05:42.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.075+0000 7f6d47400640 1 --2- 172.21.15.19:0/3279844844 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6d2406b4d0 0x7f6d2406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:42.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.076+0000 7f6d47400640 1 --2- 172.21.15.19:0/3279844844 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6d2406b4d0 0x7f6d2406d990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6d4813ed30 tx=0x7f6d30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.079+0000 7f6d3fe00640 1 -- 172.21.15.19:0/3279844844 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6d3807d740 con 0x7f6d2c0039e0 2024-03-08T06:05:42.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.322+0000 7f6d4f200640 1 -- 172.21.15.19:0/3279844844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6d480b2d90 con 0x7f6d2c0039e0 2024-03-08T06:05:42.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.841+0000 7f6d3fe00640 1 -- 172.21.15.19:0/3279844844 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6d3807d040 con 0x7f6d2c0039e0 2024-03-08T06:05:42.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.846+0000 7f6d4f200640 1 -- 172.21.15.19:0/3279844844 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6d2406b4d0 msgr2=0x7f6d2406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:42.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.846+0000 7f6d4f200640 1 --2- 172.21.15.19:0/3279844844 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6d2406b4d0 0x7f6d2406d990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6d4813ed30 tx=0x7f6d30008040 comp rx=0 tx=0).stop 2024-03-08T06:05:42.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.846+0000 7f6d4f200640 1 -- 172.21.15.19:0/3279844844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2c0039e0 msgr2=0x7f6d4813e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:42.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.846+0000 7f6d4f200640 1 --2- 172.21.15.19:0/3279844844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2c0039e0 0x7f6d4813e510 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6d3800a820 tx=0x7f6d4815f600 comp rx=0 tx=0).stop 2024-03-08T06:05:42.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.846+0000 7f6d4f200640 1 -- 172.21.15.19:0/3279844844 shutdown_connections 2024-03-08T06:05:42.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.846+0000 7f6d4f200640 1 --2- 172.21.15.19:0/3279844844 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f6d2406b4d0 0x7f6d2406d990 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:42.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.846+0000 7f6d4f200640 1 --2- 172.21.15.19:0/3279844844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d48137a40 0x7f6d4806eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:42.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.846+0000 7f6d4f200640 1 --2- 172.21.15.19:0/3279844844 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f6d481395a0 0x7f6d4813abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:42.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.846+0000 7f6d4f200640 1 --2- 172.21.15.19:0/3279844844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d2c0039e0 0x7f6d4813e510 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:42.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.846+0000 7f6d4f200640 1 -- 172.21.15.19:0/3279844844 >> 172.21.15.19:0/3279844844 conn(0x7f6d4806ae30 msgr2=0x7f6d4806d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:42.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.847+0000 7f6d4f200640 1 -- 172.21.15.19:0/3279844844 shutdown_connections 2024-03-08T06:05:42.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:42.847+0000 7f6d4f200640 1 -- 172.21.15.19:0/3279844844 wait complete. 2024-03-08T06:05:42.881 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-08T06:05:43.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.111+0000 7f0636800640 1 Processor -- start 2024-03-08T06:05:43.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.111+0000 7f0636800640 1 -- start start 2024-03-08T06:05:43.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.113+0000 7f0636800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f063015efd0 0x7f06300cca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:43.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.113+0000 7f0636800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06300714d0 con 0x7f063006eb80 2024-03-08T06:05:43.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.113+0000 7f0636800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063015f3b0 con 0x7f06300ccf80 2024-03-08T06:05:43.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.113+0000 7f0636800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0630071dc0 con 0x7f063015efd0 2024-03-08T06:05:43.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.113+0000 7f0635400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f063015efd0 0x7f06300cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:43.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.113+0000 7f0635e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f063006eb80 0x7f063015ae30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42758/0 (socket says 172.21.15.19:42758) 2024-03-08T06:05:43.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.113+0000 7f0635400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f063015efd0 0x7f06300cca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42228/0 (socket says 172.21.15.19:42228) 2024-03-08T06:05:43.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.113+0000 7f0635e00640 1 -- 172.21.15.19:0/2712019857 learned_addr learned my addr 172.21.15.19:0/2712019857 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:43.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.114+0000 7f0635400640 1 -- 172.21.15.19:0/2712019857 >> v1:172.21.15.42:6789/0 conn(0x7f06300ccf80 legacy=0x7f063006e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:43.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.114+0000 7f0635400640 1 -- 172.21.15.19:0/2712019857 >> v1:172.21.15.19:6789/0 conn(0x7f063006eb80 legacy=0x7f063015ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:43.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.114+0000 7f0635400640 1 -- 172.21.15.19:0/2712019857 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0630072250 con 0x7f063015efd0 2024-03-08T06:05:43.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.114+0000 7f062fe00640 1 -- 172.21.15.19:0/2712019857 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062066746 0 0) 0x7f06300714d0 con 0x7f063006eb80 2024-03-08T06:05:43.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.115+0000 7f0635400640 1 --2- 172.21.15.19:0/2712019857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f063015efd0 0x7f06300cca40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f06240097a0 tx=0x7f062402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f380c4d94808ec2 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:43.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.115+0000 7f062fe00640 1 -- 172.21.15.19:0/2712019857 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624035020 con 0x7f063015efd0 2024-03-08T06:05:43.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.115+0000 7f062fe00640 1 -- 172.21.15.19:0/2712019857 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0624031830 con 0x7f063015efd0 2024-03-08T06:05:43.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.115+0000 7f062fe00640 1 -- 172.21.15.19:0/2712019857 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624031c00 con 0x7f063015efd0 2024-03-08T06:05:43.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.116+0000 7f0636800640 1 -- 172.21.15.19:0/2712019857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f063015efd0 msgr2=0x7f06300cca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:43.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.116+0000 7f0636800640 1 --2- 172.21.15.19:0/2712019857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f063015efd0 0x7f06300cca40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f06240097a0 tx=0x7f062402b8d0 comp rx=0 tx=0).stop 2024-03-08T06:05:43.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.116+0000 7f0636800640 1 -- 172.21.15.19:0/2712019857 shutdown_connections 2024-03-08T06:05:43.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.116+0000 7f0636800640 1 --2- 172.21.15.19:0/2712019857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f063015efd0 0x7f06300cca40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:43.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.116+0000 7f0636800640 1 -- 172.21.15.19:0/2712019857 >> 172.21.15.19:0/2712019857 conn(0x7f06300b1600 msgr2=0x7f06300b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:43.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.116+0000 7f0636800640 1 -- 172.21.15.19:0/2712019857 shutdown_connections 2024-03-08T06:05:43.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.116+0000 7f0636800640 1 -- 172.21.15.19:0/2712019857 wait complete. 2024-03-08T06:05:43.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.118+0000 7f0636800640 1 Processor -- start 2024-03-08T06:05:43.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.118+0000 7f0636800640 1 -- start start 2024-03-08T06:05:43.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.119+0000 7f0636800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f063006eb80 0x7f0630159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:43.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.119+0000 7f0636800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f06300ccf80 0x7f06300aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:43.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.119+0000 7f0636800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f063015efd0 0x7f06300aaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:43.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.119+0000 7f0636800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06300b4830 con 0x7f063006eb80 2024-03-08T06:05:43.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.119+0000 7f0636800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0630071a50 con 0x7f063015efd0 2024-03-08T06:05:43.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.119+0000 7f0636800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06300cd4e0 con 0x7f06300ccf80 2024-03-08T06:05:43.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.119+0000 7f0635400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f063006eb80 0x7f0630159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:43.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.119+0000 7f0635400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f063006eb80 0x7f0630159260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42232/0 (socket says 172.21.15.19:42232) 2024-03-08T06:05:43.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.119+0000 7f0635400640 1 -- 172.21.15.19:0/626549235 learned_addr learned my addr 172.21.15.19:0/626549235 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:43.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.119+0000 7f0635e00640 1 --2- 172.21.15.19:0/626549235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f063015efd0 0x7f06300aaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:43.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.119+0000 7f0634a00640 1 --2- 172.21.15.19:0/626549235 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f06300ccf80 0x7f06300aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:43.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.120+0000 7f0635400640 1 -- 172.21.15.19:0/626549235 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f06300ccf80 msgr2=0x7f06300aa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:43.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.120+0000 7f0635400640 1 --2- 172.21.15.19:0/626549235 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f06300ccf80 0x7f06300aa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:43.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.120+0000 7f0635400640 1 -- 172.21.15.19:0/626549235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f063015efd0 msgr2=0x7f06300aaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:43.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.120+0000 7f0635400640 1 --2- 172.21.15.19:0/626549235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f063015efd0 0x7f06300aaa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:43.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.120+0000 7f0635400640 1 -- 172.21.15.19:0/626549235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06301436a0 con 0x7f063006eb80 2024-03-08T06:05:43.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.120+0000 7f0634a00640 1 --2- 172.21.15.19:0/626549235 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f06300ccf80 0x7f06300aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:43.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.120+0000 7f0635400640 1 --2- 172.21.15.19:0/626549235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f063006eb80 0x7f0630159260 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f06240097a0 tx=0x7f06240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:43.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.120+0000 7f062d600640 1 -- 172.21.15.19:0/626549235 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624004230 con 0x7f063006eb80 2024-03-08T06:05:43.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.120+0000 7f062d600640 1 -- 172.21.15.19:0/626549235 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06240043f0 con 0x7f063006eb80 2024-03-08T06:05:43.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.120+0000 7f062d600640 1 -- 172.21.15.19:0/626549235 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624003850 con 0x7f063006eb80 2024-03-08T06:05:43.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.120+0000 7f0636800640 1 -- 172.21.15.19:0/626549235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06301439b0 con 0x7f063006eb80 2024-03-08T06:05:43.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.120+0000 7f0636800640 1 -- 172.21.15.19:0/626549235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06301441f0 con 0x7f063006eb80 2024-03-08T06:05:43.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.122+0000 7f0636800640 1 -- 172.21.15.19:0/626549235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06300b0850 con 0x7f063006eb80 2024-03-08T06:05:43.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.123+0000 7f062d600640 1 -- 172.21.15.19:0/626549235 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f062404c060 con 0x7f063006eb80 2024-03-08T06:05:43.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.124+0000 7f062d600640 1 --2- 172.21.15.19:0/626549235 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f061006b4d0 0x7f061006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:43.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.124+0000 7f062d600640 1 -- 172.21.15.19:0/626549235 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f06240abd50 con 0x7f063006eb80 2024-03-08T06:05:43.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.124+0000 7f0634a00640 1 --2- 172.21.15.19:0/626549235 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f061006b4d0 0x7f061006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:43.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.125+0000 7f0634a00640 1 --2- 172.21.15.19:0/626549235 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f061006b4d0 0x7f061006d990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f063006e2f0 tx=0x7f061c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:43.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.128+0000 7f062d600640 1 -- 172.21.15.19:0/626549235 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f06300b0850 con 0x7f063006eb80 2024-03-08T06:05:43.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:43.328+0000 7f0636800640 1 -- 172.21.15.19:0/626549235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0630075100 con 0x7f063006eb80 2024-03-08T06:05:44.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.017+0000 7f062d600640 1 -- 172.21.15.19:0/626549235 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) v1 ==== 181+0+0 (secure 0 0 0) 0x7f06240af030 con 0x7f063006eb80 2024-03-08T06:05:44.018 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2024-03-08T06:05:44.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.021+0000 7f0636800640 1 -- 172.21.15.19:0/626549235 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f061006b4d0 msgr2=0x7f061006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:44.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.021+0000 7f0636800640 1 --2- 172.21.15.19:0/626549235 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f061006b4d0 0x7f061006d990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f063006e2f0 tx=0x7f061c009040 comp rx=0 tx=0).stop 2024-03-08T06:05:44.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.021+0000 7f0636800640 1 -- 172.21.15.19:0/626549235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f063006eb80 msgr2=0x7f0630159260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:44.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.021+0000 7f0636800640 1 --2- 172.21.15.19:0/626549235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f063006eb80 0x7f0630159260 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f06240097a0 tx=0x7f06240046c0 comp rx=0 tx=0).stop 2024-03-08T06:05:44.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.021+0000 7f0636800640 1 -- 172.21.15.19:0/626549235 shutdown_connections 2024-03-08T06:05:44.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.021+0000 7f0636800640 1 --2- 172.21.15.19:0/626549235 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f061006b4d0 0x7f061006d990 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:44.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.021+0000 7f0636800640 1 --2- 172.21.15.19:0/626549235 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f063015efd0 0x7f06300aaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:44.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.021+0000 7f0636800640 1 --2- 172.21.15.19:0/626549235 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f06300ccf80 0x7f06300aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:44.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.021+0000 7f0636800640 1 --2- 172.21.15.19:0/626549235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f063006eb80 0x7f0630159260 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:44.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.021+0000 7f0636800640 1 -- 172.21.15.19:0/626549235 >> 172.21.15.19:0/626549235 conn(0x7f06300b1600 msgr2=0x7f063006d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:44.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.021+0000 7f0636800640 1 -- 172.21.15.19:0/626549235 shutdown_connections 2024-03-08T06:05:44.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.021+0000 7f0636800640 1 -- 172.21.15.19:0/626549235 wait complete. 2024-03-08T06:05:44.047 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-08T06:05:44.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.271+0000 7f0112800640 1 Processor -- start 2024-03-08T06:05:44.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.272+0000 7f0112800640 1 -- start start 2024-03-08T06:05:44.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.273+0000 7f0112800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f010c0b97d0 0x7f010c0ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:44.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.273+0000 7f0112800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010c162520 con 0x7f010c15e230 2024-03-08T06:05:44.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.273+0000 7f0112800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010c162800 con 0x7f010c15de50 2024-03-08T06:05:44.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.273+0000 7f0112800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010c1622e0 con 0x7f010c0b97d0 2024-03-08T06:05:44.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.273+0000 7f010aa00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f010c0b97d0 0x7f010c0ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:44.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.273+0000 7f010aa00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f010c0b97d0 0x7f010c0ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42238/0 (socket says 172.21.15.19:42238) 2024-03-08T06:05:44.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.273+0000 7f010aa00640 1 -- 172.21.15.19:0/3577516902 learned_addr learned my addr 172.21.15.19:0/3577516902 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:44.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.273+0000 7f010be00640 1 --1- 172.21.15.19:0/3577516902 >> v1:172.21.15.19:6789/0 conn(0x7f010c15e230 0x7f010c0d27f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42766/0 (socket says 172.21.15.19:42766) 2024-03-08T06:05:44.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.274+0000 7f010aa00640 1 -- 172.21.15.19:0/3577516902 >> v1:172.21.15.42:6789/0 conn(0x7f010c15de50 legacy=0x7f010c161bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:44.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.274+0000 7f010aa00640 1 -- 172.21.15.19:0/3577516902 >> v1:172.21.15.19:6789/0 conn(0x7f010c15e230 legacy=0x7f010c0d27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:44.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.274+0000 7f010aa00640 1 -- 172.21.15.19:0/3577516902 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c0d1ff0 con 0x7f010c0b97d0 2024-03-08T06:05:44.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.274+0000 7f010a000640 1 -- 172.21.15.19:0/3577516902 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570660909 0 0) 0x7f010c162520 con 0x7f010c15e230 2024-03-08T06:05:44.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.275+0000 7f010aa00640 1 --2- 172.21.15.19:0/3577516902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c0b97d0 0x7f010c0ceb30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009870 tx=0x7f00f402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73b192614f9c53 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:44.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.275+0000 7f010a000640 1 -- 172.21.15.19:0/3577516902 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4034070 con 0x7f010c0b97d0 2024-03-08T06:05:44.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.276+0000 7f010a000640 1 -- 172.21.15.19:0/3577516902 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f4030860 con 0x7f010c0b97d0 2024-03-08T06:05:44.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.276+0000 7f010a000640 1 -- 172.21.15.19:0/3577516902 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4030c30 con 0x7f010c0b97d0 2024-03-08T06:05:44.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.276+0000 7f0112800640 1 -- 172.21.15.19:0/3577516902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c0b97d0 msgr2=0x7f010c0ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:44.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.276+0000 7f0112800640 1 --2- 172.21.15.19:0/3577516902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c0b97d0 0x7f010c0ceb30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009870 tx=0x7f00f402b9a0 comp rx=0 tx=0).stop 2024-03-08T06:05:44.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.276+0000 7f0112800640 1 -- 172.21.15.19:0/3577516902 shutdown_connections 2024-03-08T06:05:44.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.276+0000 7f0112800640 1 --2- 172.21.15.19:0/3577516902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c0b97d0 0x7f010c0ceb30 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:44.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.276+0000 7f0112800640 1 -- 172.21.15.19:0/3577516902 >> 172.21.15.19:0/3577516902 conn(0x7f010c06c490 msgr2=0x7f010c06c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:44.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.276+0000 7f0112800640 1 -- 172.21.15.19:0/3577516902 shutdown_connections 2024-03-08T06:05:44.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.276+0000 7f0112800640 1 -- 172.21.15.19:0/3577516902 wait complete. 2024-03-08T06:05:44.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.278+0000 7f0112800640 1 Processor -- start 2024-03-08T06:05:44.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.278+0000 7f0112800640 1 -- start start 2024-03-08T06:05:44.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.279+0000 7f0112800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f010c0b97d0 0x7f010c0b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:44.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.279+0000 7f0112800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c15de50 0x7f010c0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:44.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.279+0000 7f0112800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f010c15e230 0x7f010c158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:44.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.279+0000 7f0112800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c0cf480 con 0x7f010c15de50 2024-03-08T06:05:44.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.279+0000 7f0112800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c0cf300 con 0x7f010c15e230 2024-03-08T06:05:44.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.279+0000 7f0112800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010c162ae0 con 0x7f010c0b97d0 2024-03-08T06:05:44.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.280+0000 7f010aa00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c15de50 0x7f010c0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:44.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.280+0000 7f010aa00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c15de50 0x7f010c0b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42246/0 (socket says 172.21.15.19:42246) 2024-03-08T06:05:44.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.280+0000 7f010aa00640 1 -- 172.21.15.19:0/272883205 learned_addr learned my addr 172.21.15.19:0/272883205 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:44.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.280+0000 7f010b400640 1 --2- 172.21.15.19:0/272883205 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f010c0b97d0 0x7f010c0b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:44.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.280+0000 7f010aa00640 1 -- 172.21.15.19:0/272883205 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f010c0b97d0 msgr2=0x7f010c0b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:44.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.280+0000 7f010aa00640 1 --2- 172.21.15.19:0/272883205 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f010c0b97d0 0x7f010c0b5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:44.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.280+0000 7f010be00640 1 --2- 172.21.15.19:0/272883205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f010c15e230 0x7f010c158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:44.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.280+0000 7f010aa00640 1 -- 172.21.15.19:0/272883205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f010c15e230 msgr2=0x7f010c158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:44.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.280+0000 7f010aa00640 1 --2- 172.21.15.19:0/272883205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f010c15e230 0x7f010c158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:44.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.280+0000 7f010aa00640 1 -- 172.21.15.19:0/272883205 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c0cafd0 con 0x7f010c15de50 2024-03-08T06:05:44.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.280+0000 7f010aa00640 1 --2- 172.21.15.19:0/272883205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c15de50 0x7f010c0b45d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009870 tx=0x7f00f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:44.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.281+0000 7f0103400640 1 -- 172.21.15.19:0/272883205 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4034040 con 0x7f010c15de50 2024-03-08T06:05:44.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.281+0000 7f0103400640 1 -- 172.21.15.19:0/272883205 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f4039d90 con 0x7f010c15de50 2024-03-08T06:05:44.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.281+0000 7f0103400640 1 -- 172.21.15.19:0/272883205 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4043610 con 0x7f010c15de50 2024-03-08T06:05:44.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.281+0000 7f0112800640 1 -- 172.21.15.19:0/272883205 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010c0b5f10 con 0x7f010c15de50 2024-03-08T06:05:44.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.281+0000 7f0112800640 1 -- 172.21.15.19:0/272883205 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f010c0b5c30 con 0x7f010c15de50 2024-03-08T06:05:44.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.282+0000 7f0112800640 1 -- 172.21.15.19:0/272883205 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010c067cb0 con 0x7f010c15de50 2024-03-08T06:05:44.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.283+0000 7f0103400640 1 -- 172.21.15.19:0/272883205 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f00f404a060 con 0x7f010c15de50 2024-03-08T06:05:44.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.284+0000 7f0103400640 1 --2- 172.21.15.19:0/272883205 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f00e806b4d0 0x7f00e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:44.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.284+0000 7f0103400640 1 -- 172.21.15.19:0/272883205 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f00f40ac380 con 0x7f010c15de50 2024-03-08T06:05:44.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.285+0000 7f010b400640 1 --2- 172.21.15.19:0/272883205 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f00e806b4d0 0x7f00e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:44.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.286+0000 7f010b400640 1 --2- 172.21.15.19:0/272883205 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f00e806b4d0 0x7f00e806d990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f00fc007bf0 tx=0x7f00fc007240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:44.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.289+0000 7f0103400640 1 -- 172.21.15.19:0/272883205 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f00f403e070 con 0x7f010c15de50 2024-03-08T06:05:44.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:44.487+0000 7f0112800640 1 -- 172.21.15.19:0/272883205 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f010c0d1a70 con 0x7f010c15de50 2024-03-08T06:05:45.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.027+0000 7f0103400640 1 -- 172.21.15.19:0/272883205 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) v1 ==== 169+0+0 (secure 0 0 0) 0x7f00f404be90 con 0x7f010c15de50 2024-03-08T06:05:45.028 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2024-03-08T06:05:45.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.030+0000 7f0112800640 1 -- 172.21.15.19:0/272883205 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f00e806b4d0 msgr2=0x7f00e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:45.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.030+0000 7f0112800640 1 --2- 172.21.15.19:0/272883205 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f00e806b4d0 0x7f00e806d990 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f00fc007bf0 tx=0x7f00fc007240 comp rx=0 tx=0).stop 2024-03-08T06:05:45.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.030+0000 7f0112800640 1 -- 172.21.15.19:0/272883205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c15de50 msgr2=0x7f010c0b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:45.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.030+0000 7f0112800640 1 --2- 172.21.15.19:0/272883205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c15de50 0x7f010c0b45d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009870 tx=0x7f00f40046c0 comp rx=0 tx=0).stop 2024-03-08T06:05:45.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.031+0000 7f0112800640 1 -- 172.21.15.19:0/272883205 shutdown_connections 2024-03-08T06:05:45.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.031+0000 7f0112800640 1 --2- 172.21.15.19:0/272883205 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f00e806b4d0 0x7f00e806d990 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:45.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.031+0000 7f0112800640 1 --2- 172.21.15.19:0/272883205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f010c15e230 0x7f010c158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:45.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.031+0000 7f0112800640 1 --2- 172.21.15.19:0/272883205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f010c15de50 0x7f010c0b45d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:45.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.031+0000 7f0112800640 1 --2- 172.21.15.19:0/272883205 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f010c0b97d0 0x7f010c0b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:45.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.031+0000 7f0112800640 1 -- 172.21.15.19:0/272883205 >> 172.21.15.19:0/272883205 conn(0x7f010c06c490 msgr2=0x7f010c15ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:45.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.031+0000 7f0112800640 1 -- 172.21.15.19:0/272883205 shutdown_connections 2024-03-08T06:05:45.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.032+0000 7f0112800640 1 -- 172.21.15.19:0/272883205 wait complete. 2024-03-08T06:05:45.067 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-08T06:05:45.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.261+0000 7f2240800640 1 Processor -- start 2024-03-08T06:05:45.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.261+0000 7f2240800640 1 -- start start 2024-03-08T06:05:45.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.262+0000 7f2240800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2238161850 0x7f223806c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:45.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.262+0000 7f2240800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f22380cd240 0x7f223806ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:45.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.262+0000 7f2240800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223806c380 con 0x7f22380b4380 2024-03-08T06:05:45.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.262+0000 7f2240800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223806c0a0 con 0x7f2238161850 2024-03-08T06:05:45.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.262+0000 7f2240800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22380d1000 con 0x7f22380cd240 2024-03-08T06:05:45.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.263+0000 7f223de00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2238161850 0x7f223806c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:45.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.263+0000 7f223de00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2238161850 0x7f223806c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.19:49754/0 (socket says 172.21.15.19:49754) 2024-03-08T06:05:45.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.263+0000 7f223de00640 1 -- 172.21.15.19:0/1185296325 learned_addr learned my addr 172.21.15.19:0/1185296325 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:45.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.263+0000 7f223e800640 1 --2- 172.21.15.19:0/1185296325 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f22380cd240 0x7f223806ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:45.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.264+0000 7f223de00640 1 -- 172.21.15.19:0/1185296325 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f22380cd240 msgr2=0x7f223806ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:45.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.264+0000 7f223de00640 1 --2- 172.21.15.19:0/1185296325 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f22380cd240 0x7f223806ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:45.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.264+0000 7f223de00640 1 -- 172.21.15.19:0/1185296325 >> v1:172.21.15.42:6789/0 conn(0x7f22380b4380 legacy=0x7f22380cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:45.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.264+0000 7f223de00640 1 -- 172.21.15.19:0/1185296325 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22380d12e0 con 0x7f2238161850 2024-03-08T06:05:45.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.265+0000 7f223de00640 1 --2- 172.21.15.19:0/1185296325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2238161850 0x7f223806c770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f222c009870 tx=0x7f222c02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeab4a552490c285 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:45.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.266+0000 7f223ca00640 1 -- 172.21.15.19:0/1185296325 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c035020 con 0x7f2238161850 2024-03-08T06:05:45.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.266+0000 7f223ca00640 1 -- 172.21.15.19:0/1185296325 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222c031640 con 0x7f2238161850 2024-03-08T06:05:45.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.266+0000 7f223ca00640 1 -- 172.21.15.19:0/1185296325 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c02d040 con 0x7f2238161850 2024-03-08T06:05:45.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.267+0000 7f2240800640 1 -- 172.21.15.19:0/1185296325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2238161850 msgr2=0x7f223806c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:45.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.267+0000 7f2240800640 1 --2- 172.21.15.19:0/1185296325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2238161850 0x7f223806c770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f222c009870 tx=0x7f222c02b8f0 comp rx=0 tx=0).stop 2024-03-08T06:05:45.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.267+0000 7f2240800640 1 -- 172.21.15.19:0/1185296325 shutdown_connections 2024-03-08T06:05:45.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.267+0000 7f2240800640 1 --2- 172.21.15.19:0/1185296325 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f22380cd240 0x7f223806ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:45.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.267+0000 7f2240800640 1 --2- 172.21.15.19:0/1185296325 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2238161850 0x7f223806c770 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:45.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.267+0000 7f2240800640 1 -- 172.21.15.19:0/1185296325 >> 172.21.15.19:0/1185296325 conn(0x7f22380b36d0 msgr2=0x7f22380b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:45.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.267+0000 7f2240800640 1 -- 172.21.15.19:0/1185296325 shutdown_connections 2024-03-08T06:05:45.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.267+0000 7f2240800640 1 -- 172.21.15.19:0/1185296325 wait complete. 2024-03-08T06:05:45.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.269+0000 7f2240800640 1 Processor -- start 2024-03-08T06:05:45.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.270+0000 7f2240800640 1 -- start start 2024-03-08T06:05:45.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.271+0000 7f2240800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22380b4380 0x7f223815b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:45.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.271+0000 7f2240800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f22380cd240 0x7f22381f4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:45.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.271+0000 7f2240800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2238161850 0x7f22380b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:45.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.271+0000 7f2240800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22380b2df0 con 0x7f2238161850 2024-03-08T06:05:45.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.271+0000 7f2240800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22380b2c70 con 0x7f22380b4380 2024-03-08T06:05:45.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.271+0000 7f2240800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22380b2f70 con 0x7f22380cd240 2024-03-08T06:05:45.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.271+0000 7f223e800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2238161850 0x7f22380b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:45.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.271+0000 7f223e800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2238161850 0x7f22380b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42254/0 (socket says 172.21.15.19:42254) 2024-03-08T06:05:45.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.271+0000 7f223e800640 1 -- 172.21.15.19:0/4278132308 learned_addr learned my addr 172.21.15.19:0/4278132308 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:45.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.271+0000 7f223de00640 1 --2- 172.21.15.19:0/4278132308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22380b4380 0x7f223815b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:45.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.271+0000 7f223d400640 1 --2- 172.21.15.19:0/4278132308 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f22380cd240 0x7f22381f4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:45.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.272+0000 7f223e800640 1 -- 172.21.15.19:0/4278132308 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f22380cd240 msgr2=0x7f22381f4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:45.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.272+0000 7f223e800640 1 --2- 172.21.15.19:0/4278132308 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f22380cd240 0x7f22381f4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:45.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.272+0000 7f223e800640 1 -- 172.21.15.19:0/4278132308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22380b4380 msgr2=0x7f223815b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:45.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.272+0000 7f223e800640 1 --2- 172.21.15.19:0/4278132308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22380b4380 0x7f223815b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:45.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.272+0000 7f223e800640 1 -- 172.21.15.19:0/4278132308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22381f4d60 con 0x7f2238161850 2024-03-08T06:05:45.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.272+0000 7f223de00640 1 --2- 172.21.15.19:0/4278132308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22380b4380 0x7f223815b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:05:45.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.272+0000 7f223e800640 1 --2- 172.21.15.19:0/4278132308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2238161850 0x7f22380b1ca0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f223400efc0 tx=0x7f223400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:45.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.272+0000 7f2232000640 1 -- 172.21.15.19:0/4278132308 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234018020 con 0x7f2238161850 2024-03-08T06:05:45.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.272+0000 7f2232000640 1 -- 172.21.15.19:0/4278132308 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2234014480 con 0x7f2238161850 2024-03-08T06:05:45.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.272+0000 7f2240800640 1 -- 172.21.15.19:0/4278132308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223815c960 con 0x7f2238161850 2024-03-08T06:05:45.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.272+0000 7f2232000640 1 -- 172.21.15.19:0/4278132308 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234014870 con 0x7f2238161850 2024-03-08T06:05:45.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.273+0000 7f2240800640 1 -- 172.21.15.19:0/4278132308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223815a970 con 0x7f2238161850 2024-03-08T06:05:45.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.274+0000 7f2240800640 1 -- 172.21.15.19:0/4278132308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2238067cb0 con 0x7f2238161850 2024-03-08T06:05:45.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.275+0000 7f2232000640 1 -- 172.21.15.19:0/4278132308 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2234005d10 con 0x7f2238161850 2024-03-08T06:05:45.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.275+0000 7f2232000640 1 --2- 172.21.15.19:0/4278132308 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f221c06b4d0 0x7f221c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:45.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.276+0000 7f2232000640 1 -- 172.21.15.19:0/4278132308 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f223408aea0 con 0x7f2238161850 2024-03-08T06:05:45.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.276+0000 7f223de00640 1 --2- 172.21.15.19:0/4278132308 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f221c06b4d0 0x7f221c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:45.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.277+0000 7f223de00640 1 --2- 172.21.15.19:0/4278132308 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f221c06b4d0 0x7f221c06d990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f222c036000 tx=0x7f222c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:45.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.280+0000 7f2232000640 1 -- 172.21.15.19:0/4278132308 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2234022030 con 0x7f2238161850 2024-03-08T06:05:45.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.478+0000 7f2240800640 1 -- 172.21.15.19:0/4278132308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f223806c550 con 0x7f2238161850 2024-03-08T06:05:45.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.483+0000 7f2232000640 1 -- 172.21.15.19:0/4278132308 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f22381f4d60 con 0x7f2238161850 2024-03-08T06:05:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.486+0000 7f2240800640 1 -- 172.21.15.19:0/4278132308 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f221c06b4d0 msgr2=0x7f221c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.486+0000 7f2240800640 1 --2- 172.21.15.19:0/4278132308 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f221c06b4d0 0x7f221c06d990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f222c036000 tx=0x7f222c03c040 comp rx=0 tx=0).stop 2024-03-08T06:05:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.486+0000 7f2240800640 1 -- 172.21.15.19:0/4278132308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2238161850 msgr2=0x7f22380b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.486+0000 7f2240800640 1 --2- 172.21.15.19:0/4278132308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2238161850 0x7f22380b1ca0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f223400efc0 tx=0x7f223400c490 comp rx=0 tx=0).stop 2024-03-08T06:05:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.486+0000 7f2240800640 1 -- 172.21.15.19:0/4278132308 shutdown_connections 2024-03-08T06:05:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.486+0000 7f2240800640 1 --2- 172.21.15.19:0/4278132308 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f221c06b4d0 0x7f221c06d990 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.487+0000 7f2240800640 1 --2- 172.21.15.19:0/4278132308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2238161850 0x7f22380b1ca0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.487+0000 7f2240800640 1 --2- 172.21.15.19:0/4278132308 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f22380cd240 0x7f22381f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.487+0000 7f2240800640 1 --2- 172.21.15.19:0/4278132308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22380b4380 0x7f223815b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.487+0000 7f2240800640 1 -- 172.21.15.19:0/4278132308 >> 172.21.15.19:0/4278132308 conn(0x7f22380b36d0 msgr2=0x7f223806f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.487+0000 7f2240800640 1 -- 172.21.15.19:0/4278132308 shutdown_connections 2024-03-08T06:05:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.487+0000 7f2240800640 1 -- 172.21.15.19:0/4278132308 wait complete. 2024-03-08T06:05:45.508 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_admin.TestLabeledPerfCounters.test_per_client_labeled_perf_counters' 2024-03-08T06:05:45.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.728+0000 7efe7f200640 1 Processor -- start 2024-03-08T06:05:45.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.728+0000 7efe7f200640 1 -- start start 2024-03-08T06:05:45.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.729+0000 7efe7f200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efe7806ecf0 0x7efe7815ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:45.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.729+0000 7efe7f200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efe780b49d0 0x7efe780ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:45.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.729+0000 7efe7f200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe780b2f30 con 0x7efe781441f0 2024-03-08T06:05:45.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.729+0000 7efe7f200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe780cd1d0 con 0x7efe7806ecf0 2024-03-08T06:05:45.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.729+0000 7efe7f200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe780cd4b0 con 0x7efe780b49d0 2024-03-08T06:05:45.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.730+0000 7efe7d400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efe7806ecf0 0x7efe7815ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:45.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.730+0000 7efe7d400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efe7806ecf0 0x7efe7815ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42260/0 (socket says 172.21.15.19:42260) 2024-03-08T06:05:45.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.730+0000 7efe7d400640 1 -- 172.21.15.19:0/3493837008 learned_addr learned my addr 172.21.15.19:0/3493837008 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:45.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.730+0000 7efe7e800640 1 --2- 172.21.15.19:0/3493837008 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efe780b49d0 0x7efe780ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:45.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.730+0000 7efe7d400640 1 -- 172.21.15.19:0/3493837008 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efe780b49d0 msgr2=0x7efe780ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:45.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.730+0000 7efe7d400640 1 --2- 172.21.15.19:0/3493837008 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efe780b49d0 0x7efe780ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:45.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.730+0000 7efe7d400640 1 -- 172.21.15.19:0/3493837008 >> v1:172.21.15.42:6789/0 conn(0x7efe781441f0 legacy=0x7efe7806e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:45.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.730+0000 7efe7d400640 1 -- 172.21.15.19:0/3493837008 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7815e4b0 con 0x7efe7806ecf0 2024-03-08T06:05:45.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.732+0000 7efe7d400640 1 --2- 172.21.15.19:0/3493837008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe7806ecf0 0x7efe7815ef90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7efe68009870 tx=0x7efe6802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7334c0d34bedb60e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:45.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.732+0000 7efe7ca00640 1 -- 172.21.15.19:0/3493837008 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe68034070 con 0x7efe7806ecf0 2024-03-08T06:05:45.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.732+0000 7efe7ca00640 1 -- 172.21.15.19:0/3493837008 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe68030840 con 0x7efe7806ecf0 2024-03-08T06:05:45.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.732+0000 7efe7ca00640 1 -- 172.21.15.19:0/3493837008 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe68030c10 con 0x7efe7806ecf0 2024-03-08T06:05:45.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.732+0000 7efe7f200640 1 -- 172.21.15.19:0/3493837008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe7806ecf0 msgr2=0x7efe7815ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:45.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.732+0000 7efe7f200640 1 --2- 172.21.15.19:0/3493837008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe7806ecf0 0x7efe7815ef90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7efe68009870 tx=0x7efe6802b980 comp rx=0 tx=0).stop 2024-03-08T06:05:45.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.732+0000 7efe7f200640 1 -- 172.21.15.19:0/3493837008 shutdown_connections 2024-03-08T06:05:45.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.732+0000 7efe7f200640 1 --2- 172.21.15.19:0/3493837008 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efe780b49d0 0x7efe780ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:45.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.732+0000 7efe7f200640 1 --2- 172.21.15.19:0/3493837008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe7806ecf0 0x7efe7815ef90 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:45.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.732+0000 7efe7f200640 1 -- 172.21.15.19:0/3493837008 >> 172.21.15.19:0/3493837008 conn(0x7efe780b1600 msgr2=0x7efe780b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:45.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.732+0000 7efe7f200640 1 -- 172.21.15.19:0/3493837008 shutdown_connections 2024-03-08T06:05:45.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.732+0000 7efe7f200640 1 -- 172.21.15.19:0/3493837008 wait complete. 2024-03-08T06:05:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.734+0000 7efe7f200640 1 Processor -- start 2024-03-08T06:05:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.734+0000 7efe7f200640 1 -- start start 2024-03-08T06:05:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.735+0000 7efe7f200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efe7806ecf0 0x7efe781e5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.735+0000 7efe7f200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe780b49d0 0x7efe780b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.735+0000 7efe7f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe781441f0 0x7efe780ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.735+0000 7efe7f200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe781445d0 con 0x7efe780b49d0 2024-03-08T06:05:45.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.735+0000 7efe7f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7815ea70 con 0x7efe781441f0 2024-03-08T06:05:45.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.735+0000 7efe7f200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe78071470 con 0x7efe7806ecf0 2024-03-08T06:05:45.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.735+0000 7efe7d400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe780b49d0 0x7efe780b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:45.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.736+0000 7efe7d400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe780b49d0 0x7efe780b0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42274/0 (socket says 172.21.15.19:42274) 2024-03-08T06:05:45.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.736+0000 7efe7d400640 1 -- 172.21.15.19:0/175939697 learned_addr learned my addr 172.21.15.19:0/175939697 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:45.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.736+0000 7efe7de00640 1 --2- 172.21.15.19:0/175939697 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efe7806ecf0 0x7efe781e5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:45.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.736+0000 7efe7e800640 1 --2- 172.21.15.19:0/175939697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe781441f0 0x7efe780ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:45.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.736+0000 7efe7d400640 1 -- 172.21.15.19:0/175939697 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efe7806ecf0 msgr2=0x7efe781e5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:45.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.736+0000 7efe7d400640 1 --2- 172.21.15.19:0/175939697 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efe7806ecf0 0x7efe781e5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:45.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.736+0000 7efe7d400640 1 -- 172.21.15.19:0/175939697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe781441f0 msgr2=0x7efe780ae7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:45.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.736+0000 7efe7d400640 1 --2- 172.21.15.19:0/175939697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe781441f0 0x7efe780ae7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:45.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.736+0000 7efe7d400640 1 -- 172.21.15.19:0/175939697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7812d030 con 0x7efe780b49d0 2024-03-08T06:05:45.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.736+0000 7efe7d400640 1 --2- 172.21.15.19:0/175939697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe780b49d0 0x7efe780b0c80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7efe6802b9c0 tx=0x7efe68004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:45.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.737+0000 7efe72000640 1 -- 172.21.15.19:0/175939697 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe68048070 con 0x7efe780b49d0 2024-03-08T06:05:45.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.737+0000 7efe72000640 1 -- 172.21.15.19:0/175939697 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe68030640 con 0x7efe780b49d0 2024-03-08T06:05:45.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.737+0000 7efe72000640 1 -- 172.21.15.19:0/175939697 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe68034040 con 0x7efe780b49d0 2024-03-08T06:05:45.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.737+0000 7efe7f200640 1 -- 172.21.15.19:0/175939697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7812f630 con 0x7efe780b49d0 2024-03-08T06:05:45.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.737+0000 7efe7f200640 1 -- 172.21.15.19:0/175939697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7812fed0 con 0x7efe780b49d0 2024-03-08T06:05:45.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.738+0000 7efe7f200640 1 -- 172.21.15.19:0/175939697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe78075100 con 0x7efe780b49d0 2024-03-08T06:05:45.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.740+0000 7efe72000640 1 -- 172.21.15.19:0/175939697 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efe6804b070 con 0x7efe780b49d0 2024-03-08T06:05:45.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.740+0000 7efe72000640 1 --2- 172.21.15.19:0/175939697 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efe5c06b4d0 0x7efe5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:45.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.740+0000 7efe72000640 1 -- 172.21.15.19:0/175939697 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efe680abea0 con 0x7efe780b49d0 2024-03-08T06:05:45.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.740+0000 7efe7de00640 1 --2- 172.21.15.19:0/175939697 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efe5c06b4d0 0x7efe5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:45.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.741+0000 7efe7de00640 1 --2- 172.21.15.19:0/175939697 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efe5c06b4d0 0x7efe5c06d990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efe6c000f60 tx=0x7efe6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:45.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:45.745+0000 7efe72000640 1 -- 172.21.15.19:0/175939697 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efe6807af80 con 0x7efe780b49d0 2024-03-08T06:05:46.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:46.016+0000 7efe7f200640 1 -- 172.21.15.19:0/175939697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_admin.TestLabeledPerfCounters.test_per_client_labeled_perf_counters"]} v 0) v1 -- 0x7efe7806d670 con 0x7efe780b49d0 2024-03-08T06:05:46.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:46.030+0000 7efe72000640 1 -- 172.21.15.19:0/175939697 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_admin.TestLabeledPerfCounters.test_per_client_labeled_perf_counters"]}]=0 v134) v1 ==== 164+0+0 (secure 0 0 0) 0x7efe6807a880 con 0x7efe780b49d0 2024-03-08T06:05:46.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:46.033+0000 7efe7f200640 1 -- 172.21.15.19:0/175939697 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efe5c06b4d0 msgr2=0x7efe5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:46.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:46.033+0000 7efe7f200640 1 --2- 172.21.15.19:0/175939697 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efe5c06b4d0 0x7efe5c06d990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efe6c000f60 tx=0x7efe6c009040 comp rx=0 tx=0).stop 2024-03-08T06:05:46.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:46.033+0000 7efe7f200640 1 -- 172.21.15.19:0/175939697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe780b49d0 msgr2=0x7efe780b0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:46.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:46.033+0000 7efe7f200640 1 --2- 172.21.15.19:0/175939697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe780b49d0 0x7efe780b0c80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7efe6802b9c0 tx=0x7efe68004730 comp rx=0 tx=0).stop 2024-03-08T06:05:46.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:46.033+0000 7efe7f200640 1 -- 172.21.15.19:0/175939697 shutdown_connections 2024-03-08T06:05:46.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:46.033+0000 7efe7f200640 1 --2- 172.21.15.19:0/175939697 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efe5c06b4d0 0x7efe5c06d990 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:46.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:46.033+0000 7efe7f200640 1 --2- 172.21.15.19:0/175939697 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe781441f0 0x7efe780ae7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:46.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:46.033+0000 7efe7f200640 1 --2- 172.21.15.19:0/175939697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe780b49d0 0x7efe780b0c80 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:46.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:46.033+0000 7efe7f200640 1 --2- 172.21.15.19:0/175939697 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efe7806ecf0 0x7efe781e5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:46.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:46.033+0000 7efe7f200640 1 -- 172.21.15.19:0/175939697 >> 172.21.15.19:0/175939697 conn(0x7efe780b1600 msgr2=0x7efe7815d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:46.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:46.034+0000 7efe7f200640 1 -- 172.21.15.19:0/175939697 shutdown_connections 2024-03-08T06:05:46.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:46.034+0000 7efe7f200640 1 -- 172.21.15.19:0/175939697 wait complete. 2024-03-08T06:05:46.056 INFO:tasks.cephfs_test_runner:That the per-client labelled perf counters depict the clients ... ERROR 2024-03-08T06:05:46.057 INFO:tasks.cephfs_test_runner: 2024-03-08T06:05:46.057 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-08T06:05:46.057 INFO:tasks.cephfs_test_runner:ERROR: test_per_client_labeled_perf_counters (tasks.cephfs.test_admin.TestLabeledPerfCounters) 2024-03-08T06:05:46.057 INFO:tasks.cephfs_test_runner:That the per-client labelled perf counters depict the clients 2024-03-08T06:05:46.057 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-08T06:05:46.057 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-08T06:05:46.057 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_joscollin_ceph_de7a7e179fbee9e314fa702f8f6c09d121c5e1a7/qa/tasks/cephfs/test_admin.py", line 57, in test_per_client_labeled_perf_counters 2024-03-08T06:05:46.057 INFO:tasks.cephfs_test_runner: while proceed(): 2024-03-08T06:05:46.057 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 134, in __call__ 2024-03-08T06:05:46.057 INFO:tasks.cephfs_test_runner: raise MaxWhileTries(error_msg) 2024-03-08T06:05:46.058 INFO:tasks.cephfs_test_runner:teuthology.exceptions.MaxWhileTries: 'wait for counters - client.4646' reached maximum tries (31) after waiting for 30 seconds 2024-03-08T06:05:46.058 INFO:tasks.cephfs_test_runner: 2024-03-08T06:05:46.058 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-08T06:05:46.058 INFO:tasks.cephfs_test_runner:Ran 1 test in 107.956s 2024-03-08T06:05:46.058 INFO:tasks.cephfs_test_runner: 2024-03-08T06:05:46.058 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-03-08T06:05:46.058 INFO:tasks.cephfs_test_runner: 2024-03-08T06:05:46.058 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-08T06:05:46.058 INFO:tasks.cephfs_test_runner:ERROR: test_per_client_labeled_perf_counters (tasks.cephfs.test_admin.TestLabeledPerfCounters) 2024-03-08T06:05:46.058 INFO:tasks.cephfs_test_runner:That the per-client labelled perf counters depict the clients 2024-03-08T06:05:46.059 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-08T06:05:46.059 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-08T06:05:46.059 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_joscollin_ceph_de7a7e179fbee9e314fa702f8f6c09d121c5e1a7/qa/tasks/cephfs/test_admin.py", line 57, in test_per_client_labeled_perf_counters 2024-03-08T06:05:46.059 INFO:tasks.cephfs_test_runner: while proceed(): 2024-03-08T06:05:46.059 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 134, in __call__ 2024-03-08T06:05:46.059 INFO:tasks.cephfs_test_runner: raise MaxWhileTries(error_msg) 2024-03-08T06:05:46.059 INFO:tasks.cephfs_test_runner:teuthology.exceptions.MaxWhileTries: 'wait for counters - client.4646' reached maximum tries (31) after waiting for 30 seconds 2024-03-08T06:05:46.059 INFO:tasks.cephfs_test_runner: 2024-03-08T06:05:46.059 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_joscollin_ceph_de7a7e179fbee9e314fa702f8f6c09d121c5e1a7/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_per_client_labeled_perf_counters (tasks.cephfs.test_admin.TestLabeledPerfCounters) 2024-03-08T06:05:46.280 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=72ccc55af7c949b2b2b7ee547ec31175 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_joscollin_ceph_de7a7e179fbee9e314fa702f8f6c09d121c5e1a7/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_per_client_labeled_perf_counters (tasks.cephfs.test_admin.TestLabeledPerfCounters) 2024-03-08T06:05:46.281 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-03-08T06:05:46.290 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-08T06:05:46.302 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-08T06:05:46.302 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:05:46.302 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:05:46.364 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054202,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249800k,nr_inodes=812450,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-08T06:05:46.365 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-03-08T06:05:46.365 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:05:46.422 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054202,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249800k,nr_inodes=812450,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-08T06:05:46.422 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:05:46.423 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:05:46.484 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054202,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249800k,nr_inodes=812450,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-08T06:05:46.484 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2024-03-08T06:05:46.484 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-08T06:05:46.541 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054202,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249800k,nr_inodes=812450,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-08T06:05:46.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:05:46.541 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-03-08T06:05:46.601 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-08T06:05:46.601 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-08T06:05:46.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:05:46.603 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-08T06:05:46.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:05:46.710 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-08T06:05:46.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:05:46.800 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-03-08T06:05:46.837 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T06:05:46.851 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T06:05:46.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:05:46.932 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-03-08T06:05:46.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:05:46.974 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-03-08T06:05:47.156 INFO:teuthology.orchestra.run.smithi019.stderr:Cannot find device "ceph-brx" 2024-03-08T06:05:47.160 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T06:05:47.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:05:47.161 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-03-08T06:05:47.221 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-08T06:05:47.221 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-03-08T06:05:47.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:05:47.223 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-08T06:05:47.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:05:47.320 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-08T06:05:47.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:05:47.420 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-03-08T06:05:47.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:05:47.562 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2024-03-08T06:05:47.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-08T06:05:47.611 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2024-03-08T06:05:47.755 INFO:teuthology.orchestra.run.smithi042.stderr:Cannot find device "ceph-brx" 2024-03-08T06:05:47.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T06:05:47.760 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-08T06:05:47.770 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-08T06:05:47.771 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T06:05:48.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.002+0000 7fbbf4800640 1 Processor -- start 2024-03-08T06:05:48.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.003+0000 7fbbf4800640 1 -- start start 2024-03-08T06:05:48.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.004+0000 7fbbf4800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbbec0b5380 0x7fbbec070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:48.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.004+0000 7fbbf4800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbbec0714a0 0x7fbbec06c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:48.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.004+0000 7fbbf4800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbec0b5a40 con 0x7fbbec15de10 2024-03-08T06:05:48.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.004+0000 7fbbf4800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbec0b5810 con 0x7fbbec0b5380 2024-03-08T06:05:48.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.004+0000 7fbbf4800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec0b5d20 con 0x7fbbec0714a0 2024-03-08T06:05:48.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.005+0000 7fbbf1400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbbec0b5380 0x7fbbec070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:48.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.005+0000 7fbbf1400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbbec0b5380 0x7fbbec070f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42290/0 (socket says 172.21.15.19:42290) 2024-03-08T06:05:48.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.005+0000 7fbbf1400640 1 -- 172.21.15.19:0/1592123452 learned_addr learned my addr 172.21.15.19:0/1592123452 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:48.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.005+0000 7fbbf1400640 1 -- 172.21.15.19:0/1592123452 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbbec0714a0 msgr2=0x7fbbec06c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:48.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.005+0000 7fbbf2800640 1 --2- 172.21.15.19:0/1592123452 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbbec0714a0 0x7fbbec06c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:48.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.005+0000 7fbbf1400640 1 --2- 172.21.15.19:0/1592123452 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbbec0714a0 0x7fbbec06c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.005+0000 7fbbf1400640 1 -- 172.21.15.19:0/1592123452 >> v1:172.21.15.19:6789/0 conn(0x7fbbec15de10 legacy=0x7fbbec0b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:48.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.005+0000 7fbbf1400640 1 -- 172.21.15.19:0/1592123452 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec06bf00 con 0x7fbbec0b5380 2024-03-08T06:05:48.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.005+0000 7fbbf2800640 1 --2- 172.21.15.19:0/1592123452 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbbec0714a0 0x7fbbec06c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:48.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.007+0000 7fbbf1400640 1 --2- 172.21.15.19:0/1592123452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec0b5380 0x7fbbec070f60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009870 tx=0x7fbbdc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8ff8ba8de8555 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:48.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.007+0000 7fbbf0a00640 1 -- 172.21.15.19:0/1592123452 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc034070 con 0x7fbbec0b5380 2024-03-08T06:05:48.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.007+0000 7fbbf0a00640 1 -- 172.21.15.19:0/1592123452 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc030840 con 0x7fbbec0b5380 2024-03-08T06:05:48.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.007+0000 7fbbf0a00640 1 -- 172.21.15.19:0/1592123452 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc030c10 con 0x7fbbec0b5380 2024-03-08T06:05:48.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.007+0000 7fbbf4800640 1 -- 172.21.15.19:0/1592123452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec0b5380 msgr2=0x7fbbec070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:48.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.007+0000 7fbbf4800640 1 --2- 172.21.15.19:0/1592123452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec0b5380 0x7fbbec070f60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009870 tx=0x7fbbdc02b980 comp rx=0 tx=0).stop 2024-03-08T06:05:48.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.008+0000 7fbbf4800640 1 -- 172.21.15.19:0/1592123452 shutdown_connections 2024-03-08T06:05:48.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.008+0000 7fbbf4800640 1 --2- 172.21.15.19:0/1592123452 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbbec0714a0 0x7fbbec06c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.008+0000 7fbbf4800640 1 --2- 172.21.15.19:0/1592123452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec0b5380 0x7fbbec070f60 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.008+0000 7fbbf4800640 1 -- 172.21.15.19:0/1592123452 >> 172.21.15.19:0/1592123452 conn(0x7fbbec06f7c0 msgr2=0x7fbbec06fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:48.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.008+0000 7fbbf4800640 1 -- 172.21.15.19:0/1592123452 shutdown_connections 2024-03-08T06:05:48.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.008+0000 7fbbf4800640 1 -- 172.21.15.19:0/1592123452 wait complete. 2024-03-08T06:05:48.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.009+0000 7fbbf4800640 1 Processor -- start 2024-03-08T06:05:48.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.010+0000 7fbbf4800640 1 -- start start 2024-03-08T06:05:48.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.010+0000 7fbbf4800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbbec0714a0 0x7fbbec160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:48.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.010+0000 7fbbf4800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbec0b5380 0x7fbbec14c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:48.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.010+0000 7fbbf4800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec15de10 0x7fbbec0d1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:48.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.010+0000 7fbbf4800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec15e370 con 0x7fbbec15de10 2024-03-08T06:05:48.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.010+0000 7fbbf4800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec15e1f0 con 0x7fbbec0b5380 2024-03-08T06:05:48.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.010+0000 7fbbf4800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec06cc40 con 0x7fbbec0714a0 2024-03-08T06:05:48.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.011+0000 7fbbf2800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec15de10 0x7fbbec0d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:48.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.011+0000 7fbbf2800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec15de10 0x7fbbec0d1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42294/0 (socket says 172.21.15.19:42294) 2024-03-08T06:05:48.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.011+0000 7fbbf2800640 1 -- 172.21.15.19:0/787429213 learned_addr learned my addr 172.21.15.19:0/787429213 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:48.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.011+0000 7fbbf2800640 1 -- 172.21.15.19:0/787429213 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbbec0714a0 msgr2=0x7fbbec160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:48.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.011+0000 7fbbf2800640 1 --2- 172.21.15.19:0/787429213 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbbec0714a0 0x7fbbec160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.011+0000 7fbbf2800640 1 -- 172.21.15.19:0/787429213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbec0b5380 msgr2=0x7fbbec14c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:48.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.011+0000 7fbbf1400640 1 --2- 172.21.15.19:0/787429213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbec0b5380 0x7fbbec14c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:48.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.011+0000 7fbbf2800640 1 --2- 172.21.15.19:0/787429213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbec0b5380 0x7fbbec14c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.011+0000 7fbbf2800640 1 -- 172.21.15.19:0/787429213 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec1f4290 con 0x7fbbec15de10 2024-03-08T06:05:48.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.011+0000 7fbbf1400640 1 --2- 172.21.15.19:0/787429213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbec0b5380 0x7fbbec14c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:48.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.012+0000 7fbbf2800640 1 --2- 172.21.15.19:0/787429213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec15de10 0x7fbbec0d1190 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800cef0 tx=0x7fbbe800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:48.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.012+0000 7fbbe6000640 1 -- 172.21.15.19:0/787429213 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe801a070 con 0x7fbbec15de10 2024-03-08T06:05:48.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.012+0000 7fbbe6000640 1 -- 172.21.15.19:0/787429213 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe800d860 con 0x7fbbec15de10 2024-03-08T06:05:48.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.012+0000 7fbbe6000640 1 -- 172.21.15.19:0/787429213 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe800dc50 con 0x7fbbec15de10 2024-03-08T06:05:48.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.012+0000 7fbbf4800640 1 -- 172.21.15.19:0/787429213 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbec1f4500 con 0x7fbbec15de10 2024-03-08T06:05:48.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.012+0000 7fbbf4800640 1 -- 172.21.15.19:0/787429213 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbec1f4ac0 con 0x7fbbec15de10 2024-03-08T06:05:48.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.014+0000 7fbbf4800640 1 -- 172.21.15.19:0/787429213 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbec06fba0 con 0x7fbbec15de10 2024-03-08T06:05:48.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.014+0000 7fbbe6000640 1 -- 172.21.15.19:0/787429213 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fbbe801d070 con 0x7fbbec15de10 2024-03-08T06:05:48.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.015+0000 7fbbe6000640 1 --2- 172.21.15.19:0/787429213 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fbbd006b4d0 0x7fbbd006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:48.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.015+0000 7fbbe6000640 1 -- 172.21.15.19:0/787429213 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbbe808a870 con 0x7fbbec15de10 2024-03-08T06:05:48.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.016+0000 7fbbf1e00640 1 --2- 172.21.15.19:0/787429213 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fbbd006b4d0 0x7fbbd006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:48.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.016+0000 7fbbf1e00640 1 --2- 172.21.15.19:0/787429213 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fbbd006b4d0 0x7fbbd006d990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0ccf00 tx=0x7fbbe0007970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:48.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.020+0000 7fbbe6000640 1 -- 172.21.15.19:0/787429213 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbbec06fba0 con 0x7fbbec15de10 2024-03-08T06:05:48.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.219+0000 7fbbf4800640 1 -- 172.21.15.19:0/787429213 --> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbbec070580 con 0x7fbbd006b4d0 2024-03-08T06:05:48.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.221+0000 7fbbe6000640 1 -- 172.21.15.19:0/787429213 <== mgr.4107 v2:172.21.15.19:6832/3589745192 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13521 (secure 0 0 0) 0x7fbbec070580 con 0x7fbbd006b4d0 2024-03-08T06:05:48.221 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:05:48.222 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-08T06:05:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.224+0000 7fbbf4800640 1 -- 172.21.15.19:0/787429213 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fbbd006b4d0 msgr2=0x7fbbd006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.224+0000 7fbbf4800640 1 --2- 172.21.15.19:0/787429213 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fbbd006b4d0 0x7fbbd006d990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0ccf00 tx=0x7fbbe0007970 comp rx=0 tx=0).stop 2024-03-08T06:05:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.224+0000 7fbbf4800640 1 -- 172.21.15.19:0/787429213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec15de10 msgr2=0x7fbbec0d1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.224+0000 7fbbf4800640 1 --2- 172.21.15.19:0/787429213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec15de10 0x7fbbec0d1190 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800cef0 tx=0x7fbbe800a710 comp rx=0 tx=0).stop 2024-03-08T06:05:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.224+0000 7fbbf4800640 1 -- 172.21.15.19:0/787429213 shutdown_connections 2024-03-08T06:05:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.224+0000 7fbbf4800640 1 --2- 172.21.15.19:0/787429213 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fbbd006b4d0 0x7fbbd006d990 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.224+0000 7fbbf4800640 1 --2- 172.21.15.19:0/787429213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec15de10 0x7fbbec0d1190 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.224+0000 7fbbf4800640 1 --2- 172.21.15.19:0/787429213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbbec0b5380 0x7fbbec14c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.224+0000 7fbbf4800640 1 --2- 172.21.15.19:0/787429213 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fbbec0714a0 0x7fbbec160fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.224+0000 7fbbf4800640 1 -- 172.21.15.19:0/787429213 >> 172.21.15.19:0/787429213 conn(0x7fbbec06f7c0 msgr2=0x7fbbec06cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:48.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.225+0000 7fbbf4800640 1 -- 172.21.15.19:0/787429213 shutdown_connections 2024-03-08T06:05:48.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.225+0000 7fbbf4800640 1 -- 172.21.15.19:0/787429213 wait complete. 2024-03-08T06:05:48.244 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2024-03-08T06:05:48.126369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":279280,"kb_used_data":25684,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754695440,"statfs":{"total":773094113280,"available":772808130560,"internally_reserved":0,"allocated":26300416,"data_stored":16135343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6849798,"num_objects":-1023,"num_object_clones":0,"num_object_copies":-2046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1023,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-2082,"num_write_kb":-8675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.285039"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":199,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-08T06:05:41.848094+0000","last_change":"2024-03-08T06:03:16.679654+0000","last_active":"2024-03-08T06:05:41.848094+0000","last_peered":"2024-03-08T06:05:41.848094+0000","last_clean":"2024-03-08T06:05:41.848094+0000","last_became_active":"2024-03-08T06:03:16.676829+0000","last_became_peered":"2024-03-08T06:03:16.676829+0000","last_unstale":"2024-03-08T06:05:41.848094+0000","last_undegraded":"2024-03-08T06:05:41.848094+0000","last_fullsized":"2024-03-08T06:05:41.848094+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:14.800941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:14.800941+0000","last_clean_scrub_stamp":"2024-03-08T06:03:14.800941+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:20:09.927678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33168,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338672,"statfs":{"total":96636764160,"available":96602800128,"internally_reserved":0,"allocated":2035712,"data_stored":748540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1089536,"data_stored":158447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1433600,"data_stored":158748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35344,"kb_used_data":4164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336496,"statfs":{"total":96636764160,"available":96600571904,"internally_reserved":0,"allocated":4263936,"data_stored":2810588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43748,"kb_used_data":8408,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328092,"statfs":{"total":96636764160,"available":96591966208,"internally_reserved":0,"allocated":8609792,"data_stored":7005575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1257472,"data_stored":158022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41100,"kb_used_data":5760,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330740,"statfs":{"total":96636764160,"available":96594677760,"internally_reserved":0,"allocated":5898240,"data_stored":4353266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32848,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338992,"statfs":{"total":96636764160,"available":96603127808,"internally_reserved":0,"allocated":1712128,"data_stored":742157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T06:05:48.244 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T06:05:48.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.457+0000 7f5109200640 1 Processor -- start 2024-03-08T06:05:48.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.457+0000 7f5109200640 1 -- start start 2024-03-08T06:05:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.458+0000 7f5109200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f510415dd20 0x7f51040cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.458+0000 7f5109200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f51040d1800 0x7f51040b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.458+0000 7f5109200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f51040b5bf0 0x7f510406c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.458+0000 7f5109200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51040d3a60 con 0x7f51040b5bf0 2024-03-08T06:05:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.458+0000 7f5109200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51040b6050 con 0x7f51040d1800 2024-03-08T06:05:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.458+0000 7f5109200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51040d35d0 con 0x7f510415dd20 2024-03-08T06:05:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.458+0000 7f5102800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f51040b5bf0 0x7f510406c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.459+0000 7f5102800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f51040b5bf0 0x7f510406c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42296/0 (socket says 172.21.15.19:42296) 2024-03-08T06:05:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.459+0000 7f5102800640 1 -- 172.21.15.19:0/2071354450 learned_addr learned my addr 172.21.15.19:0/2071354450 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.459+0000 7f50fbe00640 1 --2- 172.21.15.19:0/2071354450 >> v2:172.21.15.42:3300/0 conn(0x7f51040d1800 0x7f51040b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.459+0000 7f5102800640 1 -- 172.21.15.19:0/2071354450 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f510415dd20 msgr2=0x7f51040cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.459+0000 7f5101e00640 1 --2- 172.21.15.19:0/2071354450 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f510415dd20 0x7f51040cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.459+0000 7f5102800640 1 --2- 172.21.15.19:0/2071354450 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f510415dd20 0x7f51040cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.459+0000 7f5102800640 1 -- 172.21.15.19:0/2071354450 >> v2:172.21.15.42:3300/0 conn(0x7f51040d1800 msgr2=0x7f51040b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.459+0000 7f5102800640 1 --2- 172.21.15.19:0/2071354450 >> v2:172.21.15.42:3300/0 conn(0x7f51040d1800 0x7f51040b56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.459+0000 7f5102800640 1 -- 172.21.15.19:0/2071354450 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510415e100 con 0x7f51040b5bf0 2024-03-08T06:05:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.459+0000 7f5101e00640 1 --2- 172.21.15.19:0/2071354450 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f510415dd20 0x7f51040cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.459+0000 7f50fbe00640 1 --2- 172.21.15.19:0/2071354450 >> v2:172.21.15.42:3300/0 conn(0x7f51040d1800 0x7f51040b56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:48.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.460+0000 7f5102800640 1 --2- 172.21.15.19:0/2071354450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51040b5bf0 0x7f510406c1a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5104067950 tx=0x7f50fc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679a5420ebaae70e server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:48.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.461+0000 7f5101400640 1 -- 172.21.15.19:0/2071354450 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc02cb00 con 0x7f51040b5bf0 2024-03-08T06:05:48.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.461+0000 7f5101400640 1 -- 172.21.15.19:0/2071354450 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc02cca0 con 0x7f51040b5bf0 2024-03-08T06:05:48.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.461+0000 7f5101400640 1 -- 172.21.15.19:0/2071354450 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc034610 con 0x7f51040b5bf0 2024-03-08T06:05:48.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.461+0000 7f5109200640 1 -- 172.21.15.19:0/2071354450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51040b5bf0 msgr2=0x7f510406c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:48.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.461+0000 7f5109200640 1 --2- 172.21.15.19:0/2071354450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51040b5bf0 0x7f510406c1a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5104067950 tx=0x7f50fc02bf60 comp rx=0 tx=0).stop 2024-03-08T06:05:48.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.461+0000 7f5109200640 1 -- 172.21.15.19:0/2071354450 shutdown_connections 2024-03-08T06:05:48.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.461+0000 7f5109200640 1 --2- 172.21.15.19:0/2071354450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51040b5bf0 0x7f510406c1a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.461+0000 7f5109200640 1 --2- 172.21.15.19:0/2071354450 >> v2:172.21.15.42:3300/0 conn(0x7f51040d1800 0x7f51040b56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.461+0000 7f5109200640 1 --2- 172.21.15.19:0/2071354450 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f510415dd20 0x7f51040cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.461+0000 7f5109200640 1 -- 172.21.15.19:0/2071354450 >> 172.21.15.19:0/2071354450 conn(0x7f5104067240 msgr2=0x7f51040d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.461+0000 7f5109200640 1 -- 172.21.15.19:0/2071354450 shutdown_connections 2024-03-08T06:05:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.461+0000 7f5109200640 1 -- 172.21.15.19:0/2071354450 wait complete. 2024-03-08T06:05:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.464+0000 7f5109200640 1 Processor -- start 2024-03-08T06:05:48.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.464+0000 7f5109200640 1 -- start start 2024-03-08T06:05:48.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.466+0000 7f5109200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f51040b5bf0 0x7f51040ab800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:48.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.466+0000 7f5109200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51040d1800 0x7f510414ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:48.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.466+0000 7f5109200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f510415dd20 0x7f51040ac290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:48.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.466+0000 7f5109200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51040d2f80 con 0x7f51040d1800 2024-03-08T06:05:48.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.466+0000 7f5109200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51040d2ca0 con 0x7f510415dd20 2024-03-08T06:05:48.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.466+0000 7f5109200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51040d3260 con 0x7f51040b5bf0 2024-03-08T06:05:48.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.466+0000 7f50fbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51040d1800 0x7f510414ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.466+0000 7f50fbe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51040d1800 0x7f510414ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42312/0 (socket says 172.21.15.19:42312) 2024-03-08T06:05:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.466+0000 7f50fbe00640 1 -- 172.21.15.19:0/2278813447 learned_addr learned my addr 172.21.15.19:0/2278813447 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.467+0000 7f5101e00640 1 --2- 172.21.15.19:0/2278813447 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f51040b5bf0 0x7f51040ab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.467+0000 7f5102800640 1 --2- 172.21.15.19:0/2278813447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f510415dd20 0x7f51040ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.467+0000 7f50fbe00640 1 -- 172.21.15.19:0/2278813447 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f51040b5bf0 msgr2=0x7f51040ab800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.467+0000 7f50fbe00640 1 --2- 172.21.15.19:0/2278813447 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f51040b5bf0 0x7f51040ab800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.467+0000 7f50fbe00640 1 -- 172.21.15.19:0/2278813447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f510415dd20 msgr2=0x7f51040ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.467+0000 7f50fbe00640 1 --2- 172.21.15.19:0/2278813447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f510415dd20 0x7f51040ac290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.467+0000 7f50fbe00640 1 -- 172.21.15.19:0/2278813447 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51040abd40 con 0x7f51040d1800 2024-03-08T06:05:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.467+0000 7f50fbe00640 1 --2- 172.21.15.19:0/2278813447 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51040d1800 0x7f510414ef30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f50ec00c7c0 tx=0x7f50ec00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.467+0000 7f50fa000640 1 -- 172.21.15.19:0/2278813447 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec015070 con 0x7f51040d1800 2024-03-08T06:05:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.468+0000 7f50fa000640 1 -- 172.21.15.19:0/2278813447 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec007a30 con 0x7f51040d1800 2024-03-08T06:05:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.468+0000 7f50fa000640 1 -- 172.21.15.19:0/2278813447 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec007e00 con 0x7f51040d1800 2024-03-08T06:05:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.468+0000 7f5109200640 1 -- 172.21.15.19:0/2278813447 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51040aa760 con 0x7f51040d1800 2024-03-08T06:05:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.468+0000 7f5109200640 1 -- 172.21.15.19:0/2278813447 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51040ab000 con 0x7f51040d1800 2024-03-08T06:05:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.469+0000 7f5109200640 1 -- 172.21.15.19:0/2278813447 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5104067cb0 con 0x7f51040d1800 2024-03-08T06:05:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.470+0000 7f50fa000640 1 -- 172.21.15.19:0/2278813447 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f50ec018070 con 0x7f51040d1800 2024-03-08T06:05:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.471+0000 7f50fa000640 1 --2- 172.21.15.19:0/2278813447 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f50e006b500 0x7f50e006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.471+0000 7f50fa000640 1 -- 172.21.15.19:0/2278813447 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f50ec089e70 con 0x7f51040d1800 2024-03-08T06:05:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.471+0000 7f5101e00640 1 --2- 172.21.15.19:0/2278813447 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f50e006b500 0x7f50e006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.472+0000 7f5101e00640 1 --2- 172.21.15.19:0/2278813447 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f50e006b500 0x7f50e006d9c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f50f400b840 tx=0x7f50f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.475+0000 7f50fa000640 1 -- 172.21.15.19:0/2278813447 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f50ec058f50 con 0x7f51040d1800 2024-03-08T06:05:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.673+0000 7f5109200640 1 -- 172.21.15.19:0/2278813447 --> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51040b3840 con 0x7f50e006b500 2024-03-08T06:05:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.675+0000 7f50fa000640 1 -- 172.21.15.19:0/2278813447 <== mgr.4107 v2:172.21.15.19:6832/3589745192 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13521 (secure 0 0 0) 0x7f51040b3840 con 0x7f50e006b500 2024-03-08T06:05:48.676 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:05:48.676 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-08T06:05:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.678+0000 7f5109200640 1 -- 172.21.15.19:0/2278813447 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f50e006b500 msgr2=0x7f50e006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.678+0000 7f5109200640 1 --2- 172.21.15.19:0/2278813447 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f50e006b500 0x7f50e006d9c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f50f400b840 tx=0x7f50f4008040 comp rx=0 tx=0).stop 2024-03-08T06:05:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.678+0000 7f5109200640 1 -- 172.21.15.19:0/2278813447 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51040d1800 msgr2=0x7f510414ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:48.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.678+0000 7f5109200640 1 --2- 172.21.15.19:0/2278813447 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51040d1800 0x7f510414ef30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f50ec00c7c0 tx=0x7f50ec00cc80 comp rx=0 tx=0).stop 2024-03-08T06:05:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.678+0000 7f5109200640 1 -- 172.21.15.19:0/2278813447 shutdown_connections 2024-03-08T06:05:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.678+0000 7f5109200640 1 --2- 172.21.15.19:0/2278813447 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f50e006b500 0x7f50e006d9c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.678+0000 7f5109200640 1 --2- 172.21.15.19:0/2278813447 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f510415dd20 0x7f51040ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.678+0000 7f5109200640 1 --2- 172.21.15.19:0/2278813447 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51040d1800 0x7f510414ef30 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.678+0000 7f5109200640 1 --2- 172.21.15.19:0/2278813447 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f51040b5bf0 0x7f51040ab800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.678+0000 7f5109200640 1 -- 172.21.15.19:0/2278813447 >> 172.21.15.19:0/2278813447 conn(0x7f5104067240 msgr2=0x7f51040cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:48.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.678+0000 7f5109200640 1 -- 172.21.15.19:0/2278813447 shutdown_connections 2024-03-08T06:05:48.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.679+0000 7f5109200640 1 -- 172.21.15.19:0/2278813447 wait complete. 2024-03-08T06:05:48.698 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2024-03-08T06:05:48.126369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":279280,"kb_used_data":25684,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754695440,"statfs":{"total":773094113280,"available":772808130560,"internally_reserved":0,"allocated":26300416,"data_stored":16135343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6849798,"num_objects":-1023,"num_object_clones":0,"num_object_copies":-2046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1023,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-2082,"num_write_kb":-8675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.285039"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":199,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-08T06:05:41.848094+0000","last_change":"2024-03-08T06:03:16.679654+0000","last_active":"2024-03-08T06:05:41.848094+0000","last_peered":"2024-03-08T06:05:41.848094+0000","last_clean":"2024-03-08T06:05:41.848094+0000","last_became_active":"2024-03-08T06:03:16.676829+0000","last_became_peered":"2024-03-08T06:03:16.676829+0000","last_unstale":"2024-03-08T06:05:41.848094+0000","last_undegraded":"2024-03-08T06:05:41.848094+0000","last_fullsized":"2024-03-08T06:05:41.848094+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:14.800941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:14.800941+0000","last_clean_scrub_stamp":"2024-03-08T06:03:14.800941+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:20:09.927678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33168,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338672,"statfs":{"total":96636764160,"available":96602800128,"internally_reserved":0,"allocated":2035712,"data_stored":748540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1089536,"data_stored":158447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1433600,"data_stored":158748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35344,"kb_used_data":4164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336496,"statfs":{"total":96636764160,"available":96600571904,"internally_reserved":0,"allocated":4263936,"data_stored":2810588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43748,"kb_used_data":8408,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328092,"statfs":{"total":96636764160,"available":96591966208,"internally_reserved":0,"allocated":8609792,"data_stored":7005575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1257472,"data_stored":158022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41100,"kb_used_data":5760,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330740,"statfs":{"total":96636764160,"available":96594677760,"internally_reserved":0,"allocated":5898240,"data_stored":4353266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32848,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338992,"statfs":{"total":96636764160,"available":96603127808,"internally_reserved":0,"allocated":1712128,"data_stored":742157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T06:05:48.699 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-08T06:05:48.700 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T06:05:48.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.888+0000 7fd842e00640 1 Processor -- start 2024-03-08T06:05:48.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.888+0000 7fd842e00640 1 -- start start 2024-03-08T06:05:48.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.889+0000 7fd842e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd83c06d600 0x7fd83c144d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:48.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.889+0000 7fd842e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd83c071e90 0x7fd83c1452a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:48.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.889+0000 7fd842e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83c06da80 con 0x7fd83c071ab0 2024-03-08T06:05:48.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.889+0000 7fd842e00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83c06ef40 con 0x7fd83c071e90 2024-03-08T06:05:48.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.889+0000 7fd842e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c1457e0 con 0x7fd83c06d600 2024-03-08T06:05:48.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.890+0000 7fd840e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd83c071e90 0x7fd83c1452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:48.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.890+0000 7fd833400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd83c06d600 0x7fd83c144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:48.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.890+0000 7fd840e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd83c071e90 0x7fd83c1452a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.19:49818/0 (socket says 172.21.15.19:49818) 2024-03-08T06:05:48.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.890+0000 7fd840e00640 1 -- 172.21.15.19:0/701593098 learned_addr learned my addr 172.21.15.19:0/701593098 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:48.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.891+0000 7fd833400640 1 -- 172.21.15.19:0/701593098 >> v2:172.21.15.42:3300/0 conn(0x7fd83c071e90 msgr2=0x7fd83c1452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:48.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.891+0000 7fd833400640 1 --2- 172.21.15.19:0/701593098 >> v2:172.21.15.42:3300/0 conn(0x7fd83c071e90 0x7fd83c1452a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.891+0000 7fd833400640 1 -- 172.21.15.19:0/701593098 >> v1:172.21.15.42:6789/0 conn(0x7fd83c071ab0 legacy=0x7fd83c15cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:48.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.891+0000 7fd833400640 1 -- 172.21.15.19:0/701593098 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c06dd60 con 0x7fd83c06d600 2024-03-08T06:05:48.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.891+0000 7fd840e00640 1 --2- 172.21.15.19:0/701593098 >> v2:172.21.15.42:3300/0 conn(0x7fd83c071e90 0x7fd83c1452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-08T06:05:48.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.892+0000 7fd833400640 1 --2- 172.21.15.19:0/701593098 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd83c06d600 0x7fd83c144d60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd8240097a0 tx=0x7fd82402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56e466287e4da0ef server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:48.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.893+0000 7fd83b400640 1 -- 172.21.15.19:0/701593098 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824035020 con 0x7fd83c06d600 2024-03-08T06:05:48.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.893+0000 7fd83b400640 1 -- 172.21.15.19:0/701593098 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd824031830 con 0x7fd83c06d600 2024-03-08T06:05:48.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.893+0000 7fd83b400640 1 -- 172.21.15.19:0/701593098 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824031c00 con 0x7fd83c06d600 2024-03-08T06:05:48.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.893+0000 7fd842e00640 1 -- 172.21.15.19:0/701593098 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd83c06d600 msgr2=0x7fd83c144d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:48.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.893+0000 7fd842e00640 1 --2- 172.21.15.19:0/701593098 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd83c06d600 0x7fd83c144d60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd8240097a0 tx=0x7fd82402b8d0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.894+0000 7fd842e00640 1 -- 172.21.15.19:0/701593098 shutdown_connections 2024-03-08T06:05:48.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.894+0000 7fd842e00640 1 --2- 172.21.15.19:0/701593098 >> v2:172.21.15.42:3300/0 conn(0x7fd83c071e90 0x7fd83c1452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.894+0000 7fd842e00640 1 --2- 172.21.15.19:0/701593098 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd83c06d600 0x7fd83c144d60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.894+0000 7fd842e00640 1 -- 172.21.15.19:0/701593098 >> 172.21.15.19:0/701593098 conn(0x7fd83c06ae30 msgr2=0x7fd83c06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:48.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.894+0000 7fd842e00640 1 -- 172.21.15.19:0/701593098 shutdown_connections 2024-03-08T06:05:48.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.894+0000 7fd842e00640 1 -- 172.21.15.19:0/701593098 wait complete. 2024-03-08T06:05:48.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.895+0000 7fd842e00640 1 Processor -- start 2024-03-08T06:05:48.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.896+0000 7fd842e00640 1 -- start start 2024-03-08T06:05:48.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.896+0000 7fd842e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd83c06d600 0x7fd83c15a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:48.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.896+0000 7fd842e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd83c071ab0 0x7fd83c0ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:48.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.896+0000 7fd842e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd83c071e90 0x7fd83c139d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:48.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.897+0000 7fd842e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c06e600 con 0x7fd83c071e90 2024-03-08T06:05:48.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.897+0000 7fd842e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c06e320 con 0x7fd83c071ab0 2024-03-08T06:05:48.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.897+0000 7fd842e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c15d3a0 con 0x7fd83c06d600 2024-03-08T06:05:48.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.897+0000 7fd840e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd83c071e90 0x7fd83c139d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:48.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.897+0000 7fd840e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd83c071e90 0x7fd83c139d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42320/0 (socket says 172.21.15.19:42320) 2024-03-08T06:05:48.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.897+0000 7fd840e00640 1 -- 172.21.15.19:0/757827395 learned_addr learned my addr 172.21.15.19:0/757827395 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:48.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.897+0000 7fd833400640 1 --2- 172.21.15.19:0/757827395 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd83c071ab0 0x7fd83c0ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:48.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.897+0000 7fd83be00640 1 --2- 172.21.15.19:0/757827395 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd83c06d600 0x7fd83c15a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:48.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.897+0000 7fd840e00640 1 -- 172.21.15.19:0/757827395 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd83c06d600 msgr2=0x7fd83c15a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:48.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.897+0000 7fd840e00640 1 --2- 172.21.15.19:0/757827395 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd83c06d600 0x7fd83c15a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.897+0000 7fd840e00640 1 -- 172.21.15.19:0/757827395 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd83c071ab0 msgr2=0x7fd83c0ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:48.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.897+0000 7fd840e00640 1 --2- 172.21.15.19:0/757827395 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd83c071ab0 0x7fd83c0ae6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:48.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.898+0000 7fd840e00640 1 -- 172.21.15.19:0/757827395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c13bc60 con 0x7fd83c071e90 2024-03-08T06:05:48.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.898+0000 7fd840e00640 1 --2- 172.21.15.19:0/757827395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd83c071e90 0x7fd83c139d20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd834009fa0 tx=0x7fd83400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:48.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.898+0000 7fd838c00640 1 -- 172.21.15.19:0/757827395 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834024070 con 0x7fd83c071e90 2024-03-08T06:05:48.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.898+0000 7fd838c00640 1 -- 172.21.15.19:0/757827395 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd834017c60 con 0x7fd83c071e90 2024-03-08T06:05:48.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.898+0000 7fd838c00640 1 -- 172.21.15.19:0/757827395 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83400c920 con 0x7fd83c071e90 2024-03-08T06:05:48.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.898+0000 7fd842e00640 1 -- 172.21.15.19:0/757827395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83c0ad310 con 0x7fd83c071e90 2024-03-08T06:05:48.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.898+0000 7fd842e00640 1 -- 172.21.15.19:0/757827395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83c0ad8d0 con 0x7fd83c071e90 2024-03-08T06:05:48.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.900+0000 7fd842e00640 1 -- 172.21.15.19:0/757827395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83c13be30 con 0x7fd83c071e90 2024-03-08T06:05:48.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.901+0000 7fd838c00640 1 -- 172.21.15.19:0/757827395 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd834027070 con 0x7fd83c071e90 2024-03-08T06:05:48.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.902+0000 7fd838c00640 1 --2- 172.21.15.19:0/757827395 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd81806b500 0x7fd81806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:48.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.902+0000 7fd838c00640 1 -- 172.21.15.19:0/757827395 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd834091f70 con 0x7fd83c071e90 2024-03-08T06:05:48.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.902+0000 7fd83be00640 1 --2- 172.21.15.19:0/757827395 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd81806b500 0x7fd81806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:48.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.903+0000 7fd83be00640 1 --2- 172.21.15.19:0/757827395 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd81806b500 0x7fd81806d9c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd82c001d40 tx=0x7fd82c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:48.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:48.907+0000 7fd838c00640 1 -- 172.21.15.19:0/757827395 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd834061180 con 0x7fd83c071e90 2024-03-08T06:05:49.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.107+0000 7fd842e00640 1 -- 172.21.15.19:0/757827395 --> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd83c067cb0 con 0x7fd81806b500 2024-03-08T06:05:49.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.108+0000 7fd838c00640 1 -- 172.21.15.19:0/757827395 <== mgr.4107 v2:172.21.15.19:6832/3589745192 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13521 (secure 0 0 0) 0x7fd83c067cb0 con 0x7fd81806b500 2024-03-08T06:05:49.109 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:05:49.109 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-08T06:05:49.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.111+0000 7fd842e00640 1 -- 172.21.15.19:0/757827395 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd81806b500 msgr2=0x7fd81806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:49.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.111+0000 7fd842e00640 1 --2- 172.21.15.19:0/757827395 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd81806b500 0x7fd81806d9c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd82c001d40 tx=0x7fd82c009040 comp rx=0 tx=0).stop 2024-03-08T06:05:49.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.111+0000 7fd842e00640 1 -- 172.21.15.19:0/757827395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd83c071e90 msgr2=0x7fd83c139d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:49.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.111+0000 7fd842e00640 1 --2- 172.21.15.19:0/757827395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd83c071e90 0x7fd83c139d20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd834009fa0 tx=0x7fd83400ed40 comp rx=0 tx=0).stop 2024-03-08T06:05:49.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.111+0000 7fd842e00640 1 -- 172.21.15.19:0/757827395 shutdown_connections 2024-03-08T06:05:49.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.111+0000 7fd842e00640 1 --2- 172.21.15.19:0/757827395 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd81806b500 0x7fd81806d9c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:49.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.111+0000 7fd842e00640 1 --2- 172.21.15.19:0/757827395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd83c071e90 0x7fd83c139d20 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.111+0000 7fd842e00640 1 --2- 172.21.15.19:0/757827395 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd83c071ab0 0x7fd83c0ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.111+0000 7fd842e00640 1 --2- 172.21.15.19:0/757827395 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd83c06d600 0x7fd83c15a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.111+0000 7fd842e00640 1 -- 172.21.15.19:0/757827395 >> 172.21.15.19:0/757827395 conn(0x7fd83c06ae30 msgr2=0x7fd83c0b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.111+0000 7fd842e00640 1 -- 172.21.15.19:0/757827395 shutdown_connections 2024-03-08T06:05:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.111+0000 7fd842e00640 1 -- 172.21.15.19:0/757827395 wait complete. 2024-03-08T06:05:49.129 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":108,"stamp":"2024-03-08T06:05:48.126369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":279280,"kb_used_data":25684,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754695440,"statfs":{"total":773094113280,"available":772808130560,"internally_reserved":0,"allocated":26300416,"data_stored":16135343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6849798,"num_objects":-1023,"num_object_clones":0,"num_object_copies":-2046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1023,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-2082,"num_write_kb":-8675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.285039"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":199,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-08T06:05:41.848094+0000","last_change":"2024-03-08T06:03:16.679654+0000","last_active":"2024-03-08T06:05:41.848094+0000","last_peered":"2024-03-08T06:05:41.848094+0000","last_clean":"2024-03-08T06:05:41.848094+0000","last_became_active":"2024-03-08T06:03:16.676829+0000","last_became_peered":"2024-03-08T06:03:16.676829+0000","last_unstale":"2024-03-08T06:05:41.848094+0000","last_undegraded":"2024-03-08T06:05:41.848094+0000","last_fullsized":"2024-03-08T06:05:41.848094+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:14.800941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:14.800941+0000","last_clean_scrub_stamp":"2024-03-08T06:03:14.800941+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:20:09.927678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33168,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338672,"statfs":{"total":96636764160,"available":96602800128,"internally_reserved":0,"allocated":2035712,"data_stored":748540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32244,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339596,"statfs":{"total":96636764160,"available":96603746304,"internally_reserved":0,"allocated":1089536,"data_stored":158447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1433600,"data_stored":158748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35344,"kb_used_data":4164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94336496,"statfs":{"total":96636764160,"available":96600571904,"internally_reserved":0,"allocated":4263936,"data_stored":2810588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574882,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43748,"kb_used_data":8408,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328092,"statfs":{"total":96636764160,"available":96591966208,"internally_reserved":0,"allocated":8609792,"data_stored":7005575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1257472,"data_stored":158022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41100,"kb_used_data":5760,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94330740,"statfs":{"total":96636764160,"available":96594677760,"internally_reserved":0,"allocated":5898240,"data_stored":4353266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32848,"kb_used_data":1672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338992,"statfs":{"total":96636764160,"available":96603127808,"internally_reserved":0,"allocated":1712128,"data_stored":742157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T06:05:49.129 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-08T06:05:49.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.330+0000 7f2c12200640 1 Processor -- start 2024-03-08T06:05:49.330 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.331+0000 7f2c12200640 1 -- start start 2024-03-08T06:05:49.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.332+0000 7f2c12200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2c0c0b21f0 0x7f2c0c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:49.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.332+0000 7f2c12200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c0c0cd490 con 0x7f2c0c06ac50 2024-03-08T06:05:49.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.332+0000 7f2c12200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c0c0cd730 con 0x7f2c0c0b3ed0 2024-03-08T06:05:49.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.332+0000 7f2c12200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c0cd9f0 con 0x7f2c0c0b21f0 2024-03-08T06:05:49.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.332+0000 7f2c0b400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2c0c06ac50 0x7f2c0c06b030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42792/0 (socket says 172.21.15.19:42792) 2024-03-08T06:05:49.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.332+0000 7f2c0b400640 1 -- 172.21.15.19:0/3528551571 learned_addr learned my addr 172.21.15.19:0/3528551571 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:49.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.333+0000 7f2c02a00640 1 --2- 172.21.15.19:0/3528551571 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2c0c0b21f0 0x7f2c0c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:49.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.333+0000 7f2c0aa00640 1 -- 172.21.15.19:0/3528551571 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2355957107 0 0) 0x7f2c0c0cd490 con 0x7f2c0c06ac50 2024-03-08T06:05:49.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.333+0000 7f2c0aa00640 1 -- 172.21.15.19:0/3528551571 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bf0003520 con 0x7f2c0c06ac50 2024-03-08T06:05:49.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.333+0000 7f2c0aa00640 1 -- 172.21.15.19:0/3528551571 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1747078090 0 0) 0x7f2bf0003520 con 0x7f2c0c06ac50 2024-03-08T06:05:49.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.333+0000 7f2c0aa00640 1 -- 172.21.15.19:0/3528551571 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2c0c0b21f0 msgr2=0x7f2c0c0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:49.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.333+0000 7f2c0aa00640 1 --2- 172.21.15.19:0/3528551571 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2c0c0b21f0 0x7f2c0c0b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:49.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.333+0000 7f2c0aa00640 1 -- 172.21.15.19:0/3528551571 >> v1:172.21.15.42:6789/0 conn(0x7f2c0c0b3ed0 legacy=0x7f2c0c0ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:49.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.333+0000 7f2c0aa00640 1 -- 172.21.15.19:0/3528551571 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c0cdcd0 con 0x7f2c0c06ac50 2024-03-08T06:05:49.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.333+0000 7f2c0aa00640 1 -- 172.21.15.19:0/3528551571 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f2bfc0019f0 con 0x7f2c0c06ac50 2024-03-08T06:05:49.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.333+0000 7f2c0aa00640 1 -- 172.21.15.19:0/3528551571 >> v1:172.21.15.19:6789/0 conn(0x7f2c0c06ac50 legacy=0x7f2c0c06b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:49.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.333+0000 7f2c0aa00640 1 --2- 172.21.15.19:0/3528551571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bf00039e0 0x7f2bf0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:49.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.333+0000 7f2c0aa00640 1 --2- 172.21.15.19:0/3528551571 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2c0c0b21f0 0x7f2bf0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:49.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.333+0000 7f2c0aa00640 1 --2- 172.21.15.19:0/3528551571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2bf0004d40 0x7f2bf00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:49.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.333+0000 7f2c0aa00640 1 -- 172.21.15.19:0/3528551571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c0cd9f0 con 0x7f2bf0004d40 2024-03-08T06:05:49.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.333+0000 7f2c0aa00640 1 -- 172.21.15.19:0/3528551571 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf000baa0 con 0x7f2bf00039e0 2024-03-08T06:05:49.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.333+0000 7f2c0aa00640 1 -- 172.21.15.19:0/3528551571 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf000bca0 con 0x7f2c0c0b21f0 2024-03-08T06:05:49.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.334+0000 7f2c0be00640 1 --2- 172.21.15.19:0/3528551571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2bf0004d40 0x7f2bf00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:49.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.334+0000 7f2c0b400640 1 --2- 172.21.15.19:0/3528551571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bf00039e0 0x7f2bf0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:49.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.334+0000 7f2c0be00640 1 -- 172.21.15.19:0/3528551571 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2c0c0b21f0 msgr2=0x7f2bf0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:49.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.334+0000 7f2c0be00640 1 --2- 172.21.15.19:0/3528551571 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2c0c0b21f0 0x7f2bf0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:49.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.334+0000 7f2c0be00640 1 -- 172.21.15.19:0/3528551571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bf00039e0 msgr2=0x7f2bf0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:49.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.334+0000 7f2c0be00640 1 --2- 172.21.15.19:0/3528551571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bf00039e0 0x7f2bf0003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:49.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.334+0000 7f2c0be00640 1 -- 172.21.15.19:0/3528551571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf0003520 con 0x7f2bf0004d40 2024-03-08T06:05:49.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.335+0000 7f2c0be00640 1 --2- 172.21.15.19:0/3528551571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2bf0004d40 0x7f2bf00051c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2c04001720 tx=0x7f2bf0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac269bf604fab4e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:49.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.335+0000 7f2c0aa00640 1 -- 172.21.15.19:0/3528551571 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04001370 con 0x7f2bf0004d40 2024-03-08T06:05:49.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.335+0000 7f2c0aa00640 1 -- 172.21.15.19:0/3528551571 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c040052d0 con 0x7f2bf0004d40 2024-03-08T06:05:49.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.335+0000 7f2c0aa00640 1 -- 172.21.15.19:0/3528551571 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04003830 con 0x7f2bf0004d40 2024-03-08T06:05:49.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.336+0000 7f2c12200640 1 -- 172.21.15.19:0/3528551571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2bf0004d40 msgr2=0x7f2bf00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:49.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.336+0000 7f2c12200640 1 --2- 172.21.15.19:0/3528551571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2bf0004d40 0x7f2bf00051c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2c04001720 tx=0x7f2bf0005830 comp rx=0 tx=0).stop 2024-03-08T06:05:49.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.336+0000 7f2c0be00640 1 -- 172.21.15.19:0/3528551571 reap_dead start 2024-03-08T06:05:49.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.336+0000 7f2c12200640 1 -- 172.21.15.19:0/3528551571 shutdown_connections 2024-03-08T06:05:49.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.336+0000 7f2c12200640 1 -- 172.21.15.19:0/3528551571 >> 172.21.15.19:0/3528551571 conn(0x7f2c0c0b60d0 msgr2=0x7f2c0c099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:49.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.336+0000 7f2c12200640 1 -- 172.21.15.19:0/3528551571 shutdown_connections 2024-03-08T06:05:49.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.336+0000 7f2c12200640 1 -- 172.21.15.19:0/3528551571 wait complete. 2024-03-08T06:05:49.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.338+0000 7f2c12200640 1 Processor -- start 2024-03-08T06:05:49.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.338+0000 7f2c12200640 1 -- start start 2024-03-08T06:05:49.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.339+0000 7f2c12200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bf0004d40 0x7f2c0c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:49.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.339+0000 7f2c12200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c0c1610a0 0x7f2c0c15f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:49.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.339+0000 7f2c12200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2c0c15fac0 0x7f2c0c142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.339+0000 7f2c12200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c1479e0 con 0x7f2c0c1610a0 2024-03-08T06:05:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.339+0000 7f2c12200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c147860 con 0x7f2bf0004d40 2024-03-08T06:05:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.339+0000 7f2c12200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c0b3990 con 0x7f2c0c15fac0 2024-03-08T06:05:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.339+0000 7f2c02a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c0c1610a0 0x7f2c0c15f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.339+0000 7f2c02a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c0c1610a0 0x7f2c0c15f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42340/0 (socket says 172.21.15.19:42340) 2024-03-08T06:05:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.339+0000 7f2c02a00640 1 -- 172.21.15.19:0/3050349554 learned_addr learned my addr 172.21.15.19:0/3050349554 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:49.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.339+0000 7f2c02a00640 1 -- 172.21.15.19:0/3050349554 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2c0c15fac0 msgr2=0x7f2c0c142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:49.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.339+0000 7f2c02a00640 1 --2- 172.21.15.19:0/3050349554 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2c0c15fac0 0x7f2c0c142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:49.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.339+0000 7f2c02a00640 1 -- 172.21.15.19:0/3050349554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bf0004d40 msgr2=0x7f2c0c15b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:49.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.339+0000 7f2c02a00640 1 --2- 172.21.15.19:0/3050349554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bf0004d40 0x7f2c0c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:49.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.339+0000 7f2c02a00640 1 -- 172.21.15.19:0/3050349554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c160000 con 0x7f2c0c1610a0 2024-03-08T06:05:49.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.340+0000 7f2c02a00640 1 --2- 172.21.15.19:0/3050349554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c0c1610a0 0x7f2c0c15f580 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400e820 tx=0x7f2bf400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:49.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.340+0000 7f2c03e00640 1 -- 172.21.15.19:0/3050349554 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4017070 con 0x7f2c0c1610a0 2024-03-08T06:05:49.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.340+0000 7f2c03e00640 1 -- 172.21.15.19:0/3050349554 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf400c860 con 0x7f2c0c1610a0 2024-03-08T06:05:49.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.340+0000 7f2c03e00640 1 -- 172.21.15.19:0/3050349554 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf400cc30 con 0x7f2c0c1610a0 2024-03-08T06:05:49.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.340+0000 7f2c12200640 1 -- 172.21.15.19:0/3050349554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c0c1602e0 con 0x7f2c0c1610a0 2024-03-08T06:05:49.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.340+0000 7f2c12200640 1 -- 172.21.15.19:0/3050349554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c0c1608a0 con 0x7f2c0c1610a0 2024-03-08T06:05:49.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.341+0000 7f2c12200640 1 -- 172.21.15.19:0/3050349554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c0c067cb0 con 0x7f2c0c1610a0 2024-03-08T06:05:49.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.342+0000 7f2c03e00640 1 -- 172.21.15.19:0/3050349554 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2bf401a070 con 0x7f2c0c1610a0 2024-03-08T06:05:49.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.343+0000 7f2c03e00640 1 --2- 172.21.15.19:0/3050349554 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f2be806b500 0x7f2be806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:49.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.343+0000 7f2c03e00640 1 -- 172.21.15.19:0/3050349554 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2bf408a070 con 0x7f2c0c1610a0 2024-03-08T06:05:49.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.343+0000 7f2c0b400640 1 --2- 172.21.15.19:0/3050349554 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f2be806b500 0x7f2be806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:49.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.344+0000 7f2c0b400640 1 --2- 172.21.15.19:0/3050349554 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f2be806b500 0x7f2be806d9c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc001b60 tx=0x7f2bfc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:49.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.351+0000 7f2c03e00640 1 -- 172.21.15.19:0/3050349554 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2bf4059150 con 0x7f2c0c1610a0 2024-03-08T06:05:49.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.548+0000 7f2c12200640 1 -- 172.21.15.19:0/3050349554 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c0c145970 con 0x7f2c0c1610a0 2024-03-08T06:05:49.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.549+0000 7f2c03e00640 1 -- 172.21.15.19:0/3050349554 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+12960 (secure 0 0 0) 0x7f2bf4058a50 con 0x7f2c0c1610a0 2024-03-08T06:05:49.550 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:05:49.550 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":37,"fsid":"d92b86a1-35db-4c28-a3a7-a50d6ca5cbfd","created":"2024-03-08T06:03:00.836247+0000","modified":"2024-03-08T06:05:45.018827+0000","last_up_change":"2024-03-08T06:03:12.793224+0000","last_in_change":"2024-03-08T06:03:04.353385+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-08T06:03:14.149736+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"86177ddf-4ef4-455b-81bf-0f6a924fe71e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6809","nonce":3105613222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6811","nonce":3105613222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6815","nonce":3105613222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":3105613222},{"type":"v1","addr":"172.21.15.19:6813","nonce":3105613222}]},"public_addr":"172.21.15.19:6809/3105613222","cluster_addr":"172.21.15.19:6811/3105613222","heartbeat_back_addr":"172.21.15.19:6815/3105613222","heartbeat_front_addr":"172.21.15.19:6813/3105613222","state":["exists","up"]},{"osd":1,"uuid":"111afd04-dee7-4b38-b734-67796dfd3bb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6817","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6819","nonce":2806517817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6821","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6823","nonce":2806517817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6829","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6831","nonce":2806517817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6825","nonce":2806517817},{"type":"v1","addr":"172.21.15.19:6827","nonce":2806517817}]},"public_addr":"172.21.15.19:6819/2806517817","cluster_addr":"172.21.15.19:6823/2806517817","heartbeat_back_addr":"172.21.15.19:6831/2806517817","heartbeat_front_addr":"172.21.15.19:6827/2806517817","state":["exists","up"]},{"osd":2,"uuid":"6712819c-7483-49fe-880b-1c8311c19f54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6801","nonce":2805787689}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6803","nonce":2805787689}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6807","nonce":2805787689}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":2805787689},{"type":"v1","addr":"172.21.15.19:6805","nonce":2805787689}]},"public_addr":"172.21.15.19:6801/2805787689","cluster_addr":"172.21.15.19:6803/2805787689","heartbeat_back_addr":"172.21.15.19:6807/2805787689","heartbeat_front_addr":"172.21.15.19:6805/2805787689","state":["exists","up"]},{"osd":3,"uuid":"5a1bbb06-dd2f-4ce3-a5d6-a02b6bf0876f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6818","nonce":3547775856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6822","nonce":3547775856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6830","nonce":3547775856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":3547775856},{"type":"v1","addr":"172.21.15.19:6826","nonce":3547775856}]},"public_addr":"172.21.15.19:6818/3547775856","cluster_addr":"172.21.15.19:6822/3547775856","heartbeat_back_addr":"172.21.15.19:6830/3547775856","heartbeat_front_addr":"172.21.15.19:6826/3547775856","state":["exists","up"]},{"osd":4,"uuid":"ef9772d0-4f1b-4ea6-9c7d-18427db01ca6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6801","nonce":1656053258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6803","nonce":1656053258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6807","nonce":1656053258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":1656053258},{"type":"v1","addr":"172.21.15.42:6805","nonce":1656053258}]},"public_addr":"172.21.15.42:6801/1656053258","cluster_addr":"172.21.15.42:6803/1656053258","heartbeat_back_addr":"172.21.15.42:6807/1656053258","heartbeat_front_addr":"172.21.15.42:6805/1656053258","state":["exists","up"]},{"osd":5,"uuid":"de314af8-6388-4ef6-8774-e1bc18372b31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6817","nonce":1354526460}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6819","nonce":1354526460}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6823","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6825","nonce":1354526460}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":1354526460},{"type":"v1","addr":"172.21.15.42:6822","nonce":1354526460}]},"public_addr":"172.21.15.42:6817/1354526460","cluster_addr":"172.21.15.42:6819/1354526460","heartbeat_back_addr":"172.21.15.42:6825/1354526460","heartbeat_front_addr":"172.21.15.42:6822/1354526460","state":["exists","up"]},{"osd":6,"uuid":"2dd4cc3d-53b5-42bc-8725-d04628f2b125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6821","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6824","nonce":93809742}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6827","nonce":93809742}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6831","nonce":93809742}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":93809742},{"type":"v1","addr":"172.21.15.42:6829","nonce":93809742}]},"public_addr":"172.21.15.42:6824/93809742","cluster_addr":"172.21.15.42:6827/93809742","heartbeat_back_addr":"172.21.15.42:6831/93809742","heartbeat_front_addr":"172.21.15.42:6829/93809742","state":["exists","up"]},{"osd":7,"uuid":"c0d07107-a24b-4530-976e-bdc14ea42db0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6809","nonce":3799661037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6811","nonce":3799661037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6815","nonce":3799661037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":3799661037},{"type":"v1","addr":"172.21.15.42:6813","nonce":3799661037}]},"public_addr":"172.21.15.42:6809/3799661037","cluster_addr":"172.21.15.42:6811/3799661037","heartbeat_back_addr":"172.21.15.42:6815/3799661037","heartbeat_front_addr":"172.21.15.42:6813/3799661037","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.668593+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.710488+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.654030+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.733668+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.703081+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.722674+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.775691+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-08T06:03:09.692863+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6837/1359509141":"2024-03-09T06:05:41.835415+0000","172.21.15.19:6836/1359509141":"2024-03-09T06:05:41.835415+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-08T06:05:49.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.552+0000 7f2c12200640 1 -- 172.21.15.19:0/3050349554 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f2be806b500 msgr2=0x7f2be806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:49.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.552+0000 7f2c12200640 1 --2- 172.21.15.19:0/3050349554 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f2be806b500 0x7f2be806d9c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc001b60 tx=0x7f2bfc009040 comp rx=0 tx=0).stop 2024-03-08T06:05:49.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.552+0000 7f2c12200640 1 -- 172.21.15.19:0/3050349554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c0c1610a0 msgr2=0x7f2c0c15f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:49.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.552+0000 7f2c12200640 1 --2- 172.21.15.19:0/3050349554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c0c1610a0 0x7f2c0c15f580 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2bf400e820 tx=0x7f2bf400ece0 comp rx=0 tx=0).stop 2024-03-08T06:05:49.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.552+0000 7f2c12200640 1 -- 172.21.15.19:0/3050349554 shutdown_connections 2024-03-08T06:05:49.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.552+0000 7f2c12200640 1 --2- 172.21.15.19:0/3050349554 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f2be806b500 0x7f2be806d9c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:49.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.552+0000 7f2c12200640 1 --2- 172.21.15.19:0/3050349554 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2c0c15fac0 0x7f2c0c142ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:49.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.552+0000 7f2c12200640 1 --2- 172.21.15.19:0/3050349554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c0c1610a0 0x7f2c0c15f580 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:49.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.552+0000 7f2c12200640 1 --2- 172.21.15.19:0/3050349554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bf0004d40 0x7f2c0c15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:49.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.552+0000 7f2c12200640 1 -- 172.21.15.19:0/3050349554 >> 172.21.15.19:0/3050349554 conn(0x7f2c0c0b60d0 msgr2=0x7f2c0c099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:49.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.553+0000 7f2c12200640 1 -- 172.21.15.19:0/3050349554 shutdown_connections 2024-03-08T06:05:49.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:49.553+0000 7f2c12200640 1 -- 172.21.15.19:0/3050349554 wait complete. 2024-03-08T06:05:50.571 INFO:tasks.ceph:Scrubbing osd.0 2024-03-08T06:05:50.572 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-08T06:05:50.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.805+0000 7f9c9f200640 1 Processor -- start 2024-03-08T06:05:50.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.806+0000 7f9c9f200640 1 -- start start 2024-03-08T06:05:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.807+0000 7f9c9f200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9ca015dd60 0x7f9ca0161a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.807+0000 7f9c9f200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9ca015e140 0x7f9ca00d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.807+0000 7f9c9f200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9ca0161f90 0x7f9ca00d0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.807+0000 7f9c9f200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ca0162480 con 0x7f9ca0161f90 2024-03-08T06:05:50.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.807+0000 7f9c9f200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ca0162760 con 0x7f9ca015e140 2024-03-08T06:05:50.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.807+0000 7f9c9f200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca00d1e20 con 0x7f9ca015dd60 2024-03-08T06:05:50.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.807+0000 7f9c9e800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9ca0161f90 0x7f9ca00d0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:50.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.807+0000 7f9c9e800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9ca0161f90 0x7f9ca00d0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42350/0 (socket says 172.21.15.19:42350) 2024-03-08T06:05:50.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.807+0000 7f9c9e800640 1 -- 172.21.15.19:0/3173594404 learned_addr learned my addr 172.21.15.19:0/3173594404 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:50.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.808+0000 7f9c95400640 1 --2- 172.21.15.19:0/3173594404 >> v2:172.21.15.42:3300/0 conn(0x7f9ca015e140 0x7f9ca00d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:50.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.808+0000 7f9c9de00640 1 --2- 172.21.15.19:0/3173594404 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9ca015dd60 0x7f9ca0161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:50.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.808+0000 7f9c9e800640 1 -- 172.21.15.19:0/3173594404 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9ca015dd60 msgr2=0x7f9ca0161a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:50.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.808+0000 7f9c9e800640 1 --2- 172.21.15.19:0/3173594404 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9ca015dd60 0x7f9ca0161a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:50.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.808+0000 7f9c9e800640 1 -- 172.21.15.19:0/3173594404 >> v2:172.21.15.42:3300/0 conn(0x7f9ca015e140 msgr2=0x7f9ca00d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:50.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.808+0000 7f9c9e800640 1 --2- 172.21.15.19:0/3173594404 >> v2:172.21.15.42:3300/0 conn(0x7f9ca015e140 0x7f9ca00d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:50.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.808+0000 7f9c9e800640 1 -- 172.21.15.19:0/3173594404 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca00d2100 con 0x7f9ca0161f90 2024-03-08T06:05:50.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.809+0000 7f9c9e800640 1 --2- 172.21.15.19:0/3173594404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ca0161f90 0x7f9ca00d0e20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9ca00b66c0 tx=0x7f9c9802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d605269880409d9a server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:50.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.810+0000 7f9c9d400640 1 -- 172.21.15.19:0/3173594404 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9802ca70 con 0x7f9ca0161f90 2024-03-08T06:05:50.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.810+0000 7f9c9d400640 1 -- 172.21.15.19:0/3173594404 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9802cc10 con 0x7f9ca0161f90 2024-03-08T06:05:50.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.810+0000 7f9c9d400640 1 -- 172.21.15.19:0/3173594404 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c980343f0 con 0x7f9ca0161f90 2024-03-08T06:05:50.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.810+0000 7f9c9f200640 1 -- 172.21.15.19:0/3173594404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ca0161f90 msgr2=0x7f9ca00d0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:50.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.810+0000 7f9c9f200640 1 --2- 172.21.15.19:0/3173594404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ca0161f90 0x7f9ca00d0e20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9ca00b66c0 tx=0x7f9c9802bed0 comp rx=0 tx=0).stop 2024-03-08T06:05:50.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.810+0000 7f9c9f200640 1 -- 172.21.15.19:0/3173594404 shutdown_connections 2024-03-08T06:05:50.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.810+0000 7f9c9f200640 1 --2- 172.21.15.19:0/3173594404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ca0161f90 0x7f9ca00d0e20 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:50.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.810+0000 7f9c9f200640 1 --2- 172.21.15.19:0/3173594404 >> v2:172.21.15.42:3300/0 conn(0x7f9ca015e140 0x7f9ca00d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:50.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.810+0000 7f9c9f200640 1 --2- 172.21.15.19:0/3173594404 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9ca015dd60 0x7f9ca0161a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:50.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.810+0000 7f9c9f200640 1 -- 172.21.15.19:0/3173594404 >> 172.21.15.19:0/3173594404 conn(0x7f9ca006c650 msgr2=0x7f9ca006ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:50.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.810+0000 7f9c9f200640 1 -- 172.21.15.19:0/3173594404 shutdown_connections 2024-03-08T06:05:50.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.810+0000 7f9c9f200640 1 -- 172.21.15.19:0/3173594404 wait complete. 2024-03-08T06:05:50.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.812+0000 7f9c9f200640 1 Processor -- start 2024-03-08T06:05:50.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.812+0000 7f9c9f200640 1 -- start start 2024-03-08T06:05:50.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.813+0000 7f9c9f200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9ca015dd60 0x7f9ca00cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:50.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.813+0000 7f9c9f200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ca015e140 0x7f9ca0158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:50.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.813+0000 7f9c9f200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ca0161f90 0x7f9ca014db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:50.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.813+0000 7f9c9f200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca00b5770 con 0x7f9ca015e140 2024-03-08T06:05:50.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.813+0000 7f9c9f200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca00b55f0 con 0x7f9ca0161f90 2024-03-08T06:05:50.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.813+0000 7f9c9f200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca00b58f0 con 0x7f9ca015dd60 2024-03-08T06:05:50.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.814+0000 7f9c95400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ca015e140 0x7f9ca0158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:50.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.814+0000 7f9c95400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ca015e140 0x7f9ca0158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42362/0 (socket says 172.21.15.19:42362) 2024-03-08T06:05:50.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.814+0000 7f9c95400640 1 -- 172.21.15.19:0/3060937441 learned_addr learned my addr 172.21.15.19:0/3060937441 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:50.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.814+0000 7f9c9e800640 1 --2- 172.21.15.19:0/3060937441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ca0161f90 0x7f9ca014db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:50.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.814+0000 7f9c9de00640 1 --2- 172.21.15.19:0/3060937441 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9ca015dd60 0x7f9ca00cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:50.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.814+0000 7f9c95400640 1 -- 172.21.15.19:0/3060937441 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9ca015dd60 msgr2=0x7f9ca00cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:50.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.814+0000 7f9c95400640 1 --2- 172.21.15.19:0/3060937441 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9ca015dd60 0x7f9ca00cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:50.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.814+0000 7f9c95400640 1 -- 172.21.15.19:0/3060937441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ca0161f90 msgr2=0x7f9ca014db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:50.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.814+0000 7f9c95400640 1 --2- 172.21.15.19:0/3060937441 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9ca0161f90 0x7f9ca014db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:50.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.814+0000 7f9c95400640 1 -- 172.21.15.19:0/3060937441 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca0159670 con 0x7f9ca015e140 2024-03-08T06:05:50.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.815+0000 7f9c95400640 1 --2- 172.21.15.19:0/3060937441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ca015e140 0x7f9ca0158c80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800d800 tx=0x7f9c8800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:50.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.815+0000 7f9c96a00640 1 -- 172.21.15.19:0/3060937441 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8800b6c0 con 0x7f9ca015e140 2024-03-08T06:05:50.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.815+0000 7f9c96a00640 1 -- 172.21.15.19:0/3060937441 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c88019070 con 0x7f9ca015e140 2024-03-08T06:05:50.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.815+0000 7f9c96a00640 1 -- 172.21.15.19:0/3060937441 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8800ba80 con 0x7f9ca015e140 2024-03-08T06:05:50.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.815+0000 7f9c9f200640 1 -- 172.21.15.19:0/3060937441 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca0159950 con 0x7f9ca015e140 2024-03-08T06:05:50.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.815+0000 7f9c9f200640 1 -- 172.21.15.19:0/3060937441 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca0159f10 con 0x7f9ca015e140 2024-03-08T06:05:50.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.816+0000 7f9c9f200640 1 -- 172.21.15.19:0/3060937441 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ca015a710 con 0x7f9ca015e140 2024-03-08T06:05:50.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.817+0000 7f9c96a00640 1 -- 172.21.15.19:0/3060937441 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f9c8800bc20 con 0x7f9ca015e140 2024-03-08T06:05:50.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.818+0000 7f9c96a00640 1 --2- 172.21.15.19:0/3060937441 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9c7c06b4d0 0x7f9c7c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:50.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.818+0000 7f9c96a00640 1 -- 172.21.15.19:0/3060937441 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9c8808a3f0 con 0x7f9ca015e140 2024-03-08T06:05:50.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.818+0000 7f9c96a00640 1 --2- 172.21.15.19:0/3060937441 >> [v2:172.21.15.19:6808/3105613222,v1:172.21.15.19:6809/3105613222] conn(0x7f9c7c071390 0x7f9c7c0737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:50.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.818+0000 7f9c96a00640 1 -- 172.21.15.19:0/3060937441 --> [v2:172.21.15.19:6808/3105613222,v1:172.21.15.19:6809/3105613222] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c88001d30 con 0x7f9c7c071390 2024-03-08T06:05:50.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.818+0000 7f9c96a00640 1 -- 172.21.15.19:0/3060937441 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c88091050 con 0x7f9ca015e140 2024-03-08T06:05:50.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.818+0000 7f9c9de00640 1 --2- 172.21.15.19:0/3060937441 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9c7c06b4d0 0x7f9c7c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:50.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.818+0000 7f9c9e800640 1 --2- 172.21.15.19:0/3060937441 >> [v2:172.21.15.19:6808/3105613222,v1:172.21.15.19:6809/3105613222] conn(0x7f9c7c071390 0x7f9c7c0737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:50.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.819+0000 7f9c9de00640 1 --2- 172.21.15.19:0/3060937441 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9c7c06b4d0 0x7f9c7c06d990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000a990 tx=0x7f9c90008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:50.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.819+0000 7f9c9e800640 1 --2- 172.21.15.19:0/3060937441 >> [v2:172.21.15.19:6808/3105613222,v1:172.21.15.19:6809/3105613222] conn(0x7f9c7c071390 0x7f9c7c0737b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:50.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.820+0000 7f9c96a00640 1 -- 172.21.15.19:0/3060937441 <== osd.0 v2:172.21.15.19:6808/3105613222 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9c88001d30 con 0x7f9c7c071390 2024-03-08T06:05:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.834+0000 7f9c9f200640 1 -- 172.21.15.19:0/3060937441 --> [v2:172.21.15.19:6808/3105613222,v1:172.21.15.19:6809/3105613222] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9ca0161a50 con 0x7f9c7c071390 2024-03-08T06:05:50.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.835+0000 7f9c96a00640 1 -- 172.21.15.19:0/3060937441 <== osd.0 v2:172.21.15.19:6808/3105613222 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9ca0161a50 con 0x7f9c7c071390 2024-03-08T06:05:50.835 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-08T06:05:50.835 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T06:05:50.836 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-08T06:05:50.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.835+0000 7f9c9f200640 1 -- 172.21.15.19:0/3060937441 >> [v2:172.21.15.19:6808/3105613222,v1:172.21.15.19:6809/3105613222] conn(0x7f9c7c071390 msgr2=0x7f9c7c0737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:50.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.835+0000 7f9c9f200640 1 --2- 172.21.15.19:0/3060937441 >> [v2:172.21.15.19:6808/3105613222,v1:172.21.15.19:6809/3105613222] conn(0x7f9c7c071390 0x7f9c7c0737b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:50.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.835+0000 7f9c9f200640 1 -- 172.21.15.19:0/3060937441 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9c7c06b4d0 msgr2=0x7f9c7c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:50.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.835+0000 7f9c9f200640 1 --2- 172.21.15.19:0/3060937441 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f9c7c06b4d0 0x7f9c7c06d990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000a990 tx=0x7f9c90008040 comp rx=0 tx=0).stop 2024-03-08T06:05:50.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.835+0000 7f9c9f200640 1 -- 172.21.15.19:0/3060937441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ca015e140 msgr2=0x7f9ca0158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:50.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.835+0000 7f9c9f200640 1 --2- 172.21.15.19:0/3060937441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ca015e140 0x7f9ca0158c80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800d800 tx=0x7f9c8800dcc0 comp rx=0 tx=0).stop 2024-03-08T06:05:50.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.835+0000 7f9c9e800640 1 -- 172.21.15.19:0/3060937441 reap_dead start 2024-03-08T06:05:50.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.836+0000 7f9c9f200640 1 -- 172.21.15.19:0/3060937441 shutdown_connections 2024-03-08T06:05:50.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.836+0000 7f9c9f200640 1 -- 172.21.15.19:0/3060937441 >> 172.21.15.19:0/3060937441 conn(0x7f9ca006c650 msgr2=0x7f9ca00d0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:50.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.836+0000 7f9c9f200640 1 -- 172.21.15.19:0/3060937441 shutdown_connections 2024-03-08T06:05:50.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:50.836+0000 7f9c9f200640 1 -- 172.21.15.19:0/3060937441 wait complete. 2024-03-08T06:05:50.853 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-08T06:05:51.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.062+0000 7f2db8a00640 1 Processor -- start 2024-03-08T06:05:51.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.062+0000 7f2db8a00640 1 -- start start 2024-03-08T06:05:51.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.064+0000 7f2db8a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2db4145230 0x7f2db415c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:51.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.064+0000 7f2db8a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2db415c5f0 0x7f2db40b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:51.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.064+0000 7f2db8a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2db40b66e0 0x7f2db4070d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:51.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.064+0000 7f2db8a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db40b5190 con 0x7f2db40b66e0 2024-03-08T06:05:51.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.064+0000 7f2db8a00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db40b53e0 con 0x7f2db415c5f0 2024-03-08T06:05:51.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.064+0000 7f2db8a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db40b56c0 con 0x7f2db4145230 2024-03-08T06:05:51.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.064+0000 7f2db3200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2db40b66e0 0x7f2db4070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:51.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.065+0000 7f2db3200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2db40b66e0 0x7f2db4070d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42376/0 (socket says 172.21.15.19:42376) 2024-03-08T06:05:51.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.065+0000 7f2db3200640 1 -- 172.21.15.19:0/2973512716 learned_addr learned my addr 172.21.15.19:0/2973512716 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:51.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.065+0000 7f2db1e00640 1 --2- 172.21.15.19:0/2973512716 >> v2:172.21.15.42:3300/0 conn(0x7f2db415c5f0 0x7f2db40b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:51.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.065+0000 7f2db2800640 1 --2- 172.21.15.19:0/2973512716 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2db4145230 0x7f2db415c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:51.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.065+0000 7f2db3200640 1 -- 172.21.15.19:0/2973512716 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2db4145230 msgr2=0x7f2db415c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:51.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.065+0000 7f2db3200640 1 --2- 172.21.15.19:0/2973512716 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2db4145230 0x7f2db415c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.065+0000 7f2db3200640 1 -- 172.21.15.19:0/2973512716 >> v2:172.21.15.42:3300/0 conn(0x7f2db415c5f0 msgr2=0x7f2db40b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:51.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.065+0000 7f2db3200640 1 --2- 172.21.15.19:0/2973512716 >> v2:172.21.15.42:3300/0 conn(0x7f2db415c5f0 0x7f2db40b61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.065+0000 7f2db3200640 1 -- 172.21.15.19:0/2973512716 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db40b59a0 con 0x7f2db40b66e0 2024-03-08T06:05:51.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.065+0000 7f2db2800640 1 --2- 172.21.15.19:0/2973512716 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2db4145230 0x7f2db415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:51.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.066+0000 7f2db3200640 1 --2- 172.21.15.19:0/2973512716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2db40b66e0 0x7f2db4070d80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2db406baa0 tx=0x7f2dac02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1563f795d697aaf4 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:51.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.067+0000 7f2db1400640 1 -- 172.21.15.19:0/2973512716 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac02c9e0 con 0x7f2db40b66e0 2024-03-08T06:05:51.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.067+0000 7f2db1400640 1 -- 172.21.15.19:0/2973512716 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dac02cb80 con 0x7f2db40b66e0 2024-03-08T06:05:51.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.067+0000 7f2db1400640 1 -- 172.21.15.19:0/2973512716 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac0343f0 con 0x7f2db40b66e0 2024-03-08T06:05:51.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.067+0000 7f2db8a00640 1 -- 172.21.15.19:0/2973512716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2db40b66e0 msgr2=0x7f2db4070d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:51.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.067+0000 7f2db8a00640 1 --2- 172.21.15.19:0/2973512716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2db40b66e0 0x7f2db4070d80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2db406baa0 tx=0x7f2dac02be40 comp rx=0 tx=0).stop 2024-03-08T06:05:51.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.067+0000 7f2db8a00640 1 -- 172.21.15.19:0/2973512716 shutdown_connections 2024-03-08T06:05:51.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.067+0000 7f2db8a00640 1 --2- 172.21.15.19:0/2973512716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2db40b66e0 0x7f2db4070d80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.067+0000 7f2db8a00640 1 --2- 172.21.15.19:0/2973512716 >> v2:172.21.15.42:3300/0 conn(0x7f2db415c5f0 0x7f2db40b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.067+0000 7f2db8a00640 1 --2- 172.21.15.19:0/2973512716 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2db4145230 0x7f2db415c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.067+0000 7f2db8a00640 1 -- 172.21.15.19:0/2973512716 >> 172.21.15.19:0/2973512716 conn(0x7f2db40b3480 msgr2=0x7f2db40b3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:51.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.068+0000 7f2db8a00640 1 -- 172.21.15.19:0/2973512716 shutdown_connections 2024-03-08T06:05:51.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.068+0000 7f2db8a00640 1 -- 172.21.15.19:0/2973512716 wait complete. 2024-03-08T06:05:51.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.069+0000 7f2db8a00640 1 Processor -- start 2024-03-08T06:05:51.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.069+0000 7f2db8a00640 1 -- start start 2024-03-08T06:05:51.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.070+0000 7f2db8a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2db40b66e0 0x7f2db415b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:51.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.070+0000 7f2db8a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2db4145230 0x7f2db40a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:51.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.070+0000 7f2db8a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2db415c5f0 0x7f2db4137a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:51.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.070+0000 7f2db8a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db40712c0 con 0x7f2db4145230 2024-03-08T06:05:51.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.070+0000 7f2db8a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db4145610 con 0x7f2db40b66e0 2024-03-08T06:05:51.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.070+0000 7f2db8a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db4071440 con 0x7f2db415c5f0 2024-03-08T06:05:51.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.071+0000 7f2db1e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2db4145230 0x7f2db40a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:51.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.071+0000 7f2db1e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2db4145230 0x7f2db40a8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42390/0 (socket says 172.21.15.19:42390) 2024-03-08T06:05:51.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.071+0000 7f2db1e00640 1 -- 172.21.15.19:0/3296325300 learned_addr learned my addr 172.21.15.19:0/3296325300 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:51.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.071+0000 7f2db1e00640 1 -- 172.21.15.19:0/3296325300 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2db415c5f0 msgr2=0x7f2db4137a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:51.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.071+0000 7f2db1e00640 1 --2- 172.21.15.19:0/3296325300 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2db415c5f0 0x7f2db4137a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.071+0000 7f2db1e00640 1 -- 172.21.15.19:0/3296325300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2db40b66e0 msgr2=0x7f2db415b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:51.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.071+0000 7f2db1e00640 1 --2- 172.21.15.19:0/3296325300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2db40b66e0 0x7f2db415b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.071+0000 7f2db1e00640 1 -- 172.21.15.19:0/3296325300 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db415e6b0 con 0x7f2db4145230 2024-03-08T06:05:51.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.071+0000 7f2db1e00640 1 --2- 172.21.15.19:0/3296325300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2db4145230 0x7f2db40a8fb0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2da000d5f0 tx=0x7f2da000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:51.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.071+0000 7f2daaa00640 1 -- 172.21.15.19:0/3296325300 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da00125f0 con 0x7f2db4145230 2024-03-08T06:05:51.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.072+0000 7f2daaa00640 1 -- 172.21.15.19:0/3296325300 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da0019070 con 0x7f2db4145230 2024-03-08T06:05:51.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.072+0000 7f2daaa00640 1 -- 172.21.15.19:0/3296325300 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da00129d0 con 0x7f2db4145230 2024-03-08T06:05:51.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.072+0000 7f2db8a00640 1 -- 172.21.15.19:0/3296325300 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db415e990 con 0x7f2db4145230 2024-03-08T06:05:51.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.072+0000 7f2db8a00640 1 -- 172.21.15.19:0/3296325300 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db415ef50 con 0x7f2db4145230 2024-03-08T06:05:51.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.073+0000 7f2db8a00640 1 -- 172.21.15.19:0/3296325300 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db406dec0 con 0x7f2db4145230 2024-03-08T06:05:51.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.074+0000 7f2daaa00640 1 -- 172.21.15.19:0/3296325300 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f2da0012b70 con 0x7f2db4145230 2024-03-08T06:05:51.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.074+0000 7f2daaa00640 1 --2- 172.21.15.19:0/3296325300 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f2d9406b4d0 0x7f2d9406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:51.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.075+0000 7f2daaa00640 1 -- 172.21.15.19:0/3296325300 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2da008a3b0 con 0x7f2db4145230 2024-03-08T06:05:51.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.075+0000 7f2db2800640 1 --2- 172.21.15.19:0/3296325300 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f2d9406b4d0 0x7f2d9406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:51.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.075+0000 7f2db2800640 1 --2- 172.21.15.19:0/3296325300 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f2d9406b4d0 0x7f2d9406d990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2db41f71f0 tx=0x7f2da4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:51.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.079+0000 7f2daaa00640 1 -- 172.21.15.19:0/3296325300 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2da0059490 con 0x7f2db4145230 2024-03-08T06:05:51.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.276+0000 7f2db8a00640 1 -- 172.21.15.19:0/3296325300 --> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f2db40b4800 con 0x7f2d9406b4d0 2024-03-08T06:05:51.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.277+0000 7f2daaa00640 1 -- 172.21.15.19:0/3296325300 <== mgr.4107 v2:172.21.15.19:6832/3589745192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2db40b4800 con 0x7f2d9406b4d0 2024-03-08T06:05:51.277 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 0 to deep-scrub 2024-03-08T06:05:51.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.279+0000 7f2db8a00640 1 -- 172.21.15.19:0/3296325300 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f2d9406b4d0 msgr2=0x7f2d9406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:51.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.279+0000 7f2db8a00640 1 --2- 172.21.15.19:0/3296325300 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f2d9406b4d0 0x7f2d9406d990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2db41f71f0 tx=0x7f2da4008040 comp rx=0 tx=0).stop 2024-03-08T06:05:51.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.279+0000 7f2db8a00640 1 -- 172.21.15.19:0/3296325300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2db4145230 msgr2=0x7f2db40a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:51.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.279+0000 7f2db8a00640 1 --2- 172.21.15.19:0/3296325300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2db4145230 0x7f2db40a8fb0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2da000d5f0 tx=0x7f2da000dab0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.280+0000 7f2db8a00640 1 -- 172.21.15.19:0/3296325300 shutdown_connections 2024-03-08T06:05:51.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.280+0000 7f2db8a00640 1 --2- 172.21.15.19:0/3296325300 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f2d9406b4d0 0x7f2d9406d990 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.280+0000 7f2db8a00640 1 --2- 172.21.15.19:0/3296325300 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f2db415c5f0 0x7f2db4137a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.280+0000 7f2db8a00640 1 --2- 172.21.15.19:0/3296325300 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2db4145230 0x7f2db40a8fb0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.280+0000 7f2db8a00640 1 --2- 172.21.15.19:0/3296325300 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2db40b66e0 0x7f2db415b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.280+0000 7f2db8a00640 1 -- 172.21.15.19:0/3296325300 >> 172.21.15.19:0/3296325300 conn(0x7f2db40b3480 msgr2=0x7f2db40b4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:51.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.280+0000 7f2db8a00640 1 -- 172.21.15.19:0/3296325300 shutdown_connections 2024-03-08T06:05:51.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.280+0000 7f2db8a00640 1 -- 172.21.15.19:0/3296325300 wait complete. 2024-03-08T06:05:51.297 INFO:tasks.ceph:Scrubbing osd.1 2024-03-08T06:05:51.297 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-08T06:05:51.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.519+0000 7f5cc0800640 1 Processor -- start 2024-03-08T06:05:51.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.519+0000 7f5cc0800640 1 -- start start 2024-03-08T06:05:51.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.520+0000 7f5cc0800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5cb80b3d60 0x7f5cb80b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:51.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.520+0000 7f5cc0800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5cb80cde70 0x7f5cb80ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:51.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.520+0000 7f5cc0800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb806d850 con 0x7f5cb8144540 2024-03-08T06:05:51.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.520+0000 7f5cc0800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb806e700 con 0x7f5cb80b3d60 2024-03-08T06:05:51.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.520+0000 7f5cc0800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb80b4700 con 0x7f5cb80cde70 2024-03-08T06:05:51.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.521+0000 7f5cbd400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5cb80b3d60 0x7f5cb80b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:51.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.521+0000 7f5cbd400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5cb80b3d60 0x7f5cb80b41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42402/0 (socket says 172.21.15.19:42402) 2024-03-08T06:05:51.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.521+0000 7f5cbd400640 1 -- 172.21.15.19:0/3196812251 learned_addr learned my addr 172.21.15.19:0/3196812251 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:51.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.521+0000 7f5cbe800640 1 --2- 172.21.15.19:0/3196812251 >> v2:172.21.15.42:3300/0 conn(0x7f5cb80cde70 0x7f5cb80ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:51.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.521+0000 7f5cbd400640 1 -- 172.21.15.19:0/3196812251 >> v2:172.21.15.42:3300/0 conn(0x7f5cb80cde70 msgr2=0x7f5cb80ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:51.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.521+0000 7f5cbd400640 1 --2- 172.21.15.19:0/3196812251 >> v2:172.21.15.42:3300/0 conn(0x7f5cb80cde70 0x7f5cb80ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.521+0000 7f5cbd400640 1 -- 172.21.15.19:0/3196812251 >> v1:172.21.15.42:6789/0 conn(0x7f5cb8144540 legacy=0x7f5cb806f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:51.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.521+0000 7f5cbd400640 1 -- 172.21.15.19:0/3196812251 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb806daf0 con 0x7f5cb80b3d60 2024-03-08T06:05:51.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.522+0000 7f5cbd400640 1 --2- 172.21.15.19:0/3196812251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cb80b3d60 0x7f5cb80b41c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80b2c00 tx=0x7f5ca802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e00f82eeb5d531 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:51.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.523+0000 7f5cbca00640 1 -- 172.21.15.19:0/3196812251 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8034070 con 0x7f5cb80b3d60 2024-03-08T06:05:51.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.523+0000 7f5cbca00640 1 -- 172.21.15.19:0/3196812251 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca8030860 con 0x7f5cb80b3d60 2024-03-08T06:05:51.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.523+0000 7f5cbca00640 1 -- 172.21.15.19:0/3196812251 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8030c30 con 0x7f5cb80b3d60 2024-03-08T06:05:51.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.524+0000 7f5cc0800640 1 -- 172.21.15.19:0/3196812251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cb80b3d60 msgr2=0x7f5cb80b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:51.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.524+0000 7f5cc0800640 1 --2- 172.21.15.19:0/3196812251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cb80b3d60 0x7f5cb80b41c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80b2c00 tx=0x7f5ca802b9a0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.524+0000 7f5cc0800640 1 -- 172.21.15.19:0/3196812251 shutdown_connections 2024-03-08T06:05:51.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.524+0000 7f5cc0800640 1 --2- 172.21.15.19:0/3196812251 >> v2:172.21.15.42:3300/0 conn(0x7f5cb80cde70 0x7f5cb80ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.524+0000 7f5cc0800640 1 --2- 172.21.15.19:0/3196812251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cb80b3d60 0x7f5cb80b41c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.524+0000 7f5cc0800640 1 -- 172.21.15.19:0/3196812251 >> 172.21.15.19:0/3196812251 conn(0x7f5cb80cfaa0 msgr2=0x7f5cb80cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:51.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.524+0000 7f5cc0800640 1 -- 172.21.15.19:0/3196812251 shutdown_connections 2024-03-08T06:05:51.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.524+0000 7f5cc0800640 1 -- 172.21.15.19:0/3196812251 wait complete. 2024-03-08T06:05:51.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.526+0000 7f5cc0800640 1 Processor -- start 2024-03-08T06:05:51.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.526+0000 7f5cc0800640 1 -- start start 2024-03-08T06:05:51.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.527+0000 7f5cc0800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5cb80b3d60 0x7f5cb80c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:51.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.527+0000 7f5cc0800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5cb80cde70 0x7f5cb81f8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:51.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.527+0000 7f5cc0800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cb8144540 0x7f5cb815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:51.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.527+0000 7f5cc0800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb806e390 con 0x7f5cb8144540 2024-03-08T06:05:51.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.527+0000 7f5cc0800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb806e0b0 con 0x7f5cb80b3d60 2024-03-08T06:05:51.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.527+0000 7f5cc0800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb815f620 con 0x7f5cb80cde70 2024-03-08T06:05:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.527+0000 7f5cbe800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cb8144540 0x7f5cb815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.527+0000 7f5cbe800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cb8144540 0x7f5cb815a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42414/0 (socket says 172.21.15.19:42414) 2024-03-08T06:05:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.527+0000 7f5cbe800640 1 -- 172.21.15.19:0/3917438128 learned_addr learned my addr 172.21.15.19:0/3917438128 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.527+0000 7f5cbd400640 1 --2- 172.21.15.19:0/3917438128 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5cb80cde70 0x7f5cb81f8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.527+0000 7f5cbde00640 1 --2- 172.21.15.19:0/3917438128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5cb80b3d60 0x7f5cb80c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.527+0000 7f5cbe800640 1 -- 172.21.15.19:0/3917438128 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5cb80cde70 msgr2=0x7f5cb81f8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.527+0000 7f5cbe800640 1 --2- 172.21.15.19:0/3917438128 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5cb80cde70 0x7f5cb81f8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.528+0000 7f5cbe800640 1 -- 172.21.15.19:0/3917438128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5cb80b3d60 msgr2=0x7f5cb80c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.528+0000 7f5cbe800640 1 --2- 172.21.15.19:0/3917438128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5cb80b3d60 0x7f5cb80c9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.528+0000 7f5cbe800640 1 -- 172.21.15.19:0/3917438128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb813c370 con 0x7f5cb8144540 2024-03-08T06:05:51.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.528+0000 7f5cbd400640 1 --2- 172.21.15.19:0/3917438128 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5cb80cde70 0x7f5cb81f8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:05:51.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.528+0000 7f5cbe800640 1 --2- 172.21.15.19:0/3917438128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cb8144540 0x7f5cb815a4f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4007e40 tx=0x7f5cb400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:51.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.528+0000 7f5cb2000640 1 -- 172.21.15.19:0/3917438128 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb4014620 con 0x7f5cb8144540 2024-03-08T06:05:51.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.528+0000 7f5cb2000640 1 -- 172.21.15.19:0/3917438128 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb4019070 con 0x7f5cb8144540 2024-03-08T06:05:51.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.528+0000 7f5cc0800640 1 -- 172.21.15.19:0/3917438128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb8139230 con 0x7f5cb8144540 2024-03-08T06:05:51.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.528+0000 7f5cb2000640 1 -- 172.21.15.19:0/3917438128 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb4014a20 con 0x7f5cb8144540 2024-03-08T06:05:51.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.528+0000 7f5cc0800640 1 -- 172.21.15.19:0/3917438128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb81397f0 con 0x7f5cb8144540 2024-03-08T06:05:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.529+0000 7f5cc0800640 1 -- 172.21.15.19:0/3917438128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5cb8067cb0 con 0x7f5cb8144540 2024-03-08T06:05:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.530+0000 7f5cb2000640 1 -- 172.21.15.19:0/3917438128 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5cb4014bc0 con 0x7f5cb8144540 2024-03-08T06:05:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.531+0000 7f5cb2000640 1 --2- 172.21.15.19:0/3917438128 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5c9c06b4d0 0x7f5c9c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.531+0000 7f5cb2000640 1 -- 172.21.15.19:0/3917438128 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5cb408a8e0 con 0x7f5cb8144540 2024-03-08T06:05:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.531+0000 7f5cb2000640 1 --2- 172.21.15.19:0/3917438128 >> [v2:172.21.15.19:6817/2806517817,v1:172.21.15.19:6819/2806517817] conn(0x7f5c9c071390 0x7f5c9c0737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.531+0000 7f5cb2000640 1 -- 172.21.15.19:0/3917438128 --> [v2:172.21.15.19:6817/2806517817,v1:172.21.15.19:6819/2806517817] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5cb4022ec0 con 0x7f5c9c071390 2024-03-08T06:05:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.531+0000 7f5cb2000640 1 -- 172.21.15.19:0/3917438128 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5cb408f2a0 con 0x7f5cb8144540 2024-03-08T06:05:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.531+0000 7f5cbde00640 1 --2- 172.21.15.19:0/3917438128 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5c9c06b4d0 0x7f5c9c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.532+0000 7f5cbd400640 1 --2- 172.21.15.19:0/3917438128 >> [v2:172.21.15.19:6817/2806517817,v1:172.21.15.19:6819/2806517817] conn(0x7f5c9c071390 0x7f5c9c0737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.532+0000 7f5cbde00640 1 --2- 172.21.15.19:0/3917438128 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5c9c06b4d0 0x7f5c9c06d990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5cac000f60 tx=0x7f5cac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.532+0000 7f5cbd400640 1 --2- 172.21.15.19:0/3917438128 >> [v2:172.21.15.19:6817/2806517817,v1:172.21.15.19:6819/2806517817] conn(0x7f5c9c071390 0x7f5c9c0737b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.533+0000 7f5cb2000640 1 -- 172.21.15.19:0/3917438128 <== osd.1 v2:172.21.15.19:6817/2806517817 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5cb4022ec0 con 0x7f5c9c071390 2024-03-08T06:05:51.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.548+0000 7f5cc0800640 1 -- 172.21.15.19:0/3917438128 --> [v2:172.21.15.19:6817/2806517817,v1:172.21.15.19:6819/2806517817] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5cb8143ba0 con 0x7f5c9c071390 2024-03-08T06:05:51.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.548+0000 7f5cb2000640 1 -- 172.21.15.19:0/3917438128 <== osd.1 v2:172.21.15.19:6817/2806517817 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5cb8143ba0 con 0x7f5c9c071390 2024-03-08T06:05:51.548 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-08T06:05:51.548 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T06:05:51.548 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-08T06:05:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.548+0000 7f5cc0800640 1 -- 172.21.15.19:0/3917438128 >> [v2:172.21.15.19:6817/2806517817,v1:172.21.15.19:6819/2806517817] conn(0x7f5c9c071390 msgr2=0x7f5c9c0737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.548+0000 7f5cc0800640 1 --2- 172.21.15.19:0/3917438128 >> [v2:172.21.15.19:6817/2806517817,v1:172.21.15.19:6819/2806517817] conn(0x7f5c9c071390 0x7f5c9c0737b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.548+0000 7f5cc0800640 1 -- 172.21.15.19:0/3917438128 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5c9c06b4d0 msgr2=0x7f5c9c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.548+0000 7f5cc0800640 1 --2- 172.21.15.19:0/3917438128 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5c9c06b4d0 0x7f5c9c06d990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5cac000f60 tx=0x7f5cac009040 comp rx=0 tx=0).stop 2024-03-08T06:05:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.548+0000 7f5cc0800640 1 -- 172.21.15.19:0/3917438128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cb8144540 msgr2=0x7f5cb815a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.548+0000 7f5cc0800640 1 --2- 172.21.15.19:0/3917438128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cb8144540 0x7f5cb815a4f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4007e40 tx=0x7f5cb400e4b0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.549+0000 7f5cbe800640 1 -- 172.21.15.19:0/3917438128 reap_dead start 2024-03-08T06:05:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.549+0000 7f5cc0800640 1 -- 172.21.15.19:0/3917438128 shutdown_connections 2024-03-08T06:05:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.549+0000 7f5cc0800640 1 -- 172.21.15.19:0/3917438128 >> 172.21.15.19:0/3917438128 conn(0x7f5cb80cfaa0 msgr2=0x7f5cb80cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.549+0000 7f5cc0800640 1 -- 172.21.15.19:0/3917438128 shutdown_connections 2024-03-08T06:05:51.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.549+0000 7f5cc0800640 1 -- 172.21.15.19:0/3917438128 wait complete. 2024-03-08T06:05:51.563 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-08T06:05:51.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.761+0000 7fd2ffe00640 1 Processor -- start 2024-03-08T06:05:51.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.761+0000 7fd2ffe00640 1 -- start start 2024-03-08T06:05:51.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.763+0000 7fd2ffe00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd2f80cdd50 0x7fd2f80ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:51.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.763+0000 7fd2ffe00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd2f80b21d0 0x7fd2f815f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:51.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.763+0000 7fd2ffe00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f806edb0 con 0x7fd2f8145480 2024-03-08T06:05:51.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.763+0000 7fd2ffe00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f806e920 con 0x7fd2f80b21d0 2024-03-08T06:05:51.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.763+0000 7fd2ffe00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f80ce670 con 0x7fd2f80cdd50 2024-03-08T06:05:51.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.763+0000 7fd2fd400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd2f80cdd50 0x7fd2f80ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:51.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.763+0000 7fd2fca00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd2f80b21d0 0x7fd2f815f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:51.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.763+0000 7fd2fd400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd2f80cdd50 0x7fd2f80ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3301/0 says I am v2:172.21.15.19:39948/0 (socket says 172.21.15.19:39948) 2024-03-08T06:05:51.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.763+0000 7fd2fd400640 1 -- 172.21.15.19:0/405009142 learned_addr learned my addr 172.21.15.19:0/405009142 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:51.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.764+0000 7fd2fd400640 1 -- 172.21.15.19:0/405009142 >> v2:172.21.15.42:3300/0 conn(0x7fd2f80b21d0 msgr2=0x7fd2f815f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:51.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.764+0000 7fd2fd400640 1 --2- 172.21.15.19:0/405009142 >> v2:172.21.15.42:3300/0 conn(0x7fd2f80b21d0 0x7fd2f815f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.764+0000 7fd2fd400640 1 -- 172.21.15.19:0/405009142 >> v1:172.21.15.42:6789/0 conn(0x7fd2f8145480 legacy=0x7fd2f815fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:51.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.764+0000 7fd2fd400640 1 -- 172.21.15.19:0/405009142 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f806dff0 con 0x7fd2f80cdd50 2024-03-08T06:05:51.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.766+0000 7fd2fd400640 1 --2- 172.21.15.19:0/405009142 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd2f80cdd50 0x7fd2f80ce130 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009870 tx=0x7fd2ec02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13ad2afc4d0df853 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:51.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.766+0000 7fd2f7e00640 1 -- 172.21.15.19:0/405009142 <== mon.2 v2:172.21.15.42:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec034070 con 0x7fd2f80cdd50 2024-03-08T06:05:51.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.766+0000 7fd2f7e00640 1 -- 172.21.15.19:0/405009142 <== mon.2 v2:172.21.15.42:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ec030840 con 0x7fd2f80cdd50 2024-03-08T06:05:51.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.766+0000 7fd2f7e00640 1 -- 172.21.15.19:0/405009142 <== mon.2 v2:172.21.15.42:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec030c10 con 0x7fd2f80cdd50 2024-03-08T06:05:51.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.767+0000 7fd2ffe00640 1 -- 172.21.15.19:0/405009142 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd2f80cdd50 msgr2=0x7fd2f80ce130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:51.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.767+0000 7fd2ffe00640 1 --2- 172.21.15.19:0/405009142 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd2f80cdd50 0x7fd2f80ce130 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009870 tx=0x7fd2ec02b980 comp rx=0 tx=0).stop 2024-03-08T06:05:51.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.767+0000 7fd2ffe00640 1 -- 172.21.15.19:0/405009142 shutdown_connections 2024-03-08T06:05:51.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.767+0000 7fd2ffe00640 1 --2- 172.21.15.19:0/405009142 >> v2:172.21.15.42:3300/0 conn(0x7fd2f80b21d0 0x7fd2f815f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.767+0000 7fd2ffe00640 1 --2- 172.21.15.19:0/405009142 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd2f80cdd50 0x7fd2f80ce130 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.767+0000 7fd2ffe00640 1 -- 172.21.15.19:0/405009142 >> 172.21.15.19:0/405009142 conn(0x7fd2f80b16e0 msgr2=0x7fd2f80b1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:51.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.767+0000 7fd2ffe00640 1 -- 172.21.15.19:0/405009142 shutdown_connections 2024-03-08T06:05:51.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.767+0000 7fd2ffe00640 1 -- 172.21.15.19:0/405009142 wait complete. 2024-03-08T06:05:51.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.770+0000 7fd2ffe00640 1 Processor -- start 2024-03-08T06:05:51.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.770+0000 7fd2ffe00640 1 -- start start 2024-03-08T06:05:51.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.771+0000 7fd2ffe00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd2f80cdd50 0x7fd2f8139220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:51.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.771+0000 7fd2ffe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f8145480 0x7fd2f813a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:51.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.771+0000 7fd2ffe00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd2f813a670 0x7fd2f81f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.771+0000 7fd2ffe00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f8144bd0 con 0x7fd2f8145480 2024-03-08T06:05:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.771+0000 7fd2ffe00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f806e5b0 con 0x7fd2f80cdd50 2024-03-08T06:05:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.771+0000 7fd2ffe00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f8160260 con 0x7fd2f813a670 2024-03-08T06:05:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.771+0000 7fd2fca00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f8145480 0x7fd2f813a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.771+0000 7fd2fca00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f8145480 0x7fd2f813a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42428/0 (socket says 172.21.15.19:42428) 2024-03-08T06:05:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.771+0000 7fd2fca00640 1 -- 172.21.15.19:0/3124196482 learned_addr learned my addr 172.21.15.19:0/3124196482 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:51.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.772+0000 7fd2fde00640 1 --2- 172.21.15.19:0/3124196482 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd2f813a670 0x7fd2f81f38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:51.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.772+0000 7fd2fca00640 1 -- 172.21.15.19:0/3124196482 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd2f813a670 msgr2=0x7fd2f81f38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:51.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.772+0000 7fd2fca00640 1 --2- 172.21.15.19:0/3124196482 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd2f813a670 0x7fd2f81f38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.772+0000 7fd2fca00640 1 -- 172.21.15.19:0/3124196482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd2f80cdd50 msgr2=0x7fd2f8139220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:51.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.772+0000 7fd2fca00640 1 --2- 172.21.15.19:0/3124196482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd2f80cdd50 0x7fd2f8139220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.772+0000 7fd2fca00640 1 -- 172.21.15.19:0/3124196482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f81f4670 con 0x7fd2f8145480 2024-03-08T06:05:51.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.772+0000 7fd2fde00640 1 --2- 172.21.15.19:0/3124196482 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd2f813a670 0x7fd2f81f38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:51.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.772+0000 7fd2fca00640 1 --2- 172.21.15.19:0/3124196482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f8145480 0x7fd2f813a130 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400e9e0 tx=0x7fd2e400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:51.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.772+0000 7fd2f5600640 1 -- 172.21.15.19:0/3124196482 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4017070 con 0x7fd2f8145480 2024-03-08T06:05:51.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.773+0000 7fd2f5600640 1 -- 172.21.15.19:0/3124196482 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e400c9d0 con 0x7fd2f8145480 2024-03-08T06:05:51.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.773+0000 7fd2f5600640 1 -- 172.21.15.19:0/3124196482 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e400cdc0 con 0x7fd2f8145480 2024-03-08T06:05:51.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.773+0000 7fd2ffe00640 1 -- 172.21.15.19:0/3124196482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f81e6540 con 0x7fd2f8145480 2024-03-08T06:05:51.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.773+0000 7fd2ffe00640 1 -- 172.21.15.19:0/3124196482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f8139760 con 0x7fd2f8145480 2024-03-08T06:05:51.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.774+0000 7fd2ffe00640 1 -- 172.21.15.19:0/3124196482 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f813aa80 con 0x7fd2f8145480 2024-03-08T06:05:51.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.775+0000 7fd2f5600640 1 -- 172.21.15.19:0/3124196482 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd2e401a070 con 0x7fd2f8145480 2024-03-08T06:05:51.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.776+0000 7fd2f5600640 1 --2- 172.21.15.19:0/3124196482 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd2d806b4d0 0x7fd2d806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:51.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.776+0000 7fd2f5600640 1 -- 172.21.15.19:0/3124196482 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd2e4089f90 con 0x7fd2f8145480 2024-03-08T06:05:51.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.776+0000 7fd2fd400640 1 --2- 172.21.15.19:0/3124196482 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd2d806b4d0 0x7fd2d806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:51.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.777+0000 7fd2fd400640 1 --2- 172.21.15.19:0/3124196482 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd2d806b4d0 0x7fd2d806d990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec036000 tx=0x7fd2ec03b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:51.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.781+0000 7fd2f5600640 1 -- 172.21.15.19:0/3124196482 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd2f813aa80 con 0x7fd2f8145480 2024-03-08T06:05:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.978+0000 7fd2ffe00640 1 -- 172.21.15.19:0/3124196482 --> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2f8142090 con 0x7fd2d806b4d0 2024-03-08T06:05:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.979+0000 7fd2f5600640 1 -- 172.21.15.19:0/3124196482 <== mgr.4107 v2:172.21.15.19:6832/3589745192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd2f8142090 con 0x7fd2d806b4d0 2024-03-08T06:05:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 1 to deep-scrub 2024-03-08T06:05:51.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.981+0000 7fd2ffe00640 1 -- 172.21.15.19:0/3124196482 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd2d806b4d0 msgr2=0x7fd2d806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:51.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.981+0000 7fd2ffe00640 1 --2- 172.21.15.19:0/3124196482 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd2d806b4d0 0x7fd2d806d990 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec036000 tx=0x7fd2ec03b040 comp rx=0 tx=0).stop 2024-03-08T06:05:51.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.981+0000 7fd2ffe00640 1 -- 172.21.15.19:0/3124196482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f8145480 msgr2=0x7fd2f813a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:51.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.981+0000 7fd2ffe00640 1 --2- 172.21.15.19:0/3124196482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f8145480 0x7fd2f813a130 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400e9e0 tx=0x7fd2e400eea0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.982+0000 7fd2ffe00640 1 -- 172.21.15.19:0/3124196482 shutdown_connections 2024-03-08T06:05:51.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.982+0000 7fd2ffe00640 1 --2- 172.21.15.19:0/3124196482 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd2d806b4d0 0x7fd2d806d990 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.982+0000 7fd2ffe00640 1 --2- 172.21.15.19:0/3124196482 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd2f813a670 0x7fd2f81f38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.982+0000 7fd2ffe00640 1 --2- 172.21.15.19:0/3124196482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2f8145480 0x7fd2f813a130 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.982+0000 7fd2ffe00640 1 --2- 172.21.15.19:0/3124196482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd2f80cdd50 0x7fd2f8139220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:51.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.982+0000 7fd2ffe00640 1 -- 172.21.15.19:0/3124196482 >> 172.21.15.19:0/3124196482 conn(0x7fd2f80b16e0 msgr2=0x7fd2f806d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:51.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.982+0000 7fd2ffe00640 1 -- 172.21.15.19:0/3124196482 shutdown_connections 2024-03-08T06:05:51.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:51.982+0000 7fd2ffe00640 1 -- 172.21.15.19:0/3124196482 wait complete. 2024-03-08T06:05:52.001 INFO:tasks.ceph:Scrubbing osd.2 2024-03-08T06:05:52.001 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-08T06:05:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.228+0000 7fdc2ca00640 1 Processor -- start 2024-03-08T06:05:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.228+0000 7fdc2ca00640 1 -- start start 2024-03-08T06:05:52.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.230+0000 7fdc2ca00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdc28144770 0x7fdc281451d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.230+0000 7fdc2ca00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fdc2806d520 0x7fdc28071520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.230+0000 7fdc2ca00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdc28071a60 0x7fdc2815f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.230+0000 7fdc2ca00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc28145710 con 0x7fdc28144770 2024-03-08T06:05:52.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.230+0000 7fdc2ca00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc2806dac0 con 0x7fdc2806d520 2024-03-08T06:05:52.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.230+0000 7fdc2ca00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2806dda0 con 0x7fdc28071a60 2024-03-08T06:05:52.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.230+0000 7fdc26800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdc28144770 0x7fdc281451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.230+0000 7fdc26800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdc28144770 0x7fdc281451d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40672/0 (socket says 172.21.15.19:40672) 2024-03-08T06:05:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.230+0000 7fdc26800640 1 -- 172.21.15.19:0/3798955216 learned_addr learned my addr 172.21.15.19:0/3798955216 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.231+0000 7fdc27200640 1 --2- 172.21.15.19:0/3798955216 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdc28071a60 0x7fdc2815f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.231+0000 7fdc1de00640 1 --2- 172.21.15.19:0/3798955216 >> v2:172.21.15.42:3300/0 conn(0x7fdc2806d520 0x7fdc28071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.231+0000 7fdc26800640 1 -- 172.21.15.19:0/3798955216 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdc28071a60 msgr2=0x7fdc2815f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.231+0000 7fdc26800640 1 --2- 172.21.15.19:0/3798955216 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdc28071a60 0x7fdc2815f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.231+0000 7fdc26800640 1 -- 172.21.15.19:0/3798955216 >> v2:172.21.15.42:3300/0 conn(0x7fdc2806d520 msgr2=0x7fdc28071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.231+0000 7fdc26800640 1 --2- 172.21.15.19:0/3798955216 >> v2:172.21.15.42:3300/0 conn(0x7fdc2806d520 0x7fdc28071520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.231+0000 7fdc26800640 1 -- 172.21.15.19:0/3798955216 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2806e080 con 0x7fdc28144770 2024-03-08T06:05:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.231+0000 7fdc1de00640 1 --2- 172.21.15.19:0/3798955216 >> v2:172.21.15.42:3300/0 conn(0x7fdc2806d520 0x7fdc28071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.232+0000 7fdc26800640 1 --2- 172.21.15.19:0/3798955216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc28144770 0x7fdc281451d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdc28067430 tx=0x7fdc1802b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934228c8ec0107b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:52.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.232+0000 7fdc25e00640 1 -- 172.21.15.19:0/3798955216 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc180317d0 con 0x7fdc28144770 2024-03-08T06:05:52.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.233+0000 7fdc25e00640 1 -- 172.21.15.19:0/3798955216 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc18037070 con 0x7fdc28144770 2024-03-08T06:05:52.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.233+0000 7fdc25e00640 1 -- 172.21.15.19:0/3798955216 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18031b90 con 0x7fdc28144770 2024-03-08T06:05:52.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.233+0000 7fdc2ca00640 1 -- 172.21.15.19:0/3798955216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc28144770 msgr2=0x7fdc281451d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:52.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.233+0000 7fdc2ca00640 1 --2- 172.21.15.19:0/3798955216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc28144770 0x7fdc281451d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdc28067430 tx=0x7fdc1802b870 comp rx=0 tx=0).stop 2024-03-08T06:05:52.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.233+0000 7fdc2ca00640 1 -- 172.21.15.19:0/3798955216 shutdown_connections 2024-03-08T06:05:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.233+0000 7fdc2ca00640 1 --2- 172.21.15.19:0/3798955216 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdc28071a60 0x7fdc2815f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.233+0000 7fdc2ca00640 1 --2- 172.21.15.19:0/3798955216 >> v2:172.21.15.42:3300/0 conn(0x7fdc2806d520 0x7fdc28071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.233+0000 7fdc2ca00640 1 --2- 172.21.15.19:0/3798955216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc28144770 0x7fdc281451d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.234+0000 7fdc2ca00640 1 -- 172.21.15.19:0/3798955216 >> 172.21.15.19:0/3798955216 conn(0x7fdc2806ac50 msgr2=0x7fdc2806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.234+0000 7fdc2ca00640 1 -- 172.21.15.19:0/3798955216 shutdown_connections 2024-03-08T06:05:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.234+0000 7fdc2ca00640 1 -- 172.21.15.19:0/3798955216 wait complete. 2024-03-08T06:05:52.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.236+0000 7fdc2ca00640 1 Processor -- start 2024-03-08T06:05:52.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.236+0000 7fdc2ca00640 1 -- start start 2024-03-08T06:05:52.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.237+0000 7fdc2ca00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc2806d520 0x7fdc2814d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.237+0000 7fdc2ca00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc28071a60 0x7fdc280b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.237+0000 7fdc2ca00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdc28144770 0x7fdc2815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.237+0000 7fdc2ca00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc28144b50 con 0x7fdc2806d520 2024-03-08T06:05:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.237+0000 7fdc2ca00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2815fc20 con 0x7fdc28071a60 2024-03-08T06:05:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.238+0000 7fdc2ca00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc280b4090 con 0x7fdc28144770 2024-03-08T06:05:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.238+0000 7fdc26800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc2806d520 0x7fdc2814d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.238+0000 7fdc26800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc2806d520 0x7fdc2814d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40676/0 (socket says 172.21.15.19:40676) 2024-03-08T06:05:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.238+0000 7fdc26800640 1 -- 172.21.15.19:0/4177584716 learned_addr learned my addr 172.21.15.19:0/4177584716 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.238+0000 7fdc1de00640 1 --2- 172.21.15.19:0/4177584716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc28071a60 0x7fdc280b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.238+0000 7fdc27200640 1 --2- 172.21.15.19:0/4177584716 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdc28144770 0x7fdc2815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.238+0000 7fdc26800640 1 -- 172.21.15.19:0/4177584716 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdc28144770 msgr2=0x7fdc2815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.238+0000 7fdc26800640 1 --2- 172.21.15.19:0/4177584716 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fdc28144770 0x7fdc2815d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.239+0000 7fdc26800640 1 -- 172.21.15.19:0/4177584716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc28071a60 msgr2=0x7fdc280b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:52.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.239+0000 7fdc26800640 1 --2- 172.21.15.19:0/4177584716 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdc28071a60 0x7fdc280b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.239+0000 7fdc26800640 1 -- 172.21.15.19:0/4177584716 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2814dc80 con 0x7fdc2806d520 2024-03-08T06:05:52.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.239+0000 7fdc26800640 1 --2- 172.21.15.19:0/4177584716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc2806d520 0x7fdc2814d740 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdc18000c00 tx=0x7fdc180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:52.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.239+0000 7fdc1f400640 1 -- 172.21.15.19:0/4177584716 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18032660 con 0x7fdc2806d520 2024-03-08T06:05:52.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.239+0000 7fdc1f400640 1 -- 172.21.15.19:0/4177584716 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc18032840 con 0x7fdc2806d520 2024-03-08T06:05:52.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.239+0000 7fdc2ca00640 1 -- 172.21.15.19:0/4177584716 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc280b3480 con 0x7fdc2806d520 2024-03-08T06:05:52.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.239+0000 7fdc1f400640 1 -- 172.21.15.19:0/4177584716 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18032c30 con 0x7fdc2806d520 2024-03-08T06:05:52.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.239+0000 7fdc2ca00640 1 -- 172.21.15.19:0/4177584716 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc280b3a40 con 0x7fdc2806d520 2024-03-08T06:05:52.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.240+0000 7fdc2ca00640 1 -- 172.21.15.19:0/4177584716 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdc28075090 con 0x7fdc2806d520 2024-03-08T06:05:52.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.241+0000 7fdc1f400640 1 -- 172.21.15.19:0/4177584716 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fdc1804c060 con 0x7fdc2806d520 2024-03-08T06:05:52.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.242+0000 7fdc1f400640 1 --2- 172.21.15.19:0/4177584716 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fdc0406b500 0x7fdc0406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.243+0000 7fdc1f400640 1 -- 172.21.15.19:0/4177584716 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdc180ab920 con 0x7fdc2806d520 2024-03-08T06:05:52.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.243+0000 7fdc1f400640 1 --2- 172.21.15.19:0/4177584716 >> [v2:172.21.15.19:6800/2805787689,v1:172.21.15.19:6801/2805787689] conn(0x7fdc040713c0 0x7fdc040737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.243+0000 7fdc1f400640 1 -- 172.21.15.19:0/4177584716 --> [v2:172.21.15.19:6800/2805787689,v1:172.21.15.19:6801/2805787689] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc04073e90 con 0x7fdc040713c0 2024-03-08T06:05:52.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.243+0000 7fdc1f400640 1 -- 172.21.15.19:0/4177584716 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc180b02a0 con 0x7fdc2806d520 2024-03-08T06:05:52.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.243+0000 7fdc27200640 1 --2- 172.21.15.19:0/4177584716 >> [v2:172.21.15.19:6800/2805787689,v1:172.21.15.19:6801/2805787689] conn(0x7fdc040713c0 0x7fdc040737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.243+0000 7fdc1de00640 1 --2- 172.21.15.19:0/4177584716 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fdc0406b500 0x7fdc0406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.244+0000 7fdc27200640 1 --2- 172.21.15.19:0/4177584716 >> [v2:172.21.15.19:6800/2805787689,v1:172.21.15.19:6801/2805787689] conn(0x7fdc040713c0 0x7fdc040737e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:52.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.244+0000 7fdc1de00640 1 --2- 172.21.15.19:0/4177584716 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fdc0406b500 0x7fdc0406d9c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdc281513b0 tx=0x7fdc10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:52.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.245+0000 7fdc1f400640 1 -- 172.21.15.19:0/4177584716 <== osd.2 v2:172.21.15.19:6800/2805787689 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fdc04073e90 con 0x7fdc040713c0 2024-03-08T06:05:52.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.259+0000 7fdc2ca00640 1 -- 172.21.15.19:0/4177584716 --> [v2:172.21.15.19:6800/2805787689,v1:172.21.15.19:6801/2805787689] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdc2806ea80 con 0x7fdc040713c0 2024-03-08T06:05:52.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.260+0000 7fdc1f400640 1 -- 172.21.15.19:0/4177584716 <== osd.2 v2:172.21.15.19:6800/2805787689 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdc2806ea80 con 0x7fdc040713c0 2024-03-08T06:05:52.260 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-08T06:05:52.260 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T06:05:52.261 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-08T06:05:52.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.260+0000 7fdc2ca00640 1 -- 172.21.15.19:0/4177584716 >> [v2:172.21.15.19:6800/2805787689,v1:172.21.15.19:6801/2805787689] conn(0x7fdc040713c0 msgr2=0x7fdc040737e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:52.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.260+0000 7fdc2ca00640 1 --2- 172.21.15.19:0/4177584716 >> [v2:172.21.15.19:6800/2805787689,v1:172.21.15.19:6801/2805787689] conn(0x7fdc040713c0 0x7fdc040737e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.261+0000 7fdc2ca00640 1 -- 172.21.15.19:0/4177584716 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fdc0406b500 msgr2=0x7fdc0406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:52.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.261+0000 7fdc2ca00640 1 --2- 172.21.15.19:0/4177584716 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fdc0406b500 0x7fdc0406d9c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdc281513b0 tx=0x7fdc10008040 comp rx=0 tx=0).stop 2024-03-08T06:05:52.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.261+0000 7fdc2ca00640 1 -- 172.21.15.19:0/4177584716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc2806d520 msgr2=0x7fdc2814d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:52.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.261+0000 7fdc2ca00640 1 --2- 172.21.15.19:0/4177584716 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc2806d520 0x7fdc2814d740 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fdc18000c00 tx=0x7fdc180046c0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.261+0000 7fdc27200640 1 -- 172.21.15.19:0/4177584716 reap_dead start 2024-03-08T06:05:52.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.261+0000 7fdc2ca00640 1 -- 172.21.15.19:0/4177584716 shutdown_connections 2024-03-08T06:05:52.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.261+0000 7fdc2ca00640 1 -- 172.21.15.19:0/4177584716 >> 172.21.15.19:0/4177584716 conn(0x7fdc2806ac50 msgr2=0x7fdc280cda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:52.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.261+0000 7fdc2ca00640 1 -- 172.21.15.19:0/4177584716 shutdown_connections 2024-03-08T06:05:52.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.261+0000 7fdc2ca00640 1 -- 172.21.15.19:0/4177584716 wait complete. 2024-03-08T06:05:52.277 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-08T06:05:52.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.491+0000 7f5537200640 1 Processor -- start 2024-03-08T06:05:52.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.491+0000 7f5537200640 1 -- start start 2024-03-08T06:05:52.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.492+0000 7f5537200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5538161240 0x7f55380b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.492+0000 7f5537200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55380b2ee0 con 0x7f55380b5bd0 2024-03-08T06:05:52.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.492+0000 7f5537200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55380d33a0 con 0x7f55380d0fd0 2024-03-08T06:05:52.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.492+0000 7f5537200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55380ceaa0 con 0x7f5538161240 2024-03-08T06:05:52.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.492+0000 7f5536800640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f55380b5bd0 0x7f55380d1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33402/0 (socket says 172.21.15.19:33402) 2024-03-08T06:05:52.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.492+0000 7f5536800640 1 -- 172.21.15.19:0/1868985942 learned_addr learned my addr 172.21.15.19:0/1868985942 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:52.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.493+0000 7f5535e00640 1 --2- 172.21.15.19:0/1868985942 >> v2:172.21.15.42:3300/0 conn(0x7f5538161240 0x7f55380b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.493+0000 7f5534a00640 1 -- 172.21.15.19:0/1868985942 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594982333 0 0) 0x7f5530001490 con 0x7f55380b5bd0 2024-03-08T06:05:52.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.493+0000 7f5534a00640 1 -- 172.21.15.19:0/1868985942 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f551c003520 con 0x7f55380b5bd0 2024-03-08T06:05:52.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.493+0000 7f5534a00640 1 -- 172.21.15.19:0/1868985942 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3542767376 0 0) 0x7f551c003520 con 0x7f55380b5bd0 2024-03-08T06:05:52.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.493+0000 7f5534a00640 1 -- 172.21.15.19:0/1868985942 >> v2:172.21.15.42:3300/0 conn(0x7f5538161240 msgr2=0x7f55380b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:52.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.493+0000 7f5534a00640 1 --2- 172.21.15.19:0/1868985942 >> v2:172.21.15.42:3300/0 conn(0x7f5538161240 0x7f55380b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.493+0000 7f5534a00640 1 -- 172.21.15.19:0/1868985942 >> v1:172.21.15.42:6789/0 conn(0x7f55380d0fd0 legacy=0x7f55380b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:52.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.493+0000 7f5534a00640 1 -- 172.21.15.19:0/1868985942 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55380d3680 con 0x7f55380b5bd0 2024-03-08T06:05:52.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.493+0000 7f5534a00640 1 -- 172.21.15.19:0/1868985942 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f5530001bc0 con 0x7f55380b5bd0 2024-03-08T06:05:52.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.493+0000 7f5534a00640 1 -- 172.21.15.19:0/1868985942 >> v1:172.21.15.19:6789/0 conn(0x7f55380b5bd0 legacy=0x7f55380d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:52.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.493+0000 7f5534a00640 1 --2- 172.21.15.19:0/1868985942 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f551c003a90 0x7f551c003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.493+0000 7f5534a00640 1 --2- 172.21.15.19:0/1868985942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f551c004800 0x7f551c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.493+0000 7f5534a00640 1 --2- 172.21.15.19:0/1868985942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f551c0052e0 0x7f551c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.494+0000 7f5534a00640 1 -- 172.21.15.19:0/1868985942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55380ceaa0 con 0x7f551c0052e0 2024-03-08T06:05:52.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.494+0000 7f5534a00640 1 -- 172.21.15.19:0/1868985942 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551c00c200 con 0x7f551c004800 2024-03-08T06:05:52.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.494+0000 7f5534a00640 1 -- 172.21.15.19:0/1868985942 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551c00c400 con 0x7f551c003a90 2024-03-08T06:05:52.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.494+0000 7f5536800640 1 --2- 172.21.15.19:0/1868985942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f551c0052e0 0x7f551c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.494+0000 7f5535e00640 1 --2- 172.21.15.19:0/1868985942 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f551c003a90 0x7f551c003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.494+0000 7f5536800640 1 -- 172.21.15.19:0/1868985942 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f551c003a90 msgr2=0x7f551c003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:52.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.494+0000 7f5536800640 1 --2- 172.21.15.19:0/1868985942 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f551c003a90 0x7f551c003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.494+0000 7f5536800640 1 -- 172.21.15.19:0/1868985942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f551c004800 msgr2=0x7f551c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:52.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.494+0000 7f5535400640 1 --2- 172.21.15.19:0/1868985942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f551c004800 0x7f551c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.494+0000 7f5536800640 1 --2- 172.21.15.19:0/1868985942 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f551c004800 0x7f551c004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.494+0000 7f5536800640 1 -- 172.21.15.19:0/1868985942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c003520 con 0x7f551c0052e0 2024-03-08T06:05:52.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.494+0000 7f5535e00640 1 --2- 172.21.15.19:0/1868985942 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f551c003a90 0x7f551c003ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:52.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.495+0000 7f5536800640 1 -- 172.21.15.19:0/1868985942 reap_dead start 2024-03-08T06:05:52.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.495+0000 7f5536800640 1 --2- 172.21.15.19:0/1868985942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f551c0052e0 0x7f551c00b9c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f553000a9f0 tx=0x7f551c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3f26ee872f01ab server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:52.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.496+0000 7f5534a00640 1 -- 172.21.15.19:0/1868985942 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553000a640 con 0x7f551c0052e0 2024-03-08T06:05:52.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.496+0000 7f5534a00640 1 -- 172.21.15.19:0/1868985942 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5530030070 con 0x7f551c0052e0 2024-03-08T06:05:52.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.496+0000 7f5534a00640 1 -- 172.21.15.19:0/1868985942 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530034870 con 0x7f551c0052e0 2024-03-08T06:05:52.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.496+0000 7f5537200640 1 -- 172.21.15.19:0/1868985942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f551c0052e0 msgr2=0x7f551c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:52.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.496+0000 7f5537200640 1 --2- 172.21.15.19:0/1868985942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f551c0052e0 0x7f551c00b9c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f553000a9f0 tx=0x7f551c005830 comp rx=0 tx=0).stop 2024-03-08T06:05:52.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.496+0000 7f5537200640 1 -- 172.21.15.19:0/1868985942 shutdown_connections 2024-03-08T06:05:52.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.496+0000 7f5537200640 1 --2- 172.21.15.19:0/1868985942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f551c0052e0 0x7f551c00b9c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.496+0000 7f5537200640 1 -- 172.21.15.19:0/1868985942 >> 172.21.15.19:0/1868985942 conn(0x7f553806c700 msgr2=0x7f553806cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:52.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.496+0000 7f5537200640 1 -- 172.21.15.19:0/1868985942 shutdown_connections 2024-03-08T06:05:52.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.496+0000 7f5537200640 1 -- 172.21.15.19:0/1868985942 wait complete. 2024-03-08T06:05:52.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.498+0000 7f5537200640 1 Processor -- start 2024-03-08T06:05:52.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.498+0000 7f5537200640 1 -- start start 2024-03-08T06:05:52.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.499+0000 7f5537200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f551c0052e0 0x7f5538155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.499+0000 7f5537200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55381595f0 0x7f5538147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.499+0000 7f5537200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5538148410 0x7f55381f7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.499+0000 7f5537200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5538161620 con 0x7f55381595f0 2024-03-08T06:05:52.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.499+0000 7f5537200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55380cefd0 con 0x7f551c0052e0 2024-03-08T06:05:52.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.499+0000 7f5537200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55381617a0 con 0x7f5538148410 2024-03-08T06:05:52.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.500+0000 7f5535400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55381595f0 0x7f5538147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.500+0000 7f5535400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55381595f0 0x7f5538147ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40692/0 (socket says 172.21.15.19:40692) 2024-03-08T06:05:52.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.500+0000 7f5535400640 1 -- 172.21.15.19:0/2897526150 learned_addr learned my addr 172.21.15.19:0/2897526150 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:52.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.500+0000 7f5536800640 1 --2- 172.21.15.19:0/2897526150 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5538148410 0x7f55381f7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.500+0000 7f5535400640 1 -- 172.21.15.19:0/2897526150 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5538148410 msgr2=0x7f55381f7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:52.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.500+0000 7f5535e00640 1 --2- 172.21.15.19:0/2897526150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f551c0052e0 0x7f5538155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.500+0000 7f5535400640 1 --2- 172.21.15.19:0/2897526150 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5538148410 0x7f55381f7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.500+0000 7f5535400640 1 -- 172.21.15.19:0/2897526150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f551c0052e0 msgr2=0x7f5538155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:52.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.500+0000 7f5535400640 1 --2- 172.21.15.19:0/2897526150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f551c0052e0 0x7f5538155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.500+0000 7f5535400640 1 -- 172.21.15.19:0/2897526150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55381566c0 con 0x7f55381595f0 2024-03-08T06:05:52.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.500+0000 7f5535400640 1 --2- 172.21.15.19:0/2897526150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55381595f0 0x7f5538147ed0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f552000d4c0 tx=0x7f552000d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:52.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.501+0000 7f552e000640 1 -- 172.21.15.19:0/2897526150 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520005480 con 0x7f55381595f0 2024-03-08T06:05:52.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.501+0000 7f552e000640 1 -- 172.21.15.19:0/2897526150 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5520017070 con 0x7f55381595f0 2024-03-08T06:05:52.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.501+0000 7f552e000640 1 -- 172.21.15.19:0/2897526150 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520003830 con 0x7f55381595f0 2024-03-08T06:05:52.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.501+0000 7f5537200640 1 -- 172.21.15.19:0/2897526150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5538158b10 con 0x7f55381595f0 2024-03-08T06:05:52.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.501+0000 7f5537200640 1 -- 172.21.15.19:0/2897526150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55381590d0 con 0x7f55381595f0 2024-03-08T06:05:52.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.502+0000 7f5537200640 1 -- 172.21.15.19:0/2897526150 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5538075090 con 0x7f55381595f0 2024-03-08T06:05:52.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.503+0000 7f552e000640 1 -- 172.21.15.19:0/2897526150 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5520003a90 con 0x7f55381595f0 2024-03-08T06:05:52.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.504+0000 7f552e000640 1 --2- 172.21.15.19:0/2897526150 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f551406b4d0 0x7f551406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.504+0000 7f552e000640 1 -- 172.21.15.19:0/2897526150 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5520089d40 con 0x7f55381595f0 2024-03-08T06:05:52.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.504+0000 7f5535e00640 1 --2- 172.21.15.19:0/2897526150 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f551406b4d0 0x7f551406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.505+0000 7f5535e00640 1 --2- 172.21.15.19:0/2897526150 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f551406b4d0 0x7f551406d990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f55280099c0 tx=0x7f5528008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:52.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.509+0000 7f552e000640 1 -- 172.21.15.19:0/2897526150 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5520058e20 con 0x7f55381595f0 2024-03-08T06:05:52.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.707+0000 7f5537200640 1 -- 172.21.15.19:0/2897526150 --> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5538158950 con 0x7f551406b4d0 2024-03-08T06:05:52.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.708+0000 7f552e000640 1 -- 172.21.15.19:0/2897526150 <== mgr.4107 v2:172.21.15.19:6832/3589745192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f55280118e0 con 0x7f551406b4d0 2024-03-08T06:05:52.708 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 2 to deep-scrub 2024-03-08T06:05:52.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.711+0000 7f5537200640 1 -- 172.21.15.19:0/2897526150 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f551406b4d0 msgr2=0x7f551406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:52.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.711+0000 7f5537200640 1 --2- 172.21.15.19:0/2897526150 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f551406b4d0 0x7f551406d990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f55280099c0 tx=0x7f5528008040 comp rx=0 tx=0).stop 2024-03-08T06:05:52.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.711+0000 7f5537200640 1 -- 172.21.15.19:0/2897526150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55381595f0 msgr2=0x7f5538147ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:52.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.711+0000 7f5537200640 1 --2- 172.21.15.19:0/2897526150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55381595f0 0x7f5538147ed0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f552000d4c0 tx=0x7f552000d980 comp rx=0 tx=0).stop 2024-03-08T06:05:52.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.711+0000 7f5537200640 1 -- 172.21.15.19:0/2897526150 shutdown_connections 2024-03-08T06:05:52.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.711+0000 7f5537200640 1 --2- 172.21.15.19:0/2897526150 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f551406b4d0 0x7f551406d990 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.711+0000 7f5537200640 1 --2- 172.21.15.19:0/2897526150 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5538148410 0x7f55381f7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.711+0000 7f5537200640 1 --2- 172.21.15.19:0/2897526150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55381595f0 0x7f5538147ed0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.711+0000 7f5537200640 1 --2- 172.21.15.19:0/2897526150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f551c0052e0 0x7f5538155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.711+0000 7f5537200640 1 -- 172.21.15.19:0/2897526150 >> 172.21.15.19:0/2897526150 conn(0x7f553806c700 msgr2=0x7f553806cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:52.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.711+0000 7f5537200640 1 -- 172.21.15.19:0/2897526150 shutdown_connections 2024-03-08T06:05:52.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.711+0000 7f5537200640 1 -- 172.21.15.19:0/2897526150 wait complete. 2024-03-08T06:05:52.731 INFO:tasks.ceph:Scrubbing osd.3 2024-03-08T06:05:52.731 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-08T06:05:52.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.959+0000 7f3fd5800640 1 Processor -- start 2024-03-08T06:05:52.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.960+0000 7f3fd5800640 1 -- start start 2024-03-08T06:05:52.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.961+0000 7f3fd5800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3fd01455b0 0x7f3fd015c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.961+0000 7f3fd5800640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3fd01604f0 0x7f3fd00cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.961+0000 7f3fd5800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd00cd5a0 con 0x7f3fd0071950 2024-03-08T06:05:52.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.961+0000 7f3fd5800640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd00cdc20 con 0x7f3fd01604f0 2024-03-08T06:05:52.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.961+0000 7f3fd5800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd00ccfe0 con 0x7f3fd01455b0 2024-03-08T06:05:52.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.961+0000 7f3fce000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3fd01604f0 0x7f3fd00cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.962+0000 7f3fcf400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3fd0071950 0x7f3fd00ce0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33406/0 (socket says 172.21.15.19:33406) 2024-03-08T06:05:52.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.962+0000 7f3fcf400640 1 -- 172.21.15.19:0/1889616175 learned_addr learned my addr 172.21.15.19:0/1889616175 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:52.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.962+0000 7f3fce000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3fd01604f0 0x7f3fd00cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40702/0 (socket says 172.21.15.19:40702) 2024-03-08T06:05:52.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.962+0000 7f3fcea00640 1 --2- 172.21.15.19:0/1889616175 >> v2:172.21.15.42:3300/0 conn(0x7f3fd01455b0 0x7f3fd015c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.962+0000 7f3fce000640 1 -- 172.21.15.19:0/1889616175 >> v2:172.21.15.42:3300/0 conn(0x7f3fd01455b0 msgr2=0x7f3fd015c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:52.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.962+0000 7f3fce000640 1 --2- 172.21.15.19:0/1889616175 >> v2:172.21.15.42:3300/0 conn(0x7f3fd01455b0 0x7f3fd015c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.962+0000 7f3fce000640 1 -- 172.21.15.19:0/1889616175 >> v1:172.21.15.19:6789/0 conn(0x7f3fd0071950 legacy=0x7f3fd00ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:52.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.962+0000 7f3fcd600640 1 -- 172.21.15.19:0/1889616175 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913084427 0 0) 0x7f3fd00cd5a0 con 0x7f3fd0071950 2024-03-08T06:05:52.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.962+0000 7f3fce000640 1 -- 172.21.15.19:0/1889616175 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd00cd2c0 con 0x7f3fd01604f0 2024-03-08T06:05:52.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.963+0000 7f3fce000640 1 --2- 172.21.15.19:0/1889616175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fd01604f0 0x7f3fd00cc690 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3fd006fc20 tx=0x7f3fb802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19545ccd7de05789 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:52.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.964+0000 7f3fcd600640 1 -- 172.21.15.19:0/1889616175 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8039070 con 0x7f3fd01604f0 2024-03-08T06:05:52.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.964+0000 7f3fcd600640 1 -- 172.21.15.19:0/1889616175 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb802cc80 con 0x7f3fd01604f0 2024-03-08T06:05:52.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.964+0000 7f3fcd600640 1 -- 172.21.15.19:0/1889616175 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb8034660 con 0x7f3fd01604f0 2024-03-08T06:05:52.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.964+0000 7f3fd5800640 1 -- 172.21.15.19:0/1889616175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fd01604f0 msgr2=0x7f3fd00cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:52.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.964+0000 7f3fd5800640 1 --2- 172.21.15.19:0/1889616175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fd01604f0 0x7f3fd00cc690 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3fd006fc20 tx=0x7f3fb802bed0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.964+0000 7f3fd5800640 1 -- 172.21.15.19:0/1889616175 shutdown_connections 2024-03-08T06:05:52.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.964+0000 7f3fd5800640 1 --2- 172.21.15.19:0/1889616175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fd01604f0 0x7f3fd00cc690 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.964+0000 7f3fd5800640 1 --2- 172.21.15.19:0/1889616175 >> v2:172.21.15.42:3300/0 conn(0x7f3fd01455b0 0x7f3fd015c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.964+0000 7f3fd5800640 1 -- 172.21.15.19:0/1889616175 >> 172.21.15.19:0/1889616175 conn(0x7f3fd006ae30 msgr2=0x7f3fd006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:52.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.964+0000 7f3fd5800640 1 -- 172.21.15.19:0/1889616175 shutdown_connections 2024-03-08T06:05:52.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.965+0000 7f3fd5800640 1 -- 172.21.15.19:0/1889616175 wait complete. 2024-03-08T06:05:52.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.966+0000 7f3fd5800640 1 Processor -- start 2024-03-08T06:05:52.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.966+0000 7f3fd5800640 1 -- start start 2024-03-08T06:05:52.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.967+0000 7f3fd5800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fd0071950 0x7f3fd013f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.967+0000 7f3fd5800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3fd01455b0 0x7f3fd013cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.967+0000 7f3fd5800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fd01604f0 0x7f3fd015b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.967+0000 7f3fd5800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd0145990 con 0x7f3fd01604f0 2024-03-08T06:05:52.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.967+0000 7f3fd5800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd015c710 con 0x7f3fd0071950 2024-03-08T06:05:52.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.967+0000 7f3fd5800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd00ccbd0 con 0x7f3fd01455b0 2024-03-08T06:05:52.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.968+0000 7f3fcf400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fd01604f0 0x7f3fd015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.968+0000 7f3fcf400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fd01604f0 0x7f3fd015b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40714/0 (socket says 172.21.15.19:40714) 2024-03-08T06:05:52.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.968+0000 7f3fcf400640 1 -- 172.21.15.19:0/2533532637 learned_addr learned my addr 172.21.15.19:0/2533532637 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:52.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.968+0000 7f3fce000640 1 --2- 172.21.15.19:0/2533532637 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3fd01455b0 0x7f3fd013cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.968+0000 7f3fcea00640 1 --2- 172.21.15.19:0/2533532637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fd0071950 0x7f3fd013f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.968+0000 7f3fcf400640 1 -- 172.21.15.19:0/2533532637 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3fd01455b0 msgr2=0x7f3fd013cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:52.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.968+0000 7f3fcf400640 1 --2- 172.21.15.19:0/2533532637 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3fd01455b0 0x7f3fd013cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.968+0000 7f3fcf400640 1 -- 172.21.15.19:0/2533532637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fd0071950 msgr2=0x7f3fd013f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:52.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.968+0000 7f3fcf400640 1 --2- 172.21.15.19:0/2533532637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fd0071950 0x7f3fd013f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.968+0000 7f3fcf400640 1 -- 172.21.15.19:0/2533532637 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd013d010 con 0x7f3fd01604f0 2024-03-08T06:05:52.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.968+0000 7f3fcea00640 1 --2- 172.21.15.19:0/2533532637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3fd0071950 0x7f3fd013f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:52.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.969+0000 7f3fcf400640 1 --2- 172.21.15.19:0/2533532637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fd01604f0 0x7f3fd015b320 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800c440 tx=0x7f3fc800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:52.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.969+0000 7f3fc6a00640 1 -- 172.21.15.19:0/2533532637 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc80074e0 con 0x7f3fd01604f0 2024-03-08T06:05:52.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.969+0000 7f3fc6a00640 1 -- 172.21.15.19:0/2533532637 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc80047e0 con 0x7f3fd01604f0 2024-03-08T06:05:52.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.969+0000 7f3fc6a00640 1 -- 172.21.15.19:0/2533532637 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8004bd0 con 0x7f3fd01604f0 2024-03-08T06:05:52.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.969+0000 7f3fd5800640 1 -- 172.21.15.19:0/2533532637 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd015b860 con 0x7f3fd01604f0 2024-03-08T06:05:52.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.969+0000 7f3fd5800640 1 -- 172.21.15.19:0/2533532637 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd013fa90 con 0x7f3fd01604f0 2024-03-08T06:05:52.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.970+0000 7f3fd5800640 1 -- 172.21.15.19:0/2533532637 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3fd0067cb0 con 0x7f3fd01604f0 2024-03-08T06:05:52.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.971+0000 7f3fc6a00640 1 -- 172.21.15.19:0/2533532637 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3fc8011070 con 0x7f3fd01604f0 2024-03-08T06:05:52.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.972+0000 7f3fc6a00640 1 --2- 172.21.15.19:0/2533532637 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3fac06b4d0 0x7f3fac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.972+0000 7f3fc6a00640 1 -- 172.21.15.19:0/2533532637 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3fc8089b50 con 0x7f3fd01604f0 2024-03-08T06:05:52.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.973+0000 7f3fc6a00640 1 --2- 172.21.15.19:0/2533532637 >> [v2:172.21.15.19:6816/3547775856,v1:172.21.15.19:6818/3547775856] conn(0x7f3fac071390 0x7f3fac0737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:52.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.973+0000 7f3fc6a00640 1 -- 172.21.15.19:0/2533532637 --> [v2:172.21.15.19:6816/3547775856,v1:172.21.15.19:6818/3547775856] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3fac073e60 con 0x7f3fac071390 2024-03-08T06:05:52.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.973+0000 7f3fc6a00640 1 -- 172.21.15.19:0/2533532637 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fc808e2a0 con 0x7f3fd01604f0 2024-03-08T06:05:52.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.973+0000 7f3fcea00640 1 --2- 172.21.15.19:0/2533532637 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3fac06b4d0 0x7f3fac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.973+0000 7f3fce000640 1 --2- 172.21.15.19:0/2533532637 >> [v2:172.21.15.19:6816/3547775856,v1:172.21.15.19:6818/3547775856] conn(0x7f3fac071390 0x7f3fac0737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:52.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.974+0000 7f3fcea00640 1 --2- 172.21.15.19:0/2533532637 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3fac06b4d0 0x7f3fac06d990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0006fd0 tx=0x7f3fc0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:52.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.974+0000 7f3fce000640 1 --2- 172.21.15.19:0/2533532637 >> [v2:172.21.15.19:6816/3547775856,v1:172.21.15.19:6818/3547775856] conn(0x7f3fac071390 0x7f3fac0737b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:52.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.974+0000 7f3fc6a00640 1 -- 172.21.15.19:0/2533532637 <== osd.3 v2:172.21.15.19:6816/3547775856 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3fac073e60 con 0x7f3fac071390 2024-03-08T06:05:52.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.989+0000 7f3fd5800640 1 -- 172.21.15.19:0/2533532637 --> [v2:172.21.15.19:6816/3547775856,v1:172.21.15.19:6818/3547775856] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3fd00729c0 con 0x7f3fac071390 2024-03-08T06:05:52.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.990+0000 7f3fc6a00640 1 -- 172.21.15.19:0/2533532637 <== osd.3 v2:172.21.15.19:6816/3547775856 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3fd00729c0 con 0x7f3fac071390 2024-03-08T06:05:52.990 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-08T06:05:52.990 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T06:05:52.991 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-08T06:05:52.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.990+0000 7f3fd5800640 1 -- 172.21.15.19:0/2533532637 >> [v2:172.21.15.19:6816/3547775856,v1:172.21.15.19:6818/3547775856] conn(0x7f3fac071390 msgr2=0x7f3fac0737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:52.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.990+0000 7f3fd5800640 1 --2- 172.21.15.19:0/2533532637 >> [v2:172.21.15.19:6816/3547775856,v1:172.21.15.19:6818/3547775856] conn(0x7f3fac071390 0x7f3fac0737b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:52.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.990+0000 7f3fd5800640 1 -- 172.21.15.19:0/2533532637 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3fac06b4d0 msgr2=0x7f3fac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:52.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.990+0000 7f3fd5800640 1 --2- 172.21.15.19:0/2533532637 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3fac06b4d0 0x7f3fac06d990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0006fd0 tx=0x7f3fc0008040 comp rx=0 tx=0).stop 2024-03-08T06:05:52.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.990+0000 7f3fd5800640 1 -- 172.21.15.19:0/2533532637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fd01604f0 msgr2=0x7f3fd015b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:52.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.990+0000 7f3fd5800640 1 --2- 172.21.15.19:0/2533532637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fd01604f0 0x7f3fd015b320 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800c440 tx=0x7f3fc800c900 comp rx=0 tx=0).stop 2024-03-08T06:05:52.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.990+0000 7f3fcf400640 1 -- 172.21.15.19:0/2533532637 reap_dead start 2024-03-08T06:05:52.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.991+0000 7f3fd5800640 1 -- 172.21.15.19:0/2533532637 shutdown_connections 2024-03-08T06:05:52.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.991+0000 7f3fd5800640 1 -- 172.21.15.19:0/2533532637 >> 172.21.15.19:0/2533532637 conn(0x7f3fd006ae30 msgr2=0x7f3fd006b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:52.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.991+0000 7f3fd5800640 1 -- 172.21.15.19:0/2533532637 shutdown_connections 2024-03-08T06:05:52.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:52.991+0000 7f3fd5800640 1 -- 172.21.15.19:0/2533532637 wait complete. 2024-03-08T06:05:53.011 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-08T06:05:53.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.234+0000 7fd745400640 1 Processor -- start 2024-03-08T06:05:53.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.234+0000 7fd745400640 1 -- start start 2024-03-08T06:05:53.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.235+0000 7fd745400640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd7401451b0 0x7fd74015ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.235+0000 7fd745400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd74006f050 0x7fd740071400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.235+0000 7fd745400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd74015cf70 con 0x7fd740071940 2024-03-08T06:05:53.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.235+0000 7fd745400640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd74006d600 con 0x7fd7401451b0 2024-03-08T06:05:53.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.235+0000 7fd745400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74006d8e0 con 0x7fd74006f050 2024-03-08T06:05:53.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.236+0000 7fd744a00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd740071940 0x7fd74015f5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33412/0 (socket says 172.21.15.19:33412) 2024-03-08T06:05:53.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.236+0000 7fd744a00640 1 -- 172.21.15.19:0/1410238060 learned_addr learned my addr 172.21.15.19:0/1410238060 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:53.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.236+0000 7fd73fe00640 1 --2- 172.21.15.19:0/1410238060 >> v2:172.21.15.42:3300/0 conn(0x7fd7401451b0 0x7fd74015ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.236+0000 7fd73f400640 1 -- 172.21.15.19:0/1410238060 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1781034433 0 0) 0x7fd74015cf70 con 0x7fd740071940 2024-03-08T06:05:53.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.236+0000 7fd737e00640 1 --2- 172.21.15.19:0/1410238060 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd74006f050 0x7fd740071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.236+0000 7fd73f400640 1 -- 172.21.15.19:0/1410238060 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd724003520 con 0x7fd740071940 2024-03-08T06:05:53.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.237+0000 7fd73f400640 1 -- 172.21.15.19:0/1410238060 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3323383551 0 0) 0x7fd724003520 con 0x7fd740071940 2024-03-08T06:05:53.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.237+0000 7fd73f400640 1 -- 172.21.15.19:0/1410238060 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd74006f050 msgr2=0x7fd740071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:53.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.237+0000 7fd73f400640 1 --2- 172.21.15.19:0/1410238060 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd74006f050 0x7fd740071400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.237+0000 7fd73f400640 1 -- 172.21.15.19:0/1410238060 >> v2:172.21.15.42:3300/0 conn(0x7fd7401451b0 msgr2=0x7fd74015ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:53.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.237+0000 7fd73f400640 1 --2- 172.21.15.19:0/1410238060 >> v2:172.21.15.42:3300/0 conn(0x7fd7401451b0 0x7fd74015ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.237+0000 7fd73f400640 1 -- 172.21.15.19:0/1410238060 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74006dbc0 con 0x7fd740071940 2024-03-08T06:05:53.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.237+0000 7fd73f400640 1 -- 172.21.15.19:0/1410238060 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7fd7380019f0 con 0x7fd740071940 2024-03-08T06:05:53.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.237+0000 7fd73f400640 1 -- 172.21.15.19:0/1410238060 >> v1:172.21.15.19:6789/0 conn(0x7fd740071940 legacy=0x7fd74015f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:53.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.237+0000 7fd73f400640 1 --2- 172.21.15.19:0/1410238060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd724003a90 0x7fd724003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.237+0000 7fd73f400640 1 --2- 172.21.15.19:0/1410238060 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd724004800 0x7fd724004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.237+0000 7fd73f400640 1 --2- 172.21.15.19:0/1410238060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7240051c0 0x7fd72400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.237+0000 7fd73f400640 1 -- 172.21.15.19:0/1410238060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74006d600 con 0x7fd724003a90 2024-03-08T06:05:53.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.237+0000 7fd73f400640 1 -- 172.21.15.19:0/1410238060 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74006d8e0 con 0x7fd7240051c0 2024-03-08T06:05:53.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.237+0000 7fd73f400640 1 -- 172.21.15.19:0/1410238060 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72400c030 con 0x7fd724004800 2024-03-08T06:05:53.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.237+0000 7fd737e00640 1 --2- 172.21.15.19:0/1410238060 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd74006f050 0x7fd740071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:05:53.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.237+0000 7fd73fe00640 1 --2- 172.21.15.19:0/1410238060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd724003a90 0x7fd724003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.238+0000 7fd73fe00640 1 -- 172.21.15.19:0/1410238060 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd724004800 msgr2=0x7fd724004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:53.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.238+0000 7fd73fe00640 1 --2- 172.21.15.19:0/1410238060 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd724004800 0x7fd724004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.238+0000 7fd73fe00640 1 -- 172.21.15.19:0/1410238060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7240051c0 msgr2=0x7fd72400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:53.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.238+0000 7fd73fe00640 1 --2- 172.21.15.19:0/1410238060 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7240051c0 0x7fd72400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.238+0000 7fd73fe00640 1 -- 172.21.15.19:0/1410238060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd724003520 con 0x7fd724003a90 2024-03-08T06:05:53.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.239+0000 7fd73fe00640 1 --2- 172.21.15.19:0/1410238060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd724003a90 0x7fd724003eb0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd730009ac0 tx=0x7fd724005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d3d26b61e838e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:53.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.239+0000 7fd73f400640 1 -- 172.21.15.19:0/1410238060 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd730039070 con 0x7fd724003a90 2024-03-08T06:05:53.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.239+0000 7fd73f400640 1 -- 172.21.15.19:0/1410238060 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73002c710 con 0x7fd724003a90 2024-03-08T06:05:53.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.239+0000 7fd73f400640 1 -- 172.21.15.19:0/1410238060 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd730009690 con 0x7fd724003a90 2024-03-08T06:05:53.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.240+0000 7fd745400640 1 -- 172.21.15.19:0/1410238060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd724003a90 msgr2=0x7fd724003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:53.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.240+0000 7fd745400640 1 --2- 172.21.15.19:0/1410238060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd724003a90 0x7fd724003eb0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd730009ac0 tx=0x7fd724005830 comp rx=0 tx=0).stop 2024-03-08T06:05:53.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.240+0000 7fd744a00640 1 -- 172.21.15.19:0/1410238060 reap_dead start 2024-03-08T06:05:53.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.240+0000 7fd745400640 1 -- 172.21.15.19:0/1410238060 shutdown_connections 2024-03-08T06:05:53.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.240+0000 7fd745400640 1 -- 172.21.15.19:0/1410238060 >> 172.21.15.19:0/1410238060 conn(0x7fd7400b1590 msgr2=0x7fd7400b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:53.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.240+0000 7fd745400640 1 -- 172.21.15.19:0/1410238060 shutdown_connections 2024-03-08T06:05:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.240+0000 7fd745400640 1 -- 172.21.15.19:0/1410238060 wait complete. 2024-03-08T06:05:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.241+0000 7fd745400640 1 Processor -- start 2024-03-08T06:05:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.242+0000 7fd745400640 1 -- start start 2024-03-08T06:05:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.243+0000 7fd745400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd724003a90 0x7fd7401f7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.243+0000 7fd745400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd74015b750 0x7fd74012ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.243+0000 7fd745400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd74012bfb0 0x7fd7400b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.243+0000 7fd745400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd740145710 con 0x7fd724003a90 2024-03-08T06:05:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.243+0000 7fd745400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd740145590 con 0x7fd74012bfb0 2024-03-08T06:05:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.243+0000 7fd745400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74015e1b0 con 0x7fd74015b750 2024-03-08T06:05:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.243+0000 7fd73fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd724003a90 0x7fd7401f7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.243+0000 7fd73fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd724003a90 0x7fd7401f7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40730/0 (socket says 172.21.15.19:40730) 2024-03-08T06:05:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.243+0000 7fd73fe00640 1 -- 172.21.15.19:0/401124091 learned_addr learned my addr 172.21.15.19:0/401124091 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.243+0000 7fd744a00640 1 --2- 172.21.15.19:0/401124091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd74012bfb0 0x7fd7400b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.243+0000 7fd73fe00640 1 -- 172.21.15.19:0/401124091 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd74015b750 msgr2=0x7fd74012ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:53.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.243+0000 7fd73fe00640 1 --2- 172.21.15.19:0/401124091 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd74015b750 0x7fd74012ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.243+0000 7fd73fe00640 1 -- 172.21.15.19:0/401124091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd74012bfb0 msgr2=0x7fd7400b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:53.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.243+0000 7fd73fe00640 1 --2- 172.21.15.19:0/401124091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd74012bfb0 0x7fd7400b3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.243+0000 7fd73fe00640 1 -- 172.21.15.19:0/401124091 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74015a720 con 0x7fd724003a90 2024-03-08T06:05:53.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.244+0000 7fd73fe00640 1 --2- 172.21.15.19:0/401124091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd724003a90 0x7fd7401f7710 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd730000c00 tx=0x7fd730004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:53.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.244+0000 7fd73cc00640 1 -- 172.21.15.19:0/401124091 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd730039050 con 0x7fd724003a90 2024-03-08T06:05:53.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.244+0000 7fd73cc00640 1 -- 172.21.15.19:0/401124091 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd730045070 con 0x7fd724003a90 2024-03-08T06:05:53.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.244+0000 7fd73cc00640 1 -- 172.21.15.19:0/401124091 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7300044e0 con 0x7fd724003a90 2024-03-08T06:05:53.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.244+0000 7fd745400640 1 -- 172.21.15.19:0/401124091 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7401f3680 con 0x7fd724003a90 2024-03-08T06:05:53.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.244+0000 7fd745400640 1 -- 172.21.15.19:0/401124091 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd74015ac70 con 0x7fd724003a90 2024-03-08T06:05:53.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.245+0000 7fd745400640 1 -- 172.21.15.19:0/401124091 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd740075090 con 0x7fd724003a90 2024-03-08T06:05:53.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.246+0000 7fd73cc00640 1 -- 172.21.15.19:0/401124091 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd730003a50 con 0x7fd724003a90 2024-03-08T06:05:53.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.247+0000 7fd73cc00640 1 --2- 172.21.15.19:0/401124091 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd71c06b500 0x7fd71c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.247+0000 7fd73cc00640 1 -- 172.21.15.19:0/401124091 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd7300ab9c0 con 0x7fd724003a90 2024-03-08T06:05:53.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.248+0000 7fd737e00640 1 --2- 172.21.15.19:0/401124091 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd71c06b500 0x7fd71c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.248+0000 7fd737e00640 1 --2- 172.21.15.19:0/401124091 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd71c06b500 0x7fd71c06d9c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd728006fd0 tx=0x7fd728008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:53.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.252+0000 7fd73cc00640 1 -- 172.21.15.19:0/401124091 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd73004e020 con 0x7fd724003a90 2024-03-08T06:05:53.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.448+0000 7fd745400640 1 -- 172.21.15.19:0/401124091 --> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7401601c0 con 0x7fd71c06b500 2024-03-08T06:05:53.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.450+0000 7fd73cc00640 1 -- 172.21.15.19:0/401124091 <== mgr.4107 v2:172.21.15.19:6832/3589745192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd7401601c0 con 0x7fd71c06b500 2024-03-08T06:05:53.450 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 3 to deep-scrub 2024-03-08T06:05:53.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.452+0000 7fd745400640 1 -- 172.21.15.19:0/401124091 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd71c06b500 msgr2=0x7fd71c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:53.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.452+0000 7fd745400640 1 --2- 172.21.15.19:0/401124091 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd71c06b500 0x7fd71c06d9c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd728006fd0 tx=0x7fd728008040 comp rx=0 tx=0).stop 2024-03-08T06:05:53.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.452+0000 7fd745400640 1 -- 172.21.15.19:0/401124091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd724003a90 msgr2=0x7fd7401f7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:53.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.452+0000 7fd745400640 1 --2- 172.21.15.19:0/401124091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd724003a90 0x7fd7401f7710 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd730000c00 tx=0x7fd730004730 comp rx=0 tx=0).stop 2024-03-08T06:05:53.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.453+0000 7fd745400640 1 -- 172.21.15.19:0/401124091 shutdown_connections 2024-03-08T06:05:53.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.453+0000 7fd745400640 1 --2- 172.21.15.19:0/401124091 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd71c06b500 0x7fd71c06d9c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.453+0000 7fd745400640 1 --2- 172.21.15.19:0/401124091 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd74012bfb0 0x7fd7400b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.453+0000 7fd745400640 1 --2- 172.21.15.19:0/401124091 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd74015b750 0x7fd74012ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.453+0000 7fd745400640 1 --2- 172.21.15.19:0/401124091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd724003a90 0x7fd7401f7710 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.453+0000 7fd745400640 1 -- 172.21.15.19:0/401124091 >> 172.21.15.19:0/401124091 conn(0x7fd7400b1590 msgr2=0x7fd7400afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:53.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.453+0000 7fd745400640 1 -- 172.21.15.19:0/401124091 shutdown_connections 2024-03-08T06:05:53.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.453+0000 7fd745400640 1 -- 172.21.15.19:0/401124091 wait complete. 2024-03-08T06:05:53.472 INFO:tasks.ceph:Scrubbing osd.4 2024-03-08T06:05:53.473 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-08T06:05:53.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.685+0000 7fd779a00640 1 Processor -- start 2024-03-08T06:05:53.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.686+0000 7fd779a00640 1 -- start start 2024-03-08T06:05:53.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.687+0000 7fd779a00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd7740d10c0 0x7fd7740ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.687+0000 7fd779a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd7740d3030 0x7fd7740d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.687+0000 7fd779a00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7740d0cd0 con 0x7fd774161460 2024-03-08T06:05:53.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.687+0000 7fd779a00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7740d2270 con 0x7fd7740d3030 2024-03-08T06:05:53.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.687+0000 7fd779a00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7740d2550 con 0x7fd7740d10c0 2024-03-08T06:05:53.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.688+0000 7fd779000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd7740d3030 0x7fd7740d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.688+0000 7fd779000640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd7740d3030 0x7fd7740d34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40738/0 (socket says 172.21.15.19:40738) 2024-03-08T06:05:53.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.688+0000 7fd779000640 1 -- 172.21.15.19:0/1089442215 learned_addr learned my addr 172.21.15.19:0/1089442215 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:53.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.688+0000 7fd773400640 1 --2- 172.21.15.19:0/1089442215 >> v2:172.21.15.42:3300/0 conn(0x7fd7740d10c0 0x7fd7740ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.688+0000 7fd779000640 1 -- 172.21.15.19:0/1089442215 >> v2:172.21.15.42:3300/0 conn(0x7fd7740d10c0 msgr2=0x7fd7740ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:53.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.688+0000 7fd779000640 1 --2- 172.21.15.19:0/1089442215 >> v2:172.21.15.42:3300/0 conn(0x7fd7740d10c0 0x7fd7740ceb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.688+0000 7fd779000640 1 -- 172.21.15.19:0/1089442215 >> v1:172.21.15.42:6789/0 conn(0x7fd774161460 legacy=0x7fd7740b6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:53.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.688+0000 7fd779000640 1 -- 172.21.15.19:0/1089442215 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7740d2830 con 0x7fd7740d3030 2024-03-08T06:05:53.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.689+0000 7fd779000640 1 --2- 172.21.15.19:0/1089442215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7740d3030 0x7fd7740d34c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd7740d0ae0 tx=0x7fd76c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850ee08d133763c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:53.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.690+0000 7fd772a00640 1 -- 172.21.15.19:0/1089442215 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c02ca80 con 0x7fd7740d3030 2024-03-08T06:05:53.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.690+0000 7fd772a00640 1 -- 172.21.15.19:0/1089442215 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c02cc20 con 0x7fd7740d3030 2024-03-08T06:05:53.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.690+0000 7fd772a00640 1 -- 172.21.15.19:0/1089442215 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c0343f0 con 0x7fd7740d3030 2024-03-08T06:05:53.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.690+0000 7fd779a00640 1 -- 172.21.15.19:0/1089442215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7740d3030 msgr2=0x7fd7740d34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:53.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.690+0000 7fd779a00640 1 --2- 172.21.15.19:0/1089442215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7740d3030 0x7fd7740d34c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd7740d0ae0 tx=0x7fd76c02bee0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.691+0000 7fd779a00640 1 -- 172.21.15.19:0/1089442215 shutdown_connections 2024-03-08T06:05:53.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.691+0000 7fd779a00640 1 --2- 172.21.15.19:0/1089442215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7740d3030 0x7fd7740d34c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.691+0000 7fd779a00640 1 --2- 172.21.15.19:0/1089442215 >> v2:172.21.15.42:3300/0 conn(0x7fd7740d10c0 0x7fd7740ceb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.691+0000 7fd779a00640 1 -- 172.21.15.19:0/1089442215 >> 172.21.15.19:0/1089442215 conn(0x7fd77406c7b0 msgr2=0x7fd77406cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:53.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.691+0000 7fd779a00640 1 -- 172.21.15.19:0/1089442215 shutdown_connections 2024-03-08T06:05:53.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.691+0000 7fd779a00640 1 -- 172.21.15.19:0/1089442215 wait complete. 2024-03-08T06:05:53.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.692+0000 7fd779a00640 1 Processor -- start 2024-03-08T06:05:53.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.693+0000 7fd779a00640 1 -- start start 2024-03-08T06:05:53.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.694+0000 7fd779a00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd7740d10c0 0x7fd7740cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.694+0000 7fd779a00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7740d3030 0x7fd7740ae740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.694+0000 7fd779a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd774161460 0x7fd7740aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.694+0000 7fd779a00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd774161840 con 0x7fd774161460 2024-03-08T06:05:53.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.694+0000 7fd779a00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7740cf230 con 0x7fd7740d3030 2024-03-08T06:05:53.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.694+0000 7fd779a00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7740b73a0 con 0x7fd7740d10c0 2024-03-08T06:05:53.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.694+0000 7fd779000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd774161460 0x7fd7740aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.694+0000 7fd779000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd774161460 0x7fd7740aec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40752/0 (socket says 172.21.15.19:40752) 2024-03-08T06:05:53.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.694+0000 7fd779000640 1 -- 172.21.15.19:0/787557460 learned_addr learned my addr 172.21.15.19:0/787557460 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:53.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.694+0000 7fd773400640 1 --2- 172.21.15.19:0/787557460 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7740d3030 0x7fd7740ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.694+0000 7fd773e00640 1 --2- 172.21.15.19:0/787557460 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd7740d10c0 0x7fd7740cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.694+0000 7fd779000640 1 -- 172.21.15.19:0/787557460 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd7740d10c0 msgr2=0x7fd7740cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:53.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.694+0000 7fd779000640 1 --2- 172.21.15.19:0/787557460 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fd7740d10c0 0x7fd7740cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.695+0000 7fd779000640 1 -- 172.21.15.19:0/787557460 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7740d3030 msgr2=0x7fd7740ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:53.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.695+0000 7fd779000640 1 --2- 172.21.15.19:0/787557460 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd7740d3030 0x7fd7740ae740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.695+0000 7fd779000640 1 -- 172.21.15.19:0/787557460 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77414f9d0 con 0x7fd774161460 2024-03-08T06:05:53.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.695+0000 7fd779000640 1 --2- 172.21.15.19:0/787557460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd774161460 0x7fd7740aec80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd76c02c4f0 tx=0x7fd76c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:53.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.695+0000 7fd76be00640 1 -- 172.21.15.19:0/787557460 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c043020 con 0x7fd774161460 2024-03-08T06:05:53.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.695+0000 7fd76be00640 1 -- 172.21.15.19:0/787557460 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c03e450 con 0x7fd774161460 2024-03-08T06:05:53.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.695+0000 7fd76be00640 1 -- 172.21.15.19:0/787557460 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c03e840 con 0x7fd774161460 2024-03-08T06:05:53.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.695+0000 7fd779a00640 1 -- 172.21.15.19:0/787557460 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7740b0a60 con 0x7fd774161460 2024-03-08T06:05:53.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.696+0000 7fd779a00640 1 -- 172.21.15.19:0/787557460 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7740b1020 con 0x7fd774161460 2024-03-08T06:05:53.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.696+0000 7fd779a00640 1 -- 172.21.15.19:0/787557460 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd774075090 con 0x7fd774161460 2024-03-08T06:05:53.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.698+0000 7fd76be00640 1 -- 172.21.15.19:0/787557460 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fd76c046020 con 0x7fd774161460 2024-03-08T06:05:53.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.699+0000 7fd76be00640 1 --2- 172.21.15.19:0/787557460 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd75006b500 0x7fd75006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.699+0000 7fd76be00640 1 -- 172.21.15.19:0/787557460 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd76c0acd10 con 0x7fd774161460 2024-03-08T06:05:53.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.699+0000 7fd76be00640 1 --2- 172.21.15.19:0/787557460 >> [v2:172.21.15.42:6800/1656053258,v1:172.21.15.42:6801/1656053258] conn(0x7fd7500713c0 0x7fd7500737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.699+0000 7fd76be00640 1 -- 172.21.15.19:0/787557460 --> [v2:172.21.15.42:6800/1656053258,v1:172.21.15.42:6801/1656053258] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd750073e90 con 0x7fd7500713c0 2024-03-08T06:05:53.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.699+0000 7fd773e00640 1 --2- 172.21.15.19:0/787557460 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd75006b500 0x7fd75006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.699+0000 7fd76be00640 1 -- 172.21.15.19:0/787557460 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd76c0ad0c0 con 0x7fd774161460 2024-03-08T06:05:53.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.700+0000 7fd773400640 1 --2- 172.21.15.19:0/787557460 >> [v2:172.21.15.42:6800/1656053258,v1:172.21.15.42:6801/1656053258] conn(0x7fd7500713c0 0x7fd7500737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.700+0000 7fd773e00640 1 --2- 172.21.15.19:0/787557460 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd75006b500 0x7fd75006d9c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd764003d90 tx=0x7fd764009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:53.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.700+0000 7fd773400640 1 --2- 172.21.15.19:0/787557460 >> [v2:172.21.15.42:6800/1656053258,v1:172.21.15.42:6801/1656053258] conn(0x7fd7500713c0 0x7fd7500737e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:53.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.703+0000 7fd76be00640 1 -- 172.21.15.19:0/787557460 <== osd.4 v2:172.21.15.42:6800/1656053258 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd750073e90 con 0x7fd7500713c0 2024-03-08T06:05:53.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.717+0000 7fd779a00640 1 -- 172.21.15.19:0/787557460 --> [v2:172.21.15.42:6800/1656053258,v1:172.21.15.42:6801/1656053258] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd7740b6250 con 0x7fd7500713c0 2024-03-08T06:05:53.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.718+0000 7fd76be00640 1 -- 172.21.15.19:0/787557460 <== osd.4 v2:172.21.15.42:6800/1656053258 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd7740b6250 con 0x7fd7500713c0 2024-03-08T06:05:53.719 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-08T06:05:53.719 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T06:05:53.719 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-08T06:05:53.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.719+0000 7fd779a00640 1 -- 172.21.15.19:0/787557460 >> [v2:172.21.15.42:6800/1656053258,v1:172.21.15.42:6801/1656053258] conn(0x7fd7500713c0 msgr2=0x7fd7500737e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:53.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.719+0000 7fd779a00640 1 --2- 172.21.15.19:0/787557460 >> [v2:172.21.15.42:6800/1656053258,v1:172.21.15.42:6801/1656053258] conn(0x7fd7500713c0 0x7fd7500737e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.719+0000 7fd779a00640 1 -- 172.21.15.19:0/787557460 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd75006b500 msgr2=0x7fd75006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:53.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.719+0000 7fd779a00640 1 --2- 172.21.15.19:0/787557460 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fd75006b500 0x7fd75006d9c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd764003d90 tx=0x7fd764009040 comp rx=0 tx=0).stop 2024-03-08T06:05:53.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.719+0000 7fd779a00640 1 -- 172.21.15.19:0/787557460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd774161460 msgr2=0x7fd7740aec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:53.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.719+0000 7fd779a00640 1 --2- 172.21.15.19:0/787557460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd774161460 0x7fd7740aec80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd76c02c4f0 tx=0x7fd76c004a40 comp rx=0 tx=0).stop 2024-03-08T06:05:53.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.719+0000 7fd779000640 1 -- 172.21.15.19:0/787557460 reap_dead start 2024-03-08T06:05:53.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.720+0000 7fd779a00640 1 -- 172.21.15.19:0/787557460 shutdown_connections 2024-03-08T06:05:53.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.720+0000 7fd779a00640 1 -- 172.21.15.19:0/787557460 >> 172.21.15.19:0/787557460 conn(0x7fd77406c7b0 msgr2=0x7fd774160580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:53.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.720+0000 7fd779a00640 1 -- 172.21.15.19:0/787557460 shutdown_connections 2024-03-08T06:05:53.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.720+0000 7fd779a00640 1 -- 172.21.15.19:0/787557460 wait complete. 2024-03-08T06:05:53.736 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-08T06:05:53.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.952+0000 7f5d46800640 1 Processor -- start 2024-03-08T06:05:53.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.952+0000 7f5d46800640 1 -- start start 2024-03-08T06:05:53.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.953+0000 7f5d46800640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5d40071ee0 0x7f5d400cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.953+0000 7f5d46800640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d400cc690 con 0x7f5d40145250 2024-03-08T06:05:53.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.953+0000 7f5d46800640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d400cc970 con 0x7f5d400cd730 2024-03-08T06:05:53.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.953+0000 7f5d46800640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d400ccc50 con 0x7f5d40071ee0 2024-03-08T06:05:53.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.954+0000 7f5d3f400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5d40145250 0x7f5d4006eed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33428/0 (socket says 172.21.15.19:33428) 2024-03-08T06:05:53.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.954+0000 7f5d3f400640 1 -- 172.21.15.19:0/3605427421 learned_addr learned my addr 172.21.15.19:0/3605427421 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:53.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.954+0000 7f5d3fe00640 1 --2- 172.21.15.19:0/3605427421 >> v2:172.21.15.42:3300/0 conn(0x7f5d40071ee0 0x7f5d400cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.955+0000 7f5d3e000640 1 -- 172.21.15.19:0/3605427421 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602077621 0 0) 0x7f5d400cc690 con 0x7f5d40145250 2024-03-08T06:05:53.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.955+0000 7f5d3e000640 1 -- 172.21.15.19:0/3605427421 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d24003520 con 0x7f5d40145250 2024-03-08T06:05:53.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.955+0000 7f5d3e000640 1 -- 172.21.15.19:0/3605427421 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2595198871 0 0) 0x7f5d24003520 con 0x7f5d40145250 2024-03-08T06:05:53.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.955+0000 7f5d3e000640 1 -- 172.21.15.19:0/3605427421 >> v2:172.21.15.42:3300/0 conn(0x7f5d40071ee0 msgr2=0x7f5d400cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:53.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.955+0000 7f5d3e000640 1 --2- 172.21.15.19:0/3605427421 >> v2:172.21.15.42:3300/0 conn(0x7f5d40071ee0 0x7f5d400cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.955+0000 7f5d3e000640 1 -- 172.21.15.19:0/3605427421 >> v1:172.21.15.42:6789/0 conn(0x7f5d400cd730 legacy=0x7f5d400717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:53.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.955+0000 7f5d3e000640 1 -- 172.21.15.19:0/3605427421 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d400ccf30 con 0x7f5d40145250 2024-03-08T06:05:53.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.955+0000 7f5d3e000640 1 -- 172.21.15.19:0/3605427421 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f5d300019f0 con 0x7f5d40145250 2024-03-08T06:05:53.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.955+0000 7f5d3e000640 1 -- 172.21.15.19:0/3605427421 >> v1:172.21.15.19:6789/0 conn(0x7f5d40145250 legacy=0x7f5d4006eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:53.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.955+0000 7f5d3e000640 1 --2- 172.21.15.19:0/3605427421 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5d24003a00 0x7f5d24003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.955+0000 7f5d3e000640 1 --2- 172.21.15.19:0/3605427421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d24004800 0x7f5d24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.955+0000 7f5d3e000640 1 --2- 172.21.15.19:0/3605427421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d240051c0 0x7f5d2400fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.955+0000 7f5d3e000640 1 -- 172.21.15.19:0/3605427421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d400ccc50 con 0x7f5d24004800 2024-03-08T06:05:53.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.955+0000 7f5d3e000640 1 -- 172.21.15.19:0/3605427421 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d240104d0 con 0x7f5d240051c0 2024-03-08T06:05:53.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.955+0000 7f5d3e000640 1 -- 172.21.15.19:0/3605427421 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d240106d0 con 0x7f5d24003a00 2024-03-08T06:05:53.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.956+0000 7f5d3ea00640 1 --2- 172.21.15.19:0/3605427421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d24004800 0x7f5d24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.956+0000 7f5d3f400640 1 --2- 172.21.15.19:0/3605427421 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5d24003a00 0x7f5d24003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.956+0000 7f5d3fe00640 1 --2- 172.21.15.19:0/3605427421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d240051c0 0x7f5d2400fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.956+0000 7f5d3ea00640 1 -- 172.21.15.19:0/3605427421 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5d24003a00 msgr2=0x7f5d24003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:53.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.956+0000 7f5d3ea00640 1 --2- 172.21.15.19:0/3605427421 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5d24003a00 0x7f5d24003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.956+0000 7f5d3ea00640 1 -- 172.21.15.19:0/3605427421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d240051c0 msgr2=0x7f5d2400fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:53.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.956+0000 7f5d3ea00640 1 --2- 172.21.15.19:0/3605427421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d240051c0 0x7f5d2400fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.956+0000 7f5d3ea00640 1 -- 172.21.15.19:0/3605427421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d24003520 con 0x7f5d24004800 2024-03-08T06:05:53.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.956+0000 7f5d3fe00640 1 --2- 172.21.15.19:0/3605427421 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d240051c0 0x7f5d2400fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:53.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.956+0000 7f5d3fe00640 1 -- 172.21.15.19:0/3605427421 reap_dead start 2024-03-08T06:05:53.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.957+0000 7f5d3ea00640 1 --2- 172.21.15.19:0/3605427421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d24004800 0x7f5d24004c80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c001720 tx=0x7f5d24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3e3bb40c8d6efc server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:53.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.957+0000 7f5d3e000640 1 -- 172.21.15.19:0/3605427421 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c001370 con 0x7f5d24004800 2024-03-08T06:05:53.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.958+0000 7f5d3e000640 1 -- 172.21.15.19:0/3605427421 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2c0052d0 con 0x7f5d24004800 2024-03-08T06:05:53.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.958+0000 7f5d3e000640 1 -- 172.21.15.19:0/3605427421 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c003830 con 0x7f5d24004800 2024-03-08T06:05:53.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.958+0000 7f5d46800640 1 -- 172.21.15.19:0/3605427421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d24004800 msgr2=0x7f5d24004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:53.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.958+0000 7f5d46800640 1 --2- 172.21.15.19:0/3605427421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d24004800 0x7f5d24004c80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c001720 tx=0x7f5d24005830 comp rx=0 tx=0).stop 2024-03-08T06:05:53.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.958+0000 7f5d46800640 1 -- 172.21.15.19:0/3605427421 shutdown_connections 2024-03-08T06:05:53.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.958+0000 7f5d46800640 1 --2- 172.21.15.19:0/3605427421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d24004800 0x7f5d24004c80 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.958+0000 7f5d46800640 1 -- 172.21.15.19:0/3605427421 >> 172.21.15.19:0/3605427421 conn(0x7f5d4006ae30 msgr2=0x7f5d4006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:53.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.958+0000 7f5d46800640 1 -- 172.21.15.19:0/3605427421 shutdown_connections 2024-03-08T06:05:53.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.959+0000 7f5d46800640 1 -- 172.21.15.19:0/3605427421 wait complete. 2024-03-08T06:05:53.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.960+0000 7f5d46800640 1 Processor -- start 2024-03-08T06:05:53.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.961+0000 7f5d46800640 1 -- start start 2024-03-08T06:05:53.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.961+0000 7f5d46800640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d24004800 0x7f5d4015a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.961+0000 7f5d46800640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5d40154bd0 0x7f5d40141510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.961+0000 7f5d46800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d401561c0 0x7f5d40156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.961+0000 7f5d46800640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d401457b0 con 0x7f5d401561c0 2024-03-08T06:05:53.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.962+0000 7f5d46800640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d40145630 con 0x7f5d24004800 2024-03-08T06:05:53.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.962+0000 7f5d46800640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d400cc0b0 con 0x7f5d40154bd0 2024-03-08T06:05:53.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.962+0000 7f5d3fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d401561c0 0x7f5d40156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.962+0000 7f5d3fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d401561c0 0x7f5d40156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40772/0 (socket says 172.21.15.19:40772) 2024-03-08T06:05:53.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.962+0000 7f5d3fe00640 1 -- 172.21.15.19:0/3878946998 learned_addr learned my addr 172.21.15.19:0/3878946998 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:53.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.962+0000 7f5d3ea00640 1 --2- 172.21.15.19:0/3878946998 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5d40154bd0 0x7f5d40141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.962+0000 7f5d3f400640 1 --2- 172.21.15.19:0/3878946998 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d24004800 0x7f5d4015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.962+0000 7f5d3fe00640 1 -- 172.21.15.19:0/3878946998 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5d40154bd0 msgr2=0x7f5d40141510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:53.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.962+0000 7f5d3fe00640 1 --2- 172.21.15.19:0/3878946998 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5d40154bd0 0x7f5d40141510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.962+0000 7f5d3fe00640 1 -- 172.21.15.19:0/3878946998 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d24004800 msgr2=0x7f5d4015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:53.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.962+0000 7f5d3fe00640 1 --2- 172.21.15.19:0/3878946998 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d24004800 0x7f5d4015a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:53.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.962+0000 7f5d3fe00640 1 -- 172.21.15.19:0/3878946998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d40155140 con 0x7f5d401561c0 2024-03-08T06:05:53.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.963+0000 7f5d3fe00640 1 --2- 172.21.15.19:0/3878946998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d401561c0 0x7f5d40156650 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5d400a8720 tx=0x7f5d38010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:53.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.963+0000 7f5d37400640 1 -- 172.21.15.19:0/3878946998 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3800f040 con 0x7f5d401561c0 2024-03-08T06:05:53.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.963+0000 7f5d37400640 1 -- 172.21.15.19:0/3878946998 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3801b070 con 0x7f5d401561c0 2024-03-08T06:05:53.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.963+0000 7f5d37400640 1 -- 172.21.15.19:0/3878946998 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38004430 con 0x7f5d401561c0 2024-03-08T06:05:53.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.963+0000 7f5d46800640 1 -- 172.21.15.19:0/3878946998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d40155420 con 0x7f5d401561c0 2024-03-08T06:05:53.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.963+0000 7f5d46800640 1 -- 172.21.15.19:0/3878946998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d401559e0 con 0x7f5d401561c0 2024-03-08T06:05:53.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.964+0000 7f5d46800640 1 -- 172.21.15.19:0/3878946998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d40067cb0 con 0x7f5d401561c0 2024-03-08T06:05:53.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.965+0000 7f5d37400640 1 -- 172.21.15.19:0/3878946998 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f5d38003610 con 0x7f5d401561c0 2024-03-08T06:05:53.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.966+0000 7f5d37400640 1 --2- 172.21.15.19:0/3878946998 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5d2006b4d0 0x7f5d2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:53.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.966+0000 7f5d37400640 1 -- 172.21.15.19:0/3878946998 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5d38089ea0 con 0x7f5d401561c0 2024-03-08T06:05:53.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.966+0000 7f5d3f400640 1 --2- 172.21.15.19:0/3878946998 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5d2006b4d0 0x7f5d2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:53.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.967+0000 7f5d3f400640 1 --2- 172.21.15.19:0/3878946998 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5d2006b4d0 0x7f5d2006d990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5d300013d0 tx=0x7f5d30001ee0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:53.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:53.971+0000 7f5d37400640 1 -- 172.21.15.19:0/3878946998 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5d38058f80 con 0x7f5d401561c0 2024-03-08T06:05:54.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.170+0000 7f5d46800640 1 -- 172.21.15.19:0/3878946998 --> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d40143b30 con 0x7f5d2006b4d0 2024-03-08T06:05:54.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.171+0000 7f5d37400640 1 -- 172.21.15.19:0/3878946998 <== mgr.4107 v2:172.21.15.19:6832/3589745192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5d40143b30 con 0x7f5d2006b4d0 2024-03-08T06:05:54.171 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 4 to deep-scrub 2024-03-08T06:05:54.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.174+0000 7f5d46800640 1 -- 172.21.15.19:0/3878946998 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5d2006b4d0 msgr2=0x7f5d2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:54.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.174+0000 7f5d46800640 1 --2- 172.21.15.19:0/3878946998 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5d2006b4d0 0x7f5d2006d990 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5d300013d0 tx=0x7f5d30001ee0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.174+0000 7f5d46800640 1 -- 172.21.15.19:0/3878946998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d401561c0 msgr2=0x7f5d40156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.174+0000 7f5d46800640 1 --2- 172.21.15.19:0/3878946998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d401561c0 0x7f5d40156650 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5d400a8720 tx=0x7f5d38010c20 comp rx=0 tx=0).stop 2024-03-08T06:05:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.174+0000 7f5d46800640 1 -- 172.21.15.19:0/3878946998 shutdown_connections 2024-03-08T06:05:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.174+0000 7f5d46800640 1 --2- 172.21.15.19:0/3878946998 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f5d2006b4d0 0x7f5d2006d990 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.174+0000 7f5d46800640 1 --2- 172.21.15.19:0/3878946998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d401561c0 0x7f5d40156650 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.174+0000 7f5d46800640 1 --2- 172.21.15.19:0/3878946998 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f5d40154bd0 0x7f5d40141510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.174+0000 7f5d46800640 1 --2- 172.21.15.19:0/3878946998 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d24004800 0x7f5d4015a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.174+0000 7f5d46800640 1 -- 172.21.15.19:0/3878946998 >> 172.21.15.19:0/3878946998 conn(0x7f5d4006ae30 msgr2=0x7f5d40142650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.174+0000 7f5d46800640 1 -- 172.21.15.19:0/3878946998 shutdown_connections 2024-03-08T06:05:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.174+0000 7f5d46800640 1 -- 172.21.15.19:0/3878946998 wait complete. 2024-03-08T06:05:54.193 INFO:tasks.ceph:Scrubbing osd.5 2024-03-08T06:05:54.194 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-08T06:05:54.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.421+0000 7fa6c6c00640 1 Processor -- start 2024-03-08T06:05:54.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.421+0000 7fa6c6c00640 1 -- start start 2024-03-08T06:05:54.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.423+0000 7fa6c6c00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa6c01455b0 0x7fa6c015c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:54.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.423+0000 7fa6c6c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa6c01604f0 0x7fa6c00cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:54.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.423+0000 7fa6c6c00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c00cd5a0 con 0x7fa6c0071950 2024-03-08T06:05:54.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.423+0000 7fa6c6c00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c00cdc20 con 0x7fa6c01455b0 2024-03-08T06:05:54.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.423+0000 7fa6c6c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c00ccfe0 con 0x7fa6c01604f0 2024-03-08T06:05:54.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.423+0000 7fa6bfe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa6c01455b0 0x7fa6c015c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:54.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.423+0000 7fa6bfe00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa6c01455b0 0x7fa6c015c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40778/0 (socket says 172.21.15.19:40778) 2024-03-08T06:05:54.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.423+0000 7fa6bfe00640 1 -- 172.21.15.19:0/1650456700 learned_addr learned my addr 172.21.15.19:0/1650456700 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:54.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.423+0000 7fa6bf400640 1 --2- 172.21.15.19:0/1650456700 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa6c01604f0 0x7fa6c00cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:54.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.423+0000 7fa6bfe00640 1 -- 172.21.15.19:0/1650456700 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa6c01604f0 msgr2=0x7fa6c00cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:54.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.424+0000 7fa6bfe00640 1 --2- 172.21.15.19:0/1650456700 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa6c01604f0 0x7fa6c00cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.424+0000 7fa6bfe00640 1 -- 172.21.15.19:0/1650456700 >> v1:172.21.15.42:6789/0 conn(0x7fa6c0071950 legacy=0x7fa6c00ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:54.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.424+0000 7fa6bfe00640 1 -- 172.21.15.19:0/1650456700 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c00cd2c0 con 0x7fa6c01455b0 2024-03-08T06:05:54.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.425+0000 7fa6bfe00640 1 --2- 172.21.15.19:0/1650456700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6c01455b0 0x7fa6c015c1d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00cdda0 tx=0x7fa6b002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2cdfb4b97261184 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:54.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.425+0000 7fa6bea00640 1 -- 172.21.15.19:0/1650456700 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0035020 con 0x7fa6c01455b0 2024-03-08T06:05:54.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.425+0000 7fa6bea00640 1 -- 172.21.15.19:0/1650456700 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b0031640 con 0x7fa6c01455b0 2024-03-08T06:05:54.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.425+0000 7fa6bea00640 1 -- 172.21.15.19:0/1650456700 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b002d040 con 0x7fa6c01455b0 2024-03-08T06:05:54.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.426+0000 7fa6c6c00640 1 -- 172.21.15.19:0/1650456700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6c01455b0 msgr2=0x7fa6c015c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:54.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.426+0000 7fa6c6c00640 1 --2- 172.21.15.19:0/1650456700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6c01455b0 0x7fa6c015c1d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00cdda0 tx=0x7fa6b002b8f0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.426+0000 7fa6c6c00640 1 -- 172.21.15.19:0/1650456700 shutdown_connections 2024-03-08T06:05:54.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.426+0000 7fa6c6c00640 1 --2- 172.21.15.19:0/1650456700 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa6c01604f0 0x7fa6c00cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.426+0000 7fa6c6c00640 1 --2- 172.21.15.19:0/1650456700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6c01455b0 0x7fa6c015c1d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.426+0000 7fa6c6c00640 1 -- 172.21.15.19:0/1650456700 >> 172.21.15.19:0/1650456700 conn(0x7fa6c006ae30 msgr2=0x7fa6c006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:54.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.426+0000 7fa6c6c00640 1 -- 172.21.15.19:0/1650456700 shutdown_connections 2024-03-08T06:05:54.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.426+0000 7fa6c6c00640 1 -- 172.21.15.19:0/1650456700 wait complete. 2024-03-08T06:05:54.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.428+0000 7fa6c6c00640 1 Processor -- start 2024-03-08T06:05:54.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.428+0000 7fa6c6c00640 1 -- start start 2024-03-08T06:05:54.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.429+0000 7fa6c6c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa6c0071950 0x7fa6c013b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:54.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.429+0000 7fa6c6c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6c01455b0 0x7fa6c015b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:54.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.429+0000 7fa6c6c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6c01604f0 0x7fa6c013c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:54.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.429+0000 7fa6c6c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c0145990 con 0x7fa6c01455b0 2024-03-08T06:05:54.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.429+0000 7fa6c6c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c015c710 con 0x7fa6c01604f0 2024-03-08T06:05:54.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.429+0000 7fa6c6c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c00ccbd0 con 0x7fa6c0071950 2024-03-08T06:05:54.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.429+0000 7fa6bf400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6c01455b0 0x7fa6c015b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:54.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.429+0000 7fa6bf400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6c01455b0 0x7fa6c015b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40780/0 (socket says 172.21.15.19:40780) 2024-03-08T06:05:54.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.429+0000 7fa6bf400640 1 -- 172.21.15.19:0/1609715333 learned_addr learned my addr 172.21.15.19:0/1609715333 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:54.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.429+0000 7fa6bfe00640 1 --2- 172.21.15.19:0/1609715333 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa6c0071950 0x7fa6c013b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:54.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.429+0000 7fa6c4c00640 1 --2- 172.21.15.19:0/1609715333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6c01604f0 0x7fa6c013c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:54.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.430+0000 7fa6bf400640 1 -- 172.21.15.19:0/1609715333 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa6c0071950 msgr2=0x7fa6c013b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:54.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.430+0000 7fa6bf400640 1 --2- 172.21.15.19:0/1609715333 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa6c0071950 0x7fa6c013b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.430+0000 7fa6bf400640 1 -- 172.21.15.19:0/1609715333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6c01604f0 msgr2=0x7fa6c013c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:54.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.430+0000 7fa6bf400640 1 --2- 172.21.15.19:0/1609715333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6c01604f0 0x7fa6c013c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.430+0000 7fa6bf400640 1 -- 172.21.15.19:0/1609715333 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c013d280 con 0x7fa6c01455b0 2024-03-08T06:05:54.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.430+0000 7fa6c4c00640 1 --2- 172.21.15.19:0/1609715333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6c01604f0 0x7fa6c013c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:54.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.430+0000 7fa6bf400640 1 --2- 172.21.15.19:0/1609715333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6c01455b0 0x7fa6c015b6e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac00c7c0 tx=0x7fa6ac00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.430+0000 7fa6b7e00640 1 -- 172.21.15.19:0/1609715333 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac015070 con 0x7fa6c01455b0 2024-03-08T06:05:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.430+0000 7fa6b7e00640 1 -- 172.21.15.19:0/1609715333 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ac007820 con 0x7fa6c01455b0 2024-03-08T06:05:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.430+0000 7fa6c6c00640 1 -- 172.21.15.19:0/1609715333 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c013d560 con 0x7fa6c01455b0 2024-03-08T06:05:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.430+0000 7fa6b7e00640 1 -- 172.21.15.19:0/1609715333 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac007bd0 con 0x7fa6c01455b0 2024-03-08T06:05:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.430+0000 7fa6c6c00640 1 -- 172.21.15.19:0/1609715333 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c00b32e0 con 0x7fa6c01455b0 2024-03-08T06:05:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.431+0000 7fa6c6c00640 1 -- 172.21.15.19:0/1609715333 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa6c00af770 con 0x7fa6c01455b0 2024-03-08T06:05:54.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.433+0000 7fa6b7e00640 1 -- 172.21.15.19:0/1609715333 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa6ac018070 con 0x7fa6c01455b0 2024-03-08T06:05:54.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.433+0000 7fa6b7e00640 1 --2- 172.21.15.19:0/1609715333 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa6a006b4d0 0x7fa6a006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:54.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.434+0000 7fa6b7e00640 1 -- 172.21.15.19:0/1609715333 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa6ac089aa0 con 0x7fa6c01455b0 2024-03-08T06:05:54.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.434+0000 7fa6bfe00640 1 --2- 172.21.15.19:0/1609715333 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa6a006b4d0 0x7fa6a006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:54.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.434+0000 7fa6b7e00640 1 --2- 172.21.15.19:0/1609715333 >> [v2:172.21.15.42:6816/1354526460,v1:172.21.15.42:6817/1354526460] conn(0x7fa6a0071390 0x7fa6a00737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:54.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.434+0000 7fa6b7e00640 1 -- 172.21.15.19:0/1609715333 --> [v2:172.21.15.42:6816/1354526460,v1:172.21.15.42:6817/1354526460] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6a0073e60 con 0x7fa6a0071390 2024-03-08T06:05:54.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.434+0000 7fa6b7e00640 1 -- 172.21.15.19:0/1609715333 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6ac08e2a0 con 0x7fa6c01455b0 2024-03-08T06:05:54.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.434+0000 7fa6bfe00640 1 --2- 172.21.15.19:0/1609715333 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa6a006b4d0 0x7fa6a006d990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0036000 tx=0x7fa6b003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:54.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.434+0000 7fa6c4c00640 1 --2- 172.21.15.19:0/1609715333 >> [v2:172.21.15.42:6816/1354526460,v1:172.21.15.42:6817/1354526460] conn(0x7fa6a0071390 0x7fa6a00737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:54.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.435+0000 7fa6c4c00640 1 --2- 172.21.15.19:0/1609715333 >> [v2:172.21.15.42:6816/1354526460,v1:172.21.15.42:6817/1354526460] conn(0x7fa6a0071390 0x7fa6a00737b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:54.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.438+0000 7fa6b7e00640 1 -- 172.21.15.19:0/1609715333 <== osd.5 v2:172.21.15.42:6816/1354526460 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa6a0073e60 con 0x7fa6a0071390 2024-03-08T06:05:54.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.452+0000 7fa6c6c00640 1 -- 172.21.15.19:0/1609715333 --> [v2:172.21.15.42:6816/1354526460,v1:172.21.15.42:6817/1354526460] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa6c0067cb0 con 0x7fa6a0071390 2024-03-08T06:05:54.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.453+0000 7fa6b7e00640 1 -- 172.21.15.19:0/1609715333 <== osd.5 v2:172.21.15.42:6816/1354526460 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa6c0067cb0 con 0x7fa6a0071390 2024-03-08T06:05:54.454 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-08T06:05:54.454 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T06:05:54.454 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-08T06:05:54.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.454+0000 7fa6c6c00640 1 -- 172.21.15.19:0/1609715333 >> [v2:172.21.15.42:6816/1354526460,v1:172.21.15.42:6817/1354526460] conn(0x7fa6a0071390 msgr2=0x7fa6a00737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:54.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.454+0000 7fa6c6c00640 1 --2- 172.21.15.19:0/1609715333 >> [v2:172.21.15.42:6816/1354526460,v1:172.21.15.42:6817/1354526460] conn(0x7fa6a0071390 0x7fa6a00737b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.454+0000 7fa6c6c00640 1 -- 172.21.15.19:0/1609715333 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa6a006b4d0 msgr2=0x7fa6a006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:54.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.454+0000 7fa6c6c00640 1 --2- 172.21.15.19:0/1609715333 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa6a006b4d0 0x7fa6a006d990 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0036000 tx=0x7fa6b003c040 comp rx=0 tx=0).stop 2024-03-08T06:05:54.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.454+0000 7fa6c6c00640 1 -- 172.21.15.19:0/1609715333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6c01455b0 msgr2=0x7fa6c015b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:54.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.454+0000 7fa6c6c00640 1 --2- 172.21.15.19:0/1609715333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6c01455b0 0x7fa6c015b6e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac00c7c0 tx=0x7fa6ac00cc80 comp rx=0 tx=0).stop 2024-03-08T06:05:54.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.454+0000 7fa6c4c00640 1 -- 172.21.15.19:0/1609715333 reap_dead start 2024-03-08T06:05:54.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.454+0000 7fa6c6c00640 1 -- 172.21.15.19:0/1609715333 shutdown_connections 2024-03-08T06:05:54.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.454+0000 7fa6c6c00640 1 -- 172.21.15.19:0/1609715333 >> 172.21.15.19:0/1609715333 conn(0x7fa6c006ae30 msgr2=0x7fa6c006b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:54.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.455+0000 7fa6c6c00640 1 -- 172.21.15.19:0/1609715333 shutdown_connections 2024-03-08T06:05:54.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.455+0000 7fa6c6c00640 1 -- 172.21.15.19:0/1609715333 wait complete. 2024-03-08T06:05:54.473 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-08T06:05:54.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.694+0000 7f3e20c00640 1 Processor -- start 2024-03-08T06:05:54.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.694+0000 7f3e20c00640 1 -- start start 2024-03-08T06:05:54.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.696+0000 7f3e20c00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3e1c0717d0 0x7f3e1c071c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:54.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.696+0000 7f3e20c00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e1c0b4c80 con 0x7f3e1c0b46a0 2024-03-08T06:05:54.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.696+0000 7f3e20c00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e1c0ae280 con 0x7f3e1c1444f0 2024-03-08T06:05:54.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.696+0000 7f3e20c00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e1c0ae050 con 0x7f3e1c0717d0 2024-03-08T06:05:54.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.696+0000 7f3e19400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3e1c0b46a0 0x7f3e1c0aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33434/0 (socket says 172.21.15.19:33434) 2024-03-08T06:05:54.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.696+0000 7f3e19400640 1 -- 172.21.15.19:0/798787978 learned_addr learned my addr 172.21.15.19:0/798787978 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:54.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.697+0000 7f3e1a800640 1 --2- 172.21.15.19:0/798787978 >> v2:172.21.15.42:3300/0 conn(0x7f3e1c0717d0 0x7f3e1c071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:54.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.697+0000 7f3e18a00640 1 -- 172.21.15.19:0/798787978 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965261207 0 0) 0x7f3e1c0b4c80 con 0x7f3e1c0b46a0 2024-03-08T06:05:54.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.697+0000 7f3e18a00640 1 -- 172.21.15.19:0/798787978 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e00003520 con 0x7f3e1c0b46a0 2024-03-08T06:05:54.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.697+0000 7f3e18a00640 1 -- 172.21.15.19:0/798787978 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3188843670 0 0) 0x7f3e00003520 con 0x7f3e1c0b46a0 2024-03-08T06:05:54.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.697+0000 7f3e18a00640 1 -- 172.21.15.19:0/798787978 >> v2:172.21.15.42:3300/0 conn(0x7f3e1c0717d0 msgr2=0x7f3e1c071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:54.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.697+0000 7f3e18a00640 1 --2- 172.21.15.19:0/798787978 >> v2:172.21.15.42:3300/0 conn(0x7f3e1c0717d0 0x7f3e1c071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.697+0000 7f3e18a00640 1 -- 172.21.15.19:0/798787978 >> v1:172.21.15.42:6789/0 conn(0x7f3e1c1444f0 legacy=0x7f3e1c162300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:54.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.697+0000 7f3e18a00640 1 -- 172.21.15.19:0/798787978 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c0ae560 con 0x7f3e1c0b46a0 2024-03-08T06:05:54.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.697+0000 7f3e18a00640 1 -- 172.21.15.19:0/798787978 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f3e08001670 con 0x7f3e1c0b46a0 2024-03-08T06:05:54.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.698+0000 7f3e18a00640 1 -- 172.21.15.19:0/798787978 >> v1:172.21.15.19:6789/0 conn(0x7f3e1c0b46a0 legacy=0x7f3e1c0aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:54.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.698+0000 7f3e18a00640 1 --2- 172.21.15.19:0/798787978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e000039b0 0x7f3e00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:54.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.698+0000 7f3e18a00640 1 --2- 172.21.15.19:0/798787978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e00004800 0x7f3e00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:54.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.698+0000 7f3e18a00640 1 --2- 172.21.15.19:0/798787978 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3e000051c0 0x7f3e0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:54.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.698+0000 7f3e18a00640 1 -- 172.21.15.19:0/798787978 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0000c030 con 0x7f3e00004800 2024-03-08T06:05:54.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.698+0000 7f3e18a00640 1 -- 172.21.15.19:0/798787978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0000c1e0 con 0x7f3e000039b0 2024-03-08T06:05:54.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.698+0000 7f3e18a00640 1 -- 172.21.15.19:0/798787978 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0000c3e0 con 0x7f3e000051c0 2024-03-08T06:05:54.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.698+0000 7f3e19400640 1 --2- 172.21.15.19:0/798787978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e00004800 0x7f3e00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:54.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.698+0000 7f3e19e00640 1 --2- 172.21.15.19:0/798787978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e000039b0 0x7f3e00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:54.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.698+0000 7f3e1a800640 1 --2- 172.21.15.19:0/798787978 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3e000051c0 0x7f3e0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:54.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.698+0000 7f3e19400640 1 -- 172.21.15.19:0/798787978 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3e000051c0 msgr2=0x7f3e0000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:54.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.698+0000 7f3e19400640 1 --2- 172.21.15.19:0/798787978 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3e000051c0 0x7f3e0000b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.698+0000 7f3e19400640 1 -- 172.21.15.19:0/798787978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e000039b0 msgr2=0x7f3e00003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:54.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.698+0000 7f3e19400640 1 --2- 172.21.15.19:0/798787978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e000039b0 0x7f3e00003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.698+0000 7f3e19400640 1 -- 172.21.15.19:0/798787978 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e00003520 con 0x7f3e00004800 2024-03-08T06:05:54.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.698+0000 7f3e1a800640 1 -- 172.21.15.19:0/798787978 reap_dead start 2024-03-08T06:05:54.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.700+0000 7f3e19400640 1 --2- 172.21.15.19:0/798787978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e00004800 0x7f3e00004c80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3e0800c240 tx=0x7f3e00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e671293c84ee4af server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:54.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.700+0000 7f3e18a00640 1 -- 172.21.15.19:0/798787978 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e08007cf0 con 0x7f3e00004800 2024-03-08T06:05:54.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.700+0000 7f3e18a00640 1 -- 172.21.15.19:0/798787978 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e08030070 con 0x7f3e00004800 2024-03-08T06:05:54.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.700+0000 7f3e18a00640 1 -- 172.21.15.19:0/798787978 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e08005d30 con 0x7f3e00004800 2024-03-08T06:05:54.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.700+0000 7f3e20c00640 1 -- 172.21.15.19:0/798787978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e00004800 msgr2=0x7f3e00004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:54.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.700+0000 7f3e20c00640 1 --2- 172.21.15.19:0/798787978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e00004800 0x7f3e00004c80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3e0800c240 tx=0x7f3e00005830 comp rx=0 tx=0).stop 2024-03-08T06:05:54.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.701+0000 7f3e20c00640 1 -- 172.21.15.19:0/798787978 shutdown_connections 2024-03-08T06:05:54.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.701+0000 7f3e20c00640 1 --2- 172.21.15.19:0/798787978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e00004800 0x7f3e00004c80 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.701+0000 7f3e20c00640 1 -- 172.21.15.19:0/798787978 >> 172.21.15.19:0/798787978 conn(0x7f3e1c06ae30 msgr2=0x7f3e1c06b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:54.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.701+0000 7f3e20c00640 1 -- 172.21.15.19:0/798787978 shutdown_connections 2024-03-08T06:05:54.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.701+0000 7f3e20c00640 1 -- 172.21.15.19:0/798787978 wait complete. 2024-03-08T06:05:54.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.702+0000 7f3e20c00640 1 Processor -- start 2024-03-08T06:05:54.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.702+0000 7f3e20c00640 1 -- start start 2024-03-08T06:05:54.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.703+0000 7f3e20c00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e00004800 0x7f3e1c13dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:54.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.703+0000 7f3e20c00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e1c1e7bd0 0x7f3e1c0ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:54.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.703+0000 7f3e20c00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3e1c15f590 0x7f3e1c15fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:54.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.703+0000 7f3e20c00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c071c00 con 0x7f3e1c1e7bd0 2024-03-08T06:05:54.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.703+0000 7f3e20c00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c0b4f60 con 0x7f3e00004800 2024-03-08T06:05:54.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.703+0000 7f3e20c00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c071d80 con 0x7f3e1c15f590 2024-03-08T06:05:54.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.704+0000 7f3e19400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e1c1e7bd0 0x7f3e1c0ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:54.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.704+0000 7f3e19400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e1c1e7bd0 0x7f3e1c0ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40796/0 (socket says 172.21.15.19:40796) 2024-03-08T06:05:54.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.704+0000 7f3e19400640 1 -- 172.21.15.19:0/4136388285 learned_addr learned my addr 172.21.15.19:0/4136388285 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:54.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.704+0000 7f3e19e00640 1 --2- 172.21.15.19:0/4136388285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e00004800 0x7f3e1c13dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:54.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.704+0000 7f3e19400640 1 -- 172.21.15.19:0/4136388285 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3e1c15f590 msgr2=0x7f3e1c15fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:54.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.704+0000 7f3e19400640 1 --2- 172.21.15.19:0/4136388285 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3e1c15f590 0x7f3e1c15fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.704+0000 7f3e19400640 1 -- 172.21.15.19:0/4136388285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e00004800 msgr2=0x7f3e1c13dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:54.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.704+0000 7f3e19400640 1 --2- 172.21.15.19:0/4136388285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e00004800 0x7f3e1c13dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.704+0000 7f3e19400640 1 -- 172.21.15.19:0/4136388285 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c13e330 con 0x7f3e1c1e7bd0 2024-03-08T06:05:54.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.705+0000 7f3e19400640 1 --2- 172.21.15.19:0/4136388285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e1c1e7bd0 0x7f3e1c0ce1b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3e0800c240 tx=0x7f3e1c0ae450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:54.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.705+0000 7f3e12000640 1 -- 172.21.15.19:0/4136388285 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e08046070 con 0x7f3e1c1e7bd0 2024-03-08T06:05:54.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.705+0000 7f3e12000640 1 -- 172.21.15.19:0/4136388285 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0802c9c0 con 0x7f3e1c1e7bd0 2024-03-08T06:05:54.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.705+0000 7f3e12000640 1 -- 172.21.15.19:0/4136388285 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0802cd90 con 0x7f3e1c1e7bd0 2024-03-08T06:05:54.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.705+0000 7f3e20c00640 1 -- 172.21.15.19:0/4136388285 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e1c13e610 con 0x7f3e1c1e7bd0 2024-03-08T06:05:54.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.705+0000 7f3e20c00640 1 -- 172.21.15.19:0/4136388285 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1c13ebd0 con 0x7f3e1c1e7bd0 2024-03-08T06:05:54.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.706+0000 7f3e20c00640 1 -- 172.21.15.19:0/4136388285 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e1c15ff50 con 0x7f3e1c1e7bd0 2024-03-08T06:05:54.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.708+0000 7f3e12000640 1 -- 172.21.15.19:0/4136388285 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f3e08007070 con 0x7f3e1c1e7bd0 2024-03-08T06:05:54.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.708+0000 7f3e12000640 1 --2- 172.21.15.19:0/4136388285 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3dfc06b500 0x7f3dfc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:54.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.708+0000 7f3e12000640 1 -- 172.21.15.19:0/4136388285 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3e080ab1a0 con 0x7f3e1c1e7bd0 2024-03-08T06:05:54.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.709+0000 7f3e19e00640 1 --2- 172.21.15.19:0/4136388285 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3dfc06b500 0x7f3dfc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:54.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.709+0000 7f3e19e00640 1 --2- 172.21.15.19:0/4136388285 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3dfc06b500 0x7f3dfc06d9c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c000c00 tx=0x7f3e0c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:54.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.713+0000 7f3e12000640 1 -- 172.21.15.19:0/4136388285 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3e0807a1f0 con 0x7f3e1c1e7bd0 2024-03-08T06:05:54.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.912+0000 7f3e20c00640 1 -- 172.21.15.19:0/4136388285 --> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e1c067cb0 con 0x7f3dfc06b500 2024-03-08T06:05:54.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.913+0000 7f3e12000640 1 -- 172.21.15.19:0/4136388285 <== mgr.4107 v2:172.21.15.19:6832/3589745192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3e1c067cb0 con 0x7f3dfc06b500 2024-03-08T06:05:54.913 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 5 to deep-scrub 2024-03-08T06:05:54.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.916+0000 7f3e20c00640 1 -- 172.21.15.19:0/4136388285 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3dfc06b500 msgr2=0x7f3dfc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:54.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.916+0000 7f3e20c00640 1 --2- 172.21.15.19:0/4136388285 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3dfc06b500 0x7f3dfc06d9c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c000c00 tx=0x7f3e0c009040 comp rx=0 tx=0).stop 2024-03-08T06:05:54.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.916+0000 7f3e20c00640 1 -- 172.21.15.19:0/4136388285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e1c1e7bd0 msgr2=0x7f3e1c0ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:54.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.916+0000 7f3e20c00640 1 --2- 172.21.15.19:0/4136388285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e1c1e7bd0 0x7f3e1c0ce1b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3e0800c240 tx=0x7f3e1c0ae450 comp rx=0 tx=0).stop 2024-03-08T06:05:54.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.916+0000 7f3e20c00640 1 -- 172.21.15.19:0/4136388285 shutdown_connections 2024-03-08T06:05:54.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.916+0000 7f3e20c00640 1 --2- 172.21.15.19:0/4136388285 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f3dfc06b500 0x7f3dfc06d9c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.916+0000 7f3e20c00640 1 --2- 172.21.15.19:0/4136388285 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f3e1c15f590 0x7f3e1c15fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.916+0000 7f3e20c00640 1 --2- 172.21.15.19:0/4136388285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e1c1e7bd0 0x7f3e1c0ce1b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.916+0000 7f3e20c00640 1 --2- 172.21.15.19:0/4136388285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e00004800 0x7f3e1c13dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:54.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.916+0000 7f3e20c00640 1 -- 172.21.15.19:0/4136388285 >> 172.21.15.19:0/4136388285 conn(0x7f3e1c06ae30 msgr2=0x7f3e1c15ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:54.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.916+0000 7f3e20c00640 1 -- 172.21.15.19:0/4136388285 shutdown_connections 2024-03-08T06:05:54.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:54.917+0000 7f3e20c00640 1 -- 172.21.15.19:0/4136388285 wait complete. 2024-03-08T06:05:54.935 INFO:tasks.ceph:Scrubbing osd.6 2024-03-08T06:05:54.935 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-08T06:05:55.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.165+0000 7efd7a600640 1 Processor -- start 2024-03-08T06:05:55.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.166+0000 7efd7a600640 1 -- start start 2024-03-08T06:05:55.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.167+0000 7efd7a600640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd740d10c0 0x7efd740ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:55.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.167+0000 7efd7a600640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efd740d3030 0x7efd740d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:55.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.167+0000 7efd7a600640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd740d0cd0 con 0x7efd74161460 2024-03-08T06:05:55.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.167+0000 7efd7a600640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd740d2270 con 0x7efd740d10c0 2024-03-08T06:05:55.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.167+0000 7efd7a600640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd740d2550 con 0x7efd740d3030 2024-03-08T06:05:55.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.168+0000 7efd73e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd740d10c0 0x7efd740ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:55.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.168+0000 7efd79200640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7efd74161460 0x7efd740b6c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33450/0 (socket says 172.21.15.19:33450) 2024-03-08T06:05:55.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.168+0000 7efd73e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd740d10c0 0x7efd740ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40806/0 (socket says 172.21.15.19:40806) 2024-03-08T06:05:55.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.168+0000 7efd79200640 1 -- 172.21.15.19:0/2213458522 learned_addr learned my addr 172.21.15.19:0/2213458522 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:55.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.168+0000 7efd73e00640 1 -- 172.21.15.19:0/2213458522 >> v2:172.21.15.42:3300/0 conn(0x7efd740d3030 msgr2=0x7efd740d34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:55.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.168+0000 7efd79c00640 1 --2- 172.21.15.19:0/2213458522 >> v2:172.21.15.42:3300/0 conn(0x7efd740d3030 0x7efd740d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:55.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.168+0000 7efd73e00640 1 --2- 172.21.15.19:0/2213458522 >> v2:172.21.15.42:3300/0 conn(0x7efd740d3030 0x7efd740d34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.168+0000 7efd73e00640 1 -- 172.21.15.19:0/2213458522 >> v1:172.21.15.19:6789/0 conn(0x7efd74161460 legacy=0x7efd740b6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:55.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.168+0000 7efd73e00640 1 -- 172.21.15.19:0/2213458522 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd740d2830 con 0x7efd740d10c0 2024-03-08T06:05:55.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.168+0000 7efd79c00640 1 --2- 172.21.15.19:0/2213458522 >> v2:172.21.15.42:3300/0 conn(0x7efd740d3030 0x7efd740d34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:55.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.169+0000 7efd73e00640 1 --2- 172.21.15.19:0/2213458522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd740d10c0 0x7efd740ceb30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7efd7406d790 tx=0x7efd6002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aecdfdeff08727 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:55.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.170+0000 7efd73400640 1 -- 172.21.15.19:0/2213458522 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60035020 con 0x7efd740d10c0 2024-03-08T06:05:55.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.170+0000 7efd73400640 1 -- 172.21.15.19:0/2213458522 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd60031830 con 0x7efd740d10c0 2024-03-08T06:05:55.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.170+0000 7efd73400640 1 -- 172.21.15.19:0/2213458522 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd60031c00 con 0x7efd740d10c0 2024-03-08T06:05:55.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.170+0000 7efd7a600640 1 -- 172.21.15.19:0/2213458522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd740d10c0 msgr2=0x7efd740ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:55.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.170+0000 7efd7a600640 1 --2- 172.21.15.19:0/2213458522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd740d10c0 0x7efd740ceb30 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7efd7406d790 tx=0x7efd6002b8d0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.170+0000 7efd7a600640 1 -- 172.21.15.19:0/2213458522 shutdown_connections 2024-03-08T06:05:55.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.170+0000 7efd7a600640 1 --2- 172.21.15.19:0/2213458522 >> v2:172.21.15.42:3300/0 conn(0x7efd740d3030 0x7efd740d34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.170+0000 7efd7a600640 1 --2- 172.21.15.19:0/2213458522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd740d10c0 0x7efd740ceb30 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.170+0000 7efd7a600640 1 -- 172.21.15.19:0/2213458522 >> 172.21.15.19:0/2213458522 conn(0x7efd7406c7b0 msgr2=0x7efd7406cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:55.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.171+0000 7efd7a600640 1 -- 172.21.15.19:0/2213458522 shutdown_connections 2024-03-08T06:05:55.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.171+0000 7efd7a600640 1 -- 172.21.15.19:0/2213458522 wait complete. 2024-03-08T06:05:55.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.172+0000 7efd7a600640 1 Processor -- start 2024-03-08T06:05:55.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.173+0000 7efd7a600640 1 -- start start 2024-03-08T06:05:55.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.174+0000 7efd7a600640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd740d10c0 0x7efd741f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:55.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.174+0000 7efd7a600640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd740d3030 0x7efd74160550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:55.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.174+0000 7efd7a600640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efd74161460 0x7efd740ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:55.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.174+0000 7efd7a600640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd74161840 con 0x7efd740d10c0 2024-03-08T06:05:55.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.174+0000 7efd7a600640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd740cf230 con 0x7efd740d3030 2024-03-08T06:05:55.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.174+0000 7efd7a600640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd740b73a0 con 0x7efd74161460 2024-03-08T06:05:55.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.174+0000 7efd79200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd740d10c0 0x7efd741f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:55.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.174+0000 7efd79200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd740d10c0 0x7efd741f7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40818/0 (socket says 172.21.15.19:40818) 2024-03-08T06:05:55.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.174+0000 7efd79200640 1 -- 172.21.15.19:0/793481256 learned_addr learned my addr 172.21.15.19:0/793481256 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:55.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.174+0000 7efd73e00640 1 --2- 172.21.15.19:0/793481256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd740d3030 0x7efd74160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:55.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.174+0000 7efd79200640 1 -- 172.21.15.19:0/793481256 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efd74161460 msgr2=0x7efd740ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:55.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.174+0000 7efd79200640 1 --2- 172.21.15.19:0/793481256 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efd74161460 0x7efd740ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.174+0000 7efd79200640 1 -- 172.21.15.19:0/793481256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd740d3030 msgr2=0x7efd74160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:55.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.174+0000 7efd79200640 1 --2- 172.21.15.19:0/793481256 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efd740d3030 0x7efd74160550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.174+0000 7efd79200640 1 -- 172.21.15.19:0/793481256 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd74160a90 con 0x7efd740d10c0 2024-03-08T06:05:55.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.175+0000 7efd79200640 1 --2- 172.21.15.19:0/793481256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd740d10c0 0x7efd741f7370 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7efd6400c400 tx=0x7efd6400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:55.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.175+0000 7efd70c00640 1 -- 172.21.15.19:0/793481256 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64017070 con 0x7efd740d10c0 2024-03-08T06:05:55.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.175+0000 7efd70c00640 1 -- 172.21.15.19:0/793481256 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd64005ce0 con 0x7efd740d10c0 2024-03-08T06:05:55.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.175+0000 7efd70c00640 1 -- 172.21.15.19:0/793481256 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd640072f0 con 0x7efd740d10c0 2024-03-08T06:05:55.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.175+0000 7efd7a600640 1 -- 172.21.15.19:0/793481256 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd741f7950 con 0x7efd740d10c0 2024-03-08T06:05:55.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.175+0000 7efd7a600640 1 -- 172.21.15.19:0/793481256 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd741f7f10 con 0x7efd740d10c0 2024-03-08T06:05:55.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.176+0000 7efd7a600640 1 -- 172.21.15.19:0/793481256 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efd74075090 con 0x7efd740d10c0 2024-03-08T06:05:55.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.177+0000 7efd70c00640 1 -- 172.21.15.19:0/793481256 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efd6401a070 con 0x7efd740d10c0 2024-03-08T06:05:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.178+0000 7efd70c00640 1 --2- 172.21.15.19:0/793481256 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efd5406b4d0 0x7efd5406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.178+0000 7efd70c00640 1 -- 172.21.15.19:0/793481256 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efd64089280 con 0x7efd740d10c0 2024-03-08T06:05:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.179+0000 7efd70c00640 1 --2- 172.21.15.19:0/793481256 >> [v2:172.21.15.42:6821/93809742,v1:172.21.15.42:6824/93809742] conn(0x7efd54071390 0x7efd540737b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.179+0000 7efd70c00640 1 -- 172.21.15.19:0/793481256 --> [v2:172.21.15.42:6821/93809742,v1:172.21.15.42:6824/93809742] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd64014ec0 con 0x7efd54071390 2024-03-08T06:05:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.179+0000 7efd70c00640 1 -- 172.21.15.19:0/793481256 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd64090050 con 0x7efd740d10c0 2024-03-08T06:05:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.179+0000 7efd73e00640 1 --2- 172.21.15.19:0/793481256 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efd5406b4d0 0x7efd5406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.179+0000 7efd79c00640 1 --2- 172.21.15.19:0/793481256 >> [v2:172.21.15.42:6821/93809742,v1:172.21.15.42:6824/93809742] conn(0x7efd54071390 0x7efd540737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.180+0000 7efd73e00640 1 --2- 172.21.15.19:0/793481256 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efd5406b4d0 0x7efd5406d990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efd60036000 tx=0x7efd6003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.180+0000 7efd79c00640 1 --2- 172.21.15.19:0/793481256 >> [v2:172.21.15.42:6821/93809742,v1:172.21.15.42:6824/93809742] conn(0x7efd54071390 0x7efd540737b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.183+0000 7efd70c00640 1 -- 172.21.15.19:0/793481256 <== osd.6 v2:172.21.15.42:6821/93809742 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7efd64014ec0 con 0x7efd54071390 2024-03-08T06:05:55.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.197+0000 7efd7a600640 1 -- 172.21.15.19:0/793481256 --> [v2:172.21.15.42:6821/93809742,v1:172.21.15.42:6824/93809742] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efd740b6250 con 0x7efd54071390 2024-03-08T06:05:55.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.198+0000 7efd70c00640 1 -- 172.21.15.19:0/793481256 <== osd.6 v2:172.21.15.42:6821/93809742 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efd740b6250 con 0x7efd54071390 2024-03-08T06:05:55.198 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-08T06:05:55.199 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T06:05:55.199 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-08T06:05:55.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.199+0000 7efd7a600640 1 -- 172.21.15.19:0/793481256 >> [v2:172.21.15.42:6821/93809742,v1:172.21.15.42:6824/93809742] conn(0x7efd54071390 msgr2=0x7efd540737b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:55.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.199+0000 7efd7a600640 1 --2- 172.21.15.19:0/793481256 >> [v2:172.21.15.42:6821/93809742,v1:172.21.15.42:6824/93809742] conn(0x7efd54071390 0x7efd540737b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.199+0000 7efd7a600640 1 -- 172.21.15.19:0/793481256 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efd5406b4d0 msgr2=0x7efd5406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:55.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.199+0000 7efd7a600640 1 --2- 172.21.15.19:0/793481256 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efd5406b4d0 0x7efd5406d990 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efd60036000 tx=0x7efd6003c040 comp rx=0 tx=0).stop 2024-03-08T06:05:55.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.199+0000 7efd7a600640 1 -- 172.21.15.19:0/793481256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd740d10c0 msgr2=0x7efd741f7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:55.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.199+0000 7efd7a600640 1 --2- 172.21.15.19:0/793481256 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd740d10c0 0x7efd741f7370 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7efd6400c400 tx=0x7efd6400c8c0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.199+0000 7efd79c00640 1 -- 172.21.15.19:0/793481256 reap_dead start 2024-03-08T06:05:55.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.199+0000 7efd7a600640 1 -- 172.21.15.19:0/793481256 shutdown_connections 2024-03-08T06:05:55.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.199+0000 7efd7a600640 1 -- 172.21.15.19:0/793481256 >> 172.21.15.19:0/793481256 conn(0x7efd7406c7b0 msgr2=0x7efd740b3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:55.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.199+0000 7efd7a600640 1 -- 172.21.15.19:0/793481256 shutdown_connections 2024-03-08T06:05:55.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.200+0000 7efd7a600640 1 -- 172.21.15.19:0/793481256 wait complete. 2024-03-08T06:05:55.219 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-08T06:05:55.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.442+0000 7fa9bd000640 1 Processor -- start 2024-03-08T06:05:55.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.442+0000 7fa9bd000640 1 -- start start 2024-03-08T06:05:55.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.444+0000 7fa9bd000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9b8161240 0x7fa9b80b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:55.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.444+0000 7fa9bd000640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa9b80b5bd0 0x7fa9b80d1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:55.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.444+0000 7fa9bd000640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b80b2ee0 con 0x7fa9b80d0fd0 2024-03-08T06:05:55.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.444+0000 7fa9bd000640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b80ceaa0 con 0x7fa9b80b5bd0 2024-03-08T06:05:55.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.444+0000 7fa9bd000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b80d33a0 con 0x7fa9b8161240 2024-03-08T06:05:55.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.445+0000 7fa9b7e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa9b80b5bd0 0x7fa9b80d1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:55.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.445+0000 7fa9b7400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9b8161240 0x7fa9b80b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:55.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.445+0000 7fa9b7e00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa9b80b5bd0 0x7fa9b80d1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.19:53368/0 (socket says 172.21.15.19:53368) 2024-03-08T06:05:55.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.445+0000 7fa9b7e00640 1 -- 172.21.15.19:0/3966891522 learned_addr learned my addr 172.21.15.19:0/3966891522 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:55.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.445+0000 7fa9b7e00640 1 -- 172.21.15.19:0/3966891522 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9b8161240 msgr2=0x7fa9b80b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:55.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.445+0000 7fa9b7e00640 1 --2- 172.21.15.19:0/3966891522 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9b8161240 0x7fa9b80b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.445+0000 7fa9b7e00640 1 -- 172.21.15.19:0/3966891522 >> v1:172.21.15.42:6789/0 conn(0x7fa9b80d0fd0 legacy=0x7fa9b80b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:55.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.445+0000 7fa9b7e00640 1 -- 172.21.15.19:0/3966891522 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b80d3680 con 0x7fa9b80b5bd0 2024-03-08T06:05:55.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.447+0000 7fa9b7e00640 1 --2- 172.21.15.19:0/3966891522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9b80b5bd0 0x7fa9b80d1710 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009e50 tx=0x7fa9b002bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fb5b7c8679484b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:55.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.448+0000 7fa9b6a00640 1 -- 172.21.15.19:0/3966891522 <== mon.1 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b002ca70 con 0x7fa9b80b5bd0 2024-03-08T06:05:55.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.448+0000 7fa9b6a00640 1 -- 172.21.15.19:0/3966891522 <== mon.1 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b002cc10 con 0x7fa9b80b5bd0 2024-03-08T06:05:55.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.448+0000 7fa9b6a00640 1 -- 172.21.15.19:0/3966891522 <== mon.1 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00343f0 con 0x7fa9b80b5bd0 2024-03-08T06:05:55.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.448+0000 7fa9bd000640 1 -- 172.21.15.19:0/3966891522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9b80b5bd0 msgr2=0x7fa9b80d1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:55.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.448+0000 7fa9bd000640 1 --2- 172.21.15.19:0/3966891522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9b80b5bd0 0x7fa9b80d1710 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0009e50 tx=0x7fa9b002bed0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.448+0000 7fa9bd000640 1 -- 172.21.15.19:0/3966891522 shutdown_connections 2024-03-08T06:05:55.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.448+0000 7fa9bd000640 1 --2- 172.21.15.19:0/3966891522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9b80b5bd0 0x7fa9b80d1710 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.448+0000 7fa9bd000640 1 --2- 172.21.15.19:0/3966891522 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9b8161240 0x7fa9b80b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.448+0000 7fa9bd000640 1 -- 172.21.15.19:0/3966891522 >> 172.21.15.19:0/3966891522 conn(0x7fa9b806c700 msgr2=0x7fa9b806cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:55.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.448+0000 7fa9bd000640 1 -- 172.21.15.19:0/3966891522 shutdown_connections 2024-03-08T06:05:55.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.448+0000 7fa9bd000640 1 -- 172.21.15.19:0/3966891522 wait complete. 2024-03-08T06:05:55.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.450+0000 7fa9bd000640 1 Processor -- start 2024-03-08T06:05:55.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.450+0000 7fa9bd000640 1 -- start start 2024-03-08T06:05:55.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.451+0000 7fa9bd000640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9b80b5bd0 0x7fa9b814d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:55.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.451+0000 7fa9bd000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9b80d0fd0 0x7fa9b80b75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:55.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.451+0000 7fa9bd000640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9b8161240 0x7fa9b80cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:55.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.451+0000 7fa9bd000640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b8161620 con 0x7fa9b80d0fd0 2024-03-08T06:05:55.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.451+0000 7fa9bd000640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b80cefd0 con 0x7fa9b80b5bd0 2024-03-08T06:05:55.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.451+0000 7fa9bd000640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b81617a0 con 0x7fa9b8161240 2024-03-08T06:05:55.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.452+0000 7fa9afe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9b80d0fd0 0x7fa9b80b75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:55.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.452+0000 7fa9afe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9b80d0fd0 0x7fa9b80b75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40828/0 (socket says 172.21.15.19:40828) 2024-03-08T06:05:55.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.452+0000 7fa9afe00640 1 -- 172.21.15.19:0/2801002626 learned_addr learned my addr 172.21.15.19:0/2801002626 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:55.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.452+0000 7fa9b7400640 1 --2- 172.21.15.19:0/2801002626 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9b80b5bd0 0x7fa9b814d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:55.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.452+0000 7fa9b7e00640 1 --2- 172.21.15.19:0/2801002626 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9b8161240 0x7fa9b80cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:55.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.452+0000 7fa9afe00640 1 -- 172.21.15.19:0/2801002626 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9b8161240 msgr2=0x7fa9b80cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:55.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.452+0000 7fa9afe00640 1 --2- 172.21.15.19:0/2801002626 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9b8161240 0x7fa9b80cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.452+0000 7fa9afe00640 1 -- 172.21.15.19:0/2801002626 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9b80b5bd0 msgr2=0x7fa9b814d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:55.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.452+0000 7fa9afe00640 1 --2- 172.21.15.19:0/2801002626 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9b80b5bd0 0x7fa9b814d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.452+0000 7fa9afe00640 1 -- 172.21.15.19:0/2801002626 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b81e67d0 con 0x7fa9b80d0fd0 2024-03-08T06:05:55.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.452+0000 7fa9b7400640 1 --2- 172.21.15.19:0/2801002626 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9b80b5bd0 0x7fa9b814d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:05:55.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.453+0000 7fa9afe00640 1 --2- 172.21.15.19:0/2801002626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9b80d0fd0 0x7fa9b80b75d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000c430 tx=0x7fa9a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:55.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.453+0000 7fa9af400640 1 -- 172.21.15.19:0/2801002626 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00052d0 con 0x7fa9b80d0fd0 2024-03-08T06:05:55.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.453+0000 7fa9af400640 1 -- 172.21.15.19:0/2801002626 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a0005490 con 0x7fa9b80d0fd0 2024-03-08T06:05:55.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.453+0000 7fa9af400640 1 -- 172.21.15.19:0/2801002626 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0007260 con 0x7fa9b80d0fd0 2024-03-08T06:05:55.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.453+0000 7fa9bd000640 1 -- 172.21.15.19:0/2801002626 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b81e6a70 con 0x7fa9b80d0fd0 2024-03-08T06:05:55.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.453+0000 7fa9bd000640 1 -- 172.21.15.19:0/2801002626 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b81e7030 con 0x7fa9b80d0fd0 2024-03-08T06:05:55.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.455+0000 7fa9bd000640 1 -- 172.21.15.19:0/2801002626 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b80cf440 con 0x7fa9b80d0fd0 2024-03-08T06:05:55.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.455+0000 7fa9af400640 1 -- 172.21.15.19:0/2801002626 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa9a0007400 con 0x7fa9b80d0fd0 2024-03-08T06:05:55.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.456+0000 7fa9af400640 1 --2- 172.21.15.19:0/2801002626 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa99406b4d0 0x7fa99406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:55.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.456+0000 7fa9af400640 1 -- 172.21.15.19:0/2801002626 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa9a0089490 con 0x7fa9b80d0fd0 2024-03-08T06:05:55.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.457+0000 7fa9b7400640 1 --2- 172.21.15.19:0/2801002626 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa99406b4d0 0x7fa99406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:55.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.457+0000 7fa9b7400640 1 --2- 172.21.15.19:0/2801002626 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa99406b4d0 0x7fa99406d990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80cc070 tx=0x7fa9a8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:55.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.461+0000 7fa9af400640 1 -- 172.21.15.19:0/2801002626 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa9b80cf440 con 0x7fa9b80d0fd0 2024-03-08T06:05:55.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.658+0000 7fa9bd000640 1 -- 172.21.15.19:0/2801002626 --> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9b81e7270 con 0x7fa99406b4d0 2024-03-08T06:05:55.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.659+0000 7fa9af400640 1 -- 172.21.15.19:0/2801002626 <== mgr.4107 v2:172.21.15.19:6832/3589745192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa9a8011980 con 0x7fa99406b4d0 2024-03-08T06:05:55.659 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 6 to deep-scrub 2024-03-08T06:05:55.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.662+0000 7fa9bd000640 1 -- 172.21.15.19:0/2801002626 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa99406b4d0 msgr2=0x7fa99406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:55.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.662+0000 7fa9bd000640 1 --2- 172.21.15.19:0/2801002626 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa99406b4d0 0x7fa99406d990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80cc070 tx=0x7fa9a8008040 comp rx=0 tx=0).stop 2024-03-08T06:05:55.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.662+0000 7fa9bd000640 1 -- 172.21.15.19:0/2801002626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9b80d0fd0 msgr2=0x7fa9b80b75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:55.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.662+0000 7fa9bd000640 1 --2- 172.21.15.19:0/2801002626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9b80d0fd0 0x7fa9b80b75d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa9a000c430 tx=0x7fa9a000c8f0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.662+0000 7fa9bd000640 1 -- 172.21.15.19:0/2801002626 shutdown_connections 2024-03-08T06:05:55.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.662+0000 7fa9bd000640 1 --2- 172.21.15.19:0/2801002626 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa99406b4d0 0x7fa99406d990 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.662+0000 7fa9bd000640 1 --2- 172.21.15.19:0/2801002626 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa9b8161240 0x7fa9b80cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.662+0000 7fa9bd000640 1 --2- 172.21.15.19:0/2801002626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9b80d0fd0 0x7fa9b80b75d0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.662+0000 7fa9bd000640 1 --2- 172.21.15.19:0/2801002626 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9b80b5bd0 0x7fa9b814d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.662+0000 7fa9bd000640 1 -- 172.21.15.19:0/2801002626 >> 172.21.15.19:0/2801002626 conn(0x7fa9b806c700 msgr2=0x7fa9b80b52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:55.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.662+0000 7fa9bd000640 1 -- 172.21.15.19:0/2801002626 shutdown_connections 2024-03-08T06:05:55.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.662+0000 7fa9bd000640 1 -- 172.21.15.19:0/2801002626 wait complete. 2024-03-08T06:05:55.679 INFO:tasks.ceph:Scrubbing osd.7 2024-03-08T06:05:55.680 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-08T06:05:55.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.897+0000 7ff827200640 1 Processor -- start 2024-03-08T06:05:55.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.897+0000 7ff827200640 1 -- start start 2024-03-08T06:05:55.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.899+0000 7ff827200640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff828158220 0x7ff82806e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:55.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.899+0000 7ff827200640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8280b4500 0x7ff82815ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:55.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.899+0000 7ff827200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8280b49b0 con 0x7ff828071520 2024-03-08T06:05:55.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.899+0000 7ff827200640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82806d650 con 0x7ff8280b4500 2024-03-08T06:05:55.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.899+0000 7ff827200640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8280b4f10 con 0x7ff828158220 2024-03-08T06:05:55.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.899+0000 7ff825400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8280b4500 0x7ff82815ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:55.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.899+0000 7ff825400640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8280b4500 0x7ff82815ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40842/0 (socket says 172.21.15.19:40842) 2024-03-08T06:05:55.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.899+0000 7ff825400640 1 -- 172.21.15.19:0/3651520322 learned_addr learned my addr 172.21.15.19:0/3651520322 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:55.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.899+0000 7ff826800640 1 --1- 172.21.15.19:0/3651520322 >> v1:172.21.15.19:6789/0 conn(0x7ff828071520 0x7ff8280b2a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33458/0 (socket says 172.21.15.19:33458) 2024-03-08T06:05:55.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.900+0000 7ff825e00640 1 --2- 172.21.15.19:0/3651520322 >> v2:172.21.15.42:3300/0 conn(0x7ff828158220 0x7ff82806e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:55.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.900+0000 7ff825400640 1 -- 172.21.15.19:0/3651520322 >> v2:172.21.15.42:3300/0 conn(0x7ff828158220 msgr2=0x7ff82806e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:55.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.900+0000 7ff825400640 1 --2- 172.21.15.19:0/3651520322 >> v2:172.21.15.42:3300/0 conn(0x7ff828158220 0x7ff82806e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.900+0000 7ff825400640 1 -- 172.21.15.19:0/3651520322 >> v1:172.21.15.19:6789/0 conn(0x7ff828071520 legacy=0x7ff8280b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:55.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.900+0000 7ff825400640 1 -- 172.21.15.19:0/3651520322 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8280b4c30 con 0x7ff8280b4500 2024-03-08T06:05:55.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.901+0000 7ff825400640 1 --2- 172.21.15.19:0/3651520322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8280b4500 0x7ff82815ec20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff82806eb70 tx=0x7ff81402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a271f72d49af8f server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:55.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.901+0000 7ff824a00640 1 -- 172.21.15.19:0/3651520322 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81402e070 con 0x7ff8280b4500 2024-03-08T06:05:55.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.901+0000 7ff824a00640 1 -- 172.21.15.19:0/3651520322 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff814037070 con 0x7ff8280b4500 2024-03-08T06:05:55.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.901+0000 7ff824a00640 1 -- 172.21.15.19:0/3651520322 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814031a00 con 0x7ff8280b4500 2024-03-08T06:05:55.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.902+0000 7ff827200640 1 -- 172.21.15.19:0/3651520322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8280b4500 msgr2=0x7ff82815ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:55.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.902+0000 7ff827200640 1 --2- 172.21.15.19:0/3651520322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8280b4500 0x7ff82815ec20 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff82806eb70 tx=0x7ff81402b880 comp rx=0 tx=0).stop 2024-03-08T06:05:55.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.902+0000 7ff827200640 1 -- 172.21.15.19:0/3651520322 shutdown_connections 2024-03-08T06:05:55.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.902+0000 7ff827200640 1 --2- 172.21.15.19:0/3651520322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8280b4500 0x7ff82815ec20 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.902+0000 7ff827200640 1 --2- 172.21.15.19:0/3651520322 >> v2:172.21.15.42:3300/0 conn(0x7ff828158220 0x7ff82806e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.902+0000 7ff827200640 1 -- 172.21.15.19:0/3651520322 >> 172.21.15.19:0/3651520322 conn(0x7ff82806ac50 msgr2=0x7ff82806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:55.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.902+0000 7ff827200640 1 -- 172.21.15.19:0/3651520322 shutdown_connections 2024-03-08T06:05:55.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.902+0000 7ff827200640 1 -- 172.21.15.19:0/3651520322 wait complete. 2024-03-08T06:05:55.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.905+0000 7ff827200640 1 Processor -- start 2024-03-08T06:05:55.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.905+0000 7ff827200640 1 -- start start 2024-03-08T06:05:55.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.906+0000 7ff827200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff828071520 0x7ff828142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:55.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.906+0000 7ff827200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8280b4500 0x7ff82814fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:55.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.906+0000 7ff827200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff828158220 0x7ff8281e7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:55.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.906+0000 7ff827200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff828158600 con 0x7ff828158220 2024-03-08T06:05:55.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.906+0000 7ff827200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82815f160 con 0x7ff8280b4500 2024-03-08T06:05:55.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.906+0000 7ff827200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff828158780 con 0x7ff828071520 2024-03-08T06:05:55.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.906+0000 7ff826800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff828158220 0x7ff8281e7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.907+0000 7ff826800640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff828158220 0x7ff8281e7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40848/0 (socket says 172.21.15.19:40848) 2024-03-08T06:05:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.907+0000 7ff826800640 1 -- 172.21.15.19:0/251865949 learned_addr learned my addr 172.21.15.19:0/251865949 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.907+0000 7ff825400640 1 --2- 172.21.15.19:0/251865949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8280b4500 0x7ff82814fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.907+0000 7ff825e00640 1 --2- 172.21.15.19:0/251865949 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff828071520 0x7ff828142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.907+0000 7ff826800640 1 -- 172.21.15.19:0/251865949 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff828071520 msgr2=0x7ff828142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.907+0000 7ff826800640 1 --2- 172.21.15.19:0/251865949 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7ff828071520 0x7ff828142200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.907+0000 7ff826800640 1 -- 172.21.15.19:0/251865949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8280b4500 msgr2=0x7ff82814fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:55.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.907+0000 7ff826800640 1 --2- 172.21.15.19:0/251865949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8280b4500 0x7ff82814fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.907+0000 7ff826800640 1 -- 172.21.15.19:0/251865949 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8281505a0 con 0x7ff828158220 2024-03-08T06:05:55.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.907+0000 7ff825400640 1 --2- 172.21.15.19:0/251865949 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff8280b4500 0x7ff82814fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:05:55.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.907+0000 7ff826800640 1 --2- 172.21.15.19:0/251865949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff828158220 0x7ff8281e7fc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff82000c780 tx=0x7ff82000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:55.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.908+0000 7ff81e000640 1 -- 172.21.15.19:0/251865949 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff820017070 con 0x7ff828158220 2024-03-08T06:05:55.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.908+0000 7ff81e000640 1 -- 172.21.15.19:0/251865949 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82000a640 con 0x7ff828158220 2024-03-08T06:05:55.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.908+0000 7ff81e000640 1 -- 172.21.15.19:0/251865949 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82000aa30 con 0x7ff828158220 2024-03-08T06:05:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.908+0000 7ff827200640 1 -- 172.21.15.19:0/251865949 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff828150880 con 0x7ff828158220 2024-03-08T06:05:55.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.908+0000 7ff827200640 1 -- 172.21.15.19:0/251865949 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff828150e40 con 0x7ff828158220 2024-03-08T06:05:55.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.909+0000 7ff827200640 1 -- 172.21.15.19:0/251865949 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff828075090 con 0x7ff828158220 2024-03-08T06:05:55.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.910+0000 7ff81e000640 1 -- 172.21.15.19:0/251865949 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7ff82001a070 con 0x7ff828158220 2024-03-08T06:05:55.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.911+0000 7ff81e000640 1 --2- 172.21.15.19:0/251865949 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff80806b500 0x7ff80806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:55.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.911+0000 7ff81e000640 1 -- 172.21.15.19:0/251865949 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff820089570 con 0x7ff828158220 2024-03-08T06:05:55.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.911+0000 7ff825e00640 1 --2- 172.21.15.19:0/251865949 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff80806b500 0x7ff80806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:55.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.911+0000 7ff81e000640 1 --2- 172.21.15.19:0/251865949 >> [v2:172.21.15.42:6808/3799661037,v1:172.21.15.42:6809/3799661037] conn(0x7ff8080713c0 0x7ff8080737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:55.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.911+0000 7ff81e000640 1 -- 172.21.15.19:0/251865949 --> [v2:172.21.15.42:6808/3799661037,v1:172.21.15.42:6809/3799661037] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff808073e90 con 0x7ff8080713c0 2024-03-08T06:05:55.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.912+0000 7ff81e000640 1 -- 172.21.15.19:0/251865949 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff820090050 con 0x7ff828158220 2024-03-08T06:05:55.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.912+0000 7ff825e00640 1 --2- 172.21.15.19:0/251865949 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff80806b500 0x7ff80806d9c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff818006fd0 tx=0x7ff818008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:55.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.912+0000 7ff825400640 1 --2- 172.21.15.19:0/251865949 >> [v2:172.21.15.42:6808/3799661037,v1:172.21.15.42:6809/3799661037] conn(0x7ff8080713c0 0x7ff8080737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:55.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.913+0000 7ff825400640 1 --2- 172.21.15.19:0/251865949 >> [v2:172.21.15.42:6808/3799661037,v1:172.21.15.42:6809/3799661037] conn(0x7ff8080713c0 0x7ff8080737e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:55.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.915+0000 7ff81e000640 1 -- 172.21.15.19:0/251865949 <== osd.7 v2:172.21.15.42:6808/3799661037 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff808073e90 con 0x7ff8080713c0 2024-03-08T06:05:55.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.934+0000 7ff827200640 1 -- 172.21.15.19:0/251865949 --> [v2:172.21.15.42:6808/3799661037,v1:172.21.15.42:6809/3799661037] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff828157d90 con 0x7ff8080713c0 2024-03-08T06:05:55.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.935+0000 7ff81e000640 1 -- 172.21.15.19:0/251865949 <== osd.7 v2:172.21.15.42:6808/3799661037 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff828157d90 con 0x7ff8080713c0 2024-03-08T06:05:55.935 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-03-08T06:05:55.935 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-08T06:05:55.935 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-03-08T06:05:55.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.936+0000 7ff827200640 1 -- 172.21.15.19:0/251865949 >> [v2:172.21.15.42:6808/3799661037,v1:172.21.15.42:6809/3799661037] conn(0x7ff8080713c0 msgr2=0x7ff8080737e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:55.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.936+0000 7ff827200640 1 --2- 172.21.15.19:0/251865949 >> [v2:172.21.15.42:6808/3799661037,v1:172.21.15.42:6809/3799661037] conn(0x7ff8080713c0 0x7ff8080737e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:55.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.936+0000 7ff827200640 1 -- 172.21.15.19:0/251865949 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff80806b500 msgr2=0x7ff80806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:55.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.936+0000 7ff827200640 1 --2- 172.21.15.19:0/251865949 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7ff80806b500 0x7ff80806d9c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff818006fd0 tx=0x7ff818008040 comp rx=0 tx=0).stop 2024-03-08T06:05:55.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.936+0000 7ff827200640 1 -- 172.21.15.19:0/251865949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff828158220 msgr2=0x7ff8281e7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:55.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.936+0000 7ff827200640 1 --2- 172.21.15.19:0/251865949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff828158220 0x7ff8281e7fc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff82000c780 tx=0x7ff82000cc40 comp rx=0 tx=0).stop 2024-03-08T06:05:55.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.936+0000 7ff826800640 1 -- 172.21.15.19:0/251865949 reap_dead start 2024-03-08T06:05:55.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.936+0000 7ff827200640 1 -- 172.21.15.19:0/251865949 shutdown_connections 2024-03-08T06:05:55.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.936+0000 7ff827200640 1 -- 172.21.15.19:0/251865949 >> 172.21.15.19:0/251865949 conn(0x7ff82806ac50 msgr2=0x7ff8280ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:55.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.936+0000 7ff827200640 1 -- 172.21.15.19:0/251865949 shutdown_connections 2024-03-08T06:05:55.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:55.936+0000 7ff827200640 1 -- 172.21.15.19:0/251865949 wait complete. 2024-03-08T06:05:55.957 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-08T06:05:56.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.180+0000 7efdf3e00640 1 Processor -- start 2024-03-08T06:05:56.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.180+0000 7efdf3e00640 1 -- start start 2024-03-08T06:05:56.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.182+0000 7efdf3e00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efdf415dea0 0x7efdf40d30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:56.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.182+0000 7efdf3e00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf40cf140 con 0x7efdf40cec00 2024-03-08T06:05:56.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.182+0000 7efdf3e00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf40d1e40 con 0x7efdf40d35f0 2024-03-08T06:05:56.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.182+0000 7efdf3e00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf40b3120 con 0x7efdf415dea0 2024-03-08T06:05:56.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.182+0000 7efdf2a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efdf415dea0 0x7efdf40d30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:56.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.182+0000 7efdf2a00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efdf415dea0 0x7efdf40d30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40862/0 (socket says 172.21.15.19:40862) 2024-03-08T06:05:56.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.182+0000 7efdf2a00640 1 -- 172.21.15.19:0/3554406656 learned_addr learned my addr 172.21.15.19:0/3554406656 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:56.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.182+0000 7efdf3400640 1 --1- 172.21.15.19:0/3554406656 >> v1:172.21.15.19:6789/0 conn(0x7efdf40cec00 0x7efdf40b6be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33462/0 (socket says 172.21.15.19:33462) 2024-03-08T06:05:56.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.183+0000 7efdf2a00640 1 -- 172.21.15.19:0/3554406656 >> v1:172.21.15.42:6789/0 conn(0x7efdf40d35f0 legacy=0x7efdf40ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:56.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.183+0000 7efdf2a00640 1 -- 172.21.15.19:0/3554406656 >> v1:172.21.15.19:6789/0 conn(0x7efdf40cec00 legacy=0x7efdf40b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:56.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.183+0000 7efdf2a00640 1 -- 172.21.15.19:0/3554406656 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf40d2120 con 0x7efdf415dea0 2024-03-08T06:05:56.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.183+0000 7efdf2000640 1 -- 172.21.15.19:0/3554406656 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20097107 0 0) 0x7efdf40cf140 con 0x7efdf40cec00 2024-03-08T06:05:56.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.184+0000 7efdf2a00640 1 --2- 172.21.15.19:0/3554406656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdf415dea0 0x7efdf40d30b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efde4009870 tx=0x7efde402b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656642c8a3c0284 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:56.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.184+0000 7efdf2000640 1 -- 172.21.15.19:0/3554406656 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde40317d0 con 0x7efdf415dea0 2024-03-08T06:05:56.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.184+0000 7efdf2000640 1 -- 172.21.15.19:0/3554406656 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde4037070 con 0x7efdf415dea0 2024-03-08T06:05:56.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.184+0000 7efdf2000640 1 -- 172.21.15.19:0/3554406656 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4031b90 con 0x7efdf415dea0 2024-03-08T06:05:56.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.185+0000 7efdf3e00640 1 -- 172.21.15.19:0/3554406656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdf415dea0 msgr2=0x7efdf40d30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:56.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.185+0000 7efdf3e00640 1 --2- 172.21.15.19:0/3554406656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdf415dea0 0x7efdf40d30b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efde4009870 tx=0x7efde402b870 comp rx=0 tx=0).stop 2024-03-08T06:05:56.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.185+0000 7efdf3e00640 1 -- 172.21.15.19:0/3554406656 shutdown_connections 2024-03-08T06:05:56.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.185+0000 7efdf3e00640 1 --2- 172.21.15.19:0/3554406656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdf415dea0 0x7efdf40d30b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:56.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.185+0000 7efdf3e00640 1 -- 172.21.15.19:0/3554406656 >> 172.21.15.19:0/3554406656 conn(0x7efdf40d0b30 msgr2=0x7efdf40d0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:56.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.185+0000 7efdf3e00640 1 -- 172.21.15.19:0/3554406656 shutdown_connections 2024-03-08T06:05:56.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.185+0000 7efdf3e00640 1 -- 172.21.15.19:0/3554406656 wait complete. 2024-03-08T06:05:56.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.187+0000 7efdf3e00640 1 Processor -- start 2024-03-08T06:05:56.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.187+0000 7efdf3e00640 1 -- start start 2024-03-08T06:05:56.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.188+0000 7efdf3e00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efdf40cec00 0x7efdf4150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:56.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.188+0000 7efdf3e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdf40d35f0 0x7efdf414f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:56.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.188+0000 7efdf3e00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdf415dea0 0x7efdf41607b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:56.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.188+0000 7efdf3e00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf40d2c00 con 0x7efdf40d35f0 2024-03-08T06:05:56.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.188+0000 7efdf3e00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf40b72f0 con 0x7efdf415dea0 2024-03-08T06:05:56.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.188+0000 7efdf3e00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf40b7470 con 0x7efdf40cec00 2024-03-08T06:05:56.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.188+0000 7efdebe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdf40d35f0 0x7efdf414f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:56.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.188+0000 7efdebe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdf40d35f0 0x7efdf414f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40880/0 (socket says 172.21.15.19:40880) 2024-03-08T06:05:56.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.188+0000 7efdebe00640 1 -- 172.21.15.19:0/2641004123 learned_addr learned my addr 172.21.15.19:0/2641004123 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:56.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.189+0000 7efdf3400640 1 --2- 172.21.15.19:0/2641004123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdf415dea0 0x7efdf41607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:56.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.189+0000 7efdf2a00640 1 --2- 172.21.15.19:0/2641004123 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efdf40cec00 0x7efdf4150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:56.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.189+0000 7efdebe00640 1 -- 172.21.15.19:0/2641004123 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efdf40cec00 msgr2=0x7efdf4150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:56.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.189+0000 7efdebe00640 1 --2- 172.21.15.19:0/2641004123 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efdf40cec00 0x7efdf4150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:56.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.189+0000 7efdebe00640 1 -- 172.21.15.19:0/2641004123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdf415dea0 msgr2=0x7efdf41607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:56.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.189+0000 7efdebe00640 1 --2- 172.21.15.19:0/2641004123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdf415dea0 0x7efdf41607b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:56.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.189+0000 7efdebe00640 1 -- 172.21.15.19:0/2641004123 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf4150bb0 con 0x7efdf40d35f0 2024-03-08T06:05:56.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.189+0000 7efdebe00640 1 --2- 172.21.15.19:0/2641004123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdf40d35f0 0x7efdf414f030 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7efddc00c430 tx=0x7efddc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:56.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.190+0000 7efdeaa00640 1 -- 172.21.15.19:0/2641004123 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc011790 con 0x7efdf40d35f0 2024-03-08T06:05:56.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.190+0000 7efdeaa00640 1 -- 172.21.15.19:0/2641004123 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efddc017070 con 0x7efdf40d35f0 2024-03-08T06:05:56.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.190+0000 7efdeaa00640 1 -- 172.21.15.19:0/2641004123 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc011bb0 con 0x7efdf40d35f0 2024-03-08T06:05:56.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.190+0000 7efdf3e00640 1 -- 172.21.15.19:0/2641004123 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf4159930 con 0x7efdf40d35f0 2024-03-08T06:05:56.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.190+0000 7efdf3e00640 1 -- 172.21.15.19:0/2641004123 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf414fe70 con 0x7efdf40d35f0 2024-03-08T06:05:56.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.191+0000 7efdf3e00640 1 -- 172.21.15.19:0/2641004123 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf4075090 con 0x7efdf40d35f0 2024-03-08T06:05:56.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.192+0000 7efdeaa00640 1 -- 172.21.15.19:0/2641004123 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7efddc01c460 con 0x7efdf40d35f0 2024-03-08T06:05:56.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.193+0000 7efdeaa00640 1 --2- 172.21.15.19:0/2641004123 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efdd006b4d0 0x7efdd006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:56.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.193+0000 7efdeaa00640 1 -- 172.21.15.19:0/2641004123 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efddc089dd0 con 0x7efdf40d35f0 2024-03-08T06:05:56.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.194+0000 7efdf2a00640 1 --2- 172.21.15.19:0/2641004123 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efdd006b4d0 0x7efdd006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:56.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.194+0000 7efdf2a00640 1 --2- 172.21.15.19:0/2641004123 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efdd006b4d0 0x7efdd006d990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efde4036000 tx=0x7efde403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:56.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.198+0000 7efdeaa00640 1 -- 172.21.15.19:0/2641004123 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efddc058f40 con 0x7efdf40d35f0 2024-03-08T06:05:56.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.398+0000 7efdf3e00640 1 -- 172.21.15.19:0/2641004123 --> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7efdf40d1840 con 0x7efdd006b4d0 2024-03-08T06:05:56.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.399+0000 7efdeaa00640 1 -- 172.21.15.19:0/2641004123 <== mgr.4107 v2:172.21.15.19:6832/3589745192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efdf40d1840 con 0x7efdd006b4d0 2024-03-08T06:05:56.399 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 7 to deep-scrub 2024-03-08T06:05:56.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.401+0000 7efdf3e00640 1 -- 172.21.15.19:0/2641004123 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efdd006b4d0 msgr2=0x7efdd006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:56.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.401+0000 7efdf3e00640 1 --2- 172.21.15.19:0/2641004123 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efdd006b4d0 0x7efdd006d990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efde4036000 tx=0x7efde403d040 comp rx=0 tx=0).stop 2024-03-08T06:05:56.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.401+0000 7efdf3e00640 1 -- 172.21.15.19:0/2641004123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdf40d35f0 msgr2=0x7efdf414f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:56.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.401+0000 7efdf3e00640 1 --2- 172.21.15.19:0/2641004123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdf40d35f0 0x7efdf414f030 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7efddc00c430 tx=0x7efddc00c8f0 comp rx=0 tx=0).stop 2024-03-08T06:05:56.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.401+0000 7efdf3e00640 1 -- 172.21.15.19:0/2641004123 shutdown_connections 2024-03-08T06:05:56.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.401+0000 7efdf3e00640 1 --2- 172.21.15.19:0/2641004123 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7efdd006b4d0 0x7efdd006d990 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:56.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.401+0000 7efdf3e00640 1 --2- 172.21.15.19:0/2641004123 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdf415dea0 0x7efdf41607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:56.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.401+0000 7efdf3e00640 1 --2- 172.21.15.19:0/2641004123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdf40d35f0 0x7efdf414f030 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:56.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.401+0000 7efdf3e00640 1 --2- 172.21.15.19:0/2641004123 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7efdf40cec00 0x7efdf4150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:56.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.401+0000 7efdf3e00640 1 -- 172.21.15.19:0/2641004123 >> 172.21.15.19:0/2641004123 conn(0x7efdf40d0b30 msgr2=0x7efdf40ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:56.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.401+0000 7efdf3e00640 1 -- 172.21.15.19:0/2641004123 shutdown_connections 2024-03-08T06:05:56.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.401+0000 7efdf3e00640 1 -- 172.21.15.19:0/2641004123 wait complete. 2024-03-08T06:05:56.422 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T06:05:56.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.643+0000 7fa58ba00640 1 Processor -- start 2024-03-08T06:05:56.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.643+0000 7fa58ba00640 1 -- start start 2024-03-08T06:05:56.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.644+0000 7fa58ba00640 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa58409a4c0 0x7fa58409adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:56.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.644+0000 7fa58ba00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa584071980 con 0x7fa584070d50 2024-03-08T06:05:56.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.645+0000 7fa58ba00640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5840cc5b0 con 0x7fa58415f610 2024-03-08T06:05:56.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.645+0000 7fa58ba00640 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5840711a0 con 0x7fa58409a4c0 2024-03-08T06:05:56.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.645+0000 7fa589a00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa584070d50 0x7fa5840cd330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33476/0 (socket says 172.21.15.19:33476) 2024-03-08T06:05:56.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.645+0000 7fa589a00640 1 -- 172.21.15.19:0/3023489227 learned_addr learned my addr 172.21.15.19:0/3023489227 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:05:56.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.645+0000 7fa583e00640 1 --2- 172.21.15.19:0/3023489227 >> v2:172.21.15.42:3300/0 conn(0x7fa58409a4c0 0x7fa58409adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:56.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.645+0000 7fa583400640 1 -- 172.21.15.19:0/3023489227 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285506972 0 0) 0x7fa584071980 con 0x7fa584070d50 2024-03-08T06:05:56.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.645+0000 7fa583400640 1 -- 172.21.15.19:0/3023489227 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa568003520 con 0x7fa584070d50 2024-03-08T06:05:56.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.646+0000 7fa583400640 1 -- 172.21.15.19:0/3023489227 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 189928969 0 0) 0x7fa568003520 con 0x7fa584070d50 2024-03-08T06:05:56.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.646+0000 7fa583400640 1 -- 172.21.15.19:0/3023489227 >> v2:172.21.15.42:3300/0 conn(0x7fa58409a4c0 msgr2=0x7fa58409adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:56.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.646+0000 7fa583400640 1 --2- 172.21.15.19:0/3023489227 >> v2:172.21.15.42:3300/0 conn(0x7fa58409a4c0 0x7fa58409adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:56.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.646+0000 7fa583400640 1 -- 172.21.15.19:0/3023489227 >> v1:172.21.15.42:6789/0 conn(0x7fa58415f610 legacy=0x7fa584099db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:56.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.646+0000 7fa583400640 1 -- 172.21.15.19:0/3023489227 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5840cc850 con 0x7fa584070d50 2024-03-08T06:05:56.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.646+0000 7fa583400640 1 -- 172.21.15.19:0/3023489227 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7fa57c001670 con 0x7fa584070d50 2024-03-08T06:05:56.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.646+0000 7fa583400640 1 -- 172.21.15.19:0/3023489227 >> v1:172.21.15.19:6789/0 conn(0x7fa584070d50 legacy=0x7fa5840cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:56.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.646+0000 7fa583400640 1 --2- 172.21.15.19:0/3023489227 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa568003a00 0x7fa568003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:56.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.646+0000 7fa583400640 1 --2- 172.21.15.19:0/3023489227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa568004800 0x7fa568004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:56.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.646+0000 7fa583400640 1 --2- 172.21.15.19:0/3023489227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5680051c0 0x7fa56800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:56.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.646+0000 7fa583400640 1 -- 172.21.15.19:0/3023489227 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5840711a0 con 0x7fa568004800 2024-03-08T06:05:56.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.646+0000 7fa583400640 1 -- 172.21.15.19:0/3023489227 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56800c0a0 con 0x7fa5680051c0 2024-03-08T06:05:56.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.646+0000 7fa583400640 1 -- 172.21.15.19:0/3023489227 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56800c2a0 con 0x7fa568003a00 2024-03-08T06:05:56.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.646+0000 7fa583e00640 1 --2- 172.21.15.19:0/3023489227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa568004800 0x7fa568004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:56.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.647+0000 7fa589000640 1 --2- 172.21.15.19:0/3023489227 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa568003a00 0x7fa568003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:56.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.647+0000 7fa589a00640 1 --2- 172.21.15.19:0/3023489227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5680051c0 0x7fa56800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:56.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.647+0000 7fa583e00640 1 -- 172.21.15.19:0/3023489227 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa568003a00 msgr2=0x7fa568003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:56.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.647+0000 7fa583e00640 1 --2- 172.21.15.19:0/3023489227 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa568003a00 0x7fa568003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:56.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.647+0000 7fa583e00640 1 -- 172.21.15.19:0/3023489227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5680051c0 msgr2=0x7fa56800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:05:56.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.647+0000 7fa583e00640 1 --2- 172.21.15.19:0/3023489227 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5680051c0 0x7fa56800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:56.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.647+0000 7fa583e00640 1 -- 172.21.15.19:0/3023489227 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa568003520 con 0x7fa568004800 2024-03-08T06:05:56.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.647+0000 7fa589a00640 1 -- 172.21.15.19:0/3023489227 reap_dead start 2024-03-08T06:05:56.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.648+0000 7fa583e00640 1 --2- 172.21.15.19:0/3023489227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa568004800 0x7fa568004c80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa56c009ac0 tx=0x7fa568005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144b8af585f221ef server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:56.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.648+0000 7fa583400640 1 -- 172.21.15.19:0/3023489227 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c039070 con 0x7fa568004800 2024-03-08T06:05:56.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.648+0000 7fa583400640 1 -- 172.21.15.19:0/3023489227 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c02c6b0 con 0x7fa568004800 2024-03-08T06:05:56.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.648+0000 7fa583400640 1 -- 172.21.15.19:0/3023489227 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c009690 con 0x7fa568004800 2024-03-08T06:05:56.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.648+0000 7fa58ba00640 1 -- 172.21.15.19:0/3023489227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa568004800 msgr2=0x7fa568004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:56.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.649+0000 7fa58ba00640 1 --2- 172.21.15.19:0/3023489227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa568004800 0x7fa568004c80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa56c009ac0 tx=0x7fa568005830 comp rx=0 tx=0).stop 2024-03-08T06:05:56.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.649+0000 7fa58ba00640 1 -- 172.21.15.19:0/3023489227 shutdown_connections 2024-03-08T06:05:56.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.649+0000 7fa58ba00640 1 --2- 172.21.15.19:0/3023489227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa568004800 0x7fa568004c80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:56.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.649+0000 7fa58ba00640 1 -- 172.21.15.19:0/3023489227 >> 172.21.15.19:0/3023489227 conn(0x7fa5840b3520 msgr2=0x7fa5840b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:56.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.649+0000 7fa58ba00640 1 -- 172.21.15.19:0/3023489227 shutdown_connections 2024-03-08T06:05:56.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.649+0000 7fa58ba00640 1 -- 172.21.15.19:0/3023489227 wait complete. 2024-03-08T06:05:56.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.650+0000 7fa58ba00640 1 Processor -- start 2024-03-08T06:05:56.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.651+0000 7fa58ba00640 1 -- start start 2024-03-08T06:05:56.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.651+0000 7fa58ba00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa568004800 0x7fa58409f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:56.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.651+0000 7fa58ba00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa58415d990 0x7fa5840c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:56.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.652+0000 7fa58ba00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa5840c5aa0 0x7fa5840c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:56.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.652+0000 7fa58ba00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5840ae800 con 0x7fa568004800 2024-03-08T06:05:56.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.652+0000 7fa58ba00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5840713e0 con 0x7fa58415d990 2024-03-08T06:05:56.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.652+0000 7fa58ba00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5840ae980 con 0x7fa5840c5aa0 2024-03-08T06:05:56.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.652+0000 7fa589000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa568004800 0x7fa58409f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:56.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.652+0000 7fa589000640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa568004800 0x7fa58409f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40906/0 (socket says 172.21.15.19:40906) 2024-03-08T06:05:56.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.652+0000 7fa589000640 1 -- 172.21.15.19:0/2692366806 learned_addr learned my addr 172.21.15.19:0/2692366806 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:05:56.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.652+0000 7fa589000640 1 -- 172.21.15.19:0/2692366806 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa5840c5aa0 msgr2=0x7fa5840c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:56.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.652+0000 7fa589000640 1 --2- 172.21.15.19:0/2692366806 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa5840c5aa0 0x7fa5840c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:56.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.652+0000 7fa589000640 1 -- 172.21.15.19:0/2692366806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa58415d990 msgr2=0x7fa5840c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:56.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.652+0000 7fa589000640 1 --2- 172.21.15.19:0/2692366806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa58415d990 0x7fa5840c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:56.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.652+0000 7fa589000640 1 -- 172.21.15.19:0/2692366806 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58409f790 con 0x7fa568004800 2024-03-08T06:05:56.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.653+0000 7fa589000640 1 --2- 172.21.15.19:0/2692366806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa568004800 0x7fa58409f120 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa574007b90 tx=0x7fa57400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:56.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.653+0000 7fa580c00640 1 -- 172.21.15.19:0/2692366806 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574003b80 con 0x7fa568004800 2024-03-08T06:05:56.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.653+0000 7fa580c00640 1 -- 172.21.15.19:0/2692366806 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa574018070 con 0x7fa568004800 2024-03-08T06:05:56.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.653+0000 7fa580c00640 1 -- 172.21.15.19:0/2692366806 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5740050d0 con 0x7fa568004800 2024-03-08T06:05:56.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.653+0000 7fa58ba00640 1 -- 172.21.15.19:0/2692366806 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58409b910 con 0x7fa568004800 2024-03-08T06:05:56.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.653+0000 7fa58ba00640 1 -- 172.21.15.19:0/2692366806 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58409bed0 con 0x7fa568004800 2024-03-08T06:05:56.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.654+0000 7fa58ba00640 1 -- 172.21.15.19:0/2692366806 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5840683c0 con 0x7fa568004800 2024-03-08T06:05:56.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.655+0000 7fa580c00640 1 -- 172.21.15.19:0/2692366806 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa574005270 con 0x7fa568004800 2024-03-08T06:05:56.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.656+0000 7fa580c00640 1 --2- 172.21.15.19:0/2692366806 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa56006b500 0x7fa56006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:05:56.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.656+0000 7fa580c00640 1 -- 172.21.15.19:0/2692366806 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa574089ef0 con 0x7fa568004800 2024-03-08T06:05:56.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.656+0000 7fa583e00640 1 --2- 172.21.15.19:0/2692366806 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa56006b500 0x7fa56006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:05:56.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.657+0000 7fa583e00640 1 --2- 172.21.15.19:0/2692366806 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa56006b500 0x7fa56006d9c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa56c036000 tx=0x7fa56c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:05:56.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.661+0000 7fa580c00640 1 -- 172.21.15.19:0/2692366806 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa57401a310 con 0x7fa568004800 2024-03-08T06:05:56.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.857+0000 7fa58ba00640 1 -- 172.21.15.19:0/2692366806 --> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5840ce2d0 con 0x7fa56006b500 2024-03-08T06:05:56.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.858+0000 7fa580c00640 1 -- 172.21.15.19:0/2692366806 <== mgr.4107 v2:172.21.15.19:6832/3589745192 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13353 (secure 0 0 0) 0x7fa5840ce2d0 con 0x7fa56006b500 2024-03-08T06:05:56.859 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:05:56.860 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-08T06:05:56.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.861+0000 7fa58ba00640 1 -- 172.21.15.19:0/2692366806 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa56006b500 msgr2=0x7fa56006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:56.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.861+0000 7fa58ba00640 1 --2- 172.21.15.19:0/2692366806 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa56006b500 0x7fa56006d9c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa56c036000 tx=0x7fa56c02e000 comp rx=0 tx=0).stop 2024-03-08T06:05:56.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.861+0000 7fa58ba00640 1 -- 172.21.15.19:0/2692366806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa568004800 msgr2=0x7fa58409f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:05:56.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.861+0000 7fa58ba00640 1 --2- 172.21.15.19:0/2692366806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa568004800 0x7fa58409f120 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa574007b90 tx=0x7fa57400eca0 comp rx=0 tx=0).stop 2024-03-08T06:05:56.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.861+0000 7fa58ba00640 1 -- 172.21.15.19:0/2692366806 shutdown_connections 2024-03-08T06:05:56.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.861+0000 7fa58ba00640 1 --2- 172.21.15.19:0/2692366806 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa56006b500 0x7fa56006d9c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:56.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.861+0000 7fa58ba00640 1 --2- 172.21.15.19:0/2692366806 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa5840c5aa0 0x7fa5840c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:56.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.861+0000 7fa58ba00640 1 --2- 172.21.15.19:0/2692366806 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa58415d990 0x7fa5840c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:56.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.861+0000 7fa58ba00640 1 --2- 172.21.15.19:0/2692366806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa568004800 0x7fa58409f120 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:05:56.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.861+0000 7fa58ba00640 1 -- 172.21.15.19:0/2692366806 >> 172.21.15.19:0/2692366806 conn(0x7fa5840b3520 msgr2=0x7fa5840ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:05:56.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.861+0000 7fa58ba00640 1 -- 172.21.15.19:0/2692366806 shutdown_connections 2024-03-08T06:05:56.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:05:56.862+0000 7fa58ba00640 1 -- 172.21.15.19:0/2692366806 wait complete. 2024-03-08T06:05:56.882 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2024-03-08T06:05:56.128559+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262292,"kb_used_data":4520,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754712428,"statfs":{"total":773094113280,"available":772825526272,"internally_reserved":0,"allocated":4628480,"data_stored":2532096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.098545"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":203,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-08T06:05:45.037400+0000","last_change":"2024-03-08T06:03:16.679654+0000","last_active":"2024-03-08T06:05:45.037400+0000","last_peered":"2024-03-08T06:05:45.037400+0000","last_clean":"2024-03-08T06:05:45.037400+0000","last_became_active":"2024-03-08T06:03:16.676829+0000","last_became_peered":"2024-03-08T06:03:16.676829+0000","last_unstale":"2024-03-08T06:05:45.037400+0000","last_undegraded":"2024-03-08T06:05:45.037400+0000","last_fullsized":"2024-03-08T06:05:45.037400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-08T06:03:14.800941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-08T06:03:14.800941+0000","last_clean_scrub_stamp":"2024-03-08T06:03:14.800941+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T15:20:09.927678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1024000,"data_stored":759288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":168920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":168920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":168920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35764,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336076,"statfs":{"total":96636764160,"available":96600141824,"internally_reserved":0,"allocated":430080,"data_stored":168920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":168920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35760,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336080,"statfs":{"total":96636764160,"available":96600145920,"internally_reserved":0,"allocated":430080,"data_stored":168920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1024000,"data_stored":759288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T06:05:56.885 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-08T06:03:14.800941+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=6, tm_min=3, tm_sec=14, tm_wday=4, tm_yday=68, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=8, tm_hour=6, tm_min=5, tm_sec=49, tm_wday=4, tm_yday=68, tm_isdst=0) 2024-03-08T06:05:56.885 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-08T06:06:16.886 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-08T06:06:17.012 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T06:06:17.020 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T06:06:17.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.102+0000 7fba7be00640 1 Processor -- start 2024-03-08T06:06:17.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.102+0000 7fba7be00640 1 -- start start 2024-03-08T06:06:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.104+0000 7fba7be00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fba740b21f0 0x7fba740b3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.104+0000 7fba7be00640 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fba740b3ed0 0x7fba740ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.104+0000 7fba7be00640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba740cd490 con 0x7fba7406ac50 2024-03-08T06:06:17.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.104+0000 7fba7be00640 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba740cd730 con 0x7fba740b3ed0 2024-03-08T06:06:17.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.104+0000 7fba7be00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba740cd9f0 con 0x7fba740b21f0 2024-03-08T06:06:17.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.104+0000 7fba79400640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fba7406ac50 0x7fba7406b030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34534/0 (socket says 172.21.15.19:34534) 2024-03-08T06:06:17.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.104+0000 7fba79400640 1 -- 172.21.15.19:0/1777377251 learned_addr learned my addr 172.21.15.19:0/1777377251 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:06:17.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.104+0000 7fba79e00640 1 --2- 172.21.15.19:0/1777377251 >> v2:172.21.15.19:3300/0 conn(0x7fba740b3ed0 0x7fba740ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:06:17.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.104+0000 7fba78a00640 1 --2- 172.21.15.19:0/1777377251 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fba740b21f0 0x7fba740b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:06:17.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.105+0000 7fba73e00640 1 -- 172.21.15.19:0/1777377251 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121084839 0 0) 0x7fba740cd490 con 0x7fba7406ac50 2024-03-08T06:06:17.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.105+0000 7fba73e00640 1 -- 172.21.15.19:0/1777377251 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba5c003520 con 0x7fba7406ac50 2024-03-08T06:06:17.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.105+0000 7fba79e00640 1 -- 172.21.15.19:0/1777377251 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fba740b21f0 msgr2=0x7fba740b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:06:17.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.105+0000 7fba79e00640 1 --2- 172.21.15.19:0/1777377251 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fba740b21f0 0x7fba740b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:17.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.105+0000 7fba79e00640 1 -- 172.21.15.19:0/1777377251 >> v1:172.21.15.19:6789/0 conn(0x7fba7406ac50 legacy=0x7fba7406b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:06:17.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.105+0000 7fba79e00640 1 -- 172.21.15.19:0/1777377251 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba740cdcd0 con 0x7fba740b3ed0 2024-03-08T06:06:17.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.105+0000 7fba78a00640 1 --2- 172.21.15.19:0/1777377251 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fba740b21f0 0x7fba740b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-08T06:06:17.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.106+0000 7fba79e00640 1 --2- 172.21.15.19:0/1777377251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba740b3ed0 0x7fba740ce4d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fba6c009d90 tx=0x7fba6c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706851995feade6b server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:06:17.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.106+0000 7fba73e00640 1 -- 172.21.15.19:0/1777377251 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c039070 con 0x7fba740b3ed0 2024-03-08T06:06:17.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.106+0000 7fba73e00640 1 -- 172.21.15.19:0/1777377251 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c02cc50 con 0x7fba740b3ed0 2024-03-08T06:06:17.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.106+0000 7fba73e00640 1 -- 172.21.15.19:0/1777377251 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c034440 con 0x7fba740b3ed0 2024-03-08T06:06:17.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.107+0000 7fba7be00640 1 -- 172.21.15.19:0/1777377251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba740b3ed0 msgr2=0x7fba740ce4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:06:17.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.107+0000 7fba7be00640 1 --2- 172.21.15.19:0/1777377251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba740b3ed0 0x7fba740ce4d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fba6c009d90 tx=0x7fba6c02bea0 comp rx=0 tx=0).stop 2024-03-08T06:06:17.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.107+0000 7fba7be00640 1 -- 172.21.15.19:0/1777377251 shutdown_connections 2024-03-08T06:06:17.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.107+0000 7fba7be00640 1 --2- 172.21.15.19:0/1777377251 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba740b3ed0 0x7fba740ce4d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:17.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.107+0000 7fba7be00640 1 --2- 172.21.15.19:0/1777377251 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fba740b21f0 0x7fba740b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:17.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.107+0000 7fba7be00640 1 -- 172.21.15.19:0/1777377251 >> 172.21.15.19:0/1777377251 conn(0x7fba740b60d0 msgr2=0x7fba74099a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:06:17.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.107+0000 7fba7be00640 1 -- 172.21.15.19:0/1777377251 shutdown_connections 2024-03-08T06:06:17.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.107+0000 7fba7be00640 1 -- 172.21.15.19:0/1777377251 wait complete. 2024-03-08T06:06:17.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.109+0000 7fba7be00640 1 Processor -- start 2024-03-08T06:06:17.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.109+0000 7fba7be00640 1 -- start start 2024-03-08T06:06:17.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.110+0000 7fba7be00640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fba7406ac50 0x7fba741f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:17.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.110+0000 7fba7be00640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba740b21f0 0x7fba740c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:17.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.110+0000 7fba7be00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba7409e480 0x7fba740cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:17.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.110+0000 7fba7be00640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba741479e0 con 0x7fba7409e480 2024-03-08T06:06:17.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.110+0000 7fba7be00640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba74147860 con 0x7fba740b21f0 2024-03-08T06:06:17.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.110+0000 7fba7be00640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba740cea10 con 0x7fba7406ac50 2024-03-08T06:06:17.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.110+0000 7fba79e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba7409e480 0x7fba740cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:06:17.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.110+0000 7fba79e00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba7409e480 0x7fba740cc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39342/0 (socket says 172.21.15.19:39342) 2024-03-08T06:06:17.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.110+0000 7fba79e00640 1 -- 172.21.15.19:0/2134740636 learned_addr learned my addr 172.21.15.19:0/2134740636 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:06:17.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.110+0000 7fba78a00640 1 --2- 172.21.15.19:0/2134740636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba740b21f0 0x7fba740c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:06:17.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.110+0000 7fba79e00640 1 -- 172.21.15.19:0/2134740636 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fba7406ac50 msgr2=0x7fba741f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:06:17.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.110+0000 7fba79e00640 1 --2- 172.21.15.19:0/2134740636 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fba7406ac50 0x7fba741f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:17.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.110+0000 7fba79e00640 1 -- 172.21.15.19:0/2134740636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba740b21f0 msgr2=0x7fba740c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:06:17.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.110+0000 7fba79e00640 1 --2- 172.21.15.19:0/2134740636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba740b21f0 0x7fba740c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:17.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.110+0000 7fba79e00640 1 -- 172.21.15.19:0/2134740636 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba740ca4b0 con 0x7fba7409e480 2024-03-08T06:06:17.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.110+0000 7fba78a00640 1 --2- 172.21.15.19:0/2134740636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba740b21f0 0x7fba740c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:06:17.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.111+0000 7fba79e00640 1 --2- 172.21.15.19:0/2134740636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba7409e480 0x7fba740cc090 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fba6c009d90 tx=0x7fba6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:06:17.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.111+0000 7fba71600640 1 -- 172.21.15.19:0/2134740636 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c039050 con 0x7fba7409e480 2024-03-08T06:06:17.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.111+0000 7fba71600640 1 -- 172.21.15.19:0/2134740636 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c045070 con 0x7fba7409e480 2024-03-08T06:06:17.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.111+0000 7fba71600640 1 -- 172.21.15.19:0/2134740636 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c03e610 con 0x7fba7409e480 2024-03-08T06:06:17.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.111+0000 7fba7be00640 1 -- 172.21.15.19:0/2134740636 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba740ca790 con 0x7fba7409e480 2024-03-08T06:06:17.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.111+0000 7fba7be00640 1 -- 172.21.15.19:0/2134740636 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba740cad50 con 0x7fba7409e480 2024-03-08T06:06:17.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.112+0000 7fba7be00640 1 -- 172.21.15.19:0/2134740636 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba74067cb0 con 0x7fba7409e480 2024-03-08T06:06:17.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.113+0000 7fba71600640 1 -- 172.21.15.19:0/2134740636 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fba6c03e7b0 con 0x7fba7409e480 2024-03-08T06:06:17.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.114+0000 7fba71600640 1 --2- 172.21.15.19:0/2134740636 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fba5406b4d0 0x7fba5406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:17.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.114+0000 7fba71600640 1 -- 172.21.15.19:0/2134740636 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fba6c0acae0 con 0x7fba7409e480 2024-03-08T06:06:17.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.114+0000 7fba79400640 1 --2- 172.21.15.19:0/2134740636 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fba5406b4d0 0x7fba5406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:06:17.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.115+0000 7fba79400640 1 --2- 172.21.15.19:0/2134740636 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fba5406b4d0 0x7fba5406d990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fba68000f60 tx=0x7fba680078f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:06:17.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.119+0000 7fba71600640 1 -- 172.21.15.19:0/2134740636 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fba6c07bc50 con 0x7fba7409e480 2024-03-08T06:06:17.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.321+0000 7fba7be00640 1 -- 172.21.15.19:0/2134740636 --> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba740ca250 con 0x7fba5406b4d0 2024-03-08T06:06:17.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.322+0000 7fba71600640 1 -- 172.21.15.19:0/2134740636 <== mgr.4107 v2:172.21.15.19:6832/3589745192 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13360 (secure 0 0 0) 0x7fba68005890 con 0x7fba5406b4d0 2024-03-08T06:06:17.323 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:06:17.324 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-03-08T06:06:17.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.325+0000 7fba7be00640 1 -- 172.21.15.19:0/2134740636 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fba5406b4d0 msgr2=0x7fba5406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:06:17.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.325+0000 7fba7be00640 1 --2- 172.21.15.19:0/2134740636 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fba5406b4d0 0x7fba5406d990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fba68000f60 tx=0x7fba680078f0 comp rx=0 tx=0).stop 2024-03-08T06:06:17.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.325+0000 7fba7be00640 1 -- 172.21.15.19:0/2134740636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba7409e480 msgr2=0x7fba740cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:06:17.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.325+0000 7fba7be00640 1 --2- 172.21.15.19:0/2134740636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba7409e480 0x7fba740cc090 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fba6c009d90 tx=0x7fba6c004a40 comp rx=0 tx=0).stop 2024-03-08T06:06:17.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.325+0000 7fba7be00640 1 -- 172.21.15.19:0/2134740636 shutdown_connections 2024-03-08T06:06:17.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.325+0000 7fba7be00640 1 --2- 172.21.15.19:0/2134740636 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fba5406b4d0 0x7fba5406d990 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:17.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.325+0000 7fba7be00640 1 --2- 172.21.15.19:0/2134740636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba7409e480 0x7fba740cc090 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:17.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.325+0000 7fba7be00640 1 --2- 172.21.15.19:0/2134740636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba740b21f0 0x7fba740c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:17.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.325+0000 7fba7be00640 1 --2- 172.21.15.19:0/2134740636 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fba7406ac50 0x7fba741f4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:17.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.325+0000 7fba7be00640 1 -- 172.21.15.19:0/2134740636 >> 172.21.15.19:0/2134740636 conn(0x7fba740b60d0 msgr2=0x7fba740ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:06:17.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.325+0000 7fba7be00640 1 -- 172.21.15.19:0/2134740636 shutdown_connections 2024-03-08T06:06:17.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.325+0000 7fba7be00640 1 -- 172.21.15.19:0/2134740636 wait complete. 2024-03-08T06:06:17.346 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-03-08T06:06:16.134449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262276,"kb_used_data":4520,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754712444,"statfs":{"total":773094113280,"available":772825542656,"internally_reserved":0,"allocated":4628480,"data_stored":2532096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003612"},"pg_stats":[{"pgid":"1.0","version":"37'119","reported_seq":214,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-08T06:05:57.127684+0000","last_change":"2024-03-08T06:05:57.127758+0000","last_active":"2024-03-08T06:05:57.127684+0000","last_peered":"2024-03-08T06:05:57.127684+0000","last_clean":"2024-03-08T06:05:57.127684+0000","last_became_active":"2024-03-08T06:03:16.676829+0000","last_became_peered":"2024-03-08T06:03:16.676829+0000","last_unstale":"2024-03-08T06:05:57.127684+0000","last_undegraded":"2024-03-08T06:05:57.127684+0000","last_fullsized":"2024-03-08T06:05:57.127684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'119","last_scrub_stamp":"2024-03-08T06:05:57.127458+0000","last_deep_scrub":"37'119","last_deep_scrub_stamp":"2024-03-08T06:05:57.127458+0000","last_clean_scrub_stamp":"2024-03-08T06:05:57.127458+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-09T14:54:38.360122+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1024000,"data_stored":759288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":168920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":168920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":168920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35764,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336076,"statfs":{"total":96636764160,"available":96600141824,"internally_reserved":0,"allocated":430080,"data_stored":168920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":168920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35760,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336080,"statfs":{"total":96636764160,"available":96600145920,"internally_reserved":0,"allocated":430080,"data_stored":168920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1024000,"data_stored":759288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-08T06:06:17.347 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-08T06:06:17.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.557+0000 7f941e400640 1 Processor -- start 2024-03-08T06:06:17.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.558+0000 7f941e400640 1 -- start start 2024-03-08T06:06:17.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.559+0000 7f941e400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9418145590 0x7f94180cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:17.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.559+0000 7f941e400640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9418160610 con 0x7f94180b3bd0 2024-03-08T06:06:17.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.560+0000 7f941e400640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9418071990 con 0x7f94180ccc70 2024-03-08T06:06:17.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.560+0000 7f941e400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9418071c70 con 0x7f9418145590 2024-03-08T06:06:17.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.560+0000 7f9417e00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f94180b3bd0 0x7f941815ff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34536/0 (socket says 172.21.15.19:34536) 2024-03-08T06:06:17.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.560+0000 7f9417e00640 1 -- 172.21.15.19:0/1729422661 learned_addr learned my addr 172.21.15.19:0/1729422661 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:06:17.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.560+0000 7f9417400640 1 --2- 172.21.15.19:0/1729422661 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9418145590 0x7f94180cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:06:17.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.560+0000 7f9416000640 1 -- 172.21.15.19:0/1729422661 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985654215 0 0) 0x7f9418160610 con 0x7f94180b3bd0 2024-03-08T06:06:17.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.561+0000 7f9416000640 1 -- 172.21.15.19:0/1729422661 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93fc003520 con 0x7f94180b3bd0 2024-03-08T06:06:17.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.561+0000 7f9416000640 1 -- 172.21.15.19:0/1729422661 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4131498827 0 0) 0x7f93fc003520 con 0x7f94180b3bd0 2024-03-08T06:06:17.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.561+0000 7f9416000640 1 -- 172.21.15.19:0/1729422661 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9418145590 msgr2=0x7f94180cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:06:17.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.561+0000 7f9416000640 1 --2- 172.21.15.19:0/1729422661 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9418145590 0x7f94180cf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:17.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.561+0000 7f9416000640 1 -- 172.21.15.19:0/1729422661 >> v1:172.21.15.42:6789/0 conn(0x7f94180ccc70 legacy=0x7f941815f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:06:17.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.561+0000 7f9416000640 1 -- 172.21.15.19:0/1729422661 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9418071f50 con 0x7f94180b3bd0 2024-03-08T06:06:17.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.561+0000 7f9416000640 1 -- 172.21.15.19:0/1729422661 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7f9410001670 con 0x7f94180b3bd0 2024-03-08T06:06:17.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.561+0000 7f9416000640 1 -- 172.21.15.19:0/1729422661 >> v1:172.21.15.19:6789/0 conn(0x7f94180b3bd0 legacy=0x7f941815ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:06:17.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.561+0000 7f9416000640 1 --2- 172.21.15.19:0/1729422661 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9418145590 0x7f93fc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:17.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.561+0000 7f9416000640 1 --2- 172.21.15.19:0/1729422661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93fc003f60 0x7f93fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:17.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.561+0000 7f9416000640 1 --2- 172.21.15.19:0/1729422661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93fc004d40 0x7f93fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:17.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.561+0000 7f9416000640 1 -- 172.21.15.19:0/1729422661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9418071c70 con 0x7f93fc004d40 2024-03-08T06:06:17.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.561+0000 7f9416000640 1 -- 172.21.15.19:0/1729422661 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc00baa0 con 0x7f93fc003f60 2024-03-08T06:06:17.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.561+0000 7f9416000640 1 -- 172.21.15.19:0/1729422661 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc00bca0 con 0x7f9418145590 2024-03-08T06:06:17.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.561+0000 7f9417e00640 1 --2- 172.21.15.19:0/1729422661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93fc004d40 0x7f93fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:06:17.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.562+0000 7f9416a00640 1 --2- 172.21.15.19:0/1729422661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93fc003f60 0x7f93fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:06:17.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.562+0000 7f9417400640 1 --2- 172.21.15.19:0/1729422661 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9418145590 0x7f93fc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:06:17.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.562+0000 7f9417e00640 1 -- 172.21.15.19:0/1729422661 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9418145590 msgr2=0x7f93fc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:06:17.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.562+0000 7f9417e00640 1 --2- 172.21.15.19:0/1729422661 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f9418145590 0x7f93fc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:17.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.562+0000 7f9417e00640 1 -- 172.21.15.19:0/1729422661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93fc003f60 msgr2=0x7f93fc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:06:17.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.562+0000 7f9417e00640 1 --2- 172.21.15.19:0/1729422661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93fc003f60 0x7f93fc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:17.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.562+0000 7f9417e00640 1 -- 172.21.15.19:0/1729422661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc003520 con 0x7f93fc004d40 2024-03-08T06:06:17.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.562+0000 7f9416a00640 1 --2- 172.21.15.19:0/1729422661 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f93fc003f60 0x7f93fc004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:06:17.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.563+0000 7f9417e00640 1 --2- 172.21.15.19:0/1729422661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93fc004d40 0x7f93fc0051c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f941000c210 tx=0x7f93fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a34bfbf3174635 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:06:17.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.563+0000 7f9416000640 1 -- 172.21.15.19:0/1729422661 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9410007d30 con 0x7f93fc004d40 2024-03-08T06:06:17.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.563+0000 7f9416000640 1 -- 172.21.15.19:0/1729422661 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9410030070 con 0x7f93fc004d40 2024-03-08T06:06:17.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.563+0000 7f9416000640 1 -- 172.21.15.19:0/1729422661 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941002cda0 con 0x7f93fc004d40 2024-03-08T06:06:17.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.564+0000 7f941e400640 1 -- 172.21.15.19:0/1729422661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93fc004d40 msgr2=0x7f93fc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:06:17.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.564+0000 7f941e400640 1 --2- 172.21.15.19:0/1729422661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93fc004d40 0x7f93fc0051c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f941000c210 tx=0x7f93fc005830 comp rx=0 tx=0).stop 2024-03-08T06:06:17.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.564+0000 7f9417e00640 1 -- 172.21.15.19:0/1729422661 reap_dead start 2024-03-08T06:06:17.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.564+0000 7f941e400640 1 -- 172.21.15.19:0/1729422661 shutdown_connections 2024-03-08T06:06:17.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.564+0000 7f941e400640 1 -- 172.21.15.19:0/1729422661 >> 172.21.15.19:0/1729422661 conn(0x7f94180cfaa0 msgr2=0x7f94180cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:06:17.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.564+0000 7f941e400640 1 -- 172.21.15.19:0/1729422661 shutdown_connections 2024-03-08T06:06:17.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.564+0000 7f941e400640 1 -- 172.21.15.19:0/1729422661 wait complete. 2024-03-08T06:06:17.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.566+0000 7f941e400640 1 Processor -- start 2024-03-08T06:06:17.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.566+0000 7f941e400640 1 -- start start 2024-03-08T06:06:17.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.567+0000 7f941e400640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f93fc004d40 0x7f94181404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:17.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.567+0000 7f941e400640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94181f7960 0x7f94181f7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:17.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.567+0000 7f941e400640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9418141e70 0x7f94181422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:17.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.567+0000 7f941e400640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9418145970 con 0x7f94181f7960 2024-03-08T06:06:17.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.567+0000 7f941e400640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9418072510 con 0x7f9418141e70 2024-03-08T06:06:17.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.567+0000 7f941e400640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94180cd960 con 0x7f93fc004d40 2024-03-08T06:06:17.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.567+0000 7f9416a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94181f7960 0x7f94181f7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:06:17.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.567+0000 7f9416a00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94181f7960 0x7f94181f7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39368/0 (socket says 172.21.15.19:39368) 2024-03-08T06:06:17.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.567+0000 7f9416a00640 1 -- 172.21.15.19:0/950615411 learned_addr learned my addr 172.21.15.19:0/950615411 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:06:17.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.568+0000 7f9417400640 1 --2- 172.21.15.19:0/950615411 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f93fc004d40 0x7f94181404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:06:17.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.568+0000 7f9416a00640 1 -- 172.21.15.19:0/950615411 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f93fc004d40 msgr2=0x7f94181404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:06:17.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.568+0000 7f9416a00640 1 --2- 172.21.15.19:0/950615411 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f93fc004d40 0x7f94181404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:17.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.568+0000 7f9416a00640 1 -- 172.21.15.19:0/950615411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9418141e70 msgr2=0x7f94181422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:06:17.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.568+0000 7f9416a00640 1 --2- 172.21.15.19:0/950615411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9418141e70 0x7f94181422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:17.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.568+0000 7f9416a00640 1 -- 172.21.15.19:0/950615411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94180af530 con 0x7f94181f7960 2024-03-08T06:06:17.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.568+0000 7f9416a00640 1 --2- 172.21.15.19:0/950615411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94181f7960 0x7f94181f7de0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f940400d7a0 tx=0x7f940400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:06:17.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.568+0000 7f940f400640 1 -- 172.21.15.19:0/950615411 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404005070 con 0x7f94181f7960 2024-03-08T06:06:17.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.569+0000 7f940f400640 1 -- 172.21.15.19:0/950615411 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9404005210 con 0x7f94181f7960 2024-03-08T06:06:17.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.569+0000 7f940f400640 1 -- 172.21.15.19:0/950615411 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404007030 con 0x7f94181f7960 2024-03-08T06:06:17.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.569+0000 7f941e400640 1 -- 172.21.15.19:0/950615411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94181f8800 con 0x7f94181f7960 2024-03-08T06:06:17.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.569+0000 7f941e400640 1 -- 172.21.15.19:0/950615411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94180c9000 con 0x7f94181f7960 2024-03-08T06:06:17.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.570+0000 7f941e400640 1 -- 172.21.15.19:0/950615411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9418067cb0 con 0x7f94181f7960 2024-03-08T06:06:17.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.571+0000 7f940f400640 1 -- 172.21.15.19:0/950615411 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7f940401a020 con 0x7f94181f7960 2024-03-08T06:06:17.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.572+0000 7f940f400640 1 --2- 172.21.15.19:0/950615411 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f93f806b4d0 0x7f93f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:17.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.572+0000 7f940f400640 1 -- 172.21.15.19:0/950615411 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f94040896e0 con 0x7f94181f7960 2024-03-08T06:06:17.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.572+0000 7f9417400640 1 --2- 172.21.15.19:0/950615411 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f93f806b4d0 0x7f93f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:06:17.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.573+0000 7f9417400640 1 --2- 172.21.15.19:0/950615411 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f93f806b4d0 0x7f93f806d990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9408007520 tx=0x7f940800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:06:17.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.576+0000 7f940f400640 1 -- 172.21.15.19:0/950615411 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f94180af530 con 0x7f94181f7960 2024-03-08T06:06:17.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.775+0000 7f941e400640 1 -- 172.21.15.19:0/950615411 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f94181427f0 con 0x7f94181f7960 2024-03-08T06:06:17.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.782+0000 7f940f400640 1 -- 172.21.15.19:0/950615411 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f9404058850 con 0x7f94181f7960 2024-03-08T06:06:17.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.784+0000 7f940f400640 1 -- 172.21.15.19:0/950615411 <== mon.0 v2:172.21.15.19:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9404058150 con 0x7f94181f7960 2024-03-08T06:06:17.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.786+0000 7f941e400640 1 -- 172.21.15.19:0/950615411 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f93f806b4d0 msgr2=0x7f93f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:06:17.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.786+0000 7f941e400640 1 --2- 172.21.15.19:0/950615411 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f93f806b4d0 0x7f93f806d990 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9408007520 tx=0x7f940800b040 comp rx=0 tx=0).stop 2024-03-08T06:06:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.786+0000 7f941e400640 1 -- 172.21.15.19:0/950615411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94181f7960 msgr2=0x7f94181f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:06:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.786+0000 7f941e400640 1 --2- 172.21.15.19:0/950615411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94181f7960 0x7f94181f7de0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f940400d7a0 tx=0x7f940400dc60 comp rx=0 tx=0).stop 2024-03-08T06:06:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.786+0000 7f941e400640 1 -- 172.21.15.19:0/950615411 shutdown_connections 2024-03-08T06:06:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.786+0000 7f941e400640 1 --2- 172.21.15.19:0/950615411 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7f93f806b4d0 0x7f93f806d990 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.786+0000 7f941e400640 1 --2- 172.21.15.19:0/950615411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9418141e70 0x7f94181422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.786+0000 7f941e400640 1 --2- 172.21.15.19:0/950615411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94181f7960 0x7f94181f7de0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:17.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.786+0000 7f941e400640 1 --2- 172.21.15.19:0/950615411 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7f93fc004d40 0x7f94181404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:17.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.786+0000 7f941e400640 1 -- 172.21.15.19:0/950615411 >> 172.21.15.19:0/950615411 conn(0x7f94180cfaa0 msgr2=0x7f94180cd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:06:17.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.787+0000 7f941e400640 1 -- 172.21.15.19:0/950615411 shutdown_connections 2024-03-08T06:06:17.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:17.787+0000 7f941e400640 1 -- 172.21.15.19:0/950615411 wait complete. 2024-03-08T06:06:17.808 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-08T06:06:17.808 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-08T06:06:18.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.016+0000 7fa916200640 1 Processor -- start 2024-03-08T06:06:18.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.016+0000 7fa916200640 1 -- start start 2024-03-08T06:06:18.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.018+0000 7fa916200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa910071df0 0x7fa91015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:18.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.018+0000 7fa916200640 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa91015ceb0 con 0x7fa91015bea0 2024-03-08T06:06:18.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.018+0000 7fa916200640 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa91015c330 con 0x7fa910145520 2024-03-08T06:06:18.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.018+0000 7fa916200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91015c610 con 0x7fa910071df0 2024-03-08T06:06:18.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.018+0000 7fa90fe00640 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa91015bea0 0x7fa91006d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34538/0 (socket says 172.21.15.19:34538) 2024-03-08T06:06:18.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.018+0000 7fa90fe00640 1 -- 172.21.15.19:0/120530902 learned_addr learned my addr 172.21.15.19:0/120530902 (peer_addr_for_me v1:172.21.15.19:0/0) 2024-03-08T06:06:18.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.019+0000 7fa915800640 1 --2- 172.21.15.19:0/120530902 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa910071df0 0x7fa91015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:06:18.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.019+0000 7fa90f400640 1 -- 172.21.15.19:0/120530902 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288330497 0 0) 0x7fa91015ceb0 con 0x7fa91015bea0 2024-03-08T06:06:18.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.019+0000 7fa90f400640 1 -- 172.21.15.19:0/120530902 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8f8003520 con 0x7fa91015bea0 2024-03-08T06:06:18.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.019+0000 7fa90f400640 1 -- 172.21.15.19:0/120530902 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3487588589 0 0) 0x7fa8f8003520 con 0x7fa91015bea0 2024-03-08T06:06:18.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.019+0000 7fa90f400640 1 -- 172.21.15.19:0/120530902 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa910071df0 msgr2=0x7fa91015d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:06:18.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.019+0000 7fa90f400640 1 --2- 172.21.15.19:0/120530902 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa910071df0 0x7fa91015d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:18.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.019+0000 7fa90f400640 1 -- 172.21.15.19:0/120530902 >> v1:172.21.15.42:6789/0 conn(0x7fa910145520 legacy=0x7fa9100716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:06:18.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.019+0000 7fa90f400640 1 -- 172.21.15.19:0/120530902 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91015c8f0 con 0x7fa91015bea0 2024-03-08T06:06:18.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.019+0000 7fa90f400640 1 -- 172.21.15.19:0/120530902 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1733231081 0 0) 0x7fa8fc001670 con 0x7fa91015bea0 2024-03-08T06:06:18.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.019+0000 7fa90f400640 1 -- 172.21.15.19:0/120530902 >> v1:172.21.15.19:6789/0 conn(0x7fa91015bea0 legacy=0x7fa91006d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:06:18.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.019+0000 7fa90f400640 1 --2- 172.21.15.19:0/120530902 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa910071df0 0x7fa8f80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:18.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.020+0000 7fa90f400640 1 --2- 172.21.15.19:0/120530902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8f8003f60 0x7fa8f8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:18.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.020+0000 7fa90f400640 1 --2- 172.21.15.19:0/120530902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8f8004d40 0x7fa8f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:18.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.020+0000 7fa90f400640 1 -- 172.21.15.19:0/120530902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91015c610 con 0x7fa8f8004d40 2024-03-08T06:06:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.020+0000 7fa90f400640 1 -- 172.21.15.19:0/120530902 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f800baa0 con 0x7fa8f8003f60 2024-03-08T06:06:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.020+0000 7fa90f400640 1 -- 172.21.15.19:0/120530902 --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f800bca0 con 0x7fa910071df0 2024-03-08T06:06:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.020+0000 7fa915800640 1 --2- 172.21.15.19:0/120530902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8f8004d40 0x7fa8f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:06:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.020+0000 7fa90fe00640 1 --2- 172.21.15.19:0/120530902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8f8003f60 0x7fa8f8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:06:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.020+0000 7fa914e00640 1 --2- 172.21.15.19:0/120530902 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa910071df0 0x7fa8f80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:06:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.020+0000 7fa915800640 1 -- 172.21.15.19:0/120530902 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa910071df0 msgr2=0x7fa8f80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:06:18.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.020+0000 7fa915800640 1 --2- 172.21.15.19:0/120530902 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa910071df0 0x7fa8f80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:18.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.020+0000 7fa915800640 1 -- 172.21.15.19:0/120530902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8f8003f60 msgr2=0x7fa8f8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-08T06:06:18.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.020+0000 7fa915800640 1 --2- 172.21.15.19:0/120530902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8f8003f60 0x7fa8f8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:18.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.020+0000 7fa915800640 1 -- 172.21.15.19:0/120530902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f8003520 con 0x7fa8f8004d40 2024-03-08T06:06:18.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.020+0000 7fa90fe00640 1 --2- 172.21.15.19:0/120530902 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa8f8003f60 0x7fa8f8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:06:18.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.020+0000 7fa914e00640 1 --2- 172.21.15.19:0/120530902 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa910071df0 0x7fa8f80039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:06:18.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.022+0000 7fa915800640 1 --2- 172.21.15.19:0/120530902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8f8004d40 0x7fa8f80051c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa908009f90 tx=0x7fa8f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b8ac07df6a889d server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:06:18.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.022+0000 7fa90f400640 1 -- 172.21.15.19:0/120530902 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa908039070 con 0x7fa8f8004d40 2024-03-08T06:06:18.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.022+0000 7fa90f400640 1 -- 172.21.15.19:0/120530902 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa90802cbd0 con 0x7fa8f8004d40 2024-03-08T06:06:18.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.022+0000 7fa90f400640 1 -- 172.21.15.19:0/120530902 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa908009c10 con 0x7fa8f8004d40 2024-03-08T06:06:18.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.022+0000 7fa916200640 1 -- 172.21.15.19:0/120530902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8f8004d40 msgr2=0x7fa8f80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:06:18.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.022+0000 7fa916200640 1 --2- 172.21.15.19:0/120530902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8f8004d40 0x7fa8f80051c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa908009f90 tx=0x7fa8f8005830 comp rx=0 tx=0).stop 2024-03-08T06:06:18.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.022+0000 7fa915800640 1 -- 172.21.15.19:0/120530902 reap_dead start 2024-03-08T06:06:18.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.023+0000 7fa916200640 1 -- 172.21.15.19:0/120530902 shutdown_connections 2024-03-08T06:06:18.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.023+0000 7fa916200640 1 -- 172.21.15.19:0/120530902 >> 172.21.15.19:0/120530902 conn(0x7fa9100b1850 msgr2=0x7fa9100b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:06:18.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.023+0000 7fa916200640 1 -- 172.21.15.19:0/120530902 shutdown_connections 2024-03-08T06:06:18.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.023+0000 7fa916200640 1 -- 172.21.15.19:0/120530902 wait complete. 2024-03-08T06:06:18.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.024+0000 7fa916200640 1 Processor -- start 2024-03-08T06:06:18.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.025+0000 7fa916200640 1 -- start start 2024-03-08T06:06:18.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.026+0000 7fa916200640 1 --2- >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa8f8004d40 0x7fa91015af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:18.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.026+0000 7fa916200640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa910134b30 0x7fa91015a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:18.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.026+0000 7fa916200640 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9101362b0 0x7fa9100afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:18.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.026+0000 7fa916200640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9100af1c0 con 0x7fa910134b30 2024-03-08T06:06:18.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.026+0000 7fa916200640 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9100af040 con 0x7fa9101362b0 2024-03-08T06:06:18.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.026+0000 7fa916200640 1 -- --> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91006e410 con 0x7fa8f8004d40 2024-03-08T06:06:18.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.026+0000 7fa90fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa910134b30 0x7fa91015a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:06:18.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.026+0000 7fa90fe00640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa910134b30 0x7fa91015a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39386/0 (socket says 172.21.15.19:39386) 2024-03-08T06:06:18.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.026+0000 7fa90fe00640 1 -- 172.21.15.19:0/991479166 learned_addr learned my addr 172.21.15.19:0/991479166 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-03-08T06:06:18.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.026+0000 7fa914e00640 1 --2- 172.21.15.19:0/991479166 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa8f8004d40 0x7fa91015af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:06:18.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.026+0000 7fa915800640 1 --2- 172.21.15.19:0/991479166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9101362b0 0x7fa9100afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:06:18.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.026+0000 7fa90fe00640 1 -- 172.21.15.19:0/991479166 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa8f8004d40 msgr2=0x7fa91015af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:06:18.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.026+0000 7fa90fe00640 1 --2- 172.21.15.19:0/991479166 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa8f8004d40 0x7fa91015af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:18.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.027+0000 7fa90fe00640 1 -- 172.21.15.19:0/991479166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9101362b0 msgr2=0x7fa9100afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:06:18.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.027+0000 7fa90fe00640 1 --2- 172.21.15.19:0/991479166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9101362b0 0x7fa9100afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:18.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.027+0000 7fa90fe00640 1 -- 172.21.15.19:0/991479166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa910135210 con 0x7fa910134b30 2024-03-08T06:06:18.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.027+0000 7fa915800640 1 --2- 172.21.15.19:0/991479166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9101362b0 0x7fa9100afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-08T06:06:18.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.027+0000 7fa90fe00640 1 --2- 172.21.15.19:0/991479166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa910134b30 0x7fa91015a8a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00db10 tx=0x7fa8fc007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:06:18.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.027+0000 7fa90cc00640 1 -- 172.21.15.19:0/991479166 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc019070 con 0x7fa910134b30 2024-03-08T06:06:18.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.027+0000 7fa90cc00640 1 -- 172.21.15.19:0/991479166 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa8fc0074e0 con 0x7fa910134b30 2024-03-08T06:06:18.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.027+0000 7fa916200640 1 -- 172.21.15.19:0/991479166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9101354f0 con 0x7fa910134b30 2024-03-08T06:06:18.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.027+0000 7fa90cc00640 1 -- 172.21.15.19:0/991479166 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0047e0 con 0x7fa910134b30 2024-03-08T06:06:18.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.027+0000 7fa916200640 1 -- 172.21.15.19:0/991479166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa910135ab0 con 0x7fa910134b30 2024-03-08T06:06:18.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.028+0000 7fa916200640 1 -- 172.21.15.19:0/991479166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa910075100 con 0x7fa910134b30 2024-03-08T06:06:18.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.029+0000 7fa90cc00640 1 -- 172.21.15.19:0/991479166 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 89780+0+0 (secure 0 0 0) 0x7fa8fc01c070 con 0x7fa910134b30 2024-03-08T06:06:18.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.030+0000 7fa90cc00640 1 --2- 172.21.15.19:0/991479166 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa8f006b4a0 0x7fa8f006d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-08T06:06:18.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.030+0000 7fa90cc00640 1 -- 172.21.15.19:0/991479166 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa8fc089c60 con 0x7fa910134b30 2024-03-08T06:06:18.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.031+0000 7fa914e00640 1 --2- 172.21.15.19:0/991479166 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa8f006b4a0 0x7fa8f006d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-08T06:06:18.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.031+0000 7fa914e00640 1 --2- 172.21.15.19:0/991479166 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa8f006b4a0 0x7fa8f006d960 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa9100b1440 tx=0x7fa904009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-08T06:06:18.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.035+0000 7fa90cc00640 1 -- 172.21.15.19:0/991479166 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa8fc058cb0 con 0x7fa910134b30 2024-03-08T06:06:18.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.277+0000 7fa916200640 1 -- 172.21.15.19:0/991479166 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9100cdef0 con 0x7fa910134b30 2024-03-08T06:06:18.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.279+0000 7fa90cc00640 1 -- 172.21.15.19:0/991479166 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3696 (secure 0 0 0) 0x7fa8fc0585b0 con 0x7fa910134b30 2024-03-08T06:06:18.280 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-03-08T06:06:18.280 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4565,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3542863285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3542863285},{"type":"v1","addr":"172.21.15.42:6833","nonce":3542863285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4708,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1679053115","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1679053115},{"type":"v1","addr":"172.21.15.42:6835","nonce":1679053115}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5022,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/717236359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":717236359},{"type":"v1","addr":"172.21.15.19:6835","nonce":717236359}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5427,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/3173053431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":3173053431},{"type":"v1","addr":"172.21.15.19:6837","nonce":3173053431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":18}],"filesystems":[]} 2024-03-08T06:06:18.281 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 18 2024-03-08T06:06:18.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.281+0000 7fa916200640 1 -- 172.21.15.19:0/991479166 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa8f006b4a0 msgr2=0x7fa8f006d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:06:18.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.281+0000 7fa916200640 1 --2- 172.21.15.19:0/991479166 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa8f006b4a0 0x7fa8f006d960 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa9100b1440 tx=0x7fa904009040 comp rx=0 tx=0).stop 2024-03-08T06:06:18.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.281+0000 7fa916200640 1 -- 172.21.15.19:0/991479166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa910134b30 msgr2=0x7fa91015a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-08T06:06:18.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.281+0000 7fa916200640 1 --2- 172.21.15.19:0/991479166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa910134b30 0x7fa91015a8a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00db10 tx=0x7fa8fc007e10 comp rx=0 tx=0).stop 2024-03-08T06:06:18.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.281+0000 7fa916200640 1 -- 172.21.15.19:0/991479166 shutdown_connections 2024-03-08T06:06:18.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.281+0000 7fa916200640 1 --2- 172.21.15.19:0/991479166 >> [v2:172.21.15.19:6832/3589745192,v1:172.21.15.19:6833/3589745192] conn(0x7fa8f006b4a0 0x7fa8f006d960 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:18.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.281+0000 7fa916200640 1 --2- 172.21.15.19:0/991479166 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9101362b0 0x7fa9100afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:18.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.281+0000 7fa916200640 1 --2- 172.21.15.19:0/991479166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa910134b30 0x7fa91015a8a0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:18.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.281+0000 7fa916200640 1 --2- 172.21.15.19:0/991479166 >> [v2:172.21.15.42:3301/0,v1:172.21.15.42:6790/0] conn(0x7fa8f8004d40 0x7fa91015af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-08T06:06:18.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.281+0000 7fa916200640 1 -- 172.21.15.19:0/991479166 >> 172.21.15.19:0/991479166 conn(0x7fa9100b1850 msgr2=0x7fa91015f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-08T06:06:18.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.282+0000 7fa916200640 1 -- 172.21.15.19:0/991479166 shutdown_connections 2024-03-08T06:06:18.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-03-08T06:06:18.282+0000 7fa916200640 1 -- 172.21.15.19:0/991479166 wait complete. 2024-03-08T06:06:18.301 DEBUG:tasks.cephfs.filesystem:already dead... 2024-03-08T06:06:18.302 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-08T06:06:18.302 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-08T06:06:18.302 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:06:18.328 INFO:tasks.ceph.mds.a:Stopped 2024-03-08T06:06:18.328 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-08T06:06:18.329 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:06:18.389 INFO:tasks.ceph.mds.c:Stopped 2024-03-08T06:06:18.390 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-08T06:06:18.390 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:06:18.411 INFO:tasks.ceph.mds.b:Stopped 2024-03-08T06:06:18.411 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-08T06:06:18.412 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:06:18.476 INFO:tasks.ceph.mds.d:Stopped 2024-03-08T06:06:18.476 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-08T06:06:18.477 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-08T06:06:18.477 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:06:18.528 INFO:tasks.ceph.osd.0:Stopped 2024-03-08T06:06:18.529 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-08T06:06:18.529 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:06:18.585 INFO:tasks.ceph.osd.1:Stopped 2024-03-08T06:06:18.585 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-08T06:06:18.586 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:06:18.648 INFO:tasks.ceph.osd.2:Stopped 2024-03-08T06:06:18.648 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-08T06:06:18.648 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:06:18.710 INFO:tasks.ceph.osd.3:Stopped 2024-03-08T06:06:18.710 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-08T06:06:18.710 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:06:18.753 INFO:tasks.ceph.osd.4:Stopped 2024-03-08T06:06:18.754 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-08T06:06:18.754 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:06:18.809 INFO:tasks.ceph.osd.5:Stopped 2024-03-08T06:06:18.810 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-08T06:06:18.810 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:06:18.879 INFO:tasks.ceph.osd.6:Stopped 2024-03-08T06:06:18.880 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-08T06:06:18.880 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:06:18.922 INFO:tasks.ceph.osd.7:Stopped 2024-03-08T06:06:18.922 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-08T06:06:18.923 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-08T06:06:18.923 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:06:18.998 INFO:tasks.ceph.mgr.y:Stopped 2024-03-08T06:06:18.998 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-08T06:06:18.998 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:06:19.075 INFO:tasks.ceph.mgr.x:Stopped 2024-03-08T06:06:19.076 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-08T06:06:19.076 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-08T06:06:19.076 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:06:19.121 INFO:tasks.ceph.mon.a:Stopped 2024-03-08T06:06:19.121 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-08T06:06:19.121 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:06:19.141 INFO:tasks.ceph.mon.b:Stopped 2024-03-08T06:06:19.141 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-08T06:06:19.141 INFO:teuthology.orchestra.run:waiting for 300 2024-03-08T06:06:19.224 INFO:tasks.ceph.mon.c:Stopped 2024-03-08T06:06:19.224 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-08T06:06:19.224 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'missing required features' | head -n 1 2024-03-08T06:06:19.334 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi019.front.sepia.ceph.com 2024-03-08T06:06:19.334 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-08T06:06:19.607 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi019.front.sepia.ceph.com 2024-03-08T06:06:19.608 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-08T06:06:19.870 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi019.front.sepia.ceph.com 2024-03-08T06:06:19.870 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-08T06:06:20.038 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi019.front.sepia.ceph.com 2024-03-08T06:06:20.038 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-08T06:06:20.190 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi042.front.sepia.ceph.com 2024-03-08T06:06:20.190 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-08T06:06:20.422 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi042.front.sepia.ceph.com 2024-03-08T06:06:20.423 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-08T06:06:20.591 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi042.front.sepia.ceph.com 2024-03-08T06:06:20.592 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-08T06:06:20.755 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi042.front.sepia.ceph.com 2024-03-08T06:06:20.755 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-08T06:06:20.929 INFO:tasks.ceph:Archiving mon data... 2024-03-08T06:06:20.930 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/jcollin-2024-03-08_05:43:46-fs:functional-main-distro-default-smithi/7585422/data/mon.a.tgz 2024-03-08T06:06:20.930 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-03-08T06:06:20.991 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.GVPouJJAfW 2024-03-08T06:06:20.992 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.GVPouJJAfW 2024-03-08T06:06:21.181 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.GVPouJJAfW 2024-03-08T06:06:21.340 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.GVPouJJAfW is 294KB 2024-03-08T06:06:21.450 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.GVPouJJAfW 2024-03-08T06:06:21.509 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/jcollin-2024-03-08_05:43:46-fs:functional-main-distro-default-smithi/7585422/data/mon.b.tgz 2024-03-08T06:06:21.509 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-03-08T06:06:21.566 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.oLiA0FiIG0 2024-03-08T06:06:21.566 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.oLiA0FiIG0 2024-03-08T06:06:21.774 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.oLiA0FiIG0 2024-03-08T06:06:21.933 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.oLiA0FiIG0 is 394KB 2024-03-08T06:06:22.042 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.oLiA0FiIG0 2024-03-08T06:06:22.099 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/jcollin-2024-03-08_05:43:46-fs:functional-main-distro-default-smithi/7585422/data/mon.c.tgz 2024-03-08T06:06:22.099 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2024-03-08T06:06:22.151 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.Naw7pbo04Q 2024-03-08T06:06:22.152 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Naw7pbo04Q 2024-03-08T06:06:22.341 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.Naw7pbo04Q 2024-03-08T06:06:22.497 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.Naw7pbo04Q is 394KB 2024-03-08T06:06:22.609 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.Naw7pbo04Q 2024-03-08T06:06:22.668 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-08T06:06:22.668 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-08T06:06:22.676 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-08T06:06:22.835 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-08T06:06:22.894 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-08T06:06:22.894 INFO:tasks.ceph:Archiving crash dumps... 2024-03-08T06:06:22.896 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/crash to /home/teuthworker/archive/jcollin-2024-03-08_05:43:46-fs:functional-main-distro-default-smithi/7585422/remote/smithi019/crash 2024-03-08T06:06:22.897 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-08T06:06:22.999 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/crash to /home/teuthworker/archive/jcollin-2024-03-08_05:43:46-fs:functional-main-distro-default-smithi/7585422/remote/smithi042/crash 2024-03-08T06:06:23.000 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-08T06:06:23.102 INFO:tasks.ceph:Shutting down logrotate 2024-03-08T06:06:23.102 DEBUG:teuthology.orchestra.run.smithi019:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T06:06:23.110 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-08T06:06:23.238 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-08T06:06:23.342 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-08T06:06:23.441 INFO:tasks.ceph:Compressing logs... 2024-03-08T06:06:23.441 DEBUG:teuthology.orchestra.run.smithi019:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-08T06:06:23.449 DEBUG:teuthology.orchestra.run.smithi042:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-08T06:06:23.538 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42121.log 2024-03-08T06:06:23.539 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-08T06:06:23.540 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.3.42121.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.3.42121.log.gz -5 2024-03-08T06:06:23.541 INFO:teuthology.orchestra.run.smithi042.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37192.log 2024-03-08T06:06:23.541 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41714.log 2024-03-08T06:06:23.542 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42457.log 2024-03-08T06:06:23.543 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48154.log 2024-03-08T06:06:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.37192.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37192.log.gz 2024-03-08T06:06:23.543 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-08T06:06:23.544 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42457.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42457.log.gz 2024-03-08T06:06:23.545 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-08T06:06:23.545 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.1.41714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41714.log.gz 2024-03-08T06:06:23.545 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37432.log 2024-03-08T06:06:23.545 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-08T06:06:23.547 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.37432.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-08T06:06:23.547 INFO:teuthology.orchestra.run.smithi042.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37432.log.gz 2024-03-08T06:06:23.547 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48800.log 2024-03-08T06:06:23.547 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mon.a.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48154.log.gz 2024-03-08T06:06:23.548 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51767.log 2024-03-08T06:06:23.548 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46232.log 2024-03-08T06:06:23.549 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48800.log.gz 2024-03-08T06:06:23.549 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51725.log 2024-03-08T06:06:23.549 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51767.log.gz 2024-03-08T06:06:23.550 INFO:teuthology.orchestra.run.smithi042.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-08T06:06:23.550 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37232.log 2024-03-08T06:06:23.550 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.4.log: 91.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-08T06:06:23.551 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42712.log 2024-03-08T06:06:23.551 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.37232.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-08T06:06:23.552 INFO:teuthology.orchestra.run.smithi042.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37232.log.gz 2024-03-08T06:06:23.552 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.1.42712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42712.log.gz 2024-03-08T06:06:23.552 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-08T06:06:23.553 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45854.log 2024-03-08T06:06:23.553 INFO:teuthology.orchestra.run.smithi019.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46232.log.gz 2024-03-08T06:06:23.554 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45770.log 2024-03-08T06:06:23.554 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51725.log.gz 2024-03-08T06:06:23.554 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47303.log 2024-03-08T06:06:23.554 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45854.log.gz 2024-03-08T06:06:23.556 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47345.log 2024-03-08T06:06:23.556 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45770.log.gz 2024-03-08T06:06:23.557 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47303.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47303.log.gz 2024-03-08T06:06:23.557 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51389.log 2024-03-08T06:06:23.557 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51893.log 2024-03-08T06:06:23.557 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47345.log.gz 2024-03-08T06:06:23.557 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37152.log 2024-03-08T06:06:23.557 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37352.log 2024-03-08T06:06:23.558 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.37152.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37152.log.gz 2024-03-08T06:06:23.558 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-08T06:06:23.558 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37272.log 2024-03-08T06:06:23.560 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.37352.log: /var/log/ceph/ceph-mgr.x.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37352.log.gz 2024-03-08T06:06:23.560 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37392.log 2024-03-08T06:06:23.560 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.37272.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-08T06:06:23.560 INFO:teuthology.orchestra.run.smithi042.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.37272.log.gz 2024-03-08T06:06:23.561 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50562.log 2024-03-08T06:06:23.561 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51389.log.gz 2024-03-08T06:06:23.561 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47783.log 2024-03-08T06:06:23.561 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51893.log.gz 2024-03-08T06:06:23.562 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50562.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50562.log.gz 2024-03-08T06:06:23.562 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51515.log 2024-03-08T06:06:23.562 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49880.log 2024-03-08T06:06:23.564 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47783.log.gz 2024-03-08T06:06:23.565 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45644.log 2024-03-08T06:06:23.565 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51515.log.gz 2024-03-08T06:06:23.565 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42058.log 2024-03-08T06:06:23.565 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49880.log.gz 2024-03-08T06:06:23.566 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-client.admin.37392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37312.log 2024-03-08T06:06:23.566 INFO:teuthology.orchestra.run.smithi042.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37392.log.gz 2024-03-08T06:06:23.566 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.37312.log: 93.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-08T06:06:23.566 INFO:teuthology.orchestra.run.smithi042.stderr: 91.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-08T06:06:23.566 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-08T06:06:23.566 INFO:teuthology.orchestra.run.smithi042.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37312.log.gz 2024-03-08T06:06:23.566 INFO:teuthology.orchestra.run.smithi042.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-03-08T06:06:23.568 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-08T06:06:23.568 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45644.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45644.log.gz 2024-03-08T06:06:23.568 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47909.log 2024-03-08T06:06:23.569 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51935.log 2024-03-08T06:06:23.569 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42058.log.gz 2024-03-08T06:06:23.569 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48365.log 2024-03-08T06:06:23.569 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47909.log.gz 2024-03-08T06:06:23.570 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51935.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51935.log.gz 2024-03-08T06:06:23.570 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51599.log 2024-03-08T06:06:23.571 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48533.log 2024-03-08T06:06:23.571 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48365.log.gz 2024-03-08T06:06:23.572 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50833.log 2024-03-08T06:06:23.572 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51599.log.gz 2024-03-08T06:06:23.573 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49922.log 2024-03-08T06:06:23.573 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48533.log.gz 2024-03-08T06:06:23.574 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42244.log 2024-03-08T06:06:23.574 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50833.log.gz 2024-03-08T06:06:23.575 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45244.log 2024-03-08T06:06:23.576 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49922.log.gz 2024-03-08T06:06:23.577 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42244.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42244.log.gz 2024-03-08T06:06:23.577 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51125.log 2024-03-08T06:06:23.578 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.2.45244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45244.log.gz 2024-03-08T06:06:23.578 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43477.log 2024-03-08T06:06:23.579 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51125.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51125.log.gz 2024-03-08T06:06:23.579 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50688.log 2024-03-08T06:06:23.580 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45602.log 2024-03-08T06:06:23.581 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43477.log.gz 2024-03-08T06:06:23.581 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44453.log 2024-03-08T06:06:23.582 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50688.log.gz 2024-03-08T06:06:23.583 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47261.log 2024-03-08T06:06:23.583 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45602.log.gz 2024-03-08T06:06:23.584 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44231.log 2024-03-08T06:06:23.584 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44453.log.gz 2024-03-08T06:06:23.585 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43146.log 2024-03-08T06:06:23.586 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47261.log.gz 2024-03-08T06:06:23.587 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48575.log 2024-03-08T06:06:23.587 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44231.log.gz 2024-03-08T06:06:23.588 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50084.log 2024-03-08T06:06:23.588 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43146.log.gz 2024-03-08T06:06:23.589 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44063.log 2024-03-08T06:06:23.589 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48575.log.gz 2024-03-08T06:06:23.590 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43487.log 2024-03-08T06:06:23.591 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50084.log.gz 2024-03-08T06:06:23.592 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43149.log 2024-03-08T06:06:23.592 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44063.log.gz 2024-03-08T06:06:23.593 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48968.log 2024-03-08T06:06:23.593 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43487.log.gz 2024-03-08T06:06:23.594 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49964.log 2024-03-08T06:06:23.594 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43149.log.gz 2024-03-08T06:06:23.595 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50520.log 2024-03-08T06:06:23.595 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48968.log.gz 2024-03-08T06:06:23.596 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48884.log 2024-03-08T06:06:23.597 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49964.log.gz 2024-03-08T06:06:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47099.log 2024-03-08T06:06:23.598 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50520.log.gz 2024-03-08T06:06:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42551.log 2024-03-08T06:06:23.599 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48884.log.gz 2024-03-08T06:06:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44189.log 2024-03-08T06:06:23.600 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47099.log.gz 2024-03-08T06:06:23.601 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46469.log 2024-03-08T06:06:23.601 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42551.log.gz 2024-03-08T06:06:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44021.log 2024-03-08T06:06:23.603 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44189.log.gz 2024-03-08T06:06:23.604 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44315.log 2024-03-08T06:06:23.604 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46469.log.gz 2024-03-08T06:06:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46511.log 2024-03-08T06:06:23.605 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44021.log.gz 2024-03-08T06:06:23.606 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43139.log 2024-03-08T06:06:23.607 INFO:teuthology.orchestra.run.smithi019.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44315.log.gz 2024-03-08T06:06:23.608 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49796.log 2024-03-08T06:06:23.608 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46511.log.gz 2024-03-08T06:06:23.609 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43489.log 2024-03-08T06:06:23.609 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43139.log.gz 2024-03-08T06:06:23.610 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48926.log 2024-03-08T06:06:23.610 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49796.log.gz 2024-03-08T06:06:23.611 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50791.log 2024-03-08T06:06:23.612 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43489.log.gz 2024-03-08T06:06:23.613 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42887.log 2024-03-08T06:06:23.613 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48926.log.gz 2024-03-08T06:06:23.614 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49136.log 2024-03-08T06:06:23.614 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50791.log.gz 2024-03-08T06:06:23.615 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46106.log 2024-03-08T06:06:23.616 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42887.log.gz 2024-03-08T06:06:23.617 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45476.log 2024-03-08T06:06:23.617 INFO:teuthology.orchestra.run.smithi019.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49136.log.gz 2024-03-08T06:06:23.618 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50394.log 2024-03-08T06:06:23.618 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46106.log.gz 2024-03-08T06:06:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44794.log 2024-03-08T06:06:23.620 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45476.log.gz 2024-03-08T06:06:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45812.log 2024-03-08T06:06:23.621 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50394.log.gz 2024-03-08T06:06:23.622 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.44794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44794.log.gz 2024-03-08T06:06:23.622 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49389.log 2024-03-08T06:06:23.623 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47219.log 2024-03-08T06:06:23.623 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45812.log.gz 2024-03-08T06:06:23.624 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.49389.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.0.49389.log.gz 2024-03-08T06:06:23.624 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44273.log 2024-03-08T06:06:23.626 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48073.log 2024-03-08T06:06:23.626 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47219.log.gz 2024-03-08T06:06:23.627 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49094.log 2024-03-08T06:06:23.627 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44273.log.gz 2024-03-08T06:06:23.628 INFO:teuthology.orchestra.run.smithi042.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.c.log: 93.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-03-08T06:06:23.628 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41962.log 2024-03-08T06:06:23.629 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48073.log.gz 2024-03-08T06:06:23.629 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49094.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-08T06:06:23.630 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49094.log.gz 2024-03-08T06:06:23.631 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.41962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47951.log 2024-03-08T06:06:23.631 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41962.log.gz 2024-03-08T06:06:23.632 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46799.log 2024-03-08T06:06:23.633 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52077.log 2024-03-08T06:06:23.634 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-08T06:06:23.634 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47951.log.gz 2024-03-08T06:06:23.635 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47555.log 2024-03-08T06:06:23.635 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46799.log.gz 2024-03-08T06:06:23.636 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43937.log 2024-03-08T06:06:23.636 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52077.log.gz 2024-03-08T06:06:23.636 INFO:teuthology.orchestra.run.smithi042.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-08T06:06:23.637 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50210.log 2024-03-08T06:06:23.637 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47555.log.gz 2024-03-08T06:06:23.639 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45896.log 2024-03-08T06:06:23.639 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43937.log.gz 2024-03-08T06:06:23.640 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46595.log 2024-03-08T06:06:23.640 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50210.log.gz 2024-03-08T06:06:23.641 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51305.log 2024-03-08T06:06:23.641 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45896.log.gz 2024-03-08T06:06:23.643 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46064.log 2024-03-08T06:06:23.643 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46595.log.gz 2024-03-08T06:06:23.644 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48239.log 2024-03-08T06:06:23.644 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51305.log.gz 2024-03-08T06:06:23.645 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42302.log 2024-03-08T06:06:23.645 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46064.log.gz 2024-03-08T06:06:23.646 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43150.log 2024-03-08T06:06:23.646 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48239.log.gz 2024-03-08T06:06:23.647 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49202.log 2024-03-08T06:06:23.647 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42302.log.gz 2024-03-08T06:06:23.649 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49052.log 2024-03-08T06:06:23.649 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43150.log.gz 2024-03-08T06:06:23.650 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46190.log 2024-03-08T06:06:23.650 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49202.log.gz 2024-03-08T06:06:23.651 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42761.log 2024-03-08T06:06:23.651 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49052.log.gz 2024-03-08T06:06:23.652 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42139.log 2024-03-08T06:06:23.653 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46190.log.gz 2024-03-08T06:06:23.654 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42761.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-08T06:06:23.654 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42761.log.gz 2024-03-08T06:06:23.655 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45518.log 2024-03-08T06:06:23.655 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42139.log.gz 2024-03-08T06:06:23.656 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46316.log 2024-03-08T06:06:23.658 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45518.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45518.log.gz 2024-03-08T06:06:23.658 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48714.log 2024-03-08T06:06:23.659 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46316.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30634.log 2024-03-08T06:06:23.659 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46316.log.gz 2024-03-08T06:06:23.660 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48758.log 2024-03-08T06:06:23.661 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48714.log.gz 2024-03-08T06:06:23.661 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.tmp-client.admin.30634.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30634.log.gz 2024-03-08T06:06:23.662 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50168.log 2024-03-08T06:06:23.663 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48619.log 2024-03-08T06:06:23.663 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48758.log.gz 2024-03-08T06:06:23.665 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47513.log 2024-03-08T06:06:23.665 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50168.log.gz 2024-03-08T06:06:23.666 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50436.log 2024-03-08T06:06:23.666 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48619.log.gz 2024-03-08T06:06:23.667 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47723.log 2024-03-08T06:06:23.667 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47513.log.gz 2024-03-08T06:06:23.668 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51347.log 2024-03-08T06:06:23.669 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50436.log.gz 2024-03-08T06:06:23.670 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43895.log 2024-03-08T06:06:23.670 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47723.log.gz 2024-03-08T06:06:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51262.log 2024-03-08T06:06:23.671 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51347.log.gz 2024-03-08T06:06:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36947.log 2024-03-08T06:06:23.672 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43895.log.gz 2024-03-08T06:06:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43148.log 2024-03-08T06:06:23.674 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51262.log.gz 2024-03-08T06:06:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50352.log 2024-03-08T06:06:23.675 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36947.log.gz 2024-03-08T06:06:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50738.log 2024-03-08T06:06:23.677 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43148.log.gz 2024-03-08T06:06:23.677 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46637.log 2024-03-08T06:06:23.678 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50352.log.gz 2024-03-08T06:06:23.679 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46841.log 2024-03-08T06:06:23.679 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50738.log.gz 2024-03-08T06:06:23.680 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47993.log 2024-03-08T06:06:23.680 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46637.log.gz 2024-03-08T06:06:23.681 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42719.log 2024-03-08T06:06:23.682 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46841.log.gz 2024-03-08T06:06:23.683 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47141.log 2024-03-08T06:06:23.683 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47993.log.gz 2024-03-08T06:06:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47471.log 2024-03-08T06:06:23.684 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42719.log.gz 2024-03-08T06:06:23.686 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47141.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47141.log.gz 2024-03-08T06:06:23.686 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37077.log 2024-03-08T06:06:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46274.log 2024-03-08T06:06:23.687 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47471.log.gz 2024-03-08T06:06:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.37077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50042.log 2024-03-08T06:06:23.688 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37077.log.gz 2024-03-08T06:06:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43769.log 2024-03-08T06:06:23.690 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46274.log.gz 2024-03-08T06:06:23.691 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50042.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50042.log.gz 2024-03-08T06:06:23.691 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42677.log 2024-03-08T06:06:23.692 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43769.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-08T06:06:23.693 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43769.log.gz 2024-03-08T06:06:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50478.log 2024-03-08T06:06:23.694 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42677.log.gz 2024-03-08T06:06:23.695 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43811.log 2024-03-08T06:06:23.697 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51809.log 2024-03-08T06:06:23.697 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50478.log.gz 2024-03-08T06:06:23.699 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45980.log 2024-03-08T06:06:23.699 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43811.log.gz 2024-03-08T06:06:23.700 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48491.log 2024-03-08T06:06:23.701 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51809.log.gz 2024-03-08T06:06:23.701 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46148.log 2024-03-08T06:06:23.702 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45980.log.gz 2024-03-08T06:06:23.703 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52019.log 2024-03-08T06:06:23.703 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48491.log.gz 2024-03-08T06:06:23.704 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50646.log 2024-03-08T06:06:23.705 INFO:teuthology.orchestra.run.smithi042.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-08T06:06:23.705 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46148.log.gz 2024-03-08T06:06:23.706 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48449.log 2024-03-08T06:06:23.706 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52019.log.gz 2024-03-08T06:06:23.707 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42845.log 2024-03-08T06:06:23.708 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50646.log.gz 2024-03-08T06:06:23.709 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50604.log 2024-03-08T06:06:23.709 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48449.log.gz 2024-03-08T06:06:23.711 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46973.log 2024-03-08T06:06:23.711 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42845.log.gz 2024-03-08T06:06:23.712 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45728.log 2024-03-08T06:06:23.712 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50604.log.gz 2024-03-08T06:06:23.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43685.log 2024-03-08T06:06:23.714 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46973.log.gz 2024-03-08T06:06:23.715 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51557.log 2024-03-08T06:06:23.715 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45728.log.gz 2024-03-08T06:06:23.716 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51431.log 2024-03-08T06:06:23.716 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43685.log.gz 2024-03-08T06:06:23.717 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48281.log 2024-03-08T06:06:23.718 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9%/var/log/ceph/ceph-client.admin.51431.log: -- replaced with /var/log/ceph/ceph-client.admin.51557.log.gz 2024-03-08T06:06:23.719 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46715.log 2024-03-08T06:06:23.719 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51431.log.gz 2024-03-08T06:06:23.720 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48281.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48281.log.gz 2024-03-08T06:06:23.720 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48842.log 2024-03-08T06:06:23.721 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46022.log 2024-03-08T06:06:23.722 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46715.log.gz 2024-03-08T06:06:23.723 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48323.log 2024-03-08T06:06:23.723 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48842.log.gz 2024-03-08T06:06:23.724 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46022.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46022.log.gz 2024-03-08T06:06:23.724 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50917.log 2024-03-08T06:06:23.725 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42635.log 2024-03-08T06:06:23.726 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48323.log.gz 2024-03-08T06:06:23.727 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42356.log 2024-03-08T06:06:23.727 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50917.log.gz 2024-03-08T06:06:23.728 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47015.log 2024-03-08T06:06:23.729 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42635.log.gz 2024-03-08T06:06:23.729 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42803.log 2024-03-08T06:06:23.730 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42356.log.gz 2024-03-08T06:06:23.730 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49838.log 2024-03-08T06:06:23.731 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47015.log.gz 2024-03-08T06:06:23.732 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42803.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42803.log.gz 2024-03-08T06:06:23.732 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48663.log 2024-03-08T06:06:23.733 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43153.log 2024-03-08T06:06:23.734 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49838.log.gz 2024-03-08T06:06:23.735 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48196.log 2024-03-08T06:06:23.735 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48663.log.gz 2024-03-08T06:06:23.736 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43153.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-08T06:06:23.736 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43153.log.gz 2024-03-08T06:06:23.737 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46757.log 2024-03-08T06:06:23.737 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48196.log.gz 2024-03-08T06:06:23.738 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46883.log 2024-03-08T06:06:23.739 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42184.log 2024-03-08T06:06:23.741 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46757.log.gz 2024-03-08T06:06:23.741 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50875.log 2024-03-08T06:06:23.741 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46883.log.gz 2024-03-08T06:06:23.742 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50126.log 2024-03-08T06:06:23.743 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42184.log.gz 2024-03-08T06:06:23.744 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43152.log 2024-03-08T06:06:23.744 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50875.log.gz 2024-03-08T06:06:23.745 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50268.log 2024-03-08T06:06:23.745 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50126.log.gz 2024-03-08T06:06:23.747 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43143.log 2024-03-08T06:06:23.747 INFO:teuthology.orchestra.run.smithi019.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43152.log.gz 2024-03-08T06:06:23.748 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43469.log 2024-03-08T06:06:23.748 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50268.log.gz 2024-03-08T06:06:23.749 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50310.log 2024-03-08T06:06:23.750 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43143.log.gz 2024-03-08T06:06:23.750 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43488.log 2024-03-08T06:06:23.751 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43469.log.gz 2024-03-08T06:06:23.752 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42929.log 2024-03-08T06:06:23.753 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50310.log.gz 2024-03-08T06:06:23.753 INFO:teuthology.orchestra.run.smithi042.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-08T06:06:23.753 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46553.log 2024-03-08T06:06:23.753 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43488.log.gz 2024-03-08T06:06:23.754 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51683.log 2024-03-08T06:06:23.754 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42929.log.gz 2024-03-08T06:06:23.756 INFO:teuthology.orchestra.run.smithi042.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-08T06:06:23.756 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45374.log 2024-03-08T06:06:23.756 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46553.log.gz 2024-03-08T06:06:23.757 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51168.log 2024-03-08T06:06:23.758 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51683.log.gz 2024-03-08T06:06:23.758 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47825.log 2024-03-08T06:06:23.759 INFO:teuthology.orchestra.run.smithi019.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45374.log.gz 2024-03-08T06:06:23.760 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44147.log 2024-03-08T06:06:23.760 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51168.log.gz 2024-03-08T06:06:23.761 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42971.log 2024-03-08T06:06:23.761 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47825.log.gz 2024-03-08T06:06:23.762 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45686.log 2024-03-08T06:06:23.762 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44147.log.gz 2024-03-08T06:06:23.764 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51977.log 2024-03-08T06:06:23.764 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42971.log.gz 2024-03-08T06:06:23.765 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49659.log 2024-03-08T06:06:23.765 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45686.log.gz 2024-03-08T06:06:23.766 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49527.log 2024-03-08T06:06:23.766 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51977.log.gz 2024-03-08T06:06:23.768 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44944.log 2024-03-08T06:06:23.768 INFO:teuthology.orchestra.run.smithi019.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49659.log.gz 2024-03-08T06:06:23.769 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49527.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-08T06:06:23.770 INFO:teuthology.orchestra.run.smithi019.stderr: 90.9%/var/log/ceph/ceph-client.admin.44944.log: -- replaced with /var/log/ceph/ceph-client.admin.49527.log.gz 2024-03-08T06:06:23.770 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43481.log 2024-03-08T06:06:23.770 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44944.log.gz 2024-03-08T06:06:23.772 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51473.log 2024-03-08T06:06:23.773 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42509.log 2024-03-08T06:06:23.773 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43481.log.gz 2024-03-08T06:06:23.775 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47597.log 2024-03-08T06:06:23.775 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51473.log.gz 2024-03-08T06:06:23.776 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46358.log 2024-03-08T06:06:23.776 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42509.log.gz 2024-03-08T06:06:23.776 INFO:teuthology.orchestra.run.smithi019.stderr: 90.6%/var/log/ceph/ceph-client.admin.47597.log: -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-08T06:06:23.777 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47681.log 2024-03-08T06:06:23.777 INFO:teuthology.orchestra.run.smithi042.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-08T06:06:23.778 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47597.log.gz 2024-03-08T06:06:23.778 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36692.log 2024-03-08T06:06:23.779 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47681.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46358.log.gz 2024-03-08T06:06:23.779 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47681.log.gz 2024-03-08T06:06:23.779 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-08T06:06:23.780 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.36692.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-08T06:06:23.781 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36692.log.gz 2024-03-08T06:06:23.781 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47867.log 2024-03-08T06:06:23.782 INFO:teuthology.orchestra.run.smithi019.stderr: 85.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-08T06:06:23.783 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-03-08T06:06:23.784 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45434.log 2024-03-08T06:06:23.785 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47867.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47867.log.gz 2024-03-08T06:06:23.786 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.45434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51641.log 2024-03-08T06:06:23.787 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45434.log.gz 2024-03-08T06:06:23.788 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47057.log 2024-03-08T06:06:23.789 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51641.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51641.log.gz 2024-03-08T06:06:23.790 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51213.log 2024-03-08T06:06:23.792 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47057.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47057.log.gz 2024-03-08T06:06:23.792 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42593.log 2024-03-08T06:06:23.793 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51213.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51213.log.gz 2024-03-08T06:06:23.794 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42593.log: 91.5% 88.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-08T06:06:23.795 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42593.log.gz 2024-03-08T06:06:23.795 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48407.log 2024-03-08T06:06:23.796 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43853.log 2024-03-08T06:06:23.798 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47429.log 2024-03-08T06:06:23.798 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48407.log.gz 2024-03-08T06:06:23.799 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43853.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43853.log.gz 2024-03-08T06:06:23.801 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47429.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47429.log.gz 2024-03-08T06:06:23.801 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47387.log 2024-03-08T06:06:23.802 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52119.log 2024-03-08T06:06:23.804 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43979.log 2024-03-08T06:06:23.804 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47387.log.gz 2024-03-08T06:06:23.805 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49467.log 2024-03-08T06:06:23.805 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52119.log.gz 2024-03-08T06:06:23.807 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43727.log 2024-03-08T06:06:23.807 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43979.log.gz 2024-03-08T06:06:23.808 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43485.log 2024-03-08T06:06:23.808 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49467.log.gz 2024-03-08T06:06:23.809 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51851.log 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43727.log.gz 2024-03-08T06:06:23.809 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-03-08T06:06:23.810 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43485.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43485.log.gz 2024-03-08T06:06:23.811 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-08T06:06:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45560.log 2024-03-08T06:06:23.813 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51851.log.gz 2024-03-08T06:06:23.814 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42412.log 2024-03-08T06:06:23.815 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45560.log: 91.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-08T06:06:23.815 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45560.log.gz 2024-03-08T06:06:23.817 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.42412.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42412.log.gz 2024-03-08T06:06:23.817 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49010.log 2024-03-08T06:06:23.818 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44105.log 2024-03-08T06:06:23.820 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47639.log 2024-03-08T06:06:23.820 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49010.log.gz 2024-03-08T06:06:23.821 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.44105.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44105.log.gz 2024-03-08T06:06:23.823 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.47639.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47639.log.gz 2024-03-08T06:06:23.823 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43483.log 2024-03-08T06:06:23.824 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45938.log 2024-03-08T06:06:23.826 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.43483.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43483.log.gz 2024-03-08T06:06:23.827 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.45938.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45938.log.gz 2024-03-08T06:06:23.832 INFO:teuthology.orchestra.run.smithi042.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-08T06:06:23.835 INFO:teuthology.orchestra.run.smithi042.stderr: 2024-03-08T06:06:23.835 INFO:teuthology.orchestra.run.smithi042.stderr:real 0m0.336s 2024-03-08T06:06:23.836 INFO:teuthology.orchestra.run.smithi042.stderr:user 0m1.129s 2024-03-08T06:06:23.836 INFO:teuthology.orchestra.run.smithi042.stderr:sys 0m0.213s 2024-03-08T06:06:23.941 INFO:teuthology.orchestra.run.smithi019.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-08T06:06:23.995 INFO:teuthology.orchestra.run.smithi019.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-08T06:06:24.003 INFO:teuthology.orchestra.run.smithi019.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-08T06:06:24.139 INFO:teuthology.orchestra.run.smithi019.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-08T06:06:24.957 INFO:teuthology.orchestra.run.smithi019.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-03-08T06:06:24.961 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-03-08T06:06:24.961 INFO:teuthology.orchestra.run.smithi019.stderr:real 0m1.463s 2024-03-08T06:06:24.961 INFO:teuthology.orchestra.run.smithi019.stderr:user 0m2.548s 2024-03-08T06:06:24.961 INFO:teuthology.orchestra.run.smithi019.stderr:sys 0m0.848s 2024-03-08T06:06:24.962 INFO:tasks.ceph:Archiving logs... 2024-03-08T06:06:24.963 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/log/ceph to /home/teuthworker/archive/jcollin-2024-03-08_05:43:46-fs:functional-main-distro-default-smithi/7585422/remote/smithi019/log 2024-03-08T06:06:24.964 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-08T06:06:25.485 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/log/ceph to /home/teuthworker/archive/jcollin-2024-03-08_05:43:46-fs:functional-main-distro-default-smithi/7585422/remote/smithi042/log 2024-03-08T06:06:25.486 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-08T06:06:25.709 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-08T06:06:25.719 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-08T06:06:25.719 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-08T06:06:25.727 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-08T06:06:25.884 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-08T06:06:25.893 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-08T06:06:25.893 DEBUG:teuthology.orchestra.run.smithi019:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-08T06:06:25.901 DEBUG:teuthology.orchestra.run.smithi042:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-08T06:06:25.949 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-03-08T06:06:25.956 INFO:teuthology.orchestra.run.smithi042.stderr:bash: line 1: ntpq: command not found 2024-03-08T06:06:25.959 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-08T06:06:25.960 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-03-08T06:06:25.960 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 52 +1686us[+1690us] +/- 111ms 2024-03-08T06:06:25.960 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 50 -1441us[-1441us] +/- 71ms 2024-03-08T06:06:25.960 INFO:teuthology.orchestra.run.smithi019.stdout:^* hv03.front.sepia.ceph.com 3 6 377 51 +350us[ +353us] +/- 68ms 2024-03-08T06:06:25.960 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-08T06:06:25.966 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-08T06:06:25.966 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2024-03-08T06:06:25.966 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 52 +1697us[+1704us] +/- 111ms 2024-03-08T06:06:25.966 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 52 -1425us[-1418us] +/- 71ms 2024-03-08T06:06:25.967 INFO:teuthology.orchestra.run.smithi042.stdout:^* hv03.front.sepia.ceph.com 3 6 377 51 +366us[ +373us] +/- 68ms 2024-03-08T06:06:25.967 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-08T06:06:25.968 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-08T06:06:25.976 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-08T06:06:25.977 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-08T06:06:25.985 DEBUG:teuthology.orchestra.run.smithi019:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-08T06:06:26.227 DEBUG:teuthology.orchestra.run.smithi042:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-08T06:06:26.415 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-08T06:06:26.523 INFO:teuthology.orchestra.run.smithi019.stdout:type=AVC msg=audit(1709877238.087:198): avc: denied { checkpoint_restore } for pid=1257 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1 2024-03-08T06:06:26.525 DEBUG:teuthology.task.selinux:ubuntu@smithi019.front.sepia.ceph.com has 1 denials 2024-03-08T06:06:26.525 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-08T06:06:26.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T06:06:26.631 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 166, in teardown self.get_new_denials() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 215, in get_new_denials raise SELinuxError(node=remote, teuthology.exceptions.SELinuxError: SELinux denials found on ubuntu@smithi019.front.sepia.ceph.com: ['type=AVC msg=audit(1709877238.087:198): avc: denied { checkpoint_restore } for pid=1257 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-03-08T06:06:26.638 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-08T06:06:26.647 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-08T06:06:26.656 INFO:teuthology.task.internal:Duration was 751.606225 seconds 2024-03-08T06:06:26.656 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-08T06:06:26.664 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-08T06:06:26.664 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-08T06:06:26.673 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-08T06:06:26.837 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-08T06:06:26.854 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-08T06:06:27.146 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-08T06:06:27.146 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi019.front.sepia.ceph.com 2024-03-08T06:06:27.146 DEBUG:teuthology.orchestra.run.smithi019:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-08T06:06:27.212 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi042.front.sepia.ceph.com 2024-03-08T06:06:27.212 DEBUG:teuthology.orchestra.run.smithi042:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-08T06:06:27.289 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-08T06:06:27.289 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-08T06:06:27.297 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-08T06:06:27.394 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-08T06:06:27.394 DEBUG:teuthology.orchestra.run.smithi019:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-08T06:06:27.399 DEBUG:teuthology.orchestra.run.smithi042:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-08T06:06:27.590 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-08T06:06:27.600 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-08T06:06:27.600 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-08T06:06:27.697 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-08T06:06:27.799 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-08T06:06:27.808 DEBUG:teuthology.orchestra.run.smithi019:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-08T06:06:27.816 DEBUG:teuthology.orchestra.run.smithi042:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-08T06:06:27.922 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = core 2024-03-08T06:06:27.929 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = core 2024-03-08T06:06:27.988 DEBUG:teuthology.orchestra.run.smithi019:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-08T06:06:28.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T06:06:28.043 DEBUG:teuthology.orchestra.run.smithi042:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-08T06:06:28.098 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-08T06:06:28.099 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-08T06:06:28.108 INFO:teuthology.task.internal:Transferring archived files... 2024-03-08T06:06:28.109 DEBUG:teuthology.misc:Transferring archived files from smithi019:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/jcollin-2024-03-08_05:43:46-fs:functional-main-distro-default-smithi/7585422/remote/smithi019 2024-03-08T06:06:28.109 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-08T06:06:28.221 DEBUG:teuthology.misc:Transferring archived files from smithi042:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/jcollin-2024-03-08_05:43:46-fs:functional-main-distro-default-smithi/7585422/remote/smithi042 2024-03-08T06:06:28.221 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-08T06:06:28.331 INFO:teuthology.task.internal:Removing archive directory... 2024-03-08T06:06:28.332 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-08T06:06:28.339 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-08T06:06:28.434 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-08T06:06:28.446 INFO:teuthology.task.internal:Not uploading archives. 2024-03-08T06:06:28.446 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-08T06:06:28.457 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-08T06:06:28.457 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-08T06:06:28.465 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-08T06:06:28.518 INFO:teuthology.orchestra.run.smithi019.stdout: 395187 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 8 06:06 /home/ubuntu/cephtest 2024-03-08T06:06:28.523 INFO:teuthology.orchestra.run.smithi042.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 8 06:06 /home/ubuntu/cephtest 2024-03-08T06:06:28.526 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-08T06:06:28.536 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-08T06:06:28.546 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: SELinuxError: SELinux denials found on ubuntu@smithi019.front.sepia.ceph.com: ['type=AVC msg=audit(1709877238.087:198): avc: denied { checkpoint_restore } for pid=1257 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-03-08T06:06:28.546 INFO:teuthology.nuke:Checking targets against current locks 2024-03-08T06:06:28.572 DEBUG:teuthology.nuke:shortname: smithi019 2024-03-08T06:06:28.572 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-08T06:06:28.594 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/jcollin-2024-03-08_05:43:46-fs:functional-main-distro-default-smithi/7585422', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-08 05:44:37.649108', 'locked_by': 'scheduled_jcollin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMhnua1Zs1mj8A8D1cRc/Y4IbjMxhfVpRiF2YnqmWvfyeRD6YF16t4DA+rwJyXknzLMp+oC1PbiygfStBraqs7s='} 2024-03-08T06:06:28.598 DEBUG:teuthology.nuke:shortname: smithi042 2024-03-08T06:06:28.598 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-08T06:06:28.616 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/jcollin-2024-03-08_05:43:46-fs:functional-main-distro-default-smithi/7585422', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-08 05:44:37.650371', 'locked_by': 'scheduled_jcollin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO0gN7+Sd6N91IoieoXLBfcsav/9+icq+TOZQmNNpWZeaMPPLM5qUZCadPCqlXC4aaBVccfnykxjiaVAvHI1Qz0='} 2024-03-08T06:06:28.641 INFO:teuthology.orchestra.console.smithi019:Power off 2024-03-08T06:06:28.642 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-08T06:06:28.665 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off 2024-03-08T06:06:28.665 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T06:06:28.680 INFO:teuthology.orchestra.console.smithi042:Power off 2024-03-08T06:06:28.681 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-08T06:06:28.689 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2024-03-08T06:06:28.703 DEBUG:teuthology.orchestra.console.smithi042:power off output: Chassis Power Control: Down/Off 2024-03-08T06:06:28.703 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T06:06:28.725 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on 2024-03-08T06:06:32.691 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T06:06:32.726 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T06:06:32.802 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2024-03-08T06:06:32.834 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on 2024-03-08T06:06:36.804 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T06:06:36.835 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T06:06:36.921 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2024-03-08T06:06:36.951 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off 2024-03-08T06:06:37.051 INFO:teuthology.orchestra.console.smithi042:Power off completed 2024-03-08T06:06:40.922 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-08T06:06:41.033 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2024-03-08T06:06:41.134 INFO:teuthology.orchestra.console.smithi019:Power off completed 2024-03-08T06:06:41.238 INFO:teuthology.run:Summary data: client.0-kernel-sha1: dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 client.1-kernel-sha1: dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/admin} duration: 751.6062252521515 failure_reason: 'Test failure: test_per_client_labeled_perf_counters (tasks.cephfs.test_admin.TestLabeledPerfCounters)' flavor: default owner: scheduled_jcollin@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=72ccc55af7c949b2b2b7ee547ec31175 status: fail success: false 2024-03-08T06:06:41.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-08T06:06:41.316 INFO:teuthology.run:FAIL